2024-04-26T12:24:47.510 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T12:24:47.510 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} --verbose --archive /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701 --name cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi --owner scheduled_cbodley@teuthology -- /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/orig.config.yaml 2024-04-26T12:24:47.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:24:47.636 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701 branch: wip-cbodley2-testing description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: null first_in_suite: false job_id: '7674701' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cbodley2-testing ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 rgw: frontend: beast s3tests: force-branch: ceph-squid thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley2-testing sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 8596 sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley2-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAJ1jGfgrrfekmpPC7xKDqTND93TiGkgrCW6m9Ea22RDj/DP8KCa9QKIplpj6CcQpqX/8UEkLDXzZwafNDibz3g= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLX1DRCWaQwlLlObQIqiXtEOFMgIAOgPgYzh2QdwAZF7tQSkstT+6m0mF6WejOhzQASuwZwKj6b5FSM4G3T1B5E= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_12:10:35 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T12:24:47.636 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa; will attempt to use it 2024-04-26T12:24:47.637 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa/tasks 2024-04-26T12:24:47.637 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T12:24:47.639 INFO:teuthology.task.internal:Checking packages... 2024-04-26T12:24:47.664 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0' 2024-04-26T12:24:47.664 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T12:24:47.664 INFO:teuthology.packaging:ref: None 2024-04-26T12:24:47.664 INFO:teuthology.packaging:tag: None 2024-04-26T12:24:47.664 INFO:teuthology.packaging:branch: wip-cbodley2-testing 2024-04-26T12:24:47.664 INFO:teuthology.packaging:sha1: 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:24:47.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cbodley2-testing 2024-04-26T12:24:47.817 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:24:47.818 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T12:24:47.827 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T12:24:47.827 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T12:24:47.834 INFO:teuthology.task.internal:Saving configuration 2024-04-26T12:24:47.848 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T12:24:47.855 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T12:24:47.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:19:09.576881', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMaXC7c1G0bB739h6h0ISOVr3qGWXueBFXPNMJ681Ur8'} 2024-04-26T12:24:47.907 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 12:19:09.578083', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIH6xXFNa8oscXehJ8yPRbvF/CRQjo2iocEm9J98gpizf'} 2024-04-26T12:24:47.907 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T12:24:47.914 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-26T12:24:47.914 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-26T12:24:47.914 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T12:24:47.983 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1c2a7c5280>, signals=[15]) 2024-04-26T12:24:47.983 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T12:24:47.989 INFO:teuthology.task.internal:Opening connections... 2024-04-26T12:24:47.989 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:24:47.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:24:48.073 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:24:48.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:24:48.150 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T12:24:48.157 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-04-26T12:24:48.163 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-04-26T12:24:48.163 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-26T12:24:48.212 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="22.04" 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=jammy 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T12:24:48.213 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=jammy 2024-04-26T12:24:48.214 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-26T12:24:48.245 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-04-26T12:24:48.251 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-04-26T12:24:48.251 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-04-26T12:24:48.298 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04" 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T12:24:48.299 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy 2024-04-26T12:24:48.300 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-04-26T12:24:48.311 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T12:24:48.320 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T12:24:48.325 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T12:24:48.325 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:24:48.327 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-04-26T12:24:48.345 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T12:24:48.352 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T12:24:48.352 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:24:48.374 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-04-26T12:24:48.396 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T12:24:48.446 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T12:24:48.462 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-26T12:24:48.462 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-26T12:24:48.462 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:24:48.463 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T12:24:48.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:48.467 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-26T12:24:48.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:24:48.468 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-04-26T12:24:48.513 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-56-generic 2024-04-26T12:24:48.514 INFO:teuthology.task.kernel:Running kernel on smithi016: 5.15.0-56-generic 2024-04-26T12:24:48.514 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get clean 2024-04-26T12:24:48.515 INFO:teuthology.orchestra.run.smithi131.stdout:5.15.0-56-generic 2024-04-26T12:24:48.515 INFO:teuthology.task.kernel:Running kernel on smithi131: 5.15.0-56-generic 2024-04-26T12:24:48.515 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get clean 2024-04-26T12:24:48.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-04-26T12:24:48.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-04-26T12:24:48.786 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:24:48.813 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:24:48.814 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T12:24:48.819 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T12:24:48.824 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T12:24:48.898 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T12:24:48.899 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T12:24:48.907 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T12:24:49.017 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-26T12:24:49.053 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T12:24:49.120 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T12:24:49.127 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T12:24:49.134 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T12:24:49.161 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T12:24:49.168 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T12:24:49.169 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T12:24:49.170 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T12:24:49.186 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T12:24:49.192 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T12:24:49.192 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T12:24:49.200 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T12:24:49.204 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T12:24:49.204 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T12:24:49.234 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T12:24:49.235 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T12:24:49.235 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T12:24:49.240 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T12:24:49.242 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T12:24:49.242 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T12:24:49.243 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T12:24:49.245 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T12:24:49.245 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T12:24:49.245 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T12:24:49.246 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T12:24:49.250 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T12:24:49.256 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T12:24:49.258 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T12:24:49.264 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T12:24:49.265 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T12:24:49.266 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T12:24:49.266 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T12:24:49.266 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T12:24:49.266 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T12:24:49.281 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T12:24:49.281 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [619 kB] 2024-04-26T12:24:49.281 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T12:24:49.281 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T12:24:49.282 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T12:24:49.287 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T12:24:49.287 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T12:24:49.291 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T12:24:49.297 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T12:24:49.298 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T12:24:49.299 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T12:24:49.328 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T12:24:49.332 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T12:24:49.333 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T12:24:49.340 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T12:24:49.341 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T12:24:49.351 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T12:24:49.353 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T12:24:49.353 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T12:24:49.354 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T12:24:49.354 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T12:24:49.363 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T12:24:49.364 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T12:24:49.364 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T12:24:49.365 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T12:24:49.384 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T12:24:49.384 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T12:24:49.384 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T12:24:49.385 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T12:24:49.385 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T12:24:49.627 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T12:24:49.795 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T12:24:49.808 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T12:24:49.808 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T12:24:49.810 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T12:24:49.892 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T12:24:49.900 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T12:24:49.901 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T12:24:49.922 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T12:24:50.099 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T12:24:50.504 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T12:24:50.606 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T12:24:50.607 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T12:24:50.608 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T12:24:50.609 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T12:24:54.828 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 13.2 MB in 2s (7,135 kB/s) 2024-04-26T12:24:55.226 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 13.2 MB in 2s (6,961 kB/s) 2024-04-26T12:24:56.347 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-04-26T12:24:56.365 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T12:24:56.429 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-04-26T12:24:56.589 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T12:24:56.607 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T12:24:56.609 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-04-26T12:24:56.610 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-04-26T12:24:56.667 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T12:24:56.764 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:24:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:24:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:24:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:24:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T12:24:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: python2.7-minimal 2024-04-26T12:24:56.765 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:24:56.766 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-04-26T12:24:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T12:24:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T12:24:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T12:24:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-04-26T12:24:56.768 INFO:teuthology.orchestra.run.smithi131.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T12:24:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-04-26T12:24:56.768 INFO:teuthology.orchestra.run.smithi131.stdout: thermald 2024-04-26T12:24:56.815 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-04-26T12:24:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T12:24:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T12:24:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T12:24:56.816 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages will be upgraded: 2024-04-26T12:24:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T12:24:56.867 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-26T12:24:56.868 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-26T12:24:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T12:24:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 113 MB of archives. 2024-04-26T12:24:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T12:24:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T12:24:57.050 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:24:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:24:57.050 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:24:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:24:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T12:24:57.051 INFO:teuthology.orchestra.run.smithi016.stdout: python2.7-minimal 2024-04-26T12:24:57.051 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:24:57.052 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-26T12:24:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T12:24:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T12:24:57.052 INFO:teuthology.orchestra.run.smithi016.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T12:24:57.054 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-26T12:24:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T12:24:57.054 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-04-26T12:24:57.054 INFO:teuthology.orchestra.run.smithi016.stdout: thermald 2024-04-26T12:24:57.103 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-26T12:24:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T12:24:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T12:24:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T12:24:57.105 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2024-04-26T12:24:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T12:24:57.287 INFO:teuthology.orchestra.run.smithi016.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T12:24:57.287 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 113 MB of archives. 2024-04-26T12:24:57.288 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T12:24:57.288 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T12:24:57.325 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T12:24:57.429 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T12:24:58.512 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T12:24:58.512 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T12:24:58.512 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T12:24:58.676 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T12:24:58.803 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T12:24:58.842 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T12:24:59.026 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T12:24:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 113 MB in 2s (56.1 MB/s) 2024-04-26T12:24:59.432 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T12:25:01.296 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T12:25:01.296 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T12:25:01.296 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T12:25:01.759 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T12:25:01.848 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T12:25:01.866 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T12:25:01.870 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:25:02.122 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:02.254 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 113 MB in 5s (23.9 MB/s) 2024-04-26T12:25:02.464 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T12:25:04.307 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T12:25:04.328 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:25:04.406 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:04.463 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T12:25:04.467 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:25:04.570 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:04.936 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T12:25:04.956 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:25:04.994 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:06.938 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T12:25:06.960 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:25:07.049 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:07.541 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T12:25:07.562 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:25:07.599 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:12.365 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:25:12.473 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:25:12.822 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:25:12.960 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:25:13.296 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T12:25:13.319 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T12:25:13.363 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T12:25:14.142 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:25:14.260 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:25:14.602 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:25:14.730 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:25:15.075 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T12:25:15.098 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T12:25:15.133 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T12:25:19.014 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T12:25:19.051 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:25:19.081 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:21.370 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T12:25:21.408 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T12:25:21.470 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:22.060 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:25:22.202 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:25:22.544 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T12:25:22.665 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:22.825 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T12:25:22.953 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:24.226 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T12:25:24.278 INFO:teuthology.orchestra.run.smithi131.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:25:24.278 INFO:teuthology.orchestra.run.smithi131.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T12:25:24.278 INFO:teuthology.orchestra.run.smithi131.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:25:24.278 INFO:teuthology.orchestra.run.smithi131.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T12:25:24.784 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T12:25:25.189 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:25.357 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T12:25:25.486 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:25.629 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T12:25:25.758 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:26.602 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:27.105 INFO:teuthology.orchestra.run.smithi016.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:25:27.105 INFO:teuthology.orchestra.run.smithi016.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T12:25:27.105 INFO:teuthology.orchestra.run.smithi016.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:25:27.106 INFO:teuthology.orchestra.run.smithi016.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T12:25:27.260 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:28.534 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T12:25:28.685 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T12:25:28.811 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:28.875 INFO:teuthology.orchestra.run.smithi131.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T12:25:28.875 INFO:teuthology.orchestra.run.smithi131.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:25:28.996 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:31.113 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T12:25:31.239 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T12:25:31.374 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T12:25:31.440 INFO:teuthology.orchestra.run.smithi016.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T12:25:31.440 INFO:teuthology.orchestra.run.smithi016.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:25:42.851 INFO:teuthology.orchestra.run.smithi131.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T12:25:42.851 INFO:teuthology.orchestra.run.smithi131.stdout:Sourcing file `/etc/default/grub' 2024-04-26T12:25:42.877 INFO:teuthology.orchestra.run.smithi131.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T12:25:42.895 INFO:teuthology.orchestra.run.smithi131.stdout:Generating grub configuration file ... 2024-04-26T12:25:43.187 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:25:43.215 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:25:43.544 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:25:43.550 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T12:25:43.621 INFO:teuthology.orchestra.run.smithi131.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T12:25:43.626 INFO:teuthology.orchestra.run.smithi131.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T12:25:43.819 INFO:teuthology.orchestra.run.smithi131.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T12:25:43.819 INFO:teuthology.orchestra.run.smithi131.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T12:25:43.819 INFO:teuthology.orchestra.run.smithi131.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T12:25:43.860 INFO:teuthology.orchestra.run.smithi131.stdout:done 2024-04-26T12:25:44.372 DEBUG:teuthology.orchestra.run.smithi131:> dpkg -s linux-image-generic 2024-04-26T12:25:44.436 INFO:teuthology.orchestra.run.smithi131.stdout:Package: linux-image-generic 2024-04-26T12:25:44.436 INFO:teuthology.orchestra.run.smithi131.stdout:Status: install ok installed 2024-04-26T12:25:44.436 INFO:teuthology.orchestra.run.smithi131.stdout:Priority: optional 2024-04-26T12:25:44.436 INFO:teuthology.orchestra.run.smithi131.stdout:Section: kernel 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout:Installed-Size: 21 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: amd64 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout:Source: linux-meta 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout:Version: 5.15.0.105.102 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout:Recommends: thermald 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout:Description: Generic Linux kernel image 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout: This package will always depend on the latest generic kernel image 2024-04-26T12:25:44.437 INFO:teuthology.orchestra.run.smithi131.stdout: available. 2024-04-26T12:25:44.437 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T12:25:44.438 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T12:25:44.438 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T12:25:44.438 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-26T12:25:44.438 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T12:25:44.438 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get clean 2024-04-26T12:25:44.683 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-04-26T12:25:44.943 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T12:25:45.041 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:25:45.052 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T12:25:45.073 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T12:25:45.469 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 110 kB in 1s (175 kB/s) 2024-04-26T12:25:46.031 INFO:teuthology.orchestra.run.smithi016.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T12:25:46.032 INFO:teuthology.orchestra.run.smithi016.stdout:Sourcing file `/etc/default/grub' 2024-04-26T12:25:46.043 INFO:teuthology.orchestra.run.smithi016.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T12:25:46.056 INFO:teuthology.orchestra.run.smithi016.stdout:Generating grub configuration file ... 2024-04-26T12:25:46.326 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:25:46.346 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:25:46.413 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-04-26T12:25:46.432 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T12:25:46.492 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-04-26T12:25:46.620 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:25:46.626 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T12:25:46.694 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-04-26T12:25:46.695 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-04-26T12:25:46.709 INFO:teuthology.orchestra.run.smithi016.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T12:25:46.714 INFO:teuthology.orchestra.run.smithi016.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T12:25:46.870 INFO:teuthology.orchestra.run.smithi016.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T12:25:46.870 INFO:teuthology.orchestra.run.smithi016.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T12:25:46.871 INFO:teuthology.orchestra.run.smithi016.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T12:25:46.872 INFO:teuthology.orchestra.run.smithi131.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T12:25:46.872 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:25:46.872 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:25:46.872 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:25:46.872 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:25:46.872 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T12:25:46.872 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T12:25:46.872 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:25:46.901 INFO:teuthology.orchestra.run.smithi016.stdout:done 2024-04-26T12:25:46.914 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T12:25:46.916 DEBUG:teuthology.orchestra.run.smithi131:> dpkg -s linux-image-generic 2024-04-26T12:25:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:Package: linux-image-generic 2024-04-26T12:25:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:Status: install ok installed 2024-04-26T12:25:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:Priority: optional 2024-04-26T12:25:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:Section: kernel 2024-04-26T12:25:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:Installed-Size: 21 2024-04-26T12:25:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T12:25:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: amd64 2024-04-26T12:25:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:Source: linux-meta 2024-04-26T12:25:46.933 INFO:teuthology.orchestra.run.smithi131.stdout:Version: 5.15.0.105.102 2024-04-26T12:25:46.933 INFO:teuthology.orchestra.run.smithi131.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T12:25:46.933 INFO:teuthology.orchestra.run.smithi131.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T12:25:46.933 INFO:teuthology.orchestra.run.smithi131.stdout:Recommends: thermald 2024-04-26T12:25:46.933 INFO:teuthology.orchestra.run.smithi131.stdout:Description: Generic Linux kernel image 2024-04-26T12:25:46.933 INFO:teuthology.orchestra.run.smithi131.stdout: This package will always depend on the latest generic kernel image 2024-04-26T12:25:46.933 INFO:teuthology.orchestra.run.smithi131.stdout: available. 2024-04-26T12:25:46.933 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-04-26T12:25:46.977 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.fSOJVcRa40 2024-04-26T12:25:46.977 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub/grub.cfg /tmp/tmp.fSOJVcRa40 2024-04-26T12:25:47.033 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.fSOJVcRa40 2024-04-26T12:25:47.150 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.fSOJVcRa40 is 10KB 2024-04-26T12:25:47.163 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.fSOJVcRa40 2024-04-26T12:25:47.168 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T12:25:47.220 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:25:47.221 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T12:25:47.221 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T12:25:47.314 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T12:25:47.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo update-grub 2024-04-26T12:25:47.419 DEBUG:teuthology.orchestra.run.smithi016:> dpkg -s linux-image-generic 2024-04-26T12:25:47.441 INFO:teuthology.orchestra.run.smithi016.stdout:Package: linux-image-generic 2024-04-26T12:25:47.441 INFO:teuthology.orchestra.run.smithi016.stdout:Status: install ok installed 2024-04-26T12:25:47.441 INFO:teuthology.orchestra.run.smithi016.stdout:Priority: optional 2024-04-26T12:25:47.441 INFO:teuthology.orchestra.run.smithi016.stdout:Section: kernel 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout:Installed-Size: 21 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: amd64 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout:Source: linux-meta 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout:Version: 5.15.0.105.102 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout:Recommends: thermald 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout:Description: Generic Linux kernel image 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout: This package will always depend on the latest generic kernel image 2024-04-26T12:25:47.442 INFO:teuthology.orchestra.run.smithi016.stdout: available. 2024-04-26T12:25:47.443 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T12:25:47.443 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T12:25:47.443 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T12:25:47.443 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T12:25:47.444 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T12:25:47.444 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get clean 2024-04-26T12:25:47.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-04-26T12:25:47.749 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T12:25:47.855 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:25:47.938 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T12:25:48.289 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T12:25:48.528 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 227 kB in 1s (302 kB/s) 2024-04-26T12:25:48.673 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub' 2024-04-26T12:25:48.684 INFO:teuthology.orchestra.run.smithi131.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T12:25:48.687 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-04-26T12:25:48.865 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:25:48.871 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:25:49.149 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:25:49.155 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T12:25:49.198 INFO:teuthology.orchestra.run.smithi131.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T12:25:49.204 INFO:teuthology.orchestra.run.smithi131.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T12:25:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T12:25:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T12:25:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T12:25:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-04-26T12:25:49.339 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-04-26T12:25:49.506 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T12:25:49.525 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T12:25:49.589 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T12:25:49.793 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-26T12:25:49.794 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-26T12:25:49.981 INFO:teuthology.orchestra.run.smithi016.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T12:25:49.981 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:25:49.981 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:25:49.982 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:25:49.982 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:25:49.982 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T12:25:49.982 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T12:25:49.982 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:25:50.026 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T12:25:50.028 DEBUG:teuthology.orchestra.run.smithi016:> dpkg -s linux-image-generic 2024-04-26T12:25:50.044 INFO:teuthology.orchestra.run.smithi016.stdout:Package: linux-image-generic 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Status: install ok installed 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Priority: optional 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Section: kernel 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Installed-Size: 21 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: amd64 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Source: linux-meta 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Version: 5.15.0.105.102 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Recommends: thermald 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:Description: Generic Linux kernel image 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout: This package will always depend on the latest generic kernel image 2024-04-26T12:25:50.045 INFO:teuthology.orchestra.run.smithi016.stdout: available. 2024-04-26T12:25:50.046 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-26T12:25:50.092 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.SSqGQXc6jZ 2024-04-26T12:25:50.093 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SSqGQXc6jZ 2024-04-26T12:25:50.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.SSqGQXc6jZ 2024-04-26T12:25:50.260 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.SSqGQXc6jZ is 10KB 2024-04-26T12:25:50.273 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.SSqGQXc6jZ 2024-04-26T12:25:50.279 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T12:25:50.332 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:25:50.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T12:25:50.333 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T12:25:50.426 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T12:25:50.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo update-grub 2024-04-26T12:25:51.770 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-04-26T12:25:51.771 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T12:25:51.773 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-26T12:25:51.961 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T12:25:51.968 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T12:25:52.265 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T12:25:52.271 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T12:25:52.315 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T12:25:52.320 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T12:25:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T12:25:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T12:25:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T12:25:52.458 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-26T12:25:52.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2024-04-26T12:26:19.366 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-26T12:26:19.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-26T12:26:19.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:26:22.466 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T12:26:22.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T12:26:22.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:26:37.731 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-26T12:26:40.798 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-26T12:26:46.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-26T12:26:46.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:26:49.794 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-26T12:26:49.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T12:26:49.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:27:01.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-26T12:27:01.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:27:20.226 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-26T12:27:35.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-26T12:27:35.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:27:35.516 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-04-26T12:27:36.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-26T12:27:36.117 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-26T12:27:36.118 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-04-26T12:27:36.162 INFO:teuthology.orchestra.run.smithi131.stdout:5.15.0-105-generic 2024-04-26T12:27:36.162 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T12:27:36.163 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T12:27:36.163 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T12:27:37.164 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-26T12:27:37.164 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:27:37.522 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-04-26T12:27:37.552 DEBUG:teuthology.parallel:result is None 2024-04-26T12:27:49.802 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T12:28:01.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T12:28:01.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:28:02.015 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-26T12:28:02.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T12:28:02.606 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-26T12:28:02.606 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-26T12:28:02.651 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-105-generic 2024-04-26T12:28:02.651 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T12:28:02.651 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T12:28:02.651 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T12:28:03.652 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T12:28:03.653 DEBUG:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T12:28:03.716 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2024-04-26T12:28:03.740 DEBUG:teuthology.parallel:result is None 2024-04-26T12:28:03.741 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T12:28:03.751 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T12:28:03.752 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:28:03.754 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T12:28:03.761 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T12:28:03.767 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T12:28:03.778 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T12:28:03.779 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:28:03.800 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T12:28:03.881 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T12:28:03.888 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T12:28:03.888 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:28:03.890 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T12:28:03.908 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:28:03.912 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:28:03.915 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:28:03.921 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T12:28:03.922 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T12:28:03.929 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T12:28:03.929 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:28:03.968 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T12:28:03.982 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T12:28:03.991 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T12:28:03.991 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:28:04.020 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T12:28:04.030 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:28:04.075 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:28:04.124 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:28:04.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:28:04.179 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T12:28:04.185 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T12:28:04.231 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:28:04.231 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T12:28:04.309 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-04-26T12:28:04.312 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-04-26T12:28:04.389 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T12:28:04.402 INFO:teuthology.task.internal:Starting timer... 2024-04-26T12:28:04.402 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T12:28:04.619 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T12:28:04.629 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2024-04-26T12:28:04.629 DEBUG:teuthology.task.selinux:Excluding smithi131: OS 'ubuntu' does not support SELinux 2024-04-26T12:28:04.630 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T12:28:04.630 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T12:28:04.630 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T12:28:04.630 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T12:28:04.638 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T12:28:04.656 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T12:28:04.657 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T12:35:11.736 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2024-04-26T12:35:11.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T12:35:11.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:35:11.822 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-26T12:35:11.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-26T12:35:11.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-26T12:35:11.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T12:35:11.978 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-04-26T12:35:12.054 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-26T12:35:12.055 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T12:35:12.065 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T12:35:12.065 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:35:12.066 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:35:12.068 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T12:35:12.068 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:35:12.098 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T12:35:12.098 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: Command line: ntpd -gq 2024-04-26T12:35:12.098 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: ---------------------------------------------------- 2024-04-26T12:35:12.098 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T12:35:12.098 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T12:35:12.098 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: corporation. Support and training for ntp-4 are 2024-04-26T12:35:12.098 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: available at https://www.nwtime.org/support 2024-04-26T12:35:12.098 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: ---------------------------------------------------- 2024-04-26T12:35:12.099 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: proto: precision = 0.099 usec (-23) 2024-04-26T12:35:12.099 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: basedate set to 2022-02-04 2024-04-26T12:35:12.099 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: gps base set to 2022-02-06 (week 2196) 2024-04-26T12:35:12.099 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T12:35:12.100 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T12:35:12.100 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T12:35:12.100 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T12:35:12.101 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T12:35:12.101 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T12:35:12.101 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T12:35:12.101 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: Listen normally on 3 ens1f0 172.21.15.16:123 2024-04-26T12:35:12.101 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: Listen normally on 4 lo [::1]:123 2024-04-26T12:35:12.101 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%4]:123 2024-04-26T12:35:12.102 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:12 ntpd[17119]: Listening on routing socket on fd #22 for interface updates 2024-04-26T12:35:12.122 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T12:35:12.122 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: Command line: ntpd -gq 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: ---------------------------------------------------- 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: corporation. Support and training for ntp-4 are 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: available at https://www.nwtime.org/support 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: ---------------------------------------------------- 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: proto: precision = 0.045 usec (-24) 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: basedate set to 2022-02-04 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: gps base set to 2022-02-06 (week 2196) 2024-04-26T12:35:12.123 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T12:35:12.124 INFO:teuthology.orchestra.run.smithi131.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T12:35:12.124 INFO:teuthology.orchestra.run.smithi131.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T12:35:12.125 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T12:35:12.125 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T12:35:12.125 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T12:35:12.125 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T12:35:12.125 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: Listen normally on 3 enp3s0f1 172.21.15.131:123 2024-04-26T12:35:12.126 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: Listen normally on 4 lo [::1]:123 2024-04-26T12:35:12.126 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:72f9%5]:123 2024-04-26T12:35:12.126 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:12 ntpd[17258]: Listening on routing socket on fd #22 for interface updates 2024-04-26T12:35:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:13.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:13.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:13.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:13.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:13.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:13.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:13.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:13 ntpd[17119]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:13.122 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:13.122 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:13.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:13 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:14.122 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:14 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:14.122 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:14 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:15.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:15 ntpd[17119]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:15.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:15.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:15.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:15.127 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:15.127 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:15.127 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:15.127 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:15.127 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:15 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:16.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:16 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:16.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:16 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:16.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:16 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:16.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:16 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:16.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:16 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:16.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:16 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:16.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:16 ntpd[17119]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:16.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:16 ntpd[17119]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:17.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:17.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:17 ntpd[17119]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:17.124 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.124 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:17.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:17.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:17.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:17.126 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:17 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:18 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:18 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:18 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:18 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:18 ntpd[17119]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:18.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:18 ntpd[17119]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:19.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:19.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:19.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:19.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:19.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:19.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:19.099 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:19.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:19.100 INFO:teuthology.orchestra.run.smithi016.stdout:26 Apr 12:35:19 ntpd[17119]: ntpd: time slew -0.000534 s 2024-04-26T12:35:19.100 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew -0.000534s 2024-04-26T12:35:19.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T12:35:19.100 INFO:teuthology.orchestra.run.smithi016.stderr:26 Apr 12:35:19 ntpd[17119]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T12:35:19.123 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T12:35:19.124 INFO:teuthology.orchestra.run.smithi131.stdout:26 Apr 12:35:19 ntpd[17258]: ntpd: time slew -0.001450 s 2024-04-26T12:35:19.124 INFO:teuthology.orchestra.run.smithi131.stdout:ntpd: time slew -0.001450s 2024-04-26T12:35:19.124 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T12:35:19.124 INFO:teuthology.orchestra.run.smithi131.stderr:26 Apr 12:35:19 ntpd[17258]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T12:35:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T12:35:19.151 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-26T12:35:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:35:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:35:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:35:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:35:19.169 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T12:35:19.169 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-04-26T12:35:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:35:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:35:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:35:19.170 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:35:19.170 INFO:teuthology.run_tasks:Running task install... 2024-04-26T12:35:19.180 DEBUG:teuthology.task.install:project ceph 2024-04-26T12:35:19.181 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}} 2024-04-26T12:35:19.181 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'} 2024-04-26T12:35:19.181 INFO:teuthology.task.install:Using flavor: default 2024-04-26T12:35:19.192 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T12:35:19.193 INFO:teuthology.task.install:extra packages: [] 2024-04-26T12:35:19.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2024-04-26T12:35:19.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-key list | grep Ceph 2024-04-26T12:35:19.255 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T12:35:19.264 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T12:35:19.285 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T12:35:19.285 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T12:35:19.285 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T12:35:19.285 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:35:19.290 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T12:35:19.291 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T12:35:19.291 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T12:35:19.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:35:19.516 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default/ 2024-04-26T12:35:19.516 INFO:teuthology.task.install.deb:Package version is 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:35:19.519 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default/ 2024-04-26T12:35:19.519 INFO:teuthology.task.install.deb:Package version is 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:35:19.631 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:35:19.631 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T12:35:19.646 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-04-26T12:35:19.685 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:35:19.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T12:35:19.699 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-04-26T12:35:19.823 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T12:35:19.870 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T12:35:19.891 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T12:35:19.913 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T12:35:19.934 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T12:35:19.962 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-26T12:35:19.983 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T12:35:20.019 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T12:35:20.059 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T12:35:20.095 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T12:35:20.142 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-26T12:35:20.375 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T12:35:20.438 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:35:20.488 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T12:35:20.520 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T12:35:20.570 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T12:35:20.602 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T12:35:20.651 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T12:35:20.782 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 29.0 kB in 1s (30.6 kB/s) 2024-04-26T12:35:20.792 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 29.0 kB in 1s (31.6 kB/s) 2024-04-26T12:35:21.766 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T12:35:21.774 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-04-26T12:35:21.780 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2451-g7fad7ff2-1jammy cephadm=19.0.0-2451-g7fad7ff2-1jammy ceph-mds=19.0.0-2451-g7fad7ff2-1jammy ceph-mgr=19.0.0-2451-g7fad7ff2-1jammy ceph-common=19.0.0-2451-g7fad7ff2-1jammy ceph-fuse=19.0.0-2451-g7fad7ff2-1jammy ceph-test=19.0.0-2451-g7fad7ff2-1jammy ceph-volume=19.0.0-2451-g7fad7ff2-1jammy radosgw=19.0.0-2451-g7fad7ff2-1jammy python3-rados=19.0.0-2451-g7fad7ff2-1jammy python3-rgw=19.0.0-2451-g7fad7ff2-1jammy python3-cephfs=19.0.0-2451-g7fad7ff2-1jammy python3-rbd=19.0.0-2451-g7fad7ff2-1jammy libcephfs2=19.0.0-2451-g7fad7ff2-1jammy libcephfs-dev=19.0.0-2451-g7fad7ff2-1jammy librados2=19.0.0-2451-g7fad7ff2-1jammy librbd1=19.0.0-2451-g7fad7ff2-1jammy rbd-fuse=19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:35:21.789 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2451-g7fad7ff2-1jammy cephadm=19.0.0-2451-g7fad7ff2-1jammy ceph-mds=19.0.0-2451-g7fad7ff2-1jammy ceph-mgr=19.0.0-2451-g7fad7ff2-1jammy ceph-common=19.0.0-2451-g7fad7ff2-1jammy ceph-fuse=19.0.0-2451-g7fad7ff2-1jammy ceph-test=19.0.0-2451-g7fad7ff2-1jammy ceph-volume=19.0.0-2451-g7fad7ff2-1jammy radosgw=19.0.0-2451-g7fad7ff2-1jammy python3-rados=19.0.0-2451-g7fad7ff2-1jammy python3-rgw=19.0.0-2451-g7fad7ff2-1jammy python3-cephfs=19.0.0-2451-g7fad7ff2-1jammy python3-rbd=19.0.0-2451-g7fad7ff2-1jammy libcephfs2=19.0.0-2451-g7fad7ff2-1jammy libcephfs-dev=19.0.0-2451-g7fad7ff2-1jammy librados2=19.0.0-2451-g7fad7ff2-1jammy librbd1=19.0.0-2451-g7fad7ff2-1jammy rbd-fuse=19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:35:21.833 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-26T12:35:21.851 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-04-26T12:35:22.015 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-26T12:35:22.015 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-26T12:35:22.051 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-04-26T12:35:22.051 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-04-26T12:35:22.194 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:35:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:35:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:35:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:35:22.195 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T12:35:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T12:35:22.196 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:35:22.196 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-26T12:35:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T12:35:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T12:35:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T12:35:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T12:35:22.197 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T12:35:22.197 INFO:teuthology.orchestra.run.smithi016.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T12:35:22.198 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet zip 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T12:35:22.199 INFO:teuthology.orchestra.run.smithi016.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T12:35:22.200 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T12:35:22.200 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T12:35:22.200 INFO:teuthology.orchestra.run.smithi016.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T12:35:22.200 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T12:35:22.200 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-04-26T12:35:22.200 INFO:teuthology.orchestra.run.smithi016.stdout: btrfs-tools 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T12:35:22.248 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T12:35:22.249 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T12:35:22.250 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T12:35:22.250 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T12:35:22.250 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T12:35:22.250 INFO:teuthology.orchestra.run.smithi131.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T12:35:22.250 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T12:35:22.250 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T12:35:22.250 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet zip 2024-04-26T12:35:22.250 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-04-26T12:35:22.250 INFO:teuthology.orchestra.run.smithi131.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T12:35:22.251 INFO:teuthology.orchestra.run.smithi131.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T12:35:22.251 INFO:teuthology.orchestra.run.smithi131.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T12:35:22.251 INFO:teuthology.orchestra.run.smithi131.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T12:35:22.251 INFO:teuthology.orchestra.run.smithi131.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T12:35:22.251 INFO:teuthology.orchestra.run.smithi131.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T12:35:22.251 INFO:teuthology.orchestra.run.smithi131.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T12:35:22.251 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-04-26T12:35:22.251 INFO:teuthology.orchestra.run.smithi131.stdout: btrfs-tools 2024-04-26T12:35:22.300 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-26T12:35:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T12:35:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T12:35:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T12:35:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T12:35:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T12:35:22.301 INFO:teuthology.orchestra.run.smithi016.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T12:35:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T12:35:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T12:35:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T12:35:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T12:35:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T12:35:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T12:35:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T12:35:22.302 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T12:35:22.303 INFO:teuthology.orchestra.run.smithi016.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T12:35:22.351 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-04-26T12:35:22.351 INFO:teuthology.orchestra.run.smithi131.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T12:35:22.351 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T12:35:22.354 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T12:35:22.354 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T12:35:22.354 INFO:teuthology.orchestra.run.smithi131.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T12:35:22.354 INFO:teuthology.orchestra.run.smithi131.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T12:35:22.354 INFO:teuthology.orchestra.run.smithi131.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T12:35:22.354 INFO:teuthology.orchestra.run.smithi131.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T12:35:22.354 INFO:teuthology.orchestra.run.smithi131.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T12:35:22.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T12:35:22.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T12:35:22.356 INFO:teuthology.orchestra.run.smithi131.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T12:35:22.437 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T12:35:22.437 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 180 MB of archives. 2024-04-26T12:35:22.437 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T12:35:22.438 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T12:35:22.443 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2451-g7fad7ff2-1jammy [3,547 kB] 2024-04-26T12:35:22.493 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T12:35:22.493 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 180 MB of archives. 2024-04-26T12:35:22.493 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T12:35:22.493 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2451-g7fad7ff2-1jammy [3,547 kB] 2024-04-26T12:35:22.540 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T12:35:22.696 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T12:35:22.708 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T12:35:22.757 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T12:35:22.817 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2451-g7fad7ff2-1jammy [3,216 kB] 2024-04-26T12:35:22.958 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T12:35:22.966 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T12:35:22.967 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T12:35:22.979 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T12:35:23.009 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T12:35:23.023 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T12:35:23.024 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T12:35:23.025 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T12:35:23.040 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T12:35:23.049 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T12:35:23.059 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T12:35:23.061 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T12:35:23.061 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T12:35:23.066 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T12:35:23.071 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T12:35:23.098 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T12:35:23.102 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T12:35:23.103 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T12:35:23.104 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T12:35:23.106 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T12:35:23.107 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T12:35:23.107 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T12:35:23.108 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T12:35:23.125 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2451-g7fad7ff2-1jammy [711 kB] 2024-04-26T12:35:23.139 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2451-g7fad7ff2-1jammy [357 kB] 2024-04-26T12:35:23.139 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T12:35:23.140 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T12:35:23.141 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T12:35:23.146 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2451-g7fad7ff2-1jammy [32.8 kB] 2024-04-26T12:35:23.147 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2451-g7fad7ff2-1jammy [180 kB] 2024-04-26T12:35:23.175 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T12:35:23.176 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T12:35:23.177 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T12:35:23.178 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T12:35:23.180 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T12:35:23.181 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T12:35:23.182 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T12:35:23.182 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2451-g7fad7ff2-1jammy [65.7 kB] 2024-04-26T12:35:23.184 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2451-g7fad7ff2-1jammy [330 kB] 2024-04-26T12:35:23.196 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2451-g7fad7ff2-1jammy [6,778 kB] 2024-04-26T12:35:23.216 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T12:35:23.218 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T12:35:23.218 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T12:35:23.270 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T12:35:23.274 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T12:35:23.274 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T12:35:23.274 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T12:35:23.275 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T12:35:23.279 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T12:35:23.281 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T12:35:23.290 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T12:35:23.303 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T12:35:23.332 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T12:35:23.333 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T12:35:23.334 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T12:35:23.339 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T12:35:23.341 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T12:35:23.342 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T12:35:23.344 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T12:35:23.362 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T12:35:23.395 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T12:35:23.396 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T12:35:23.401 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T12:35:23.531 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T12:35:23.584 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T12:35:23.586 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T12:35:23.587 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T12:35:23.588 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T12:35:23.590 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T12:35:23.620 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T12:35:23.623 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T12:35:23.624 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T12:35:23.675 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T12:35:23.675 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T12:35:23.677 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T12:35:23.678 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T12:35:23.679 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T12:35:23.680 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T12:35:23.693 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2451-g7fad7ff2-1jammy [3,216 kB] 2024-04-26T12:35:23.706 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T12:35:23.707 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T12:35:23.717 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T12:35:23.746 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T12:35:23.750 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T12:35:23.751 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T12:35:23.760 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T12:35:23.767 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T12:35:23.769 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T12:35:23.771 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T12:35:23.790 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T12:35:23.791 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T12:35:23.792 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2451-g7fad7ff2-1jammy [112 kB] 2024-04-26T12:35:23.795 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2451-g7fad7ff2-1jammy [466 kB] 2024-04-26T12:35:23.802 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T12:35:23.832 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T12:35:23.834 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T12:35:23.835 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T12:35:23.839 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T12:35:23.841 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T12:35:23.853 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2451-g7fad7ff2-1jammy [25.6 MB] 2024-04-26T12:35:23.859 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T12:35:23.860 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T12:35:23.872 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T12:35:23.880 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T12:35:23.882 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T12:35:23.944 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T12:35:23.977 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T12:35:23.979 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T12:35:24.060 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T12:35:24.111 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T12:35:24.133 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T12:35:24.140 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T12:35:24.141 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T12:35:24.153 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T12:35:24.153 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T12:35:24.287 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2451-g7fad7ff2-1jammy [711 kB] 2024-04-26T12:35:24.319 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T12:35:24.402 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T12:35:24.430 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T12:35:24.435 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2451-g7fad7ff2-1jammy [357 kB] 2024-04-26T12:35:24.447 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T12:35:24.448 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2451-g7fad7ff2-1jammy [32.8 kB] 2024-04-26T12:35:24.449 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2451-g7fad7ff2-1jammy [180 kB] 2024-04-26T12:35:24.492 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T12:35:24.517 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2451-g7fad7ff2-1jammy [65.7 kB] 2024-04-26T12:35:24.519 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2451-g7fad7ff2-1jammy [330 kB] 2024-04-26T12:35:24.609 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2451-g7fad7ff2-1jammy [6,778 kB] 2024-04-26T12:35:24.709 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T12:35:24.722 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T12:35:24.728 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T12:35:24.734 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T12:35:24.755 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T12:35:24.759 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T12:35:24.924 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T12:35:25.259 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T12:35:25.291 INFO:teuthology.orchestra.run.smithi131.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T12:35:25.302 INFO:teuthology.orchestra.run.smithi131.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T12:35:25.505 INFO:teuthology.orchestra.run.smithi131.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T12:35:25.505 INFO:teuthology.orchestra.run.smithi131.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T12:35:25.512 INFO:teuthology.orchestra.run.smithi131.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T12:35:25.518 INFO:teuthology.orchestra.run.smithi131.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T12:35:25.528 INFO:teuthology.orchestra.run.smithi131.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2451-g7fad7ff2-1jammy [112 kB] 2024-04-26T12:35:25.533 INFO:teuthology.orchestra.run.smithi131.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T12:35:25.545 INFO:teuthology.orchestra.run.smithi131.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2451-g7fad7ff2-1jammy [466 kB] 2024-04-26T12:35:25.554 INFO:teuthology.orchestra.run.smithi131.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T12:35:25.560 INFO:teuthology.orchestra.run.smithi131.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T12:35:25.609 INFO:teuthology.orchestra.run.smithi131.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2451-g7fad7ff2-1jammy [25.6 MB] 2024-04-26T12:35:25.736 INFO:teuthology.orchestra.run.smithi131.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T12:35:25.999 INFO:teuthology.orchestra.run.smithi131.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T12:35:26.178 INFO:teuthology.orchestra.run.smithi131.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T12:35:26.191 INFO:teuthology.orchestra.run.smithi131.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T12:35:26.211 INFO:teuthology.orchestra.run.smithi131.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T12:35:26.275 INFO:teuthology.orchestra.run.smithi131.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T12:35:26.432 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2451-g7fad7ff2-1jammy [5,084 kB] 2024-04-26T12:35:26.564 INFO:teuthology.orchestra.run.smithi131.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T12:35:26.566 INFO:teuthology.orchestra.run.smithi131.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T12:35:26.568 INFO:teuthology.orchestra.run.smithi131.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T12:35:26.569 INFO:teuthology.orchestra.run.smithi131.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T12:35:26.571 INFO:teuthology.orchestra.run.smithi131.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T12:35:26.798 INFO:teuthology.orchestra.run.smithi131.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T12:35:26.833 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2451-g7fad7ff2-1jammy [244 kB] 2024-04-26T12:35:26.874 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2451-g7fad7ff2-1jammy [124 kB] 2024-04-26T12:35:26.878 INFO:teuthology.orchestra.run.smithi016.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2451-g7fad7ff2-1jammy [1,527 kB] 2024-04-26T12:35:27.019 INFO:teuthology.orchestra.run.smithi016.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2451-g7fad7ff2-1jammy [6,245 kB] 2024-04-26T12:35:27.228 INFO:teuthology.orchestra.run.smithi131.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T12:35:27.234 INFO:teuthology.orchestra.run.smithi131.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T12:35:27.525 INFO:teuthology.orchestra.run.smithi131.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T12:35:27.525 INFO:teuthology.orchestra.run.smithi131.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T12:35:27.527 INFO:teuthology.orchestra.run.smithi131.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T12:35:27.529 INFO:teuthology.orchestra.run.smithi131.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T12:35:27.530 INFO:teuthology.orchestra.run.smithi131.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T12:35:27.533 INFO:teuthology.orchestra.run.smithi131.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T12:35:27.534 INFO:teuthology.orchestra.run.smithi131.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T12:35:27.535 INFO:teuthology.orchestra.run.smithi131.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T12:35:27.644 INFO:teuthology.orchestra.run.smithi016.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2451-g7fad7ff2-1jammy [22.7 MB] 2024-04-26T12:35:27.717 INFO:teuthology.orchestra.run.smithi131.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T12:35:28.129 INFO:teuthology.orchestra.run.smithi131.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T12:35:28.174 INFO:teuthology.orchestra.run.smithi131.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T12:35:28.210 INFO:teuthology.orchestra.run.smithi131.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T12:35:28.306 INFO:teuthology.orchestra.run.smithi131.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T12:35:28.346 INFO:teuthology.orchestra.run.smithi131.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T12:35:28.357 INFO:teuthology.orchestra.run.smithi131.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T12:35:28.363 INFO:teuthology.orchestra.run.smithi131.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T12:35:28.410 INFO:teuthology.orchestra.run.smithi131.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T12:35:28.413 INFO:teuthology.orchestra.run.smithi131.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T12:35:28.434 INFO:teuthology.orchestra.run.smithi131.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T12:35:28.598 INFO:teuthology.orchestra.run.smithi131.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T12:35:28.873 INFO:teuthology.orchestra.run.smithi131.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T12:35:28.889 INFO:teuthology.orchestra.run.smithi131.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T12:35:29.043 INFO:teuthology.orchestra.run.smithi131.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T12:35:29.072 INFO:teuthology.orchestra.run.smithi131.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T12:35:29.197 INFO:teuthology.orchestra.run.smithi131.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2451-g7fad7ff2-1jammy [5,084 kB] 2024-04-26T12:35:29.255 INFO:teuthology.orchestra.run.smithi131.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T12:35:29.256 INFO:teuthology.orchestra.run.smithi131.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T12:35:29.258 INFO:teuthology.orchestra.run.smithi131.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T12:35:29.276 INFO:teuthology.orchestra.run.smithi131.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T12:35:29.280 INFO:teuthology.orchestra.run.smithi131.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T12:35:29.826 INFO:teuthology.orchestra.run.smithi131.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2451-g7fad7ff2-1jammy [244 kB] 2024-04-26T12:35:29.830 INFO:teuthology.orchestra.run.smithi131.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2451-g7fad7ff2-1jammy [124 kB] 2024-04-26T12:35:29.853 INFO:teuthology.orchestra.run.smithi131.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2451-g7fad7ff2-1jammy [1,527 kB] 2024-04-26T12:35:30.028 INFO:teuthology.orchestra.run.smithi016.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2451-g7fad7ff2-1jammy [14.0 kB] 2024-04-26T12:35:30.028 INFO:teuthology.orchestra.run.smithi016.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2451-g7fad7ff2-1jammy [869 kB] 2024-04-26T12:35:30.045 INFO:teuthology.orchestra.run.smithi016.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2451-g7fad7ff2-1jammy [2,437 kB] 2024-04-26T12:35:30.048 INFO:teuthology.orchestra.run.smithi131.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2451-g7fad7ff2-1jammy [6,245 kB] 2024-04-26T12:35:30.305 INFO:teuthology.orchestra.run.smithi016.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2451-g7fad7ff2-1jammy [791 kB] 2024-04-26T12:35:30.379 INFO:teuthology.orchestra.run.smithi016.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2451-g7fad7ff2-1jammy [147 kB] 2024-04-26T12:35:30.383 INFO:teuthology.orchestra.run.smithi016.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2451-g7fad7ff2-1jammy [2,293 kB] 2024-04-26T12:35:30.613 INFO:teuthology.orchestra.run.smithi016.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2451-g7fad7ff2-1jammy [8,625 kB] 2024-04-26T12:35:30.895 INFO:teuthology.orchestra.run.smithi131.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2451-g7fad7ff2-1jammy [22.7 MB] 2024-04-26T12:35:31.481 INFO:teuthology.orchestra.run.smithi016.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2451-g7fad7ff2-1jammy [14.2 kB] 2024-04-26T12:35:31.482 INFO:teuthology.orchestra.run.smithi016.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2451-g7fad7ff2-1jammy [50.7 MB] 2024-04-26T12:35:33.994 INFO:teuthology.orchestra.run.smithi131.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2451-g7fad7ff2-1jammy [14.0 kB] 2024-04-26T12:35:33.994 INFO:teuthology.orchestra.run.smithi131.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2451-g7fad7ff2-1jammy [869 kB] 2024-04-26T12:35:34.031 INFO:teuthology.orchestra.run.smithi131.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2451-g7fad7ff2-1jammy [2,437 kB] 2024-04-26T12:35:34.273 INFO:teuthology.orchestra.run.smithi131.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2451-g7fad7ff2-1jammy [791 kB] 2024-04-26T12:35:34.322 INFO:teuthology.orchestra.run.smithi131.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2451-g7fad7ff2-1jammy [147 kB] 2024-04-26T12:35:34.327 INFO:teuthology.orchestra.run.smithi131.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2451-g7fad7ff2-1jammy [2,293 kB] 2024-04-26T12:35:34.501 INFO:teuthology.orchestra.run.smithi131.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2451-g7fad7ff2-1jammy [8,625 kB] 2024-04-26T12:35:35.182 INFO:teuthology.orchestra.run.smithi131.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2451-g7fad7ff2-1jammy [14.2 kB] 2024-04-26T12:35:35.182 INFO:teuthology.orchestra.run.smithi131.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2451-g7fad7ff2-1jammy [50.7 MB] 2024-04-26T12:35:35.750 INFO:teuthology.orchestra.run.smithi016.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2451-g7fad7ff2-1jammy [121 kB] 2024-04-26T12:35:35.752 INFO:teuthology.orchestra.run.smithi016.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2451-g7fad7ff2-1jammy [38.9 kB] 2024-04-26T12:35:35.754 INFO:teuthology.orchestra.run.smithi016.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2451-g7fad7ff2-1jammy [13.4 MB] 2024-04-26T12:35:36.404 INFO:teuthology.orchestra.run.smithi016.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2451-g7fad7ff2-1jammy [91.6 kB] 2024-04-26T12:35:36.992 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 180 MB in 14s (12.7 MB/s) 2024-04-26T12:35:37.125 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T12:35:37.224 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T12:35:37.230 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T12:35:37.349 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T12:35:37.670 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T12:35:37.697 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T12:35:37.736 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T12:35:37.821 INFO:teuthology.orchestra.run.smithi131.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2451-g7fad7ff2-1jammy [121 kB] 2024-04-26T12:35:37.826 INFO:teuthology.orchestra.run.smithi131.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2451-g7fad7ff2-1jammy [38.9 kB] 2024-04-26T12:35:37.826 INFO:teuthology.orchestra.run.smithi131.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2451-g7fad7ff2-1jammy [13.4 MB] 2024-04-26T12:35:38.072 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T12:35:38.099 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T12:35:38.139 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T12:35:38.308 INFO:teuthology.orchestra.run.smithi131.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-cbodley2-testing/7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2451-g7fad7ff2-1jammy [91.6 kB] 2024-04-26T12:35:38.518 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T12:35:38.545 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:35:38.584 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:35:38.871 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 180 MB in 16s (11.3 MB/s) 2024-04-26T12:35:39.004 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T12:35:39.031 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:35:39.034 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T12:35:39.071 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:35:39.135 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T12:35:39.140 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T12:35:39.224 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T12:35:39.399 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T12:35:39.426 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:35:39.457 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:35:39.553 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T12:35:39.568 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T12:35:39.653 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T12:35:39.836 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T12:35:39.863 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T12:35:39.902 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T12:35:40.230 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librados2. 2024-04-26T12:35:40.240 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T12:35:40.257 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-librados2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:40.266 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T12:35:40.297 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:40.306 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T12:35:40.727 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T12:35:40.754 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:35:40.801 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:35:40.867 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librbd1. 2024-04-26T12:35:40.883 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-librbd1_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:40.917 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:41.213 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T12:35:41.240 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:35:41.280 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:35:41.328 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T12:35:41.355 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:41.394 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:41.600 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T12:35:41.627 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T12:35:41.675 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:35:41.680 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rados. 2024-04-26T12:35:41.696 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:41.739 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rados (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:42.020 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T12:35:42.047 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T12:35:42.086 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T12:35:42.209 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T12:35:42.225 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:35:42.258 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-argparse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:42.415 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librados2. 2024-04-26T12:35:42.441 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../007-librados2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:42.481 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librados2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:42.486 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T12:35:42.502 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:42.544 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cephfs (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:42.839 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T12:35:42.854 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:35:42.895 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:42.947 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librbd1. 2024-04-26T12:35:42.973 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../008-librbd1_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:43.017 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librbd1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:43.175 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T12:35:43.202 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T12:35:43.234 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T12:35:43.470 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T12:35:43.497 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:43.537 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:43.578 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T12:35:43.605 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T12:35:43.645 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T12:35:43.914 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T12:35:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:43.981 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rbd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:44.014 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rados. 2024-04-26T12:35:44.030 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:44.073 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rados (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:44.326 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T12:35:44.353 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T12:35:44.392 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T12:35:44.401 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T12:35:44.428 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:35:44.467 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-argparse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:44.678 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T12:35:44.694 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T12:35:44.703 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T12:35:44.719 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:44.737 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T12:35:44.753 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cephfs (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:45.023 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T12:35:45.038 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T12:35:45.056 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T12:35:45.083 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:35:45.089 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T12:35:45.123 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:45.435 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua5.1. 2024-04-26T12:35:45.451 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T12:35:45.462 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T12:35:45.478 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T12:35:45.493 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T12:35:45.518 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T12:35:45.787 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T12:35:45.803 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T12:35:45.813 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-any. 2024-04-26T12:35:45.837 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T12:35:45.840 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T12:35:45.879 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T12:35:46.098 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T12:35:46.125 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:46.141 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package zip. 2024-04-26T12:35:46.165 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rbd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:46.168 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T12:35:46.207 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T12:35:46.486 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package unzip. 2024-04-26T12:35:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T12:35:46.527 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T12:35:46.544 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T12:35:46.553 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T12:35:46.593 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T12:35:46.888 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T12:35:46.903 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T12:35:46.914 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package luarocks. 2024-04-26T12:35:46.937 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T12:35:46.941 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T12:35:46.981 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T12:35:47.241 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T12:35:47.256 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T12:35:47.299 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T12:35:47.364 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2024-04-26T12:35:47.391 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-librgw2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:47.422 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:47.636 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua5.1. 2024-04-26T12:35:47.665 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T12:35:47.702 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T12:35:47.983 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T12:35:47.999 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:48.005 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-any. 2024-04-26T12:35:48.021 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T12:35:48.041 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:48.056 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T12:35:48.266 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package zip. 2024-04-26T12:35:48.282 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T12:35:48.325 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T12:35:48.328 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T12:35:48.355 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T12:35:48.386 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T12:35:48.637 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package unzip. 2024-04-26T12:35:48.664 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T12:35:48.681 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T12:35:48.704 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T12:35:48.707 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:48.747 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:49.116 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package luarocks. 2024-04-26T12:35:49.142 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T12:35:49.184 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2024-04-26T12:35:49.190 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T12:35:49.211 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:49.251 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:49.632 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librgw2. 2024-04-26T12:35:49.659 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../025-librgw2_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:49.699 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librgw2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:50.285 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T12:35:50.312 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:50.352 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:50.640 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2024-04-26T12:35:50.667 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:50.688 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T12:35:50.715 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T12:35:50.716 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:50.763 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T12:35:51.133 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T12:35:51.160 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:51.208 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libradosstriper1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:51.327 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T12:35:51.343 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T12:35:51.386 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T12:35:51.628 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-common. 2024-04-26T12:35:51.639 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T12:35:51.654 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:51.665 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T12:35:51.695 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:51.697 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T12:35:52.017 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T12:35:52.044 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T12:35:52.084 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T12:35:52.528 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T12:35:52.555 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T12:35:52.645 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T12:35:52.923 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T12:35:52.949 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T12:35:52.989 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T12:35:53.050 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-base. 2024-04-26T12:35:53.077 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:35:53.135 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-base (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:35:53.309 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T12:35:53.336 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T12:35:53.376 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T12:35:53.679 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-portend. 2024-04-26T12:35:53.705 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T12:35:53.738 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T12:35:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T12:35:53.764 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T12:35:53.805 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T12:35:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T12:35:54.033 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T12:35:54.064 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T12:35:54.074 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T12:35:54.101 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T12:35:54.141 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T12:35:54.326 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T12:35:54.353 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T12:35:54.384 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T12:35:54.628 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T12:35:54.643 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T12:35:54.677 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T12:35:54.738 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T12:35:54.765 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T12:35:54.805 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T12:35:55.556 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T12:35:55.583 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T12:35:55.789 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T12:35:55.861 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T12:35:55.888 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T12:35:55.927 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T12:35:56.076 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T12:35:56.102 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T12:35:56.142 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T12:35:56.238 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T12:35:56.265 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T12:35:56.305 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T12:35:56.429 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T12:35:56.455 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T12:35:56.495 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T12:35:56.583 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-mako. 2024-04-26T12:35:56.609 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T12:35:56.641 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T12:35:56.798 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-portend. 2024-04-26T12:35:56.825 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T12:35:56.865 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T12:35:56.969 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T12:35:56.996 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T12:35:57.036 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T12:35:57.126 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T12:35:57.153 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T12:35:57.193 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T12:35:57.322 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T12:35:57.349 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T12:35:57.388 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T12:35:57.538 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T12:35:57.564 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T12:35:57.604 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T12:35:57.682 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webob. 2024-04-26T12:35:57.699 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T12:35:57.748 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T12:35:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T12:35:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T12:35:58.016 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T12:35:58.053 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T12:35:58.079 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T12:35:58.114 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T12:35:58.380 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T12:35:58.386 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T12:35:58.407 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T12:35:58.413 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T12:35:58.447 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T12:35:58.461 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T12:35:58.750 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-paste. 2024-04-26T12:35:58.776 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T12:35:58.814 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T12:35:58.816 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T12:35:58.841 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T12:35:58.881 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T12:35:59.111 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T12:35:59.127 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T12:35:59.161 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T12:35:59.167 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-mako. 2024-04-26T12:35:59.193 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T12:35:59.234 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T12:35:59.464 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T12:35:59.491 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T12:35:59.530 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T12:35:59.579 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T12:35:59.606 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T12:35:59.646 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T12:35:59.833 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T12:35:59.860 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T12:35:59.900 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T12:35:59.924 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T12:35:59.950 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T12:35:59.990 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T12:36:00.220 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T12:36:00.247 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T12:36:00.286 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T12:36:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webob. 2024-04-26T12:36:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T12:36:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T12:36:00.633 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T12:36:00.660 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T12:36:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T12:36:00.690 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T12:36:00.699 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T12:36:00.733 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T12:36:01.002 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-idna. 2024-04-26T12:36:01.029 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T12:36:01.041 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T12:36:01.060 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T12:36:01.067 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T12:36:01.107 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T12:36:01.369 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-paste. 2024-04-26T12:36:01.371 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T12:36:01.395 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T12:36:01.398 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T12:36:01.427 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T12:36:01.438 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T12:36:01.722 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T12:36:01.737 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T12:36:01.766 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests. 2024-04-26T12:36:01.780 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T12:36:01.793 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T12:36:01.833 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T12:36:02.042 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T12:36:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T12:36:02.100 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T12:36:02.144 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T12:36:02.171 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T12:36:02.211 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T12:36:02.411 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T12:36:02.438 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T12:36:02.478 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T12:36:02.497 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T12:36:02.524 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:02.564 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:02.790 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T12:36:02.816 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T12:36:02.856 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T12:36:03.119 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T12:36:03.146 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:03.185 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:03.222 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T12:36:03.248 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T12:36:03.288 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T12:36:03.472 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T12:36:03.498 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T12:36:03.538 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T12:36:03.558 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-idna. 2024-04-26T12:36:03.573 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T12:36:03.607 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T12:36:03.842 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T12:36:03.868 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T12:36:03.907 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T12:36:03.919 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T12:36:03.945 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T12:36:04.002 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T12:36:04.252 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T12:36:04.279 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:04.314 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests. 2024-04-26T12:36:04.318 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:04.341 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T12:36:04.381 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T12:36:04.680 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T12:36:04.707 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:04.724 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T12:36:04.738 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:04.750 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T12:36:04.900 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T12:36:05.220 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T12:36:05.235 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:05.279 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:05.334 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T12:36:05.360 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:05.400 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:05.634 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T12:36:05.660 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:05.692 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:05.978 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T12:36:06.004 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T12:36:06.045 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T12:36:06.365 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T12:36:06.391 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T12:36:06.431 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T12:36:06.537 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2024-04-26T12:36:06.564 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-ceph_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:06.603 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:06.776 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T12:36:06.802 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:06.842 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:06.864 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T12:36:06.880 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:06.914 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:07.251 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T12:36:07.263 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T12:36:07.278 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:07.289 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:07.317 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:07.329 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mon (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:07.729 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephadm. 2024-04-26T12:36:07.756 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-cephadm_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:07.795 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:07.933 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T12:36:07.960 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:07.999 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-osd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:08.256 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T12:36:08.283 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T12:36:08.322 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T12:36:08.659 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T12:36:08.686 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T12:36:08.725 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T12:36:09.061 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph. 2024-04-26T12:36:09.076 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../066-ceph_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:09.111 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:09.398 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T12:36:09.424 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:09.464 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:09.747 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-babel. 2024-04-26T12:36:09.774 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T12:36:09.813 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T12:36:09.826 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T12:36:09.852 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:09.892 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mds (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:10.124 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T12:36:10.140 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T12:36:10.174 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T12:36:10.329 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephadm. 2024-04-26T12:36:10.355 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../069-cephadm_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:10.395 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:10.544 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T12:36:10.571 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:10.613 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:10.656 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T12:36:10.683 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T12:36:10.715 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T12:36:10.939 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T12:36:10.966 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T12:36:11.006 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T12:36:11.026 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T12:36:11.041 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T12:36:11.075 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T12:36:11.267 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-routes. 2024-04-26T12:36:11.282 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T12:36:11.316 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T12:36:11.603 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T12:36:11.631 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:11.661 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:12.106 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-babel. 2024-04-26T12:36:12.134 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T12:36:12.173 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T12:36:12.493 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T12:36:12.519 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T12:36:12.559 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T12:36:12.875 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T12:36:12.891 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T12:36:12.912 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T12:36:12.933 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T12:36:12.939 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:12.979 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:13.341 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T12:36:13.368 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T12:36:13.407 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T12:36:13.437 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T12:36:13.464 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T12:36:13.503 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T12:36:13.685 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-routes. 2024-04-26T12:36:13.712 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T12:36:13.752 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T12:36:13.815 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T12:36:13.842 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T12:36:13.881 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T12:36:14.114 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T12:36:14.141 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:14.180 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:14.218 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T12:36:14.245 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T12:36:14.284 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T12:36:14.976 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T12:36:15.004 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:15.128 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:15.360 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T12:36:15.373 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T12:36:15.410 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T12:36:15.923 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T12:36:15.939 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T12:36:15.981 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T12:36:16.040 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T12:36:16.067 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T12:36:16.106 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T12:36:16.360 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T12:36:16.376 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T12:36:16.409 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T12:36:16.417 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T12:36:16.437 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T12:36:16.542 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T12:36:16.862 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T12:36:16.889 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T12:36:16.904 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T12:36:16.920 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T12:36:16.932 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T12:36:16.971 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T12:36:17.282 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T12:36:17.310 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T12:36:17.348 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T12:36:17.597 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T12:36:17.624 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:17.669 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T12:36:17.696 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T12:36:17.735 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T12:36:17.782 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:18.080 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T12:36:18.108 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T12:36:18.147 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T12:36:18.625 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T12:36:18.652 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T12:36:18.683 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T12:36:18.736 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T12:36:18.763 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T12:36:18.802 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T12:36:18.953 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T12:36:18.981 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T12:36:19.028 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T12:36:19.089 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T12:36:19.116 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T12:36:19.155 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T12:36:19.484 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T12:36:19.511 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T12:36:19.550 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T12:36:19.708 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T12:36:19.725 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:19.758 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:19.862 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T12:36:19.889 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T12:36:19.928 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T12:36:20.045 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T12:36:20.072 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T12:36:20.111 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T12:36:20.191 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T12:36:20.218 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T12:36:20.257 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T12:36:20.456 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T12:36:20.484 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T12:36:20.522 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T12:36:20.552 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T12:36:20.580 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T12:36:20.619 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T12:36:20.767 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2024-04-26T12:36:20.794 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T12:36:20.833 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T12:36:20.930 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T12:36:20.958 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T12:36:20.997 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T12:36:21.054 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2024-04-26T12:36:21.069 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T12:36:21.102 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T12:36:21.309 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T12:36:21.336 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T12:36:21.375 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T12:36:21.380 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T12:36:21.397 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T12:36:21.439 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T12:36:21.824 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2024-04-26T12:36:21.851 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:21.884 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:22.031 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T12:36:22.048 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:22.089 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:22.368 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T12:36:22.395 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T12:36:22.425 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T12:36:22.779 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T12:36:22.807 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T12:36:22.845 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T12:36:23.115 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package jq. 2024-04-26T12:36:23.143 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T12:36:23.181 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T12:36:23.417 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package socat. 2024-04-26T12:36:23.434 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T12:36:23.467 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T12:36:23.746 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T12:36:23.762 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T12:36:23.796 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T12:36:24.126 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-test. 2024-04-26T12:36:24.153 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:24.192 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-test (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:24.256 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T12:36:24.283 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:24.322 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-volume (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:24.618 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T12:36:24.645 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:24.684 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:25.020 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T12:36:25.048 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T12:36:25.087 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T12:36:25.425 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T12:36:25.453 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T12:36:25.491 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T12:36:25.853 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T12:36:25.881 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T12:36:25.928 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T12:36:26.342 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pkg-config. 2024-04-26T12:36:26.370 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T12:36:26.408 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T12:36:26.580 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T12:36:26.608 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2451-g7fad7ff2-1jammy_all.deb ... 2024-04-26T12:36:26.647 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-volume (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:26.661 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T12:36:26.678 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T12:36:26.719 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T12:36:26.917 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T12:36:26.933 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:26.967 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs-dev (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:27.206 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T12:36:27.234 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T12:36:27.272 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T12:36:27.295 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T12:36:27.323 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T12:36:27.361 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T12:36:27.525 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T12:36:27.553 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T12:36:27.583 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T12:36:27.683 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T12:36:27.711 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T12:36:27.750 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T12:36:27.878 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T12:36:27.906 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T12:36:27.945 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T12:36:28.063 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T12:36:28.090 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T12:36:28.120 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T12:36:28.265 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T12:36:28.293 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T12:36:28.331 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T12:36:28.493 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pkg-config. 2024-04-26T12:36:28.521 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T12:36:28.559 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T12:36:28.684 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-py. 2024-04-26T12:36:28.712 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T12:36:28.750 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T12:36:28.812 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T12:36:28.828 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T12:36:28.870 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T12:36:29.071 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T12:36:29.099 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T12:36:29.137 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T12:36:29.307 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T12:36:29.335 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T12:36:29.374 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T12:36:29.608 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T12:36:29.636 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T12:36:29.674 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T12:36:29.676 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T12:36:29.705 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T12:36:29.743 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T12:36:29.994 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-toml. 2024-04-26T12:36:30.025 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T12:36:30.030 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T12:36:30.058 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T12:36:30.069 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T12:36:30.088 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T12:36:30.380 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T12:36:30.409 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T12:36:30.409 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T12:36:30.435 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T12:36:30.446 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T12:36:30.474 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T12:36:30.800 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T12:36:30.820 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-py. 2024-04-26T12:36:30.828 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T12:36:30.847 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T12:36:30.866 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T12:36:30.886 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T12:36:31.136 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T12:36:31.161 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T12:36:31.202 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T12:36:31.215 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T12:36:31.243 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T12:36:31.281 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T12:36:31.735 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T12:36:31.763 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T12:36:31.802 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T12:36:31.965 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2024-04-26T12:36:31.993 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../116-radosgw_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:32.031 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:32.113 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-toml. 2024-04-26T12:36:32.140 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T12:36:32.179 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T12:36:32.441 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T12:36:32.469 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T12:36:32.499 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T12:36:32.844 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T12:36:32.872 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T12:36:32.884 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T12:36:32.901 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:32.911 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T12:36:32.942 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:33.205 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T12:36:33.221 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T12:36:33.239 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T12:36:33.272 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T12:36:33.522 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T12:36:33.648 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T12:36:33.923 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T12:36:34.043 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package radosgw. 2024-04-26T12:36:34.071 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../116-radosgw_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:34.109 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking radosgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:34.246 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T12:36:34.683 INFO:teuthology.orchestra.run.smithi016.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T12:36:34.758 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:34.870 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T12:36:34.886 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2451-g7fad7ff2-1jammy_amd64.deb ... 2024-04-26T12:36:34.920 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking rbd-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:35.197 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T12:36:35.284 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user cephadm....done 2024-04-26T12:36:35.440 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T12:36:35.459 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T12:36:35.585 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T12:36:35.716 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T12:36:35.856 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T12:36:35.950 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T12:36:36.052 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T12:36:36.175 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T12:36:36.294 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T12:36:36.556 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T12:36:36.595 INFO:teuthology.orchestra.run.smithi131.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T12:36:36.682 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T12:36:36.696 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:37.000 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T12:36:37.369 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T12:36:37.487 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user cephadm....done 2024-04-26T12:36:37.636 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T12:36:37.645 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T12:36:37.921 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T12:36:37.938 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T12:36:38.164 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T12:36:38.190 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T12:36:38.290 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T12:36:38.458 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T12:36:38.541 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T12:36:38.725 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T12:36:38.801 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T12:36:38.927 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T12:36:39.072 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-argparse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:39.212 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T12:36:39.573 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T12:36:39.652 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T12:36:39.787 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T12:36:39.824 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T12:36:39.913 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T12:36:40.039 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T12:36:40.092 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T12:36:40.298 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T12:36:40.326 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T12:36:40.594 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T12:36:40.672 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T12:36:40.704 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T12:36:40.760 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T12:36:40.854 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T12:36:40.861 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T12:36:41.097 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-argparse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:41.220 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T12:36:41.340 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T12:36:41.346 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T12:36:41.466 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T12:36:41.592 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T12:36:41.614 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T12:36:41.718 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T12:36:41.890 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T12:36:41.977 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T12:36:42.184 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T12:36:42.310 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T12:36:42.340 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T12:36:42.385 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T12:36:42.439 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T12:36:42.540 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T12:36:42.900 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T12:36:42.995 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T12:36:43.043 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T12:36:43.246 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T12:36:43.319 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T12:36:43.372 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T12:36:43.498 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T12:36:43.571 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T12:36:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T12:36:43.863 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T12:36:43.991 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T12:36:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T12:36:44.426 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T12:36:44.643 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T12:36:44.803 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T12:36:44.927 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T12:36:45.053 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T12:36:45.163 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T12:36:45.179 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T12:36:45.480 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T12:36:45.515 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T12:36:45.774 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T12:36:45.865 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T12:36:45.883 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:46.099 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T12:36:46.193 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T12:36:46.476 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T12:36:46.519 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T12:36:46.769 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T12:36:47.103 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T12:36:47.354 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T12:36:47.455 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:47.750 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T12:36:47.756 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T12:36:47.976 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:36:48.074 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T12:36:48.094 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T12:36:48.353 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T12:36:48.479 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T12:36:48.605 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T12:36:48.957 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T12:36:49.180 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T12:36:49.225 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T12:36:49.431 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:36:49.467 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:36:49.549 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T12:36:49.568 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T12:36:49.808 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T12:36:49.870 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T12:36:49.934 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T12:36:50.060 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T12:36:50.137 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T12:36:50.378 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T12:36:50.405 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T12:36:50.646 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T12:36:50.681 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T12:36:50.872 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:36:50.941 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T12:36:50.973 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T12:36:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T12:36:51.266 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T12:36:51.318 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T12:36:51.517 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T12:36:51.586 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T12:36:51.704 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T12:36:51.776 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T12:36:51.997 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T12:36:52.027 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T12:36:52.287 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T12:36:52.323 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T12:36:52.537 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T12:36:52.590 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T12:36:52.665 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T12:36:52.717 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T12:36:52.843 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T12:36:52.915 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T12:36:52.931 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T12:36:53.074 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T12:36:53.169 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T12:36:53.295 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T12:36:53.358 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T12:36:53.689 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T12:36:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T12:36:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T12:36:54.367 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T12:36:54.476 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T12:36:54.786 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T12:36:55.129 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T12:36:55.413 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T12:36:55.548 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T12:36:55.840 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T12:36:56.108 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T12:36:56.495 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T12:36:56.897 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T12:36:57.182 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T12:36:57.559 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T12:36:57.668 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:57.769 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:57.913 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T12:36:58.257 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T12:36:58.383 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:58.509 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librados2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:58.793 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:58.903 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-modules-core (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T12:36:59.029 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:59.246 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T12:36:59.247 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libradosstriper1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T12:36:59.730 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librbd1 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:59.857 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rados (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-modules-core (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:36:59.982 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:00.084 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs-dev (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rados (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librgw2 (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T12:37:01.304 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rbd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:01.430 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:01.556 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:01.691 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cephfs (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:01.817 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:02.254 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rbd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:02.335 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2024-04-26T12:37:02.355 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up rbd-fuse (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:02.456 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:02.573 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cephfs (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:02.686 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2024-04-26T12:37:02.708 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-common (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:02.855 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2024-04-26T12:37:02.868 INFO:teuthology.orchestra.run.smithi016.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T12:37:03.009 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T12:37:03.251 INFO:teuthology.orchestra.run.smithi131.stdout:Adding group ceph....done 2024-04-26T12:37:03.329 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T12:37:03.585 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user ceph....done 2024-04-26T12:37:03.753 INFO:teuthology.orchestra.run.smithi131.stdout:Setting system user ceph properties....done 2024-04-26T12:37:03.767 INFO:teuthology.orchestra.run.smithi131.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T12:37:03.793 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:03.904 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T12:37:03.911 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:04.203 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T12:37:04.374 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:37:04.374 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:37:04.650 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-test (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:04.776 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up radosgw (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:04.846 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:05.213 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T12:37:05.239 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:37:05.239 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T12:37:05.690 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:05.694 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-base (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:05.893 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T12:37:05.893 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T12:37:06.038 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T12:37:06.384 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:06.488 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mds (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:06.612 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T12:37:06.612 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T12:37:06.689 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T12:37:06.689 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T12:37:07.102 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:07.139 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:07.353 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T12:37:07.354 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T12:37:07.372 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T12:37:07.372 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T12:37:07.834 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-osd (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:07.837 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:07.988 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:08.152 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:08.223 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T12:37:08.223 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T12:37:08.367 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T12:37:08.367 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T12:37:08.686 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:08.811 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:08.834 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:08.958 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:08.962 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mon (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:09.076 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:09.177 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T12:37:09.178 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T12:37:09.227 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-volume (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:09.579 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T12:37:09.680 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-cephadm (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:09.697 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T12:37:09.815 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:09.833 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T12:37:09.916 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-dashboard (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:10.050 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-volume (19.0.0-2451-g7fad7ff2-1jammy) ... 2024-04-26T12:37:10.419 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T12:37:10.520 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T12:37:10.663 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T12:37:11.326 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T12:37:11.405 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T12:37:11.990 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T12:37:11.996 DEBUG:teuthology.parallel:result is None 2024-04-26T12:37:12.082 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T12:37:12.087 DEBUG:teuthology.parallel:result is None 2024-04-26T12:37:12.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:37:12.233 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2024-04-26T12:37:12.252 INFO:teuthology.orchestra.run.smithi016.stdout:19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:37:12.253 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:37:12.253 INFO:teuthology.task.install:The correct ceph version 19.0.0-2451-g7fad7ff2-1jammy is installed. 2024-04-26T12:37:12.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:37:12.471 DEBUG:teuthology.orchestra.run.smithi131:> dpkg-query -W -f '${Version}' ceph 2024-04-26T12:37:12.489 INFO:teuthology.orchestra.run.smithi131.stdout:19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:37:12.490 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2451-g7fad7ff2-1jammy 2024-04-26T12:37:12.490 INFO:teuthology.task.install:The correct ceph version 19.0.0-2451-g7fad7ff2-1jammy is installed. 2024-04-26T12:37:12.491 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T12:37:12.492 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:12.492 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:37:12.506 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:12.507 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T12:37:12.544 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T12:37:12.544 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:12.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:37:12.564 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:37:12.618 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:12.618 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T12:37:12.632 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T12:37:12.687 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T12:37:12.687 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:12.687 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:37:12.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:37:12.755 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:12.755 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T12:37:12.768 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T12:37:12.823 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T12:37:12.823 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:12.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:37:12.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:37:12.891 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:12.891 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T12:37:12.904 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T12:37:12.960 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T12:37:13.052 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T12:37:13.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-04-26T12:37:13.056 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-04-26T12:37:13.069 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T12:37:13.069 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:37:13.112 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T12:37:13.124 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T12:37:13.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:37:13.168 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T12:37:13.191 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T12:37:13.191 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T12:37:13.191 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701', 'branch': 'wip-cbodley2-testing', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7674701', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cbodley2-testing'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-squid'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley2-testing', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 8596, 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley2-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0', 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAJ1jGfgrrfekmpPC7xKDqTND93TiGkgrCW6m9Ea22RDj/DP8KCa9QKIplpj6CcQpqX/8UEkLDXzZwafNDibz3g=', 'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLX1DRCWaQwlLlObQIqiXtEOFMgIAOgPgYzh2QdwAZF7tQSkstT+6m0mF6WejOhzQASuwZwKj6b5FSM4G3T1B5E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_12:10:35', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T12:37:13.192 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:37:13.224 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T12:37:13.230 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:37:13.272 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T12:37:13.285 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:13.285 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:37:13.331 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:37:13.331 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-04-26T12:37:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:37:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:37:13.384 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-04-26T12:37:13.384 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:37:13.384 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 12:31:53.230015536 +0000 2024-04-26T12:37:13.384 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 12:31:52.966017894 +0000 2024-04-26T12:37:13.384 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 12:31:52.966017894 +0000 2024-04-26T12:37:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-04-26T12:37:13.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:37:13.438 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T12:37:13.438 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T12:37:13.438 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000310436 s, 1.6 MB/s 2024-04-26T12:37:13.439 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:37:13.488 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-04-26T12:37:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:37:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:37:13.535 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-04-26T12:37:13.535 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:37:13.535 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 12:31:53.702011319 +0000 2024-04-26T12:37:13.535 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 12:31:53.446013607 +0000 2024-04-26T12:37:13.535 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 12:31:53.446013607 +0000 2024-04-26T12:37:13.535 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-04-26T12:37:13.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:37:13.590 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T12:37:13.590 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T12:37:13.590 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000292308 s, 1.8 MB/s 2024-04-26T12:37:13.591 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:37:13.640 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-04-26T12:37:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:37:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:37:13.687 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-26T12:37:13.687 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:37:13.687 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 12:31:54.162007210 +0000 2024-04-26T12:37:13.688 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 12:31:53.914009426 +0000 2024-04-26T12:37:13.688 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 12:31:53.914009426 +0000 2024-04-26T12:37:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-04-26T12:37:13.688 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:37:13.741 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T12:37:13.742 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T12:37:13.742 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000302237 s, 1.7 MB/s 2024-04-26T12:37:13.743 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:37:13.792 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-04-26T12:37:13.839 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:37:13.839 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:37:13.839 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-26T12:37:13.839 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:37:13.839 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-26 12:31:54.410004995 +0000 2024-04-26T12:37:13.839 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-26 12:31:54.406005031 +0000 2024-04-26T12:37:13.839 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-26 12:31:54.406005031 +0000 2024-04-26T12:37:13.839 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2024-04-26T12:37:13.840 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:37:13.893 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-26T12:37:13.893 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-26T12:37:13.893 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000247592 s, 2.1 MB/s 2024-04-26T12:37:13.894 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:37:13.946 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:13.946 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:13.946 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T12:37:13.955 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T12:37:13.955 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-04-26T12:37:14.000 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T12:37:14.000 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:37:14.001 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 873 Links: 1 2024-04-26T12:37:14.001 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:37:14.001 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-26 12:31:52.453791029 +0000 2024-04-26T12:37:14.001 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-26 12:31:52.197793316 +0000 2024-04-26T12:37:14.001 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-26 12:31:52.197793316 +0000 2024-04-26T12:37:14.001 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-04-26T12:37:14.001 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T12:37:14.055 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-26T12:37:14.055 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-26T12:37:14.055 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000438552 s, 1.2 MB/s 2024-04-26T12:37:14.056 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T12:37:14.105 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-04-26T12:37:14.160 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T12:37:14.160 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:37:14.160 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-04-26T12:37:14.160 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:37:14.161 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-26 12:31:52.953786564 +0000 2024-04-26T12:37:14.161 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-26 12:31:52.681788993 +0000 2024-04-26T12:37:14.161 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-26 12:31:52.681788993 +0000 2024-04-26T12:37:14.161 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-04-26T12:37:14.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T12:37:14.214 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-26T12:37:14.215 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-26T12:37:14.215 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000418611 s, 1.2 MB/s 2024-04-26T12:37:14.216 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T12:37:14.266 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-04-26T12:37:14.312 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T12:37:14.312 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:37:14.312 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-04-26T12:37:14.312 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:37:14.312 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-26 12:31:53.457782062 +0000 2024-04-26T12:37:14.312 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-26 12:31:53.197784384 +0000 2024-04-26T12:37:14.313 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-26 12:31:53.197784384 +0000 2024-04-26T12:37:14.313 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-04-26T12:37:14.313 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T12:37:14.375 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-26T12:37:14.375 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-26T12:37:14.375 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000433883 s, 1.2 MB/s 2024-04-26T12:37:14.377 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T12:37:14.425 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-04-26T12:37:14.472 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T12:37:14.472 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T12:37:14.472 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-04-26T12:37:14.472 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T12:37:14.472 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-26 12:31:53.917777952 +0000 2024-04-26T12:37:14.472 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-26 12:31:53.673780132 +0000 2024-04-26T12:37:14.472 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-26 12:31:53.673780132 +0000 2024-04-26T12:37:14.473 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-04-26T12:37:14.473 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T12:37:14.527 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-26T12:37:14.527 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-26T12:37:14.527 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000287195 s, 1.8 MB/s 2024-04-26T12:37:14.528 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T12:37:14.578 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:14.578 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T12:37:14.578 INFO:tasks.ceph:Generating config... 2024-04-26T12:37:14.579 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-04-26T12:37:14.579 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T12:37:14.579 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T12:37:14.580 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T12:37:14.580 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T12:37:14.580 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T12:37:14.580 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T12:37:14.581 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T12:37:14.581 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T12:37:14.581 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T12:37:14.581 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T12:37:14.581 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T12:37:14.581 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T12:37:14.581 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-26T12:37:14.582 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T12:37:14.582 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T12:37:14.616 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T12:37:14.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T12:37:14.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:37:14.758 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.c', '[v2:172.21.15.16:3301,v1:172.21.15.16:6790]'), ('mon.b', '172.21.15.131')] 2024-04-26T12:37:14.759 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.131'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-26T12:37:14.759 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:14.760 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:37:14.807 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --addv c '[v2:172.21.15.16:3301,v1:172.21.15.16:6790]' --add b 172.21.15.131 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:14.894 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid 4374a7a0-1dca-4b47-945f-16be0ea888cb 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 4374a7a0-1dca-4b47-945f-16be0ea888cb 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-04-26T12:37:14.895189+0000 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-04-26T12:37:14.895189+0000 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2024-04-26T12:37:14.895 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T12:37:14.897 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T12:37:14.901 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4374a7a0-1dca-4b47-945f-16be0ea888cb... 2024-04-26T12:37:14.902 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:37:14.945 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T12:37:14.969 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-04-26T12:37:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-04-26T12:37:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-04-26T12:37:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.131" 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 4374a7a0-1dca-4b47-945f-16be0ea888cb 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-04-26T12:37:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-04-26T12:37:14.974 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-04-26T12:37:14.974 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-04-26T12:37:14.974 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.974 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-04-26T12:37:14.974 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-04-26T12:37:14.974 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.974 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:37:14.974 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.977 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-04-26T12:37:14.978 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.978 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-04-26T12:37:14.978 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.978 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:37:14.978 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-04-26T12:37:14.978 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.978 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-04-26T12:37:14.978 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:37:14.979 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: osd max markdown count = 1000 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: osd shutdown pgref assert = True 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-04-26T12:37:14.980 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-04-26T12:37:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:37:14.982 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:37:14.983 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:37:14.984 INFO:teuthology.orchestra.run.smithi016.stdout: rgw relaxed s3 bucket names = True 2024-04-26T12:37:14.984 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-04-26T12:37:14.984 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2024-04-26T12:37:14.984 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2024-04-26T12:37:14.986 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-04-26T12:37:14.986 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-04-26T12:37:14.986 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T12:37:14.986 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-04-26T12:37:14.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.986 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-04-26T12:37:14.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.986 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T12:37:14.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T12:37:14.988 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.131" 2024-04-26T12:37:14.989 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 4374a7a0-1dca-4b47-945f-16be0ea888cb 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.990 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.991 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: bdev async discard = True 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: bdev enable discard = True 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore allocator = bitmap 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 1/20 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 1/20 2024-04-26T12:37:14.992 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 4/10 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: osd blocked scrub grace period = 3600 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: osd max markdown count = 1000 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: osd shutdown pgref assert = True 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.993 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-26T12:37:14.994 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T12:37:14.995 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-26T12:37:14.996 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-04-26T12:37:14.997 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-04-26T12:37:14.997 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2024-04-26T12:37:14.997 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-04-26T12:37:14.997 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T12:37:14.997 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T12:37:14.997 INFO:teuthology.orchestra.run.smithi131.stdout: rgw relaxed s3 bucket names = True 2024-04-26T12:37:14.997 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-04-26T12:37:14.997 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2024-04-26T12:37:14.997 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2024-04-26T12:37:14.997 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T12:37:14.998 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T12:37:15.078 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T12:37:15.078 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:15.078 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T12:37:15.084 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:15.084 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T12:37:15.131 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:37:15.132 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:15.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:37:15.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:37:15.233 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:15.233 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:15.279 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:37:15.279 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:15.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T12:37:15.280 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T12:37:15.303 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:15.303 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:15.349 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T12:37:15.349 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T12:37:15.349 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:37:15.394 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T12:37:15.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:37:15.438 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T12:37:15.449 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T12:37:15.449 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T12:37:15.450 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T12:37:15.487 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T12:37:15.499 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T12:37:15.534 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T12:37:15.545 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T12:37:15.545 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T12:37:15.545 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T12:37:15.560 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:15.561 INFO:tasks.ceph:role: osd.0 2024-04-26T12:37:15.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:37:15.561 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:37:15.615 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:37:15.615 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:37:15.616 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:37:15.616 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:37:15.616 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:37:15.616 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:37:15.616 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:37:15.616 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:37:15.616 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:37:15.616 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:37:15.640 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T12:37:15.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T12:37:15.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T12:37:15.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T12:37:15.756 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:37:15.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:37:15.757 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T12:37:15.809 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:15.810 INFO:tasks.ceph:role: osd.1 2024-04-26T12:37:15.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:37:15.810 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T12:37:15.862 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:37:15.862 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:37:15.862 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:37:15.863 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:37:15.863 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:37:15.863 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:37:15.863 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:37:15.863 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:37:15.863 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:37:15.863 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:37:15.888 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T12:37:15.889 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T12:37:15.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T12:37:15.951 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T12:37:16.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:37:16.006 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:37:16.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T12:37:16.061 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:16.062 INFO:tasks.ceph:role: osd.2 2024-04-26T12:37:16.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:37:16.062 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T12:37:16.119 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:37:16.119 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:37:16.119 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:37:16.119 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:37:16.119 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:37:16.119 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:37:16.119 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:37:16.119 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:37:16.120 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:37:16.120 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:37:16.143 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T12:37:16.145 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T12:37:16.145 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T12:37:16.201 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T12:37:16.251 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:37:16.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:37:16.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T12:37:16.305 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:16.305 INFO:tasks.ceph:role: osd.3 2024-04-26T12:37:16.305 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:37:16.306 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T12:37:16.361 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:37:16.361 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:37:16.361 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:37:16.361 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:37:16.361 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:37:16.362 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:37:16.362 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:37:16.362 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:37:16.362 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:37:16.362 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:37:16.389 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-26T12:37:16.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-26T12:37:16.391 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T12:37:16.452 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T12:37:16.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:37:16.508 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:37:16.508 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:16.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:16.603+0000 7f1d5daea7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T12:37:16.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:16.603+0000 7f1d5daea7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T12:37:16.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:16.603+0000 7f1d5daea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:37:16.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:16.603+0000 7f1d5daea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:37:16.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:16.603+0000 7f1d5daea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T12:37:16.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:16.603+0000 7f1d5daea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T12:37:19.590 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T12:37:19.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:19.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:19.679+0000 7fa59e5a17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T12:37:19.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:19.679+0000 7fa59e5a17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T12:37:19.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:19.679+0000 7fa59e5a17c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:37:19.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:19.679+0000 7fa59e5a17c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:37:19.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:19.679+0000 7fa59e5a17c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T12:37:19.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:19.683+0000 7fa59e5a17c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T12:37:22.671 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T12:37:22.727 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:22.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:22.807+0000 7f7d1c9217c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T12:37:22.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:22.807+0000 7f7d1c9217c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T12:37:22.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:22.807+0000 7f7d1c9217c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:37:22.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:22.807+0000 7f7d1c9217c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:37:22.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:22.807+0000 7f7d1c9217c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T12:37:22.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:22.807+0000 7f7d1c9217c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T12:37:25.762 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T12:37:25.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:25.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:25.899+0000 7f71bcebd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T12:37:25.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:25.899+0000 7f71bcebd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T12:37:25.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:25.899+0000 7f71bcebd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T12:37:25.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:25.899+0000 7f71bcebd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T12:37:25.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:25.899+0000 7f71bcebd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T12:37:25.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-26T12:37:25.899+0000 7f71bcebd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T12:37:28.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T12:37:28.964 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T12:37:28.978 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:28.978 INFO:tasks.ceph:role: osd.4 2024-04-26T12:37:28.978 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:37:28.979 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:37:29.040 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:37:29.492 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-26T12:37:29.494 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-26T12:37:29.494 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T12:37:29.593 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T12:37:29.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:37:29.604 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:37:29.605 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T12:37:29.659 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:29.659 INFO:tasks.ceph:role: osd.5 2024-04-26T12:37:29.659 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:37:29.659 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T12:37:29.719 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:37:29.719 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:37:29.719 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:37:29.719 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:37:29.719 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:37:29.720 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:37:29.720 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:37:29.720 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:37:29.720 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:37:29.720 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:37:30.194 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-26T12:37:30.196 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-26T12:37:30.196 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T12:37:30.341 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T12:37:30.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:37:30.353 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:37:30.353 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T12:37:30.408 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:30.408 INFO:tasks.ceph:role: osd.6 2024-04-26T12:37:30.408 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:37:30.408 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T12:37:30.472 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:37:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:37:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:37:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:37:30.473 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:37:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:37:30.473 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:37:30.473 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:37:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:37:30.473 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:37:30.922 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-26T12:37:30.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-26T12:37:30.924 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T12:37:31.056 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T12:37:31.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:37:31.067 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:37:31.068 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T12:37:31.124 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T12:37:31.124 INFO:tasks.ceph:role: osd.7 2024-04-26T12:37:31.124 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:37:31.124 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T12:37:31.187 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T12:37:31.187 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T12:37:31.187 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T12:37:31.187 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T12:37:31.187 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T12:37:31.188 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-26T12:37:31.188 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T12:37:31.188 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T12:37:31.188 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T12:37:31.188 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T12:37:31.611 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-26T12:37:31.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-26T12:37:31.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T12:37:31.698 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T12:37:31.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:37:31.751 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T12:37:31.751 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:31.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:31.873+0000 7f95bbb977c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T12:37:31.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:31.877+0000 7f95bbb977c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T12:37:31.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:31.877+0000 7f95bbb977c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T12:37:31.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:31.877+0000 7f95bbb977c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T12:37:31.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:31.877+0000 7f95bbb977c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T12:37:31.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:31.881+0000 7f95bbb977c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T12:37:34.882 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T12:37:34.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:34.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:34.973+0000 7fe0bc0cd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T12:37:34.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:34.973+0000 7fe0bc0cd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T12:37:34.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:34.973+0000 7fe0bc0cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T12:37:34.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:34.973+0000 7fe0bc0cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T12:37:34.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:34.973+0000 7fe0bc0cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T12:37:34.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:34.973+0000 7fe0bc0cd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T12:37:37.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T12:37:38.033 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:38.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:38.109+0000 7f9edb4a77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T12:37:38.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:38.109+0000 7f9edb4a77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T12:37:38.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:38.109+0000 7f9edb4a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T12:37:38.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:38.109+0000 7f9edb4a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T12:37:38.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:38.109+0000 7f9edb4a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T12:37:38.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:38.113+0000 7f9edb4a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T12:37:41.112 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T12:37:41.168 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:41.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:41.245+0000 7f03dc3c17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T12:37:41.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:41.245+0000 7f03dc3c17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T12:37:41.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:41.245+0000 7f03dc3c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T12:37:41.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:41.245+0000 7f03dc3c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T12:37:41.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:41.245+0000 7f03dc3c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T12:37:41.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-26T12:37:41.245+0000 7f03dc3c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T12:37:44.227 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T12:37:44.285 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T12:37:44.285 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:44.285 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T12:37:44.300 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:44.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T12:37:44.355 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:44.355 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T12:37:44.410 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:44.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T12:37:44.466 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:44.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T12:37:44.522 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:44.522 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T12:37:44.536 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:44.536 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T12:37:44.591 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:44.591 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T12:37:44.647 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:44.647 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T12:37:44.702 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:44.702 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T12:37:44.755 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:44.755 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T12:37:44.761 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:44.761 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T12:37:44.804 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T12:37:44.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T12:37:44.807 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T12:37:44.850 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2024-04-26T12:37:44.850 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQD7nytmIvWGFxAAjQiqErffEnyD+4oED7hirg== 2024-04-26T12:37:44.850 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-04-26T12:37:44.850 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQD8nytmxEBWJBAA6Omp1atEFy93rLgSWbRO9Q== 2024-04-26T12:37:44.850 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQD/nytmpRLnKBAAQE9taSbAWYwQbLvN9isMRQ== 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQACoCtmcI1fMBAAJBysf65jYkBU8GSL+p3+qg== 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAFoCtmcpXUNRAAiFpAL5s966QGbH36/TyRPg== 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQD7nytm6/UqGhAA7sFTwsCFWgMdDYX/FwCmeg== 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQALoCtmRJh2NBAAU5T85c4uWFXTNdtD6CQLBg== 2024-04-26T12:37:44.851 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-04-26T12:37:44.852 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAOoCtmXWBcOhAATxZNQQa4CA3MBMMqct4kuA== 2024-04-26T12:37:44.852 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2024-04-26T12:37:44.852 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQASoCtmQWvlBhAAJ2ZGknEuZyCreG19Ra9mVw== 2024-04-26T12:37:44.852 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2024-04-26T12:37:44.852 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAVoCtmjqz7DhAA0u1wPCiKGTdc8Z9zRezf7A== 2024-04-26T12:37:44.852 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-26T12:37:44.852 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQD7nytmq8ASHRAA/+EmSrkkWJruFGqdJ9xAKg== 2024-04-26T12:37:44.852 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2024-04-26T12:37:44.852 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQD7nytmghfmHxAAExSC5cKwLbgizM74fYPKQA== 2024-04-26T12:37:44.858 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2024-04-26T12:37:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQD7nytmIvWGFxAAjQiqErffEnyD+4oED7hirg== 2024-04-26T12:37:44.858 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2024-04-26T12:37:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQD8nytmxEBWJBAA6Omp1atEFy93rLgSWbRO9Q== 2024-04-26T12:37:44.858 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2024-04-26T12:37:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQD/nytmpRLnKBAAQE9taSbAWYwQbLvN9isMRQ== 2024-04-26T12:37:44.858 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2024-04-26T12:37:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQACoCtmcI1fMBAAJBysf65jYkBU8GSL+p3+qg== 2024-04-26T12:37:44.859 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2024-04-26T12:37:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAFoCtmcpXUNRAAiFpAL5s966QGbH36/TyRPg== 2024-04-26T12:37:44.860 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQD7nytm6/UqGhAA7sFTwsCFWgMdDYX/FwCmeg== 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQALoCtmRJh2NBAAU5T85c4uWFXTNdtD6CQLBg== 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAOoCtmXWBcOhAATxZNQQa4CA3MBMMqct4kuA== 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQASoCtmQWvlBhAAJ2ZGknEuZyCreG19Ra9mVw== 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQAVoCtmjqz7DhAA0u1wPCiKGTdc8Z9zRezf7A== 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-04-26T12:37:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQD7nytmq8ASHRAA/+EmSrkkWJruFGqdJ9xAKg== 2024-04-26T12:37:44.862 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2024-04-26T12:37:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQD7nytmghfmHxAAExSC5cKwLbgizM74fYPKQA== 2024-04-26T12:37:44.866 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:37:44.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:37:44.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:44.955 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.039 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.124 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.202 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.207 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.282 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:37:45.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T12:37:45.362 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.380 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.464 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.526 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.552 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.613 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T12:37:45.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:37:45.696 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:37:45.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:37:45.784 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T12:37:45.856 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T12:37:45.856 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T12:37:45.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:37:45.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T12:37:46.028 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T12:37:46.080 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:37:46.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T12:37:46.185 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T12:37:46.199 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T12:37:46.293 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T12:37:46.304 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:46.306 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T12:37:46.352 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T12:37:46.352 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T12:37:46.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T12:37:46.355 INFO:tasks.ceph.mon.a:Started 2024-04-26T12:37:46.356 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T12:37:46.356 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T12:37:46.358 INFO:tasks.ceph.mon.c:Started 2024-04-26T12:37:46.358 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T12:37:46.359 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T12:37:46.397 INFO:tasks.ceph.mon.b:Started 2024-04-26T12:37:46.397 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T12:37:46.397 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T12:37:46.397 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T12:37:46.400 INFO:tasks.ceph.mgr.y:Started 2024-04-26T12:37:46.400 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T12:37:46.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T12:37:46.402 INFO:tasks.ceph.mgr.x:Started 2024-04-26T12:37:46.403 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T12:37:46.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T12:37:51.864 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-04-26T12:37:51.884 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T12:37:51.884 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T12:37:51.885 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:51.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T12:37:51.897 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:51.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T12:37:51.954 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:51.954 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T12:37:52.010 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:37:52.011 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T12:37:52.022 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:52.015+0000 7f2f077b2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:37:52.034 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:52.035 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T12:37:52.049 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:52.049 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T12:37:52.103 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:52.104 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T12:37:52.160 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-26T12:37:52.160 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T12:37:52.215 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 90a13ba3-26fb-4d53-bc0e-3583fa4cb8db 0 2024-04-26T12:37:52.562 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:52.559+0000 7f2f077b2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:37:52.579 INFO:teuthology.orchestra.run.smithi131.stdout:0 2024-04-26T12:37:52.597 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 60315ae7-75f7-42f0-ab6b-f0fe033f1b55 1 2024-04-26T12:37:52.707 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:52.701+0000 7fa22a515180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T12:37:52.784 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:52.779+0000 7f2f077b2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:37:52.804 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-26T12:37:52.821 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new e28bef44-fbf9-4f45-b0da-c32cf691116c 2 2024-04-26T12:37:53.011 INFO:teuthology.orchestra.run.smithi131.stdout:2 2024-04-26T12:37:53.027 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 70916512-1197-4640-9b97-8347d50bf4ec 3 2024-04-26T12:37:53.182 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:53.177+0000 7fa22a515180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T12:37:53.226 INFO:teuthology.orchestra.run.smithi131.stdout:3 2024-04-26T12:37:53.243 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 15c55012-eac6-4672-b905-d5cc0bf1979c 4 2024-04-26T12:37:53.368 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:53.365+0000 7fa22a515180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T12:37:53.375 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:53.371+0000 7f2f077b2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:37:53.432 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:53.427+0000 7f2f077b2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:37:53.436 INFO:teuthology.orchestra.run.smithi131.stdout:4 2024-04-26T12:37:53.453 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 7d4bbd49-33e4-43b2-a28b-891d83bf482a 5 2024-04-26T12:37:53.489 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:53.483+0000 7f2f077b2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:37:53.570 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:53.563+0000 7f2f077b2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:37:53.625 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:53.619+0000 7f2f077b2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:37:53.667 INFO:teuthology.orchestra.run.smithi131.stdout:5 2024-04-26T12:37:53.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 3f455889-5a74-491d-b799-9703cfeed14a 6 2024-04-26T12:37:53.707 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:53.703+0000 7f2f077b2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:37:53.764 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:53.759+0000 7f2f077b2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:37:53.889 INFO:teuthology.orchestra.run.smithi131.stdout:6 2024-04-26T12:37:53.905 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 22f42260-a14c-4667-95d6-b6392596f262 7 2024-04-26T12:37:53.923 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:53.919+0000 7f2f077b2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:37:53.942 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:53.937+0000 7fa22a515180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T12:37:53.988 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:53.983+0000 7f2f077b2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:37:54.002 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:53.997+0000 7fa22a515180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T12:37:54.059 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:54.053+0000 7fa22a515180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T12:37:54.102 INFO:teuthology.orchestra.run.smithi131.stdout:7 2024-04-26T12:37:54.119 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T12:37:54.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T12:37:54.122 INFO:tasks.ceph.osd.0:Started 2024-04-26T12:37:54.122 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T12:37:54.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T12:37:54.124 INFO:tasks.ceph.osd.1:Started 2024-04-26T12:37:54.124 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T12:37:54.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T12:37:54.127 INFO:tasks.ceph.osd.2:Started 2024-04-26T12:37:54.127 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T12:37:54.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T12:37:54.129 INFO:tasks.ceph.osd.3:Started 2024-04-26T12:37:54.130 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T12:37:54.130 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T12:37:54.138 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:54.133+0000 7fa22a515180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T12:37:54.140 INFO:tasks.ceph.osd.4:Started 2024-04-26T12:37:54.140 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T12:37:54.140 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T12:37:54.142 INFO:tasks.ceph.osd.5:Started 2024-04-26T12:37:54.142 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T12:37:54.142 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T12:37:54.144 INFO:tasks.ceph.osd.6:Started 2024-04-26T12:37:54.144 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T12:37:54.144 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T12:37:54.146 INFO:tasks.ceph.osd.7:Started 2024-04-26T12:37:54.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:37:54.217 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:54.213+0000 7fa22a515180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T12:37:54.295 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:54.293+0000 7fa22a515180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T12:37:54.348 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:54.345+0000 7fa22a515180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T12:37:54.389 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:37:54.389 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"4374a7a0-1dca-4b47-945f-16be0ea888cb","created":"2024-04-26T12:37:51.731809+0000","modified":"2024-04-26T12:37:54.098182+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:37:54.098182+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"90a13ba3-26fb-4d53-bc0e-3583fa4cb8db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"60315ae7-75f7-42f0-ab6b-f0fe033f1b55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e28bef44-fbf9-4f45-b0da-c32cf691116c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70916512-1197-4640-9b97-8347d50bf4ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"15c55012-eac6-4672-b905-d5cc0bf1979c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7d4bbd49-33e4-43b2-a28b-891d83bf482a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3f455889-5a74-491d-b799-9703cfeed14a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22f42260-a14c-4667-95d6-b6392596f262","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:37:54.404 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T12:37:54.404 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T12:37:54.495 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:54.489+0000 7fa22a515180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T12:37:54.556 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:54.553+0000 7fa22a515180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T12:37:54.664 INFO:tasks.ceph.mgr.y.smithi016.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T12:37:54.664 INFO:tasks.ceph.mgr.y.smithi016.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T12:37:54.664 INFO:tasks.ceph.mgr.y.smithi016.stderr: from numpy import show_config as show_numpy_config 2024-04-26T12:37:54.711 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:54.707+0000 7f2f077b2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:37:54.736 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:37:54.731+0000 7ff0b11297c0 -1 Falling back to public interface 2024-04-26T12:37:54.740 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:37:54.737+0000 7f6b7750a7c0 -1 Falling back to public interface 2024-04-26T12:37:54.747 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:37:54.743+0000 7f06d58a47c0 -1 Falling back to public interface 2024-04-26T12:37:54.748 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:37:54.745+0000 7f4c2ebd87c0 -1 Falling back to public interface 2024-04-26T12:37:54.755 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:37:54.753+0000 7f632aa327c0 -1 Falling back to public interface 2024-04-26T12:37:54.762 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:37:54.759+0000 7fe621fdc7c0 -1 Falling back to public interface 2024-04-26T12:37:54.766 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:37:54.763+0000 7fb21cc667c0 -1 Falling back to public interface 2024-04-26T12:37:54.775 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:37:54.773+0000 7f33a64297c0 -1 Falling back to public interface 2024-04-26T12:37:54.863 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:54.859+0000 7f2f077b2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:37:55.037 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:55.031+0000 7f2f077b2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:37:55.106 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:55.099+0000 7f2f077b2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:37:55.182 INFO:tasks.ceph.mgr.x.smithi131.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T12:37:55.182 INFO:tasks.ceph.mgr.x.smithi131.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T12:37:55.182 INFO:tasks.ceph.mgr.x.smithi131.stderr: from numpy import show_config as show_numpy_config 2024-04-26T12:37:55.210 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:37:55.247 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:55.243+0000 7f2f077b2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:37:55.253 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:55.249+0000 7fa22a515180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T12:37:55.403 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-26T12:37:55.403 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"4374a7a0-1dca-4b47-945f-16be0ea888cb","created":"2024-04-26T12:37:51.731809+0000","modified":"2024-04-26T12:37:54.098182+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T12:37:54.098182+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"90a13ba3-26fb-4d53-bc0e-3583fa4cb8db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"60315ae7-75f7-42f0-ab6b-f0fe033f1b55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e28bef44-fbf9-4f45-b0da-c32cf691116c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"70916512-1197-4640-9b97-8347d50bf4ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"15c55012-eac6-4672-b905-d5cc0bf1979c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7d4bbd49-33e4-43b2-a28b-891d83bf482a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3f455889-5a74-491d-b799-9703cfeed14a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22f42260-a14c-4667-95d6-b6392596f262","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:37:55.419 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T12:37:55.437 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:55.433+0000 7fa22a515180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:37:55.605 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:55.601+0000 7fa22a515180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T12:37:55.674 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:55.669+0000 7fa22a515180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T12:37:55.821 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:55.817+0000 7fa22a515180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T12:37:55.926 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:55.919+0000 7f2f077b2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:37:56.005 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:55.999+0000 7f2f077b2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:37:56.195 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:56.191+0000 7f2f077b2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:37:56.273 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:56.267+0000 7f2f077b2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:37:56.451 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:56.445+0000 7fa22a515180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T12:37:56.525 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:56.521+0000 7fa22a515180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T12:37:56.576 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:56.571+0000 7f2f077b2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:37:56.641 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:56.635+0000 7f2f077b2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:37:56.709 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:56.705+0000 7fa22a515180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T12:37:56.787 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:56.785+0000 7fa22a515180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T12:37:57.072 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:57.069+0000 7fa22a515180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T12:37:57.133 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-04-26T12:37:57.129+0000 7fa22a515180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T12:37:57.690 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:57.683+0000 7f2eaebf9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T12:37:57.690 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-26T12:37:57.683+0000 7f2eaebf9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T12:37:58.512 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:37:58.509+0000 7f6b7750a7c0 -1 osd.4 0 log_to_monitors true 2024-04-26T12:37:58.603 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:37:58.601+0000 7f632aa327c0 -1 osd.7 0 log_to_monitors true 2024-04-26T12:37:58.619 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:37:58.615+0000 7fb21cc667c0 -1 osd.2 0 log_to_monitors true 2024-04-26T12:37:58.622 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:37:58.617+0000 7f4c2ebd87c0 -1 osd.5 0 log_to_monitors true 2024-04-26T12:37:58.629 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:37:58.623+0000 7fe621fdc7c0 -1 osd.3 0 log_to_monitors true 2024-04-26T12:37:58.655 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:37:58.651+0000 7ff0b11297c0 -1 osd.1 0 log_to_monitors true 2024-04-26T12:37:58.690 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:37:58.685+0000 7f33a64297c0 -1 osd.6 0 log_to_monitors true 2024-04-26T12:37:58.738 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:37:58.735+0000 7f06d58a47c0 -1 osd.0 0 log_to_monitors true 2024-04-26T12:38:01.336 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:01.331+0000 7fe61d762640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T12:38:01.367 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:01.363+0000 7fe615da9640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:38:01.370 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:01.367+0000 7f06d102a640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T12:38:01.398 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:01.395+0000 7f06c9671640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:38:01.419 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:01.415+0000 7fb2183ec640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T12:38:01.421 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:01.415+0000 7ff0ac8af640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T12:38:01.438 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:01.435+0000 7fb210a33640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:38:01.455 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:01.451+0000 7ff0a4ef6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:38:01.925 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:01.921+0000 7f33a1baf640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T12:38:01.930 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:01.925+0000 7f6b744c6640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T12:38:01.938 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:01.933+0000 7f63261b8640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T12:38:01.960 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:01.957+0000 7f339a1f6640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:38:01.961 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:01.957+0000 7f4c2a35e640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T12:38:01.976 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:01.973+0000 7f6b6b2d7640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:38:01.984 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:01.981+0000 7f631e7ff640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:38:01.988 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:01.985+0000 7f4c229a5640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:38:02.227 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T12:38:02.529 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-26T12:38:02.530 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":13,"fsid":"4374a7a0-1dca-4b47-945f-16be0ea888cb","created":"2024-04-26T12:37:51.731809+0000","modified":"2024-04-26T12:38:02.339304+0000","last_up_change":"2024-04-26T12:38:02.339304+0000","last_in_change":"2024-04-26T12:37:54.098182+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"90a13ba3-26fb-4d53-bc0e-3583fa4cb8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6809","nonce":389368420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6811","nonce":389368420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6815","nonce":389368420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6813","nonce":389368420}]},"public_addr":"172.21.15.16:6809/389368420","cluster_addr":"172.21.15.16:6811/389368420","heartbeat_back_addr":"172.21.15.16:6815/389368420","heartbeat_front_addr":"172.21.15.16:6813/389368420","state":["exists","up"]},{"osd":1,"uuid":"60315ae7-75f7-42f0-ab6b-f0fe033f1b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6801","nonce":1763484355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6803","nonce":1763484355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6807","nonce":1763484355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6805","nonce":1763484355}]},"public_addr":"172.21.15.16:6801/1763484355","cluster_addr":"172.21.15.16:6803/1763484355","heartbeat_back_addr":"172.21.15.16:6807/1763484355","heartbeat_front_addr":"172.21.15.16:6805/1763484355","state":["exists","up"]},{"osd":2,"uuid":"e28bef44-fbf9-4f45-b0da-c32cf691116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6825","nonce":732776315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6827","nonce":732776315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6831","nonce":732776315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6829","nonce":732776315}]},"public_addr":"172.21.15.16:6825/732776315","cluster_addr":"172.21.15.16:6827/732776315","heartbeat_back_addr":"172.21.15.16:6831/732776315","heartbeat_front_addr":"172.21.15.16:6829/732776315","state":["exists","up"]},{"osd":3,"uuid":"70916512-1197-4640-9b97-8347d50bf4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6817","nonce":979309964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6819","nonce":979309964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6823","nonce":979309964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6821","nonce":979309964}]},"public_addr":"172.21.15.16:6817/979309964","cluster_addr":"172.21.15.16:6819/979309964","heartbeat_back_addr":"172.21.15.16:6823/979309964","heartbeat_front_addr":"172.21.15.16:6821/979309964","state":["exists","up"]},{"osd":4,"uuid":"15c55012-eac6-4672-b905-d5cc0bf1979c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6801","nonce":4277454900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6803","nonce":4277454900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6807","nonce":4277454900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6805","nonce":4277454900}]},"public_addr":"172.21.15.131:6801/4277454900","cluster_addr":"172.21.15.131:6803/4277454900","heartbeat_back_addr":"172.21.15.131:6807/4277454900","heartbeat_front_addr":"172.21.15.131:6805/4277454900","state":["exists","up"]},{"osd":5,"uuid":"7d4bbd49-33e4-43b2-a28b-891d83bf482a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6809","nonce":1890605084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6811","nonce":1890605084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6815","nonce":1890605084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6813","nonce":1890605084}]},"public_addr":"172.21.15.131:6809/1890605084","cluster_addr":"172.21.15.131:6811/1890605084","heartbeat_back_addr":"172.21.15.131:6815/1890605084","heartbeat_front_addr":"172.21.15.131:6813/1890605084","state":["exists","up"]},{"osd":6,"uuid":"3f455889-5a74-491d-b799-9703cfeed14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6825","nonce":2862642741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6827","nonce":2862642741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6831","nonce":2862642741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6829","nonce":2862642741}]},"public_addr":"172.21.15.131:6825/2862642741","cluster_addr":"172.21.15.131:6827/2862642741","heartbeat_back_addr":"172.21.15.131:6831/2862642741","heartbeat_front_addr":"172.21.15.131:6829/2862642741","state":["exists","up"]},{"osd":7,"uuid":"22f42260-a14c-4667-95d6-b6392596f262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6817","nonce":2576109125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6819","nonce":2576109125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6823","nonce":2576109125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6821","nonce":2576109125}]},"public_addr":"172.21.15.131:6817/2576109125","cluster_addr":"172.21.15.131:6819/2576109125","heartbeat_back_addr":"172.21.15.131:6823/2576109125","heartbeat_front_addr":"172.21.15.131:6821/2576109125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:38:02.546 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T12:38:02.546 INFO:tasks.ceph:Creating RBD pool 2024-04-26T12:38:02.546 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T12:38:03.365 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'rbd' created 2024-04-26T12:38:03.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T12:38:04.367 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T12:38:04.398 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T12:38:04.398 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T12:38:04.398 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T12:38:04.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T12:38:04.399 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T12:38:04.773 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:38:04.791 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2135663473},{"type":"v1","addr":"172.21.15.16:6833","nonce":2135663473}]},"active_addr":"172.21.15.16:6833/2135663473","active_change":"2024-04-26T12:37:56.665145+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4117,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":4102021267}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":837793386}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.16:0","nonce":31825254}]}]} 2024-04-26T12:38:04.799 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T12:38:04.799 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:38:04.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:38:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:38:05.094 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":15,"fsid":"4374a7a0-1dca-4b47-945f-16be0ea888cb","created":"2024-04-26T12:37:51.731809+0000","modified":"2024-04-26T12:38:04.365057+0000","last_up_change":"2024-04-26T12:38:02.339304+0000","last_in_change":"2024-04-26T12:37:54.098182+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:38:02.737185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:38:02.884644+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90a13ba3-26fb-4d53-bc0e-3583fa4cb8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6809","nonce":389368420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6811","nonce":389368420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6815","nonce":389368420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6813","nonce":389368420}]},"public_addr":"172.21.15.16:6809/389368420","cluster_addr":"172.21.15.16:6811/389368420","heartbeat_back_addr":"172.21.15.16:6815/389368420","heartbeat_front_addr":"172.21.15.16:6813/389368420","state":["exists","up"]},{"osd":1,"uuid":"60315ae7-75f7-42f0-ab6b-f0fe033f1b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6801","nonce":1763484355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6803","nonce":1763484355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6807","nonce":1763484355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6805","nonce":1763484355}]},"public_addr":"172.21.15.16:6801/1763484355","cluster_addr":"172.21.15.16:6803/1763484355","heartbeat_back_addr":"172.21.15.16:6807/1763484355","heartbeat_front_addr":"172.21.15.16:6805/1763484355","state":["exists","up"]},{"osd":2,"uuid":"e28bef44-fbf9-4f45-b0da-c32cf691116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6825","nonce":732776315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6827","nonce":732776315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6831","nonce":732776315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6829","nonce":732776315}]},"public_addr":"172.21.15.16:6825/732776315","cluster_addr":"172.21.15.16:6827/732776315","heartbeat_back_addr":"172.21.15.16:6831/732776315","heartbeat_front_addr":"172.21.15.16:6829/732776315","state":["exists","up"]},{"osd":3,"uuid":"70916512-1197-4640-9b97-8347d50bf4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6817","nonce":979309964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6819","nonce":979309964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6823","nonce":979309964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6821","nonce":979309964}]},"public_addr":"172.21.15.16:6817/979309964","cluster_addr":"172.21.15.16:6819/979309964","heartbeat_back_addr":"172.21.15.16:6823/979309964","heartbeat_front_addr":"172.21.15.16:6821/979309964","state":["exists","up"]},{"osd":4,"uuid":"15c55012-eac6-4672-b905-d5cc0bf1979c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6801","nonce":4277454900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6803","nonce":4277454900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6807","nonce":4277454900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6805","nonce":4277454900}]},"public_addr":"172.21.15.131:6801/4277454900","cluster_addr":"172.21.15.131:6803/4277454900","heartbeat_back_addr":"172.21.15.131:6807/4277454900","heartbeat_front_addr":"172.21.15.131:6805/4277454900","state":["exists","up"]},{"osd":5,"uuid":"7d4bbd49-33e4-43b2-a28b-891d83bf482a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6809","nonce":1890605084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6811","nonce":1890605084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6815","nonce":1890605084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6813","nonce":1890605084}]},"public_addr":"172.21.15.131:6809/1890605084","cluster_addr":"172.21.15.131:6811/1890605084","heartbeat_back_addr":"172.21.15.131:6815/1890605084","heartbeat_front_addr":"172.21.15.131:6813/1890605084","state":["exists","up"]},{"osd":6,"uuid":"3f455889-5a74-491d-b799-9703cfeed14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6825","nonce":2862642741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6827","nonce":2862642741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6831","nonce":2862642741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6829","nonce":2862642741}]},"public_addr":"172.21.15.131:6825/2862642741","cluster_addr":"172.21.15.131:6827/2862642741","heartbeat_back_addr":"172.21.15.131:6831/2862642741","heartbeat_front_addr":"172.21.15.131:6829/2862642741","state":["exists","up"]},{"osd":7,"uuid":"22f42260-a14c-4667-95d6-b6392596f262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6817","nonce":2576109125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6819","nonce":2576109125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6823","nonce":2576109125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6821","nonce":2576109125}]},"public_addr":"172.21.15.131:6817/2576109125","cluster_addr":"172.21.15.131:6819/2576109125","heartbeat_back_addr":"172.21.15.131:6823/2576109125","heartbeat_front_addr":"172.21.15.131:6821/2576109125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.696345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.654165+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.655130+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.669673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.496810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.595760+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.713008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.560060+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:38:05.113 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:38:05.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:38:05.417 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:38:05.417 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":16,"fsid":"4374a7a0-1dca-4b47-945f-16be0ea888cb","created":"2024-04-26T12:37:51.731809+0000","modified":"2024-04-26T12:38:05.375969+0000","last_up_change":"2024-04-26T12:38:02.339304+0000","last_in_change":"2024-04-26T12:37:54.098182+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:38:02.737185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:38:02.884644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90a13ba3-26fb-4d53-bc0e-3583fa4cb8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6809","nonce":389368420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6811","nonce":389368420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6815","nonce":389368420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6813","nonce":389368420}]},"public_addr":"172.21.15.16:6809/389368420","cluster_addr":"172.21.15.16:6811/389368420","heartbeat_back_addr":"172.21.15.16:6815/389368420","heartbeat_front_addr":"172.21.15.16:6813/389368420","state":["exists","up"]},{"osd":1,"uuid":"60315ae7-75f7-42f0-ab6b-f0fe033f1b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6801","nonce":1763484355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6803","nonce":1763484355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6807","nonce":1763484355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6805","nonce":1763484355}]},"public_addr":"172.21.15.16:6801/1763484355","cluster_addr":"172.21.15.16:6803/1763484355","heartbeat_back_addr":"172.21.15.16:6807/1763484355","heartbeat_front_addr":"172.21.15.16:6805/1763484355","state":["exists","up"]},{"osd":2,"uuid":"e28bef44-fbf9-4f45-b0da-c32cf691116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6825","nonce":732776315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6827","nonce":732776315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6831","nonce":732776315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6829","nonce":732776315}]},"public_addr":"172.21.15.16:6825/732776315","cluster_addr":"172.21.15.16:6827/732776315","heartbeat_back_addr":"172.21.15.16:6831/732776315","heartbeat_front_addr":"172.21.15.16:6829/732776315","state":["exists","up"]},{"osd":3,"uuid":"70916512-1197-4640-9b97-8347d50bf4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6817","nonce":979309964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6819","nonce":979309964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6823","nonce":979309964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":979309964},{"type":"v1","addr":"172.21.15.16:6821","nonce":979309964}]},"public_addr":"172.21.15.16:6817/979309964","cluster_addr":"172.21.15.16:6819/979309964","heartbeat_back_addr":"172.21.15.16:6823/979309964","heartbeat_front_addr":"172.21.15.16:6821/979309964","state":["exists","up"]},{"osd":4,"uuid":"15c55012-eac6-4672-b905-d5cc0bf1979c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6801","nonce":4277454900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6803","nonce":4277454900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6807","nonce":4277454900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6805","nonce":4277454900}]},"public_addr":"172.21.15.131:6801/4277454900","cluster_addr":"172.21.15.131:6803/4277454900","heartbeat_back_addr":"172.21.15.131:6807/4277454900","heartbeat_front_addr":"172.21.15.131:6805/4277454900","state":["exists","up"]},{"osd":5,"uuid":"7d4bbd49-33e4-43b2-a28b-891d83bf482a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6809","nonce":1890605084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6811","nonce":1890605084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6815","nonce":1890605084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6813","nonce":1890605084}]},"public_addr":"172.21.15.131:6809/1890605084","cluster_addr":"172.21.15.131:6811/1890605084","heartbeat_back_addr":"172.21.15.131:6815/1890605084","heartbeat_front_addr":"172.21.15.131:6813/1890605084","state":["exists","up"]},{"osd":6,"uuid":"3f455889-5a74-491d-b799-9703cfeed14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6825","nonce":2862642741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6827","nonce":2862642741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6831","nonce":2862642741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6829","nonce":2862642741}]},"public_addr":"172.21.15.131:6825/2862642741","cluster_addr":"172.21.15.131:6827/2862642741","heartbeat_back_addr":"172.21.15.131:6831/2862642741","heartbeat_front_addr":"172.21.15.131:6829/2862642741","state":["exists","up"]},{"osd":7,"uuid":"22f42260-a14c-4667-95d6-b6392596f262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6817","nonce":2576109125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6819","nonce":2576109125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6823","nonce":2576109125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6821","nonce":2576109125}]},"public_addr":"172.21.15.131:6817/2576109125","cluster_addr":"172.21.15.131:6819/2576109125","heartbeat_back_addr":"172.21.15.131:6823/2576109125","heartbeat_front_addr":"172.21.15.131:6821/2576109125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.696345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.654165+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.655130+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.669673+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.496810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.595760+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.713008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.560060+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:38:05.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:38:05.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:38:05.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:38:05.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T12:38:05.438 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T12:38:05.438 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T12:38:05.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T12:38:05.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T12:38:05.690 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T12:38:05.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:38:05.693 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:05.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T12:38:05.710 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:05.710 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:38:05.720 INFO:teuthology.orchestra.run.smithi016.stdout:55834574850 2024-04-26T12:38:05.721 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T12:38:05.747 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T12:38:05.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T12:38:05.749 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:05.749 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:38:05.750 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T12:38:05.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:38:05.759 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T12:38:05.759 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T12:38:06.230 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:06.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-04-26T12:38:06.265 INFO:teuthology.orchestra.run.smithi016.stdout:55834574849 2024-04-26T12:38:06.270 INFO:teuthology.orchestra.run.smithi016.stdout:55834574850 2024-04-26T12:38:06.291 INFO:teuthology.orchestra.run.smithi016.stdout:55834574850 2024-04-26T12:38:06.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.7 2024-04-26T12:38:06.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2024-04-26T12:38:06.311 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:06.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.4 2024-04-26T12:38:06.317 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:06.321 INFO:teuthology.orchestra.run.smithi016.stdout:55834574850 2024-04-26T12:38:06.326 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:06.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-04-26T12:38:06.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-04-26T12:38:06.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2024-04-26T12:38:06.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-04-26T12:38:07.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:38:07.294 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T12:38:07.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:38:07.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T12:38:07.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T12:38:07.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T12:38:07.346 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:38:07.349 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:38:07.786 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T12:38:07.807 INFO:teuthology.orchestra.run.smithi016.stdout:55834574850 2024-04-26T12:38:07.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-04-26T12:38:07.813 DEBUG:teuthology.parallel:result is None 2024-04-26T12:38:07.820 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:07.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.7 2024-04-26T12:38:07.828 DEBUG:teuthology.parallel:result is None 2024-04-26T12:38:07.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2024-04-26T12:38:07.844 DEBUG:teuthology.parallel:result is None 2024-04-26T12:38:07.872 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T12:38:07.874 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:07.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-04-26T12:38:07.893 INFO:teuthology.orchestra.run.smithi016.stdout:55834574851 2024-04-26T12:38:07.893 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T12:38:07.893 DEBUG:teuthology.parallel:result is None 2024-04-26T12:38:07.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.4 2024-04-26T12:38:07.896 DEBUG:teuthology.parallel:result is None 2024-04-26T12:38:07.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2024-04-26T12:38:07.911 DEBUG:teuthology.parallel:result is None 2024-04-26T12:38:07.916 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-04-26T12:38:07.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-04-26T12:38:07.917 DEBUG:teuthology.parallel:result is None 2024-04-26T12:38:07.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2024-04-26T12:38:07.933 DEBUG:teuthology.parallel:result is None 2024-04-26T12:38:07.933 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:38:07.934 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:38:08.252 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:38:08.252 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:38:08.269 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-04-26T12:38:06.673877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235724,"kb_used_data":2292,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738996,"statfs":{"total":773094113280,"available":772852731904,"internally_reserved":0,"allocated":2347008,"data_stored":1520990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.387579+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:38:04.387579+0000","last_peered":"2024-04-26T12:38:04.387579+0000","last_clean":"2024-04-26T12:38:04.387579+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:38:04.387579+0000","last_undegraded":"2024-04-26T12:38:04.387579+0000","last_fullsized":"2024-04-26T12:38:04.387579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:08.326915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.383589+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:38:04.383589+0000","last_peered":"2024-04-26T12:38:04.383589+0000","last_clean":"2024-04-26T12:38:04.383589+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:38:04.383589+0000","last_undegraded":"2024-04-26T12:38:04.383589+0000","last_fullsized":"2024-04-26T12:38:04.383589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:27.848534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.413989+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:38:04.413989+0000","last_peered":"2024-04-26T12:38:04.413989+0000","last_clean":"2024-04-26T12:38:04.413989+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:38:04.413989+0000","last_undegraded":"2024-04-26T12:38:04.413989+0000","last_fullsized":"2024-04-26T12:38:04.413989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.411938+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:38:04.411938+0000","last_peered":"2024-04-26T12:38:04.411938+0000","last_clean":"2024-04-26T12:38:04.411938+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:38:04.411938+0000","last_undegraded":"2024-04-26T12:38:04.411938+0000","last_fullsized":"2024-04-26T12:38:04.411938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.384615+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:38:04.384615+0000","last_peered":"2024-04-26T12:38:04.384615+0000","last_clean":"2024-04-26T12:38:04.384615+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:38:04.384615+0000","last_undegraded":"2024-04-26T12:38:04.384615+0000","last_fullsized":"2024-04-26T12:38:04.384615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:27.848534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:38:05.381238+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:38:05.381238+0000","last_peered":"2024-04-26T12:38:05.381238+0000","last_clean":"2024-04-26T12:38:05.381238+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:38:05.381238+0000","last_undegraded":"2024-04-26T12:38:05.381238+0000","last_fullsized":"2024-04-26T12:38:05.381238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.386959+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:38:04.386959+0000","last_peered":"2024-04-26T12:38:04.386959+0000","last_clean":"2024-04-26T12:38:04.386959+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:38:04.386959+0000","last_undegraded":"2024-04-26T12:38:04.386959+0000","last_fullsized":"2024-04-26T12:38:04.386959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:08.326915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.386961+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:38:04.386961+0000","last_peered":"2024-04-26T12:38:04.386961+0000","last_clean":"2024-04-26T12:38:04.386961+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:38:04.386961+0000","last_undegraded":"2024-04-26T12:38:04.386961+0000","last_fullsized":"2024-04-26T12:38:04.386961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'105","reported_seq":144,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:05.164045+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:38:05.164045+0000","last_peered":"2024-04-26T12:38:05.164045+0000","last_clean":"2024-04-26T12:38:05.164045+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:38:05.164045+0000","last_undegraded":"2024-04-26T12:38:05.164045+0000","last_fullsized":"2024-04-26T12:38:05.164045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":737280,"data_stored":632135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":737280,"data_stored":632135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:38:08.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:38:08.561 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:38:08.561 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:38:08.577 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-04-26T12:38:06.673877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235724,"kb_used_data":2292,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738996,"statfs":{"total":773094113280,"available":772852731904,"internally_reserved":0,"allocated":2347008,"data_stored":1520990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.387579+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:38:04.387579+0000","last_peered":"2024-04-26T12:38:04.387579+0000","last_clean":"2024-04-26T12:38:04.387579+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:38:04.387579+0000","last_undegraded":"2024-04-26T12:38:04.387579+0000","last_fullsized":"2024-04-26T12:38:04.387579+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:08.326915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.383589+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:38:04.383589+0000","last_peered":"2024-04-26T12:38:04.383589+0000","last_clean":"2024-04-26T12:38:04.383589+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:38:04.383589+0000","last_undegraded":"2024-04-26T12:38:04.383589+0000","last_fullsized":"2024-04-26T12:38:04.383589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:27.848534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.413989+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:38:04.413989+0000","last_peered":"2024-04-26T12:38:04.413989+0000","last_clean":"2024-04-26T12:38:04.413989+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:38:04.413989+0000","last_undegraded":"2024-04-26T12:38:04.413989+0000","last_fullsized":"2024-04-26T12:38:04.413989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.411938+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:38:04.411938+0000","last_peered":"2024-04-26T12:38:04.411938+0000","last_clean":"2024-04-26T12:38:04.411938+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:38:04.411938+0000","last_undegraded":"2024-04-26T12:38:04.411938+0000","last_fullsized":"2024-04-26T12:38:04.411938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.384615+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:38:04.384615+0000","last_peered":"2024-04-26T12:38:04.384615+0000","last_clean":"2024-04-26T12:38:04.384615+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:38:04.384615+0000","last_undegraded":"2024-04-26T12:38:04.384615+0000","last_fullsized":"2024-04-26T12:38:04.384615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:27.848534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-26T12:38:05.381238+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:38:05.381238+0000","last_peered":"2024-04-26T12:38:05.381238+0000","last_clean":"2024-04-26T12:38:05.381238+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:38:05.381238+0000","last_undegraded":"2024-04-26T12:38:05.381238+0000","last_fullsized":"2024-04-26T12:38:05.381238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.386959+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:38:04.386959+0000","last_peered":"2024-04-26T12:38:04.386959+0000","last_clean":"2024-04-26T12:38:04.386959+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:38:04.386959+0000","last_undegraded":"2024-04-26T12:38:04.386959+0000","last_fullsized":"2024-04-26T12:38:04.386959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:08.326915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:04.386961+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:38:04.386961+0000","last_peered":"2024-04-26T12:38:04.386961+0000","last_clean":"2024-04-26T12:38:04.386961+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:38:04.386961+0000","last_undegraded":"2024-04-26T12:38:04.386961+0000","last_fullsized":"2024-04-26T12:38:04.386961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'105","reported_seq":144,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T12:38:05.164045+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:38:05.164045+0000","last_peered":"2024-04-26T12:38:05.164045+0000","last_clean":"2024-04-26T12:38:05.164045+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:38:05.164045+0000","last_undegraded":"2024-04-26T12:38:05.164045+0000","last_fullsized":"2024-04-26T12:38:05.164045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":737280,"data_stored":632135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":155648,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":143360,"data_stored":41767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":737280,"data_stored":632135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:38:08.578 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:38:08.578 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T12:38:08.578 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T12:38:08.579 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T12:38:08.893 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:38:08.893 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T12:38:08.910 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T12:38:08.911 INFO:teuthology.run_tasks:Running task rgw... 2024-04-26T12:38:08.927 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-26T12:38:08.927 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-26T12:38:08.927 INFO:tasks.rgw:Creating data pools 2024-04-26T12:38:08.927 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-26T12:38:08.927 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-04-26T12:38:09.418 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'default.rgw.buckets.data' created 2024-04-26T12:38:09.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-26T12:38:10.419 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-26T12:38:10.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-26T12:38:11.414 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'default.rgw.buckets.index' created 2024-04-26T12:38:11.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-26T12:38:12.433 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-26T12:38:12.479 DEBUG:tasks.rgw:Pools created 2024-04-26T12:38:12.479 INFO:tasks.rgw:Starting rgw... 2024-04-26T12:38:12.479 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-26T12:38:12.479 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-26T12:38:12.479 DEBUG:teuthology.orchestra.run.smithi016:> sudo echo -n http://smithi016.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-26T12:38:12.491 INFO:teuthology.orchestra.run.smithi016.stdout:http://smithi016.front.sepia.ceph.com:80 2024-04-26T12:38:12.492 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-26T12:38:12.547 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-26T12:38:12.548 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-26T12:38:12.591 INFO:tasks.rgw.client.0:Started 2024-04-26T12:38:12.592 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi016.front.sepia.ceph.com:80/ 2024-04-26T12:38:12.592 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-04-26T12:38:12.631 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:38:12.631 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:38:12.631 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:38:12.631 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:38:12.631 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T12:38:13.632 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-04-26T12:38:13.644 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:38:13.644 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:38:13.644 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:38:13.645 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:38:13.645 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T12:38:15.646 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-04-26T12:38:15.659 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:38:15.659 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:38:15.659 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:38:15.659 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T12:38:15.660 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:38:19.661 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-04-26T12:38:19.673 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:38:19.673 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:38:19.673 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-26T12:38:19.673 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-26T12:38:19.674 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-26T12:38:21.658 INFO:tasks.rgw.client.0.smithi016.stdout:2024-04-26T12:38:21.655+0000 7f9467d90a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-26T12:38:27.675 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:80/ 2024-04-26T12:38:27.687 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-26T12:38:27.687 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-04-26T12:38:27.691 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 53597 0 --:--:-- --:--:-- --:--:-- 62333 2024-04-26T12:38:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:anonymous 2024-04-26T12:38:27.692 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T12:38:27.710 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T12:38:27.710 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-cbodley2-testing'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-squid'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley2-testing', 'sha1': '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'}} 2024-04-26T12:38:27.710 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T12:38:27.710 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T12:38:28.069 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T12:38:28.070 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:38:28.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:38:28.412 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:38:28.420 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:38:28.436 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-26T12:38:26.680902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":516,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236716,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738004,"statfs":{"total":773094113280,"available":772851716096,"internally_reserved":0,"allocated":4038656,"data_stored":2332030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.199701"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513744+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:38:21.513744+0000","last_peered":"2024-04-26T12:38:21.513744+0000","last_clean":"2024-04-26T12:38:21.513744+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:38:21.513744+0000","last_undegraded":"2024-04-26T12:38:21.513744+0000","last_fullsized":"2024-04-26T12:38:21.513744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502484+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:38:21.502484+0000","last_peered":"2024-04-26T12:38:21.502484+0000","last_clean":"2024-04-26T12:38:21.502484+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:38:21.502484+0000","last_undegraded":"2024-04-26T12:38:21.502484+0000","last_fullsized":"2024-04-26T12:38:21.502484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497793+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:38:21.497793+0000","last_peered":"2024-04-26T12:38:21.497793+0000","last_clean":"2024-04-26T12:38:21.497793+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:38:21.497793+0000","last_undegraded":"2024-04-26T12:38:21.497793+0000","last_fullsized":"2024-04-26T12:38:21.497793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511771+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:38:21.511771+0000","last_peered":"2024-04-26T12:38:21.511771+0000","last_clean":"2024-04-26T12:38:21.511771+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:38:21.511771+0000","last_undegraded":"2024-04-26T12:38:21.511771+0000","last_fullsized":"2024-04-26T12:38:21.511771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508676+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:38:21.508676+0000","last_peered":"2024-04-26T12:38:21.508676+0000","last_clean":"2024-04-26T12:38:21.508676+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:38:21.508676+0000","last_undegraded":"2024-04-26T12:38:21.508676+0000","last_fullsized":"2024-04-26T12:38:21.508676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494997+0000","last_change":"2024-04-26T12:38:12.451601+0000","last_active":"2024-04-26T12:38:21.494997+0000","last_peered":"2024-04-26T12:38:21.494997+0000","last_clean":"2024-04-26T12:38:21.494997+0000","last_became_active":"2024-04-26T12:38:12.450849+0000","last_became_peered":"2024-04-26T12:38:12.450849+0000","last_unstale":"2024-04-26T12:38:21.494997+0000","last_undegraded":"2024-04-26T12:38:21.494997+0000","last_fullsized":"2024-04-26T12:38:21.494997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503726+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:38:21.503726+0000","last_peered":"2024-04-26T12:38:21.503726+0000","last_clean":"2024-04-26T12:38:21.503726+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:38:21.503726+0000","last_undegraded":"2024-04-26T12:38:21.503726+0000","last_fullsized":"2024-04-26T12:38:21.503726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507580+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:38:21.507580+0000","last_peered":"2024-04-26T12:38:21.507580+0000","last_clean":"2024-04-26T12:38:21.507580+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:38:21.507580+0000","last_undegraded":"2024-04-26T12:38:21.507580+0000","last_fullsized":"2024-04-26T12:38:21.507580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512121+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:38:21.512121+0000","last_peered":"2024-04-26T12:38:21.512121+0000","last_clean":"2024-04-26T12:38:21.512121+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:38:21.512121+0000","last_undegraded":"2024-04-26T12:38:21.512121+0000","last_fullsized":"2024-04-26T12:38:21.512121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.522967+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:38:21.522967+0000","last_peered":"2024-04-26T12:38:21.522967+0000","last_clean":"2024-04-26T12:38:21.522967+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:38:21.522967+0000","last_undegraded":"2024-04-26T12:38:21.522967+0000","last_fullsized":"2024-04-26T12:38:21.522967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502798+0000","last_change":"2024-04-26T12:38:10.458364+0000","last_active":"2024-04-26T12:38:21.502798+0000","last_peered":"2024-04-26T12:38:21.502798+0000","last_clean":"2024-04-26T12:38:21.502798+0000","last_became_active":"2024-04-26T12:38:10.457610+0000","last_became_peered":"2024-04-26T12:38:10.457610+0000","last_unstale":"2024-04-26T12:38:21.502798+0000","last_undegraded":"2024-04-26T12:38:21.502798+0000","last_fullsized":"2024-04-26T12:38:21.502798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496193+0000","last_change":"2024-04-26T12:38:12.451810+0000","last_active":"2024-04-26T12:38:21.496193+0000","last_peered":"2024-04-26T12:38:21.496193+0000","last_clean":"2024-04-26T12:38:21.496193+0000","last_became_active":"2024-04-26T12:38:12.450926+0000","last_became_peered":"2024-04-26T12:38:12.450926+0000","last_unstale":"2024-04-26T12:38:21.496193+0000","last_undegraded":"2024-04-26T12:38:21.496193+0000","last_fullsized":"2024-04-26T12:38:21.496193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512043+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:38:21.512043+0000","last_peered":"2024-04-26T12:38:21.512043+0000","last_clean":"2024-04-26T12:38:21.512043+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:38:21.512043+0000","last_undegraded":"2024-04-26T12:38:21.512043+0000","last_fullsized":"2024-04-26T12:38:21.512043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503886+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:38:21.503886+0000","last_peered":"2024-04-26T12:38:21.503886+0000","last_clean":"2024-04-26T12:38:21.503886+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:38:21.503886+0000","last_undegraded":"2024-04-26T12:38:21.503886+0000","last_fullsized":"2024-04-26T12:38:21.503886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493301+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:38:21.493301+0000","last_peered":"2024-04-26T12:38:21.493301+0000","last_clean":"2024-04-26T12:38:21.493301+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:38:21.493301+0000","last_undegraded":"2024-04-26T12:38:21.493301+0000","last_fullsized":"2024-04-26T12:38:21.493301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.538310+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:38:21.538310+0000","last_peered":"2024-04-26T12:38:21.538310+0000","last_clean":"2024-04-26T12:38:21.538310+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:38:21.538310+0000","last_undegraded":"2024-04-26T12:38:21.538310+0000","last_fullsized":"2024-04-26T12:38:21.538310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494188+0000","last_change":"2024-04-26T12:38:12.452715+0000","last_active":"2024-04-26T12:38:21.494188+0000","last_peered":"2024-04-26T12:38:21.494188+0000","last_clean":"2024-04-26T12:38:21.494188+0000","last_became_active":"2024-04-26T12:38:12.451136+0000","last_became_peered":"2024-04-26T12:38:12.451136+0000","last_unstale":"2024-04-26T12:38:21.494188+0000","last_undegraded":"2024-04-26T12:38:21.494188+0000","last_fullsized":"2024-04-26T12:38:21.494188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513740+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:38:21.513740+0000","last_peered":"2024-04-26T12:38:21.513740+0000","last_clean":"2024-04-26T12:38:21.513740+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:38:21.513740+0000","last_undegraded":"2024-04-26T12:38:21.513740+0000","last_fullsized":"2024-04-26T12:38:21.513740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511947+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:38:21.511947+0000","last_peered":"2024-04-26T12:38:21.511947+0000","last_clean":"2024-04-26T12:38:21.511947+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:38:21.511947+0000","last_undegraded":"2024-04-26T12:38:21.511947+0000","last_fullsized":"2024-04-26T12:38:21.511947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.523979+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:38:21.523979+0000","last_peered":"2024-04-26T12:38:21.523979+0000","last_clean":"2024-04-26T12:38:21.523979+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:38:21.523979+0000","last_undegraded":"2024-04-26T12:38:21.523979+0000","last_fullsized":"2024-04-26T12:38:21.523979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503147+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:38:21.503147+0000","last_peered":"2024-04-26T12:38:21.503147+0000","last_clean":"2024-04-26T12:38:21.503147+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:38:21.503147+0000","last_undegraded":"2024-04-26T12:38:21.503147+0000","last_fullsized":"2024-04-26T12:38:21.503147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524089+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:38:21.524089+0000","last_peered":"2024-04-26T12:38:21.524089+0000","last_clean":"2024-04-26T12:38:21.524089+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:38:21.524089+0000","last_undegraded":"2024-04-26T12:38:21.524089+0000","last_fullsized":"2024-04-26T12:38:21.524089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536949+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:38:21.536949+0000","last_peered":"2024-04-26T12:38:21.536949+0000","last_clean":"2024-04-26T12:38:21.536949+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:38:21.536949+0000","last_undegraded":"2024-04-26T12:38:21.536949+0000","last_fullsized":"2024-04-26T12:38:21.536949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495339+0000","last_change":"2024-04-26T12:38:10.455020+0000","last_active":"2024-04-26T12:38:21.495339+0000","last_peered":"2024-04-26T12:38:21.495339+0000","last_clean":"2024-04-26T12:38:21.495339+0000","last_became_active":"2024-04-26T12:38:10.454255+0000","last_became_peered":"2024-04-26T12:38:10.454255+0000","last_unstale":"2024-04-26T12:38:21.495339+0000","last_undegraded":"2024-04-26T12:38:21.495339+0000","last_fullsized":"2024-04-26T12:38:21.495339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.149264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537779+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:38:21.537779+0000","last_peered":"2024-04-26T12:38:21.537779+0000","last_clean":"2024-04-26T12:38:21.537779+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:38:21.537779+0000","last_undegraded":"2024-04-26T12:38:21.537779+0000","last_fullsized":"2024-04-26T12:38:21.537779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494259+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:38:21.494259+0000","last_peered":"2024-04-26T12:38:21.494259+0000","last_clean":"2024-04-26T12:38:21.494259+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:38:21.494259+0000","last_undegraded":"2024-04-26T12:38:21.494259+0000","last_fullsized":"2024-04-26T12:38:21.494259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496054+0000","last_change":"2024-04-26T12:38:12.448918+0000","last_active":"2024-04-26T12:38:21.496054+0000","last_peered":"2024-04-26T12:38:21.496054+0000","last_clean":"2024-04-26T12:38:21.496054+0000","last_became_active":"2024-04-26T12:38:12.448093+0000","last_became_peered":"2024-04-26T12:38:12.448093+0000","last_unstale":"2024-04-26T12:38:21.496054+0000","last_undegraded":"2024-04-26T12:38:21.496054+0000","last_fullsized":"2024-04-26T12:38:21.496054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507290+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:38:21.507290+0000","last_peered":"2024-04-26T12:38:21.507290+0000","last_clean":"2024-04-26T12:38:21.507290+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:38:21.507290+0000","last_undegraded":"2024-04-26T12:38:21.507290+0000","last_fullsized":"2024-04-26T12:38:21.507290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494006+0000","last_change":"2024-04-26T12:38:20.512422+0000","last_active":"2024-04-26T12:38:21.494006+0000","last_peered":"2024-04-26T12:38:21.494006+0000","last_clean":"2024-04-26T12:38:21.494006+0000","last_became_active":"2024-04-26T12:38:20.512129+0000","last_became_peered":"2024-04-26T12:38:20.512129+0000","last_unstale":"2024-04-26T12:38:21.494006+0000","last_undegraded":"2024-04-26T12:38:21.494006+0000","last_fullsized":"2024-04-26T12:38:21.494006+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495627+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:38:21.495627+0000","last_peered":"2024-04-26T12:38:21.495627+0000","last_clean":"2024-04-26T12:38:21.495627+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:38:21.495627+0000","last_undegraded":"2024-04-26T12:38:21.495627+0000","last_fullsized":"2024-04-26T12:38:21.495627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512370+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:38:21.512370+0000","last_peered":"2024-04-26T12:38:21.512370+0000","last_clean":"2024-04-26T12:38:21.512370+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:38:21.512370+0000","last_undegraded":"2024-04-26T12:38:21.512370+0000","last_fullsized":"2024-04-26T12:38:21.512370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503707+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:38:21.503707+0000","last_peered":"2024-04-26T12:38:21.503707+0000","last_clean":"2024-04-26T12:38:21.503707+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:38:21.503707+0000","last_undegraded":"2024-04-26T12:38:21.503707+0000","last_fullsized":"2024-04-26T12:38:21.503707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.895753+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:38:21.895753+0000","last_peered":"2024-04-26T12:38:21.895753+0000","last_clean":"2024-04-26T12:38:21.895753+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:38:21.895753+0000","last_undegraded":"2024-04-26T12:38:21.895753+0000","last_fullsized":"2024-04-26T12:38:21.895753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513057+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:38:21.513057+0000","last_peered":"2024-04-26T12:38:21.513057+0000","last_clean":"2024-04-26T12:38:21.513057+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:38:21.513057+0000","last_undegraded":"2024-04-26T12:38:21.513057+0000","last_fullsized":"2024-04-26T12:38:21.513057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502369+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:38:21.502369+0000","last_peered":"2024-04-26T12:38:21.502369+0000","last_clean":"2024-04-26T12:38:21.502369+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:38:21.502369+0000","last_undegraded":"2024-04-26T12:38:21.502369+0000","last_fullsized":"2024-04-26T12:38:21.502369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504557+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:38:21.504557+0000","last_peered":"2024-04-26T12:38:21.504557+0000","last_clean":"2024-04-26T12:38:21.504557+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:38:21.504557+0000","last_undegraded":"2024-04-26T12:38:21.504557+0000","last_fullsized":"2024-04-26T12:38:21.504557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507300+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:38:21.507300+0000","last_peered":"2024-04-26T12:38:21.507300+0000","last_clean":"2024-04-26T12:38:21.507300+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:38:21.507300+0000","last_undegraded":"2024-04-26T12:38:21.507300+0000","last_fullsized":"2024-04-26T12:38:21.507300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495219+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:38:21.495219+0000","last_peered":"2024-04-26T12:38:21.495219+0000","last_clean":"2024-04-26T12:38:21.495219+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:38:21.495219+0000","last_undegraded":"2024-04-26T12:38:21.495219+0000","last_fullsized":"2024-04-26T12:38:21.495219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.295172+0000","last_change":"2024-04-26T12:38:16.458863+0000","last_active":"2024-04-26T12:38:22.295172+0000","last_peered":"2024-04-26T12:38:22.295172+0000","last_clean":"2024-04-26T12:38:22.295172+0000","last_became_active":"2024-04-26T12:38:16.458097+0000","last_became_peered":"2024-04-26T12:38:16.458097+0000","last_unstale":"2024-04-26T12:38:22.295172+0000","last_undegraded":"2024-04-26T12:38:22.295172+0000","last_fullsized":"2024-04-26T12:38:22.295172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495852+0000","last_change":"2024-04-26T12:38:18.498229+0000","last_active":"2024-04-26T12:38:21.495852+0000","last_peered":"2024-04-26T12:38:21.495852+0000","last_clean":"2024-04-26T12:38:21.495852+0000","last_became_active":"2024-04-26T12:38:18.497486+0000","last_became_peered":"2024-04-26T12:38:18.497486+0000","last_unstale":"2024-04-26T12:38:21.495852+0000","last_undegraded":"2024-04-26T12:38:21.495852+0000","last_fullsized":"2024-04-26T12:38:21.495852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.506818+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:38:21.506818+0000","last_peered":"2024-04-26T12:38:21.506818+0000","last_clean":"2024-04-26T12:38:21.506818+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:38:21.506818+0000","last_undegraded":"2024-04-26T12:38:21.506818+0000","last_fullsized":"2024-04-26T12:38:21.506818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511965+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:38:21.511965+0000","last_peered":"2024-04-26T12:38:21.511965+0000","last_clean":"2024-04-26T12:38:21.511965+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:38:21.511965+0000","last_undegraded":"2024-04-26T12:38:21.511965+0000","last_fullsized":"2024-04-26T12:38:21.511965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512190+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:38:21.512190+0000","last_peered":"2024-04-26T12:38:21.512190+0000","last_clean":"2024-04-26T12:38:21.512190+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:38:21.512190+0000","last_undegraded":"2024-04-26T12:38:21.512190+0000","last_fullsized":"2024-04-26T12:38:21.512190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.498954+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:38:21.498954+0000","last_peered":"2024-04-26T12:38:21.498954+0000","last_clean":"2024-04-26T12:38:21.498954+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:38:21.498954+0000","last_undegraded":"2024-04-26T12:38:21.498954+0000","last_fullsized":"2024-04-26T12:38:21.498954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.350584+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:38:22.350584+0000","last_peered":"2024-04-26T12:38:22.350584+0000","last_clean":"2024-04-26T12:38:22.350584+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:38:22.350584+0000","last_undegraded":"2024-04-26T12:38:22.350584+0000","last_fullsized":"2024-04-26T12:38:22.350584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511780+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:38:21.511780+0000","last_peered":"2024-04-26T12:38:21.511780+0000","last_clean":"2024-04-26T12:38:21.511780+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:38:21.511780+0000","last_undegraded":"2024-04-26T12:38:21.511780+0000","last_fullsized":"2024-04-26T12:38:21.511780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494842+0000","last_change":"2024-04-26T12:38:20.713393+0000","last_active":"2024-04-26T12:38:21.494842+0000","last_peered":"2024-04-26T12:38:21.494842+0000","last_clean":"2024-04-26T12:38:21.494842+0000","last_became_active":"2024-04-26T12:38:20.712649+0000","last_became_peered":"2024-04-26T12:38:20.712649+0000","last_unstale":"2024-04-26T12:38:21.494842+0000","last_undegraded":"2024-04-26T12:38:21.494842+0000","last_fullsized":"2024-04-26T12:38:21.494842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495199+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:38:21.495199+0000","last_peered":"2024-04-26T12:38:21.495199+0000","last_clean":"2024-04-26T12:38:21.495199+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:38:21.495199+0000","last_undegraded":"2024-04-26T12:38:21.495199+0000","last_fullsized":"2024-04-26T12:38:21.495199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521264+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:38:21.521264+0000","last_peered":"2024-04-26T12:38:21.521264+0000","last_clean":"2024-04-26T12:38:21.521264+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:38:21.521264+0000","last_undegraded":"2024-04-26T12:38:21.521264+0000","last_fullsized":"2024-04-26T12:38:21.521264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503644+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:38:21.503644+0000","last_peered":"2024-04-26T12:38:21.503644+0000","last_clean":"2024-04-26T12:38:21.503644+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:38:21.503644+0000","last_undegraded":"2024-04-26T12:38:21.503644+0000","last_fullsized":"2024-04-26T12:38:21.503644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.358883+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:38:22.358883+0000","last_peered":"2024-04-26T12:38:22.358883+0000","last_clean":"2024-04-26T12:38:22.358883+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:38:22.358883+0000","last_undegraded":"2024-04-26T12:38:22.358883+0000","last_fullsized":"2024-04-26T12:38:22.358883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494346+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:38:21.494346+0000","last_peered":"2024-04-26T12:38:21.494346+0000","last_clean":"2024-04-26T12:38:21.494346+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:38:21.494346+0000","last_undegraded":"2024-04-26T12:38:21.494346+0000","last_fullsized":"2024-04-26T12:38:21.494346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503488+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:38:21.503488+0000","last_peered":"2024-04-26T12:38:21.503488+0000","last_clean":"2024-04-26T12:38:21.503488+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:38:21.503488+0000","last_undegraded":"2024-04-26T12:38:21.503488+0000","last_fullsized":"2024-04-26T12:38:21.503488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513985+0000","last_change":"2024-04-26T12:38:10.472878+0000","last_active":"2024-04-26T12:38:21.513985+0000","last_peered":"2024-04-26T12:38:21.513985+0000","last_clean":"2024-04-26T12:38:21.513985+0000","last_became_active":"2024-04-26T12:38:10.471901+0000","last_became_peered":"2024-04-26T12:38:10.471901+0000","last_unstale":"2024-04-26T12:38:21.513985+0000","last_undegraded":"2024-04-26T12:38:21.513985+0000","last_fullsized":"2024-04-26T12:38:21.513985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511030+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:38:21.511030+0000","last_peered":"2024-04-26T12:38:21.511030+0000","last_clean":"2024-04-26T12:38:21.511030+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:38:21.511030+0000","last_undegraded":"2024-04-26T12:38:21.511030+0000","last_fullsized":"2024-04-26T12:38:21.511030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"29'19","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.457877+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:38:22.457877+0000","last_peered":"2024-04-26T12:38:22.457877+0000","last_clean":"2024-04-26T12:38:22.457877+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:38:22.457877+0000","last_undegraded":"2024-04-26T12:38:22.457877+0000","last_fullsized":"2024-04-26T12:38:22.457877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492862+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:38:21.492862+0000","last_peered":"2024-04-26T12:38:21.492862+0000","last_clean":"2024-04-26T12:38:21.492862+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:38:21.492862+0000","last_undegraded":"2024-04-26T12:38:21.492862+0000","last_fullsized":"2024-04-26T12:38:21.492862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503222+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:38:21.503222+0000","last_peered":"2024-04-26T12:38:21.503222+0000","last_clean":"2024-04-26T12:38:21.503222+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:38:21.503222+0000","last_undegraded":"2024-04-26T12:38:21.503222+0000","last_fullsized":"2024-04-26T12:38:21.503222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494295+0000","last_change":"2024-04-26T12:38:12.451622+0000","last_active":"2024-04-26T12:38:21.494295+0000","last_peered":"2024-04-26T12:38:21.494295+0000","last_clean":"2024-04-26T12:38:21.494295+0000","last_became_active":"2024-04-26T12:38:12.449737+0000","last_became_peered":"2024-04-26T12:38:12.449737+0000","last_unstale":"2024-04-26T12:38:21.494295+0000","last_undegraded":"2024-04-26T12:38:21.494295+0000","last_fullsized":"2024-04-26T12:38:21.494295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513305+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:38:21.513305+0000","last_peered":"2024-04-26T12:38:21.513305+0000","last_clean":"2024-04-26T12:38:21.513305+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:38:21.513305+0000","last_undegraded":"2024-04-26T12:38:21.513305+0000","last_fullsized":"2024-04-26T12:38:21.513305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536524+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:38:21.536524+0000","last_peered":"2024-04-26T12:38:21.536524+0000","last_clean":"2024-04-26T12:38:21.536524+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:38:21.536524+0000","last_undegraded":"2024-04-26T12:38:21.536524+0000","last_fullsized":"2024-04-26T12:38:21.536524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.329717+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:38:22.329717+0000","last_peered":"2024-04-26T12:38:22.329717+0000","last_clean":"2024-04-26T12:38:22.329717+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:38:22.329717+0000","last_undegraded":"2024-04-26T12:38:22.329717+0000","last_fullsized":"2024-04-26T12:38:22.329717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492897+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:38:21.492897+0000","last_peered":"2024-04-26T12:38:21.492897+0000","last_clean":"2024-04-26T12:38:21.492897+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:38:21.492897+0000","last_undegraded":"2024-04-26T12:38:21.492897+0000","last_fullsized":"2024-04-26T12:38:21.492897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.522768+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:38:21.522768+0000","last_peered":"2024-04-26T12:38:21.522768+0000","last_clean":"2024-04-26T12:38:21.522768+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:38:21.522768+0000","last_undegraded":"2024-04-26T12:38:21.522768+0000","last_fullsized":"2024-04-26T12:38:21.522768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521974+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:38:21.521974+0000","last_peered":"2024-04-26T12:38:21.521974+0000","last_clean":"2024-04-26T12:38:21.521974+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:38:21.521974+0000","last_undegraded":"2024-04-26T12:38:21.521974+0000","last_fullsized":"2024-04-26T12:38:21.521974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513197+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:38:21.513197+0000","last_peered":"2024-04-26T12:38:21.513197+0000","last_clean":"2024-04-26T12:38:21.513197+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:38:21.513197+0000","last_undegraded":"2024-04-26T12:38:21.513197+0000","last_fullsized":"2024-04-26T12:38:21.513197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537349+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:38:21.537349+0000","last_peered":"2024-04-26T12:38:21.537349+0000","last_clean":"2024-04-26T12:38:21.537349+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:38:21.537349+0000","last_undegraded":"2024-04-26T12:38:21.537349+0000","last_fullsized":"2024-04-26T12:38:21.537349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.244659+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:38:22.244659+0000","last_peered":"2024-04-26T12:38:22.244659+0000","last_clean":"2024-04-26T12:38:22.244659+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:38:22.244659+0000","last_undegraded":"2024-04-26T12:38:22.244659+0000","last_fullsized":"2024-04-26T12:38:22.244659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.505927+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:38:21.505927+0000","last_peered":"2024-04-26T12:38:21.505927+0000","last_clean":"2024-04-26T12:38:21.505927+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:38:21.505927+0000","last_undegraded":"2024-04-26T12:38:21.505927+0000","last_fullsized":"2024-04-26T12:38:21.505927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.509854+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:38:21.509854+0000","last_peered":"2024-04-26T12:38:21.509854+0000","last_clean":"2024-04-26T12:38:21.509854+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:38:21.509854+0000","last_undegraded":"2024-04-26T12:38:21.509854+0000","last_fullsized":"2024-04-26T12:38:21.509854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508736+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:38:21.508736+0000","last_peered":"2024-04-26T12:38:21.508736+0000","last_clean":"2024-04-26T12:38:21.508736+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:38:21.508736+0000","last_undegraded":"2024-04-26T12:38:21.508736+0000","last_fullsized":"2024-04-26T12:38:21.508736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504248+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:38:21.504248+0000","last_peered":"2024-04-26T12:38:21.504248+0000","last_clean":"2024-04-26T12:38:21.504248+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:38:21.504248+0000","last_undegraded":"2024-04-26T12:38:21.504248+0000","last_fullsized":"2024-04-26T12:38:21.504248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536832+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:38:21.536832+0000","last_peered":"2024-04-26T12:38:21.536832+0000","last_clean":"2024-04-26T12:38:21.536832+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:38:21.536832+0000","last_undegraded":"2024-04-26T12:38:21.536832+0000","last_fullsized":"2024-04-26T12:38:21.536832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.857199+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:38:21.857199+0000","last_peered":"2024-04-26T12:38:21.857199+0000","last_clean":"2024-04-26T12:38:21.857199+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:38:21.857199+0000","last_undegraded":"2024-04-26T12:38:21.857199+0000","last_fullsized":"2024-04-26T12:38:21.857199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536322+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:38:21.536322+0000","last_peered":"2024-04-26T12:38:21.536322+0000","last_clean":"2024-04-26T12:38:21.536322+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:38:21.536322+0000","last_undegraded":"2024-04-26T12:38:21.536322+0000","last_fullsized":"2024-04-26T12:38:21.536322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497930+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:38:21.497930+0000","last_peered":"2024-04-26T12:38:21.497930+0000","last_clean":"2024-04-26T12:38:21.497930+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:38:21.497930+0000","last_undegraded":"2024-04-26T12:38:21.497930+0000","last_fullsized":"2024-04-26T12:38:21.497930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496008+0000","last_change":"2024-04-26T12:38:12.437210+0000","last_active":"2024-04-26T12:38:21.496008+0000","last_peered":"2024-04-26T12:38:21.496008+0000","last_clean":"2024-04-26T12:38:21.496008+0000","last_became_active":"2024-04-26T12:38:12.436501+0000","last_became_peered":"2024-04-26T12:38:12.436501+0000","last_unstale":"2024-04-26T12:38:21.496008+0000","last_undegraded":"2024-04-26T12:38:21.496008+0000","last_fullsized":"2024-04-26T12:38:21.496008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493561+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:38:21.493561+0000","last_peered":"2024-04-26T12:38:21.493561+0000","last_clean":"2024-04-26T12:38:21.493561+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:38:21.493561+0000","last_undegraded":"2024-04-26T12:38:21.493561+0000","last_fullsized":"2024-04-26T12:38:21.493561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537610+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:38:21.537610+0000","last_peered":"2024-04-26T12:38:21.537610+0000","last_clean":"2024-04-26T12:38:21.537610+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:38:21.537610+0000","last_undegraded":"2024-04-26T12:38:21.537610+0000","last_fullsized":"2024-04-26T12:38:21.537610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.394619+0000","last_change":"2024-04-26T12:38:16.478219+0000","last_active":"2024-04-26T12:38:22.394619+0000","last_peered":"2024-04-26T12:38:22.394619+0000","last_clean":"2024-04-26T12:38:22.394619+0000","last_became_active":"2024-04-26T12:38:16.477536+0000","last_became_peered":"2024-04-26T12:38:16.477536+0000","last_unstale":"2024-04-26T12:38:22.394619+0000","last_undegraded":"2024-04-26T12:38:22.394619+0000","last_fullsized":"2024-04-26T12:38:22.394619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.509512+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:38:21.509512+0000","last_peered":"2024-04-26T12:38:21.509512+0000","last_clean":"2024-04-26T12:38:21.509512+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:38:21.509512+0000","last_undegraded":"2024-04-26T12:38:21.509512+0000","last_fullsized":"2024-04-26T12:38:21.509512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491797+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:38:21.491797+0000","last_peered":"2024-04-26T12:38:21.491797+0000","last_clean":"2024-04-26T12:38:21.491797+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:38:21.491797+0000","last_undegraded":"2024-04-26T12:38:21.491797+0000","last_fullsized":"2024-04-26T12:38:21.491797+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496486+0000","last_change":"2024-04-26T12:38:12.448475+0000","last_active":"2024-04-26T12:38:21.496486+0000","last_peered":"2024-04-26T12:38:21.496486+0000","last_clean":"2024-04-26T12:38:21.496486+0000","last_became_active":"2024-04-26T12:38:12.446234+0000","last_became_peered":"2024-04-26T12:38:12.446234+0000","last_unstale":"2024-04-26T12:38:21.496486+0000","last_undegraded":"2024-04-26T12:38:21.496486+0000","last_fullsized":"2024-04-26T12:38:21.496486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.522240+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:38:21.522240+0000","last_peered":"2024-04-26T12:38:21.522240+0000","last_clean":"2024-04-26T12:38:21.522240+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:38:21.522240+0000","last_undegraded":"2024-04-26T12:38:21.522240+0000","last_fullsized":"2024-04-26T12:38:21.522240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494191+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:38:21.494191+0000","last_peered":"2024-04-26T12:38:21.494191+0000","last_clean":"2024-04-26T12:38:21.494191+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:38:21.494191+0000","last_undegraded":"2024-04-26T12:38:21.494191+0000","last_fullsized":"2024-04-26T12:38:21.494191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.464410+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:38:22.464410+0000","last_peered":"2024-04-26T12:38:22.464410+0000","last_clean":"2024-04-26T12:38:22.464410+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:38:22.464410+0000","last_undegraded":"2024-04-26T12:38:22.464410+0000","last_fullsized":"2024-04-26T12:38:22.464410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537925+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:38:21.537925+0000","last_peered":"2024-04-26T12:38:21.537925+0000","last_clean":"2024-04-26T12:38:21.537925+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:38:21.537925+0000","last_undegraded":"2024-04-26T12:38:21.537925+0000","last_fullsized":"2024-04-26T12:38:21.537925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491879+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:38:21.491879+0000","last_peered":"2024-04-26T12:38:21.491879+0000","last_clean":"2024-04-26T12:38:21.491879+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:38:21.491879+0000","last_undegraded":"2024-04-26T12:38:21.491879+0000","last_fullsized":"2024-04-26T12:38:21.491879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496531+0000","last_change":"2024-04-26T12:38:12.455790+0000","last_active":"2024-04-26T12:38:21.496531+0000","last_peered":"2024-04-26T12:38:21.496531+0000","last_clean":"2024-04-26T12:38:21.496531+0000","last_became_active":"2024-04-26T12:38:12.454940+0000","last_became_peered":"2024-04-26T12:38:12.454940+0000","last_unstale":"2024-04-26T12:38:21.496531+0000","last_undegraded":"2024-04-26T12:38:21.496531+0000","last_fullsized":"2024-04-26T12:38:21.496531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494913+0000","last_change":"2024-04-26T12:38:10.439940+0000","last_active":"2024-04-26T12:38:21.494913+0000","last_peered":"2024-04-26T12:38:21.494913+0000","last_clean":"2024-04-26T12:38:21.494913+0000","last_became_active":"2024-04-26T12:38:10.439126+0000","last_became_peered":"2024-04-26T12:38:10.439126+0000","last_unstale":"2024-04-26T12:38:21.494913+0000","last_undegraded":"2024-04-26T12:38:21.494913+0000","last_fullsized":"2024-04-26T12:38:21.494913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:07.267189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503931+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:38:21.503931+0000","last_peered":"2024-04-26T12:38:21.503931+0000","last_clean":"2024-04-26T12:38:21.503931+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:38:21.503931+0000","last_undegraded":"2024-04-26T12:38:21.503931+0000","last_fullsized":"2024-04-26T12:38:21.503931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.250292+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:38:22.250292+0000","last_peered":"2024-04-26T12:38:22.250292+0000","last_clean":"2024-04-26T12:38:22.250292+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:38:22.250292+0000","last_undegraded":"2024-04-26T12:38:22.250292+0000","last_fullsized":"2024-04-26T12:38:22.250292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.523605+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:38:21.523605+0000","last_peered":"2024-04-26T12:38:21.523605+0000","last_clean":"2024-04-26T12:38:21.523605+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:38:21.523605+0000","last_undegraded":"2024-04-26T12:38:21.523605+0000","last_fullsized":"2024-04-26T12:38:21.523605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494898+0000","last_change":"2024-04-26T12:38:20.506311+0000","last_active":"2024-04-26T12:38:21.494898+0000","last_peered":"2024-04-26T12:38:21.494898+0000","last_clean":"2024-04-26T12:38:21.494898+0000","last_became_active":"2024-04-26T12:38:20.505525+0000","last_became_peered":"2024-04-26T12:38:20.505525+0000","last_unstale":"2024-04-26T12:38:21.494898+0000","last_undegraded":"2024-04-26T12:38:21.494898+0000","last_fullsized":"2024-04-26T12:38:21.494898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.498061+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:38:21.498061+0000","last_peered":"2024-04-26T12:38:21.498061+0000","last_clean":"2024-04-26T12:38:21.498061+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:38:21.498061+0000","last_undegraded":"2024-04-26T12:38:21.498061+0000","last_fullsized":"2024-04-26T12:38:21.498061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493645+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:38:21.493645+0000","last_peered":"2024-04-26T12:38:21.493645+0000","last_clean":"2024-04-26T12:38:21.493645+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:38:21.493645+0000","last_undegraded":"2024-04-26T12:38:21.493645+0000","last_fullsized":"2024-04-26T12:38:21.493645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496157+0000","last_change":"2024-04-26T12:38:14.450109+0000","last_active":"2024-04-26T12:38:21.496157+0000","last_peered":"2024-04-26T12:38:21.496157+0000","last_clean":"2024-04-26T12:38:21.496157+0000","last_became_active":"2024-04-26T12:38:14.449387+0000","last_became_peered":"2024-04-26T12:38:14.449387+0000","last_unstale":"2024-04-26T12:38:21.496157+0000","last_undegraded":"2024-04-26T12:38:21.496157+0000","last_fullsized":"2024-04-26T12:38:21.496157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"29'17","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.387691+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:38:22.387691+0000","last_peered":"2024-04-26T12:38:22.387691+0000","last_clean":"2024-04-26T12:38:22.387691+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:38:22.387691+0000","last_undegraded":"2024-04-26T12:38:22.387691+0000","last_fullsized":"2024-04-26T12:38:22.387691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.522456+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:38:21.522456+0000","last_peered":"2024-04-26T12:38:21.522456+0000","last_clean":"2024-04-26T12:38:21.522456+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:38:21.522456+0000","last_undegraded":"2024-04-26T12:38:21.522456+0000","last_fullsized":"2024-04-26T12:38:21.522456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492715+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:38:21.492715+0000","last_peered":"2024-04-26T12:38:21.492715+0000","last_clean":"2024-04-26T12:38:21.492715+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:38:21.492715+0000","last_undegraded":"2024-04-26T12:38:21.492715+0000","last_fullsized":"2024-04-26T12:38:21.492715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.523935+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:38:21.523935+0000","last_peered":"2024-04-26T12:38:21.523935+0000","last_clean":"2024-04-26T12:38:21.523935+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:38:21.523935+0000","last_undegraded":"2024-04-26T12:38:21.523935+0000","last_fullsized":"2024-04-26T12:38:21.523935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511362+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:38:21.511362+0000","last_peered":"2024-04-26T12:38:21.511362+0000","last_clean":"2024-04-26T12:38:21.511362+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:38:21.511362+0000","last_undegraded":"2024-04-26T12:38:21.511362+0000","last_fullsized":"2024-04-26T12:38:21.511362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503104+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:38:21.503104+0000","last_peered":"2024-04-26T12:38:21.503104+0000","last_clean":"2024-04-26T12:38:21.503104+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:38:21.503104+0000","last_undegraded":"2024-04-26T12:38:21.503104+0000","last_fullsized":"2024-04-26T12:38:21.503104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493615+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:38:21.493615+0000","last_peered":"2024-04-26T12:38:21.493615+0000","last_clean":"2024-04-26T12:38:21.493615+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:38:21.493615+0000","last_undegraded":"2024-04-26T12:38:21.493615+0000","last_fullsized":"2024-04-26T12:38:21.493615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511988+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:38:21.511988+0000","last_peered":"2024-04-26T12:38:21.511988+0000","last_clean":"2024-04-26T12:38:21.511988+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:38:21.511988+0000","last_undegraded":"2024-04-26T12:38:21.511988+0000","last_fullsized":"2024-04-26T12:38:21.511988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"29'13","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.178104+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:38:22.178104+0000","last_peered":"2024-04-26T12:38:22.178104+0000","last_clean":"2024-04-26T12:38:22.178104+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:38:22.178104+0000","last_undegraded":"2024-04-26T12:38:22.178104+0000","last_fullsized":"2024-04-26T12:38:22.178104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511139+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:38:21.511139+0000","last_peered":"2024-04-26T12:38:21.511139+0000","last_clean":"2024-04-26T12:38:21.511139+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:38:21.511139+0000","last_undegraded":"2024-04-26T12:38:21.511139+0000","last_fullsized":"2024-04-26T12:38:21.511139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521300+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:38:21.521300+0000","last_peered":"2024-04-26T12:38:21.521300+0000","last_clean":"2024-04-26T12:38:21.521300+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:38:21.521300+0000","last_undegraded":"2024-04-26T12:38:21.521300+0000","last_fullsized":"2024-04-26T12:38:21.521300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511770+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:38:21.511770+0000","last_peered":"2024-04-26T12:38:21.511770+0000","last_clean":"2024-04-26T12:38:21.511770+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:38:21.511770+0000","last_undegraded":"2024-04-26T12:38:21.511770+0000","last_fullsized":"2024-04-26T12:38:21.511770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511082+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:38:21.511082+0000","last_peered":"2024-04-26T12:38:21.511082+0000","last_clean":"2024-04-26T12:38:21.511082+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:38:21.511082+0000","last_undegraded":"2024-04-26T12:38:21.511082+0000","last_fullsized":"2024-04-26T12:38:21.511082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.506799+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:38:21.506799+0000","last_peered":"2024-04-26T12:38:21.506799+0000","last_clean":"2024-04-26T12:38:21.506799+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:38:21.506799+0000","last_undegraded":"2024-04-26T12:38:21.506799+0000","last_fullsized":"2024-04-26T12:38:21.506799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504663+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:38:21.504663+0000","last_peered":"2024-04-26T12:38:21.504663+0000","last_clean":"2024-04-26T12:38:21.504663+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:38:21.504663+0000","last_undegraded":"2024-04-26T12:38:21.504663+0000","last_fullsized":"2024-04-26T12:38:21.504663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.372676+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:38:22.372676+0000","last_peered":"2024-04-26T12:38:22.372676+0000","last_clean":"2024-04-26T12:38:22.372676+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:38:22.372676+0000","last_undegraded":"2024-04-26T12:38:22.372676+0000","last_fullsized":"2024-04-26T12:38:22.372676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512432+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:38:21.512432+0000","last_peered":"2024-04-26T12:38:21.512432+0000","last_clean":"2024-04-26T12:38:21.512432+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:38:21.512432+0000","last_undegraded":"2024-04-26T12:38:21.512432+0000","last_fullsized":"2024-04-26T12:38:21.512432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491837+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:38:21.491837+0000","last_peered":"2024-04-26T12:38:21.491837+0000","last_clean":"2024-04-26T12:38:21.491837+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:38:21.491837+0000","last_undegraded":"2024-04-26T12:38:21.491837+0000","last_fullsized":"2024-04-26T12:38:21.491837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.498212+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:38:21.498212+0000","last_peered":"2024-04-26T12:38:21.498212+0000","last_clean":"2024-04-26T12:38:21.498212+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:38:21.498212+0000","last_undegraded":"2024-04-26T12:38:21.498212+0000","last_fullsized":"2024-04-26T12:38:21.498212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536791+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:38:21.536791+0000","last_peered":"2024-04-26T12:38:21.536791+0000","last_clean":"2024-04-26T12:38:21.536791+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:38:21.536791+0000","last_undegraded":"2024-04-26T12:38:21.536791+0000","last_fullsized":"2024-04-26T12:38:21.536791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.490960+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:38:21.490960+0000","last_peered":"2024-04-26T12:38:21.490960+0000","last_clean":"2024-04-26T12:38:21.490960+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:38:21.490960+0000","last_undegraded":"2024-04-26T12:38:21.490960+0000","last_fullsized":"2024-04-26T12:38:21.490960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.538248+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:38:21.538248+0000","last_peered":"2024-04-26T12:38:21.538248+0000","last_clean":"2024-04-26T12:38:21.538248+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:38:21.538248+0000","last_undegraded":"2024-04-26T12:38:21.538248+0000","last_fullsized":"2024-04-26T12:38:21.538248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'15","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.380778+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:38:22.380778+0000","last_peered":"2024-04-26T12:38:22.380778+0000","last_clean":"2024-04-26T12:38:22.380778+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:38:22.380778+0000","last_undegraded":"2024-04-26T12:38:22.380778+0000","last_fullsized":"2024-04-26T12:38:22.380778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507840+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:38:21.507840+0000","last_peered":"2024-04-26T12:38:21.507840+0000","last_clean":"2024-04-26T12:38:21.507840+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:38:21.507840+0000","last_undegraded":"2024-04-26T12:38:21.507840+0000","last_fullsized":"2024-04-26T12:38:21.507840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495152+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:38:21.495152+0000","last_peered":"2024-04-26T12:38:21.495152+0000","last_clean":"2024-04-26T12:38:21.495152+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:38:21.495152+0000","last_undegraded":"2024-04-26T12:38:21.495152+0000","last_fullsized":"2024-04-26T12:38:21.495152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494447+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:38:21.494447+0000","last_peered":"2024-04-26T12:38:21.494447+0000","last_clean":"2024-04-26T12:38:21.494447+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:38:21.494447+0000","last_undegraded":"2024-04-26T12:38:21.494447+0000","last_fullsized":"2024-04-26T12:38:21.494447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503559+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:38:21.503559+0000","last_peered":"2024-04-26T12:38:21.503559+0000","last_clean":"2024-04-26T12:38:21.503559+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:38:21.503559+0000","last_undegraded":"2024-04-26T12:38:21.503559+0000","last_fullsized":"2024-04-26T12:38:21.503559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495252+0000","last_change":"2024-04-26T12:38:10.462754+0000","last_active":"2024-04-26T12:38:21.495252+0000","last_peered":"2024-04-26T12:38:21.495252+0000","last_clean":"2024-04-26T12:38:21.495252+0000","last_became_active":"2024-04-26T12:38:10.461697+0000","last_became_peered":"2024-04-26T12:38:10.461697+0000","last_unstale":"2024-04-26T12:38:21.495252+0000","last_undegraded":"2024-04-26T12:38:21.495252+0000","last_fullsized":"2024-04-26T12:38:21.495252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:40.556384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507901+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:38:21.507901+0000","last_peered":"2024-04-26T12:38:21.507901+0000","last_clean":"2024-04-26T12:38:21.507901+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:38:21.507901+0000","last_undegraded":"2024-04-26T12:38:21.507901+0000","last_fullsized":"2024-04-26T12:38:21.507901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.213171+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:38:22.213171+0000","last_peered":"2024-04-26T12:38:22.213171+0000","last_clean":"2024-04-26T12:38:22.213171+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:38:22.213171+0000","last_undegraded":"2024-04-26T12:38:22.213171+0000","last_fullsized":"2024-04-26T12:38:22.213171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524472+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:38:21.524472+0000","last_peered":"2024-04-26T12:38:21.524472+0000","last_clean":"2024-04-26T12:38:21.524472+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:38:21.524472+0000","last_undegraded":"2024-04-26T12:38:21.524472+0000","last_fullsized":"2024-04-26T12:38:21.524472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502339+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:38:21.502339+0000","last_peered":"2024-04-26T12:38:21.502339+0000","last_clean":"2024-04-26T12:38:21.502339+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:38:21.502339+0000","last_undegraded":"2024-04-26T12:38:21.502339+0000","last_fullsized":"2024-04-26T12:38:21.502339+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492488+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:38:21.492488+0000","last_peered":"2024-04-26T12:38:21.492488+0000","last_clean":"2024-04-26T12:38:21.492488+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:38:21.492488+0000","last_undegraded":"2024-04-26T12:38:21.492488+0000","last_fullsized":"2024-04-26T12:38:21.492488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504799+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:38:21.504799+0000","last_peered":"2024-04-26T12:38:21.504799+0000","last_clean":"2024-04-26T12:38:21.504799+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:38:21.504799+0000","last_undegraded":"2024-04-26T12:38:21.504799+0000","last_fullsized":"2024-04-26T12:38:21.504799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494789+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:38:21.494789+0000","last_peered":"2024-04-26T12:38:21.494789+0000","last_clean":"2024-04-26T12:38:21.494789+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:38:21.494789+0000","last_undegraded":"2024-04-26T12:38:21.494789+0000","last_fullsized":"2024-04-26T12:38:21.494789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507971+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:38:21.507971+0000","last_peered":"2024-04-26T12:38:21.507971+0000","last_clean":"2024-04-26T12:38:21.507971+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:38:21.507971+0000","last_undegraded":"2024-04-26T12:38:21.507971+0000","last_fullsized":"2024-04-26T12:38:21.507971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'18","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.307945+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:38:22.307945+0000","last_peered":"2024-04-26T12:38:22.307945+0000","last_clean":"2024-04-26T12:38:22.307945+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:38:22.307945+0000","last_undegraded":"2024-04-26T12:38:22.307945+0000","last_fullsized":"2024-04-26T12:38:22.307945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493912+0000","last_change":"2024-04-26T12:38:18.479417+0000","last_active":"2024-04-26T12:38:21.493912+0000","last_peered":"2024-04-26T12:38:21.493912+0000","last_clean":"2024-04-26T12:38:21.493912+0000","last_became_active":"2024-04-26T12:38:18.478693+0000","last_became_peered":"2024-04-26T12:38:18.478693+0000","last_unstale":"2024-04-26T12:38:21.493912+0000","last_undegraded":"2024-04-26T12:38:21.493912+0000","last_fullsized":"2024-04-26T12:38:21.493912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508801+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:38:21.508801+0000","last_peered":"2024-04-26T12:38:21.508801+0000","last_clean":"2024-04-26T12:38:21.508801+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:38:21.508801+0000","last_undegraded":"2024-04-26T12:38:21.508801+0000","last_fullsized":"2024-04-26T12:38:21.508801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508676+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:38:21.508676+0000","last_peered":"2024-04-26T12:38:21.508676+0000","last_clean":"2024-04-26T12:38:21.508676+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:38:21.508676+0000","last_undegraded":"2024-04-26T12:38:21.508676+0000","last_fullsized":"2024-04-26T12:38:21.508676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494539+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:38:21.494539+0000","last_peered":"2024-04-26T12:38:21.494539+0000","last_clean":"2024-04-26T12:38:21.494539+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:38:21.494539+0000","last_undegraded":"2024-04-26T12:38:21.494539+0000","last_fullsized":"2024-04-26T12:38:21.494539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513507+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:38:21.513507+0000","last_peered":"2024-04-26T12:38:21.513507+0000","last_clean":"2024-04-26T12:38:21.513507+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:38:21.513507+0000","last_undegraded":"2024-04-26T12:38:21.513507+0000","last_fullsized":"2024-04-26T12:38:21.513507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521762+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:38:21.521762+0000","last_peered":"2024-04-26T12:38:21.521762+0000","last_clean":"2024-04-26T12:38:21.521762+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:38:21.521762+0000","last_undegraded":"2024-04-26T12:38:21.521762+0000","last_fullsized":"2024-04-26T12:38:21.521762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.408269+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:38:22.408269+0000","last_peered":"2024-04-26T12:38:22.408269+0000","last_clean":"2024-04-26T12:38:22.408269+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:38:22.408269+0000","last_undegraded":"2024-04-26T12:38:22.408269+0000","last_fullsized":"2024-04-26T12:38:22.408269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502630+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:38:21.502630+0000","last_peered":"2024-04-26T12:38:21.502630+0000","last_clean":"2024-04-26T12:38:21.502630+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:38:21.502630+0000","last_undegraded":"2024-04-26T12:38:21.502630+0000","last_fullsized":"2024-04-26T12:38:21.502630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495702+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:38:21.495702+0000","last_peered":"2024-04-26T12:38:21.495702+0000","last_clean":"2024-04-26T12:38:21.495702+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:38:21.495702+0000","last_undegraded":"2024-04-26T12:38:21.495702+0000","last_fullsized":"2024-04-26T12:38:21.495702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492675+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:38:21.492675+0000","last_peered":"2024-04-26T12:38:21.492675+0000","last_clean":"2024-04-26T12:38:21.492675+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:38:21.492675+0000","last_undegraded":"2024-04-26T12:38:21.492675+0000","last_fullsized":"2024-04-26T12:38:21.492675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494868+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:38:21.494868+0000","last_peered":"2024-04-26T12:38:21.494868+0000","last_clean":"2024-04-26T12:38:21.494868+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:38:21.494868+0000","last_undegraded":"2024-04-26T12:38:21.494868+0000","last_fullsized":"2024-04-26T12:38:21.494868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.498023+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:38:21.498023+0000","last_peered":"2024-04-26T12:38:21.498023+0000","last_clean":"2024-04-26T12:38:21.498023+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:38:21.498023+0000","last_undegraded":"2024-04-26T12:38:21.498023+0000","last_fullsized":"2024-04-26T12:38:21.498023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494193+0000","last_change":"2024-04-26T12:38:14.446941+0000","last_active":"2024-04-26T12:38:21.494193+0000","last_peered":"2024-04-26T12:38:21.494193+0000","last_clean":"2024-04-26T12:38:21.494193+0000","last_became_active":"2024-04-26T12:38:14.446196+0000","last_became_peered":"2024-04-26T12:38:14.446196+0000","last_unstale":"2024-04-26T12:38:21.494193+0000","last_undegraded":"2024-04-26T12:38:21.494193+0000","last_fullsized":"2024-04-26T12:38:21.494193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.366185+0000","last_change":"2024-04-26T12:38:16.468798+0000","last_active":"2024-04-26T12:38:22.366185+0000","last_peered":"2024-04-26T12:38:22.366185+0000","last_clean":"2024-04-26T12:38:22.366185+0000","last_became_active":"2024-04-26T12:38:16.468104+0000","last_became_peered":"2024-04-26T12:38:16.468104+0000","last_unstale":"2024-04-26T12:38:22.366185+0000","last_undegraded":"2024-04-26T12:38:22.366185+0000","last_fullsized":"2024-04-26T12:38:22.366185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.499238+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:38:21.499238+0000","last_peered":"2024-04-26T12:38:21.499238+0000","last_clean":"2024-04-26T12:38:21.499238+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:38:21.499238+0000","last_undegraded":"2024-04-26T12:38:21.499238+0000","last_fullsized":"2024-04-26T12:38:21.499238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508444+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:38:21.508444+0000","last_peered":"2024-04-26T12:38:21.508444+0000","last_clean":"2024-04-26T12:38:21.508444+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:38:21.508444+0000","last_undegraded":"2024-04-26T12:38:21.508444+0000","last_fullsized":"2024-04-26T12:38:21.508444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494501+0000","last_change":"2024-04-26T12:38:12.457737+0000","last_active":"2024-04-26T12:38:21.494501+0000","last_peered":"2024-04-26T12:38:21.494501+0000","last_clean":"2024-04-26T12:38:21.494501+0000","last_became_active":"2024-04-26T12:38:12.457046+0000","last_became_peered":"2024-04-26T12:38:12.457046+0000","last_unstale":"2024-04-26T12:38:21.494501+0000","last_undegraded":"2024-04-26T12:38:21.494501+0000","last_fullsized":"2024-04-26T12:38:21.494501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512192+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:38:21.512192+0000","last_peered":"2024-04-26T12:38:21.512192+0000","last_clean":"2024-04-26T12:38:21.512192+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:38:21.512192+0000","last_undegraded":"2024-04-26T12:38:21.512192+0000","last_fullsized":"2024-04-26T12:38:21.512192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.525166+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:38:21.525166+0000","last_peered":"2024-04-26T12:38:21.525166+0000","last_clean":"2024-04-26T12:38:21.525166+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:38:21.525166+0000","last_undegraded":"2024-04-26T12:38:21.525166+0000","last_fullsized":"2024-04-26T12:38:21.525166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492293+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:38:21.492293+0000","last_peered":"2024-04-26T12:38:21.492293+0000","last_clean":"2024-04-26T12:38:21.492293+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:38:21.492293+0000","last_undegraded":"2024-04-26T12:38:21.492293+0000","last_fullsized":"2024-04-26T12:38:21.492293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'19","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.344336+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:38:22.344336+0000","last_peered":"2024-04-26T12:38:22.344336+0000","last_clean":"2024-04-26T12:38:22.344336+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:38:22.344336+0000","last_undegraded":"2024-04-26T12:38:22.344336+0000","last_fullsized":"2024-04-26T12:38:22.344336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493152+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:38:21.493152+0000","last_peered":"2024-04-26T12:38:21.493152+0000","last_clean":"2024-04-26T12:38:21.493152+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:38:21.493152+0000","last_undegraded":"2024-04-26T12:38:21.493152+0000","last_fullsized":"2024-04-26T12:38:21.493152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503557+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:38:21.503557+0000","last_peered":"2024-04-26T12:38:21.503557+0000","last_clean":"2024-04-26T12:38:21.503557+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:38:21.503557+0000","last_undegraded":"2024-04-26T12:38:21.503557+0000","last_fullsized":"2024-04-26T12:38:21.503557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.509567+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:38:21.509567+0000","last_peered":"2024-04-26T12:38:21.509567+0000","last_clean":"2024-04-26T12:38:21.509567+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:38:21.509567+0000","last_undegraded":"2024-04-26T12:38:21.509567+0000","last_fullsized":"2024-04-26T12:38:21.509567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494805+0000","last_change":"2024-04-26T12:38:12.442031+0000","last_active":"2024-04-26T12:38:21.494805+0000","last_peered":"2024-04-26T12:38:21.494805+0000","last_clean":"2024-04-26T12:38:21.494805+0000","last_became_active":"2024-04-26T12:38:12.436985+0000","last_became_peered":"2024-04-26T12:38:12.436985+0000","last_unstale":"2024-04-26T12:38:21.494805+0000","last_undegraded":"2024-04-26T12:38:21.494805+0000","last_fullsized":"2024-04-26T12:38:21.494805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495332+0000","last_change":"2024-04-26T12:38:10.440637+0000","last_active":"2024-04-26T12:38:21.495332+0000","last_peered":"2024-04-26T12:38:21.495332+0000","last_clean":"2024-04-26T12:38:21.495332+0000","last_became_active":"2024-04-26T12:38:10.438246+0000","last_became_peered":"2024-04-26T12:38:10.438246+0000","last_unstale":"2024-04-26T12:38:21.495332+0000","last_undegraded":"2024-04-26T12:38:21.495332+0000","last_fullsized":"2024-04-26T12:38:21.495332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492757+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:38:21.492757+0000","last_peered":"2024-04-26T12:38:21.492757+0000","last_clean":"2024-04-26T12:38:21.492757+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:38:21.492757+0000","last_undegraded":"2024-04-26T12:38:21.492757+0000","last_fullsized":"2024-04-26T12:38:21.492757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.414961+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:38:22.414961+0000","last_peered":"2024-04-26T12:38:22.414961+0000","last_clean":"2024-04-26T12:38:22.414961+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:38:22.414961+0000","last_undegraded":"2024-04-26T12:38:22.414961+0000","last_fullsized":"2024-04-26T12:38:22.414961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491931+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:38:21.491931+0000","last_peered":"2024-04-26T12:38:21.491931+0000","last_clean":"2024-04-26T12:38:21.491931+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:38:21.491931+0000","last_undegraded":"2024-04-26T12:38:21.491931+0000","last_fullsized":"2024-04-26T12:38:21.491931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494921+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:38:21.494921+0000","last_peered":"2024-04-26T12:38:21.494921+0000","last_clean":"2024-04-26T12:38:21.494921+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:38:21.494921+0000","last_undegraded":"2024-04-26T12:38:21.494921+0000","last_fullsized":"2024-04-26T12:38:21.494921+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492925+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:38:21.492925+0000","last_peered":"2024-04-26T12:38:21.492925+0000","last_clean":"2024-04-26T12:38:21.492925+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:38:21.492925+0000","last_undegraded":"2024-04-26T12:38:21.492925+0000","last_fullsized":"2024-04-26T12:38:21.492925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513138+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:38:21.513138+0000","last_peered":"2024-04-26T12:38:21.513138+0000","last_clean":"2024-04-26T12:38:21.513138+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:38:21.513138+0000","last_undegraded":"2024-04-26T12:38:21.513138+0000","last_fullsized":"2024-04-26T12:38:21.513138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494505+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:38:21.494505+0000","last_peered":"2024-04-26T12:38:21.494505+0000","last_clean":"2024-04-26T12:38:21.494505+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:38:21.494505+0000","last_undegraded":"2024-04-26T12:38:21.494505+0000","last_fullsized":"2024-04-26T12:38:21.494505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.862833+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:38:21.862833+0000","last_peered":"2024-04-26T12:38:21.862833+0000","last_clean":"2024-04-26T12:38:21.862833+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:38:21.862833+0000","last_undegraded":"2024-04-26T12:38:21.862833+0000","last_fullsized":"2024-04-26T12:38:21.862833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511300+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:38:21.511300+0000","last_peered":"2024-04-26T12:38:21.511300+0000","last_clean":"2024-04-26T12:38:21.511300+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:38:21.511300+0000","last_undegraded":"2024-04-26T12:38:21.511300+0000","last_fullsized":"2024-04-26T12:38:21.511300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508207+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:38:21.508207+0000","last_peered":"2024-04-26T12:38:21.508207+0000","last_clean":"2024-04-26T12:38:21.508207+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:38:21.508207+0000","last_undegraded":"2024-04-26T12:38:21.508207+0000","last_fullsized":"2024-04-26T12:38:21.508207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492746+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:38:21.492746+0000","last_peered":"2024-04-26T12:38:21.492746+0000","last_clean":"2024-04-26T12:38:21.492746+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:38:21.492746+0000","last_undegraded":"2024-04-26T12:38:21.492746+0000","last_fullsized":"2024-04-26T12:38:21.492746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504442+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:38:21.504442+0000","last_peered":"2024-04-26T12:38:21.504442+0000","last_clean":"2024-04-26T12:38:21.504442+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:38:21.504442+0000","last_undegraded":"2024-04-26T12:38:21.504442+0000","last_fullsized":"2024-04-26T12:38:21.504442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.510613+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:38:21.510613+0000","last_peered":"2024-04-26T12:38:21.510613+0000","last_clean":"2024-04-26T12:38:21.510613+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:38:21.510613+0000","last_undegraded":"2024-04-26T12:38:21.510613+0000","last_fullsized":"2024-04-26T12:38:21.510613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.322468+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:38:22.322468+0000","last_peered":"2024-04-26T12:38:22.322468+0000","last_clean":"2024-04-26T12:38:22.322468+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:38:22.322468+0000","last_undegraded":"2024-04-26T12:38:22.322468+0000","last_fullsized":"2024-04-26T12:38:22.322468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521522+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:38:21.521522+0000","last_peered":"2024-04-26T12:38:21.521522+0000","last_clean":"2024-04-26T12:38:21.521522+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:38:21.521522+0000","last_undegraded":"2024-04-26T12:38:21.521522+0000","last_fullsized":"2024-04-26T12:38:21.521522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503061+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:38:21.503061+0000","last_peered":"2024-04-26T12:38:21.503061+0000","last_clean":"2024-04-26T12:38:21.503061+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:38:21.503061+0000","last_undegraded":"2024-04-26T12:38:21.503061+0000","last_fullsized":"2024-04-26T12:38:21.503061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493075+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:38:21.493075+0000","last_peered":"2024-04-26T12:38:21.493075+0000","last_clean":"2024-04-26T12:38:21.493075+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:38:21.493075+0000","last_undegraded":"2024-04-26T12:38:21.493075+0000","last_fullsized":"2024-04-26T12:38:21.493075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511466+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:38:21.511466+0000","last_peered":"2024-04-26T12:38:21.511466+0000","last_clean":"2024-04-26T12:38:21.511466+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:38:21.511466+0000","last_undegraded":"2024-04-26T12:38:21.511466+0000","last_fullsized":"2024-04-26T12:38:21.511466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521609+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:38:21.521609+0000","last_peered":"2024-04-26T12:38:21.521609+0000","last_clean":"2024-04-26T12:38:21.521609+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:38:21.521609+0000","last_undegraded":"2024-04-26T12:38:21.521609+0000","last_fullsized":"2024-04-26T12:38:21.521609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.096359+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:38:22.096359+0000","last_peered":"2024-04-26T12:38:22.096359+0000","last_clean":"2024-04-26T12:38:22.096359+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:38:22.096359+0000","last_undegraded":"2024-04-26T12:38:22.096359+0000","last_fullsized":"2024-04-26T12:38:22.096359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507246+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:38:21.507246+0000","last_peered":"2024-04-26T12:38:21.507246+0000","last_clean":"2024-04-26T12:38:21.507246+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:38:21.507246+0000","last_undegraded":"2024-04-26T12:38:21.507246+0000","last_fullsized":"2024-04-26T12:38:21.507246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524792+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:38:21.524792+0000","last_peered":"2024-04-26T12:38:21.524792+0000","last_clean":"2024-04-26T12:38:21.524792+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:38:21.524792+0000","last_undegraded":"2024-04-26T12:38:21.524792+0000","last_fullsized":"2024-04-26T12:38:21.524792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493440+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:38:21.493440+0000","last_peered":"2024-04-26T12:38:21.493440+0000","last_clean":"2024-04-26T12:38:21.493440+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:38:21.493440+0000","last_undegraded":"2024-04-26T12:38:21.493440+0000","last_fullsized":"2024-04-26T12:38:21.493440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511404+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:38:21.511404+0000","last_peered":"2024-04-26T12:38:21.511404+0000","last_clean":"2024-04-26T12:38:21.511404+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:38:21.511404+0000","last_undegraded":"2024-04-26T12:38:21.511404+0000","last_fullsized":"2024-04-26T12:38:21.511404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.442415+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:38:22.442415+0000","last_peered":"2024-04-26T12:38:22.442415+0000","last_clean":"2024-04-26T12:38:22.442415+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:38:22.442415+0000","last_undegraded":"2024-04-26T12:38:22.442415+0000","last_fullsized":"2024-04-26T12:38:22.442415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503241+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:38:21.503241+0000","last_peered":"2024-04-26T12:38:21.503241+0000","last_clean":"2024-04-26T12:38:21.503241+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:38:21.503241+0000","last_undegraded":"2024-04-26T12:38:21.503241+0000","last_fullsized":"2024-04-26T12:38:21.503241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493230+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:38:21.493230+0000","last_peered":"2024-04-26T12:38:21.493230+0000","last_clean":"2024-04-26T12:38:21.493230+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:38:21.493230+0000","last_undegraded":"2024-04-26T12:38:21.493230+0000","last_fullsized":"2024-04-26T12:38:21.493230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511659+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:38:21.511659+0000","last_peered":"2024-04-26T12:38:21.511659+0000","last_clean":"2024-04-26T12:38:21.511659+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:38:21.511659+0000","last_undegraded":"2024-04-26T12:38:21.511659+0000","last_fullsized":"2024-04-26T12:38:21.511659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492195+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:38:21.492195+0000","last_peered":"2024-04-26T12:38:21.492195+0000","last_clean":"2024-04-26T12:38:21.492195+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:38:21.492195+0000","last_undegraded":"2024-04-26T12:38:21.492195+0000","last_fullsized":"2024-04-26T12:38:21.492195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524584+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:38:21.524584+0000","last_peered":"2024-04-26T12:38:21.524584+0000","last_clean":"2024-04-26T12:38:21.524584+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:38:21.524584+0000","last_undegraded":"2024-04-26T12:38:21.524584+0000","last_fullsized":"2024-04-26T12:38:21.524584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.220910+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:38:22.220910+0000","last_peered":"2024-04-26T12:38:22.220910+0000","last_clean":"2024-04-26T12:38:22.220910+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:38:22.220910+0000","last_undegraded":"2024-04-26T12:38:22.220910+0000","last_fullsized":"2024-04-26T12:38:22.220910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495635+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:38:21.495635+0000","last_peered":"2024-04-26T12:38:21.495635+0000","last_clean":"2024-04-26T12:38:21.495635+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:38:21.495635+0000","last_undegraded":"2024-04-26T12:38:21.495635+0000","last_fullsized":"2024-04-26T12:38:21.495635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521616+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:38:21.521616+0000","last_peered":"2024-04-26T12:38:21.521616+0000","last_clean":"2024-04-26T12:38:21.521616+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:38:21.521616+0000","last_undegraded":"2024-04-26T12:38:21.521616+0000","last_fullsized":"2024-04-26T12:38:21.521616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494558+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:38:21.494558+0000","last_peered":"2024-04-26T12:38:21.494558+0000","last_clean":"2024-04-26T12:38:21.494558+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:38:21.494558+0000","last_undegraded":"2024-04-26T12:38:21.494558+0000","last_fullsized":"2024-04-26T12:38:21.494558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495583+0000","last_change":"2024-04-26T12:38:10.432447+0000","last_active":"2024-04-26T12:38:21.495583+0000","last_peered":"2024-04-26T12:38:21.495583+0000","last_clean":"2024-04-26T12:38:21.495583+0000","last_became_active":"2024-04-26T12:38:10.431629+0000","last_became_peered":"2024-04-26T12:38:10.431629+0000","last_unstale":"2024-04-26T12:38:21.495583+0000","last_undegraded":"2024-04-26T12:38:21.495583+0000","last_fullsized":"2024-04-26T12:38:21.495583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496523+0000","last_change":"2024-04-26T12:38:14.443557+0000","last_active":"2024-04-26T12:38:21.496523+0000","last_peered":"2024-04-26T12:38:21.496523+0000","last_clean":"2024-04-26T12:38:21.496523+0000","last_became_active":"2024-04-26T12:38:14.442780+0000","last_became_peered":"2024-04-26T12:38:14.442780+0000","last_unstale":"2024-04-26T12:38:21.496523+0000","last_undegraded":"2024-04-26T12:38:21.496523+0000","last_fullsized":"2024-04-26T12:38:21.496523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.421725+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:38:22.421725+0000","last_peered":"2024-04-26T12:38:22.421725+0000","last_clean":"2024-04-26T12:38:22.421725+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:38:22.421725+0000","last_undegraded":"2024-04-26T12:38:22.421725+0000","last_fullsized":"2024-04-26T12:38:22.421725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495398+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:38:21.495398+0000","last_peered":"2024-04-26T12:38:21.495398+0000","last_clean":"2024-04-26T12:38:21.495398+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:38:21.495398+0000","last_undegraded":"2024-04-26T12:38:21.495398+0000","last_fullsized":"2024-04-26T12:38:21.495398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502568+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:38:21.502568+0000","last_peered":"2024-04-26T12:38:21.502568+0000","last_clean":"2024-04-26T12:38:21.502568+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:38:21.502568+0000","last_undegraded":"2024-04-26T12:38:21.502568+0000","last_fullsized":"2024-04-26T12:38:21.502568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537854+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:38:21.537854+0000","last_peered":"2024-04-26T12:38:21.537854+0000","last_clean":"2024-04-26T12:38:21.537854+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:38:21.537854+0000","last_undegraded":"2024-04-26T12:38:21.537854+0000","last_fullsized":"2024-04-26T12:38:21.537854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507581+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:38:21.507581+0000","last_peered":"2024-04-26T12:38:21.507581+0000","last_clean":"2024-04-26T12:38:21.507581+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:38:21.507581+0000","last_undegraded":"2024-04-26T12:38:21.507581+0000","last_fullsized":"2024-04-26T12:38:21.507581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496463+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:38:21.496463+0000","last_peered":"2024-04-26T12:38:21.496463+0000","last_clean":"2024-04-26T12:38:21.496463+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:38:21.496463+0000","last_undegraded":"2024-04-26T12:38:21.496463+0000","last_fullsized":"2024-04-26T12:38:21.496463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.402397+0000","last_change":"2024-04-26T12:38:16.531118+0000","last_active":"2024-04-26T12:38:22.402397+0000","last_peered":"2024-04-26T12:38:22.402397+0000","last_clean":"2024-04-26T12:38:22.402397+0000","last_became_active":"2024-04-26T12:38:16.530342+0000","last_became_peered":"2024-04-26T12:38:16.530342+0000","last_unstale":"2024-04-26T12:38:22.402397+0000","last_undegraded":"2024-04-26T12:38:22.402397+0000","last_fullsized":"2024-04-26T12:38:22.402397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"26'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524269+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:38:21.524269+0000","last_peered":"2024-04-26T12:38:21.524269+0000","last_clean":"2024-04-26T12:38:21.524269+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:38:21.524269+0000","last_undegraded":"2024-04-26T12:38:21.524269+0000","last_fullsized":"2024-04-26T12:38:21.524269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.510703+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:38:21.510703+0000","last_peered":"2024-04-26T12:38:21.510703+0000","last_clean":"2024-04-26T12:38:21.510703+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:38:21.510703+0000","last_undegraded":"2024-04-26T12:38:21.510703+0000","last_fullsized":"2024-04-26T12:38:21.510703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494507+0000","last_change":"2024-04-26T12:38:12.449983+0000","last_active":"2024-04-26T12:38:21.494507+0000","last_peered":"2024-04-26T12:38:21.494507+0000","last_clean":"2024-04-26T12:38:21.494507+0000","last_became_active":"2024-04-26T12:38:12.445024+0000","last_became_peered":"2024-04-26T12:38:12.445024+0000","last_unstale":"2024-04-26T12:38:21.494507+0000","last_undegraded":"2024-04-26T12:38:21.494507+0000","last_fullsized":"2024-04-26T12:38:21.494507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504001+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:38:21.504001+0000","last_peered":"2024-04-26T12:38:21.504001+0000","last_clean":"2024-04-26T12:38:21.504001+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:38:21.504001+0000","last_undegraded":"2024-04-26T12:38:21.504001+0000","last_fullsized":"2024-04-26T12:38:21.504001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511495+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:38:21.511495+0000","last_peered":"2024-04-26T12:38:21.511495+0000","last_clean":"2024-04-26T12:38:21.511495+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:38:21.511495+0000","last_undegraded":"2024-04-26T12:38:21.511495+0000","last_fullsized":"2024-04-26T12:38:21.511495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.436526+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:38:22.436526+0000","last_peered":"2024-04-26T12:38:22.436526+0000","last_clean":"2024-04-26T12:38:22.436526+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:38:22.436526+0000","last_undegraded":"2024-04-26T12:38:22.436526+0000","last_fullsized":"2024-04-26T12:38:22.436526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.505519+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:38:21.505519+0000","last_peered":"2024-04-26T12:38:21.505519+0000","last_clean":"2024-04-26T12:38:21.505519+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:38:21.505519+0000","last_undegraded":"2024-04-26T12:38:21.505519+0000","last_fullsized":"2024-04-26T12:38:21.505519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.514265+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:38:21.514265+0000","last_peered":"2024-04-26T12:38:21.514265+0000","last_clean":"2024-04-26T12:38:21.514265+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:38:21.514265+0000","last_undegraded":"2024-04-26T12:38:21.514265+0000","last_fullsized":"2024-04-26T12:38:21.514265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495330+0000","last_change":"2024-04-26T12:38:12.439866+0000","last_active":"2024-04-26T12:38:21.495330+0000","last_peered":"2024-04-26T12:38:21.495330+0000","last_clean":"2024-04-26T12:38:21.495330+0000","last_became_active":"2024-04-26T12:38:12.439091+0000","last_became_peered":"2024-04-26T12:38:12.439091+0000","last_unstale":"2024-04-26T12:38:21.495330+0000","last_undegraded":"2024-04-26T12:38:21.495330+0000","last_fullsized":"2024-04-26T12:38:21.495330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504697+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:38:21.504697+0000","last_peered":"2024-04-26T12:38:21.504697+0000","last_clean":"2024-04-26T12:38:21.504697+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:38:21.504697+0000","last_undegraded":"2024-04-26T12:38:21.504697+0000","last_fullsized":"2024-04-26T12:38:21.504697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502774+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:38:21.502774+0000","last_peered":"2024-04-26T12:38:21.502774+0000","last_clean":"2024-04-26T12:38:21.502774+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:38:21.502774+0000","last_undegraded":"2024-04-26T12:38:21.502774+0000","last_fullsized":"2024-04-26T12:38:21.502774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.812758+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:38:21.812758+0000","last_peered":"2024-04-26T12:38:21.812758+0000","last_clean":"2024-04-26T12:38:21.812758+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:38:21.812758+0000","last_undegraded":"2024-04-26T12:38:21.812758+0000","last_fullsized":"2024-04-26T12:38:21.812758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521239+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:38:21.521239+0000","last_peered":"2024-04-26T12:38:21.521239+0000","last_clean":"2024-04-26T12:38:21.521239+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:38:21.521239+0000","last_undegraded":"2024-04-26T12:38:21.521239+0000","last_fullsized":"2024-04-26T12:38:21.521239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495362+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:38:21.495362+0000","last_peered":"2024-04-26T12:38:21.495362+0000","last_clean":"2024-04-26T12:38:21.495362+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:38:21.495362+0000","last_undegraded":"2024-04-26T12:38:21.495362+0000","last_fullsized":"2024-04-26T12:38:21.495362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492951+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:38:21.492951+0000","last_peered":"2024-04-26T12:38:21.492951+0000","last_clean":"2024-04-26T12:38:21.492951+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:38:21.492951+0000","last_undegraded":"2024-04-26T12:38:21.492951+0000","last_fullsized":"2024-04-26T12:38:21.492951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495974+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:38:21.495974+0000","last_peered":"2024-04-26T12:38:21.495974+0000","last_clean":"2024-04-26T12:38:21.495974+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:38:21.495974+0000","last_undegraded":"2024-04-26T12:38:21.495974+0000","last_fullsized":"2024-04-26T12:38:21.495974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493758+0000","last_change":"2024-04-26T12:38:14.454833+0000","last_active":"2024-04-26T12:38:21.493758+0000","last_peered":"2024-04-26T12:38:21.493758+0000","last_clean":"2024-04-26T12:38:21.493758+0000","last_became_active":"2024-04-26T12:38:14.454109+0000","last_became_peered":"2024-04-26T12:38:14.454109+0000","last_unstale":"2024-04-26T12:38:21.493758+0000","last_undegraded":"2024-04-26T12:38:21.493758+0000","last_fullsized":"2024-04-26T12:38:21.493758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"29'5","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.044462+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:38:22.044462+0000","last_peered":"2024-04-26T12:38:22.044462+0000","last_clean":"2024-04-26T12:38:22.044462+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:38:22.044462+0000","last_undegraded":"2024-04-26T12:38:22.044462+0000","last_fullsized":"2024-04-26T12:38:22.044462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494113+0000","last_change":"2024-04-26T12:38:18.476037+0000","last_active":"2024-04-26T12:38:21.494113+0000","last_peered":"2024-04-26T12:38:21.494113+0000","last_clean":"2024-04-26T12:38:21.494113+0000","last_became_active":"2024-04-26T12:38:18.475286+0000","last_became_peered":"2024-04-26T12:38:18.475286+0000","last_unstale":"2024-04-26T12:38:21.494113+0000","last_undegraded":"2024-04-26T12:38:21.494113+0000","last_fullsized":"2024-04-26T12:38:21.494113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512848+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:38:21.512848+0000","last_peered":"2024-04-26T12:38:21.512848+0000","last_clean":"2024-04-26T12:38:21.512848+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:38:21.512848+0000","last_undegraded":"2024-04-26T12:38:21.512848+0000","last_fullsized":"2024-04-26T12:38:21.512848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494341+0000","last_change":"2024-04-26T12:38:12.438062+0000","last_active":"2024-04-26T12:38:21.494341+0000","last_peered":"2024-04-26T12:38:21.494341+0000","last_clean":"2024-04-26T12:38:21.494341+0000","last_became_active":"2024-04-26T12:38:12.437302+0000","last_became_peered":"2024-04-26T12:38:12.437302+0000","last_unstale":"2024-04-26T12:38:21.494341+0000","last_undegraded":"2024-04-26T12:38:21.494341+0000","last_fullsized":"2024-04-26T12:38:21.494341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511133+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:38:21.511133+0000","last_peered":"2024-04-26T12:38:21.511133+0000","last_clean":"2024-04-26T12:38:21.511133+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:38:21.511133+0000","last_undegraded":"2024-04-26T12:38:21.511133+0000","last_fullsized":"2024-04-26T12:38:21.511133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491337+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:38:21.491337+0000","last_peered":"2024-04-26T12:38:21.491337+0000","last_clean":"2024-04-26T12:38:21.491337+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:38:21.491337+0000","last_undegraded":"2024-04-26T12:38:21.491337+0000","last_fullsized":"2024-04-26T12:38:21.491337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.117019+0000","last_change":"2024-04-26T12:38:16.464070+0000","last_active":"2024-04-26T12:38:22.117019+0000","last_peered":"2024-04-26T12:38:22.117019+0000","last_clean":"2024-04-26T12:38:22.117019+0000","last_became_active":"2024-04-26T12:38:16.463281+0000","last_became_peered":"2024-04-26T12:38:16.463281+0000","last_unstale":"2024-04-26T12:38:22.117019+0000","last_undegraded":"2024-04-26T12:38:22.117019+0000","last_fullsized":"2024-04-26T12:38:22.117019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:58.107169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507266+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:38:21.507266+0000","last_peered":"2024-04-26T12:38:21.507266+0000","last_clean":"2024-04-26T12:38:21.507266+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:38:21.507266+0000","last_undegraded":"2024-04-26T12:38:21.507266+0000","last_fullsized":"2024-04-26T12:38:21.507266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496957+0000","last_change":"2024-04-26T12:38:20.503205+0000","last_active":"2024-04-26T12:38:21.496957+0000","last_peered":"2024-04-26T12:38:21.496957+0000","last_clean":"2024-04-26T12:38:21.496957+0000","last_became_active":"2024-04-26T12:38:20.502345+0000","last_became_peered":"2024-04-26T12:38:20.502345+0000","last_unstale":"2024-04-26T12:38:21.496957+0000","last_undegraded":"2024-04-26T12:38:21.496957+0000","last_fullsized":"2024-04-26T12:38:21.496957+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497950+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:38:21.497950+0000","last_peered":"2024-04-26T12:38:21.497950+0000","last_clean":"2024-04-26T12:38:21.497950+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:38:21.497950+0000","last_undegraded":"2024-04-26T12:38:21.497950+0000","last_fullsized":"2024-04-26T12:38:21.497950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521143+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:38:21.521143+0000","last_peered":"2024-04-26T12:38:21.521143+0000","last_clean":"2024-04-26T12:38:21.521143+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:38:21.521143+0000","last_undegraded":"2024-04-26T12:38:21.521143+0000","last_fullsized":"2024-04-26T12:38:21.521143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497563+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:38:21.497563+0000","last_peered":"2024-04-26T12:38:21.497563+0000","last_clean":"2024-04-26T12:38:21.497563+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:38:21.497563+0000","last_undegraded":"2024-04-26T12:38:21.497563+0000","last_fullsized":"2024-04-26T12:38:21.497563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536523+0000","last_change":"2024-04-26T12:38:10.436330+0000","last_active":"2024-04-26T12:38:21.536523+0000","last_peered":"2024-04-26T12:38:21.536523+0000","last_clean":"2024-04-26T12:38:21.536523+0000","last_became_active":"2024-04-26T12:38:10.435576+0000","last_became_peered":"2024-04-26T12:38:10.435576+0000","last_unstale":"2024-04-26T12:38:21.536523+0000","last_undegraded":"2024-04-26T12:38:21.536523+0000","last_fullsized":"2024-04-26T12:38:21.536523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.428203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503906+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:38:21.503906+0000","last_peered":"2024-04-26T12:38:21.503906+0000","last_clean":"2024-04-26T12:38:21.503906+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:38:21.503906+0000","last_undegraded":"2024-04-26T12:38:21.503906+0000","last_fullsized":"2024-04-26T12:38:21.503906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503397+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:38:21.503397+0000","last_peered":"2024-04-26T12:38:21.503397+0000","last_clean":"2024-04-26T12:38:21.503397+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:38:21.503397+0000","last_undegraded":"2024-04-26T12:38:21.503397+0000","last_fullsized":"2024-04-26T12:38:21.503397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494703+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:38:21.494703+0000","last_peered":"2024-04-26T12:38:21.494703+0000","last_clean":"2024-04-26T12:38:21.494703+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:38:21.494703+0000","last_undegraded":"2024-04-26T12:38:21.494703+0000","last_fullsized":"2024-04-26T12:38:21.494703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507957+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:38:21.507957+0000","last_peered":"2024-04-26T12:38:21.507957+0000","last_clean":"2024-04-26T12:38:21.507957+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:38:21.507957+0000","last_undegraded":"2024-04-26T12:38:21.507957+0000","last_fullsized":"2024-04-26T12:38:21.507957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495480+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:38:21.495480+0000","last_peered":"2024-04-26T12:38:21.495480+0000","last_clean":"2024-04-26T12:38:21.495480+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:38:21.495480+0000","last_undegraded":"2024-04-26T12:38:21.495480+0000","last_fullsized":"2024-04-26T12:38:21.495480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496230+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:38:21.496230+0000","last_peered":"2024-04-26T12:38:21.496230+0000","last_clean":"2024-04-26T12:38:21.496230+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:38:21.496230+0000","last_undegraded":"2024-04-26T12:38:21.496230+0000","last_fullsized":"2024-04-26T12:38:21.496230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495507+0000","last_change":"2024-04-26T12:38:12.457598+0000","last_active":"2024-04-26T12:38:21.495507+0000","last_peered":"2024-04-26T12:38:21.495507+0000","last_clean":"2024-04-26T12:38:21.495507+0000","last_became_active":"2024-04-26T12:38:12.456792+0000","last_became_peered":"2024-04-26T12:38:12.456792+0000","last_unstale":"2024-04-26T12:38:21.495507+0000","last_undegraded":"2024-04-26T12:38:21.495507+0000","last_fullsized":"2024-04-26T12:38:21.495507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497091+0000","last_change":"2024-04-26T12:38:10.446304+0000","last_active":"2024-04-26T12:38:21.497091+0000","last_peered":"2024-04-26T12:38:21.497091+0000","last_clean":"2024-04-26T12:38:21.497091+0000","last_became_active":"2024-04-26T12:38:10.445526+0000","last_became_peered":"2024-04-26T12:38:10.445526+0000","last_unstale":"2024-04-26T12:38:21.497091+0000","last_undegraded":"2024-04-26T12:38:21.497091+0000","last_fullsized":"2024-04-26T12:38:21.497091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492543+0000","last_change":"2024-04-26T12:38:12.448125+0000","last_active":"2024-04-26T12:38:21.492543+0000","last_peered":"2024-04-26T12:38:21.492543+0000","last_clean":"2024-04-26T12:38:21.492543+0000","last_became_active":"2024-04-26T12:38:12.444323+0000","last_became_peered":"2024-04-26T12:38:12.444323+0000","last_unstale":"2024-04-26T12:38:21.492543+0000","last_undegraded":"2024-04-26T12:38:21.492543+0000","last_fullsized":"2024-04-26T12:38:21.492543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524186+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:38:21.524186+0000","last_peered":"2024-04-26T12:38:21.524186+0000","last_clean":"2024-04-26T12:38:21.524186+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:38:21.524186+0000","last_undegraded":"2024-04-26T12:38:21.524186+0000","last_fullsized":"2024-04-26T12:38:21.524186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521013+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:38:21.521013+0000","last_peered":"2024-04-26T12:38:21.521013+0000","last_clean":"2024-04-26T12:38:21.521013+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:38:21.521013+0000","last_undegraded":"2024-04-26T12:38:21.521013+0000","last_fullsized":"2024-04-26T12:38:21.521013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495338+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:38:21.495338+0000","last_peered":"2024-04-26T12:38:21.495338+0000","last_clean":"2024-04-26T12:38:21.495338+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:38:21.495338+0000","last_undegraded":"2024-04-26T12:38:21.495338+0000","last_fullsized":"2024-04-26T12:38:21.495338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511310+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:38:21.511310+0000","last_peered":"2024-04-26T12:38:21.511310+0000","last_clean":"2024-04-26T12:38:21.511310+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:38:21.511310+0000","last_undegraded":"2024-04-26T12:38:21.511310+0000","last_fullsized":"2024-04-26T12:38:21.511310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504010+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:38:21.504010+0000","last_peered":"2024-04-26T12:38:21.504010+0000","last_clean":"2024-04-26T12:38:21.504010+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:38:21.504010+0000","last_undegraded":"2024-04-26T12:38:21.504010+0000","last_fullsized":"2024-04-26T12:38:21.504010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496519+0000","last_change":"2024-04-26T12:38:12.447248+0000","last_active":"2024-04-26T12:38:21.496519+0000","last_peered":"2024-04-26T12:38:21.496519+0000","last_clean":"2024-04-26T12:38:21.496519+0000","last_became_active":"2024-04-26T12:38:12.446444+0000","last_became_peered":"2024-04-26T12:38:12.446444+0000","last_unstale":"2024-04-26T12:38:21.496519+0000","last_undegraded":"2024-04-26T12:38:21.496519+0000","last_fullsized":"2024-04-26T12:38:21.496519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493001+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:38:21.493001+0000","last_peered":"2024-04-26T12:38:21.493001+0000","last_clean":"2024-04-26T12:38:21.493001+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:38:21.493001+0000","last_undegraded":"2024-04-26T12:38:21.493001+0000","last_fullsized":"2024-04-26T12:38:21.493001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537873+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:38:21.537873+0000","last_peered":"2024-04-26T12:38:21.537873+0000","last_clean":"2024-04-26T12:38:21.537873+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:38:21.537873+0000","last_undegraded":"2024-04-26T12:38:21.537873+0000","last_fullsized":"2024-04-26T12:38:21.537873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503305+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:38:21.503305+0000","last_peered":"2024-04-26T12:38:21.503305+0000","last_clean":"2024-04-26T12:38:21.503305+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:38:21.503305+0000","last_undegraded":"2024-04-26T12:38:21.503305+0000","last_fullsized":"2024-04-26T12:38:21.503305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496150+0000","last_change":"2024-04-26T12:38:12.455971+0000","last_active":"2024-04-26T12:38:21.496150+0000","last_peered":"2024-04-26T12:38:21.496150+0000","last_clean":"2024-04-26T12:38:21.496150+0000","last_became_active":"2024-04-26T12:38:12.455261+0000","last_became_peered":"2024-04-26T12:38:12.455261+0000","last_unstale":"2024-04-26T12:38:21.496150+0000","last_undegraded":"2024-04-26T12:38:21.496150+0000","last_fullsized":"2024-04-26T12:38:21.496150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508246+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:38:21.508246+0000","last_peered":"2024-04-26T12:38:21.508246+0000","last_clean":"2024-04-26T12:38:21.508246+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:38:21.508246+0000","last_undegraded":"2024-04-26T12:38:21.508246+0000","last_fullsized":"2024-04-26T12:38:21.508246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511798+0000","last_change":"2024-04-26T12:38:12.464343+0000","last_active":"2024-04-26T12:38:21.511798+0000","last_peered":"2024-04-26T12:38:21.511798+0000","last_clean":"2024-04-26T12:38:21.511798+0000","last_became_active":"2024-04-26T12:38:12.463599+0000","last_became_peered":"2024-04-26T12:38:12.463599+0000","last_unstale":"2024-04-26T12:38:21.511798+0000","last_undegraded":"2024-04-26T12:38:21.511798+0000","last_fullsized":"2024-04-26T12:38:21.511798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.523244+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:38:21.523244+0000","last_peered":"2024-04-26T12:38:21.523244+0000","last_clean":"2024-04-26T12:38:21.523244+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:38:21.523244+0000","last_undegraded":"2024-04-26T12:38:21.523244+0000","last_fullsized":"2024-04-26T12:38:21.523244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.506266+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:38:21.506266+0000","last_peered":"2024-04-26T12:38:21.506266+0000","last_clean":"2024-04-26T12:38:21.506266+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:38:21.506266+0000","last_undegraded":"2024-04-26T12:38:21.506266+0000","last_fullsized":"2024-04-26T12:38:21.506266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513431+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:38:21.513431+0000","last_peered":"2024-04-26T12:38:21.513431+0000","last_clean":"2024-04-26T12:38:21.513431+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:38:21.513431+0000","last_undegraded":"2024-04-26T12:38:21.513431+0000","last_fullsized":"2024-04-26T12:38:21.513431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492462+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:38:21.492462+0000","last_peered":"2024-04-26T12:38:21.492462+0000","last_clean":"2024-04-26T12:38:21.492462+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:38:21.492462+0000","last_undegraded":"2024-04-26T12:38:21.492462+0000","last_fullsized":"2024-04-26T12:38:21.492462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.538533+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:38:21.538533+0000","last_peered":"2024-04-26T12:38:21.538533+0000","last_clean":"2024-04-26T12:38:21.538533+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:38:21.538533+0000","last_undegraded":"2024-04-26T12:38:21.538533+0000","last_fullsized":"2024-04-26T12:38:21.538533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.510882+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:38:21.510882+0000","last_peered":"2024-04-26T12:38:21.510882+0000","last_clean":"2024-04-26T12:38:21.510882+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:38:21.510882+0000","last_undegraded":"2024-04-26T12:38:21.510882+0000","last_fullsized":"2024-04-26T12:38:21.510882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504825+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:38:21.504825+0000","last_peered":"2024-04-26T12:38:21.504825+0000","last_clean":"2024-04-26T12:38:21.504825+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:38:21.504825+0000","last_undegraded":"2024-04-26T12:38:21.504825+0000","last_fullsized":"2024-04-26T12:38:21.504825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503759+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:38:21.503759+0000","last_peered":"2024-04-26T12:38:21.503759+0000","last_clean":"2024-04-26T12:38:21.503759+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:38:21.503759+0000","last_undegraded":"2024-04-26T12:38:21.503759+0000","last_fullsized":"2024-04-26T12:38:21.503759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.509739+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:38:21.509739+0000","last_peered":"2024-04-26T12:38:21.509739+0000","last_clean":"2024-04-26T12:38:21.509739+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:38:21.509739+0000","last_undegraded":"2024-04-26T12:38:21.509739+0000","last_fullsized":"2024-04-26T12:38:21.509739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491993+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:38:21.491993+0000","last_peered":"2024-04-26T12:38:21.491993+0000","last_clean":"2024-04-26T12:38:21.491993+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:38:21.491993+0000","last_undegraded":"2024-04-26T12:38:21.491993+0000","last_fullsized":"2024-04-26T12:38:21.491993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504228+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:38:21.504228+0000","last_peered":"2024-04-26T12:38:21.504228+0000","last_clean":"2024-04-26T12:38:21.504228+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:38:21.504228+0000","last_undegraded":"2024-04-26T12:38:21.504228+0000","last_fullsized":"2024-04-26T12:38:21.504228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":734425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":143397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":145654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":142895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":360448,"data_stored":143793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":335872,"data_stored":143395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":144640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":942080,"data_stored":733831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:38:28.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:38:28.802 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:38:28.810 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:38:28.826 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-26T12:38:28.681581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236716,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738004,"statfs":{"total":773094113280,"available":772851716096,"internally_reserved":0,"allocated":4038656,"data_stored":2332030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.197226"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513744+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:38:21.513744+0000","last_peered":"2024-04-26T12:38:21.513744+0000","last_clean":"2024-04-26T12:38:21.513744+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:38:21.513744+0000","last_undegraded":"2024-04-26T12:38:21.513744+0000","last_fullsized":"2024-04-26T12:38:21.513744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502484+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:38:21.502484+0000","last_peered":"2024-04-26T12:38:21.502484+0000","last_clean":"2024-04-26T12:38:21.502484+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:38:21.502484+0000","last_undegraded":"2024-04-26T12:38:21.502484+0000","last_fullsized":"2024-04-26T12:38:21.502484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497793+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:38:21.497793+0000","last_peered":"2024-04-26T12:38:21.497793+0000","last_clean":"2024-04-26T12:38:21.497793+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:38:21.497793+0000","last_undegraded":"2024-04-26T12:38:21.497793+0000","last_fullsized":"2024-04-26T12:38:21.497793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511771+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:38:21.511771+0000","last_peered":"2024-04-26T12:38:21.511771+0000","last_clean":"2024-04-26T12:38:21.511771+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:38:21.511771+0000","last_undegraded":"2024-04-26T12:38:21.511771+0000","last_fullsized":"2024-04-26T12:38:21.511771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508676+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:38:21.508676+0000","last_peered":"2024-04-26T12:38:21.508676+0000","last_clean":"2024-04-26T12:38:21.508676+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:38:21.508676+0000","last_undegraded":"2024-04-26T12:38:21.508676+0000","last_fullsized":"2024-04-26T12:38:21.508676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494997+0000","last_change":"2024-04-26T12:38:12.451601+0000","last_active":"2024-04-26T12:38:21.494997+0000","last_peered":"2024-04-26T12:38:21.494997+0000","last_clean":"2024-04-26T12:38:21.494997+0000","last_became_active":"2024-04-26T12:38:12.450849+0000","last_became_peered":"2024-04-26T12:38:12.450849+0000","last_unstale":"2024-04-26T12:38:21.494997+0000","last_undegraded":"2024-04-26T12:38:21.494997+0000","last_fullsized":"2024-04-26T12:38:21.494997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503726+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:38:21.503726+0000","last_peered":"2024-04-26T12:38:21.503726+0000","last_clean":"2024-04-26T12:38:21.503726+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:38:21.503726+0000","last_undegraded":"2024-04-26T12:38:21.503726+0000","last_fullsized":"2024-04-26T12:38:21.503726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507580+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:38:21.507580+0000","last_peered":"2024-04-26T12:38:21.507580+0000","last_clean":"2024-04-26T12:38:21.507580+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:38:21.507580+0000","last_undegraded":"2024-04-26T12:38:21.507580+0000","last_fullsized":"2024-04-26T12:38:21.507580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512121+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:38:21.512121+0000","last_peered":"2024-04-26T12:38:21.512121+0000","last_clean":"2024-04-26T12:38:21.512121+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:38:21.512121+0000","last_undegraded":"2024-04-26T12:38:21.512121+0000","last_fullsized":"2024-04-26T12:38:21.512121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.522967+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:38:21.522967+0000","last_peered":"2024-04-26T12:38:21.522967+0000","last_clean":"2024-04-26T12:38:21.522967+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:38:21.522967+0000","last_undegraded":"2024-04-26T12:38:21.522967+0000","last_fullsized":"2024-04-26T12:38:21.522967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502798+0000","last_change":"2024-04-26T12:38:10.458364+0000","last_active":"2024-04-26T12:38:21.502798+0000","last_peered":"2024-04-26T12:38:21.502798+0000","last_clean":"2024-04-26T12:38:21.502798+0000","last_became_active":"2024-04-26T12:38:10.457610+0000","last_became_peered":"2024-04-26T12:38:10.457610+0000","last_unstale":"2024-04-26T12:38:21.502798+0000","last_undegraded":"2024-04-26T12:38:21.502798+0000","last_fullsized":"2024-04-26T12:38:21.502798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496193+0000","last_change":"2024-04-26T12:38:12.451810+0000","last_active":"2024-04-26T12:38:21.496193+0000","last_peered":"2024-04-26T12:38:21.496193+0000","last_clean":"2024-04-26T12:38:21.496193+0000","last_became_active":"2024-04-26T12:38:12.450926+0000","last_became_peered":"2024-04-26T12:38:12.450926+0000","last_unstale":"2024-04-26T12:38:21.496193+0000","last_undegraded":"2024-04-26T12:38:21.496193+0000","last_fullsized":"2024-04-26T12:38:21.496193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512043+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:38:21.512043+0000","last_peered":"2024-04-26T12:38:21.512043+0000","last_clean":"2024-04-26T12:38:21.512043+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:38:21.512043+0000","last_undegraded":"2024-04-26T12:38:21.512043+0000","last_fullsized":"2024-04-26T12:38:21.512043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503886+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:38:21.503886+0000","last_peered":"2024-04-26T12:38:21.503886+0000","last_clean":"2024-04-26T12:38:21.503886+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:38:21.503886+0000","last_undegraded":"2024-04-26T12:38:21.503886+0000","last_fullsized":"2024-04-26T12:38:21.503886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493301+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:38:21.493301+0000","last_peered":"2024-04-26T12:38:21.493301+0000","last_clean":"2024-04-26T12:38:21.493301+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:38:21.493301+0000","last_undegraded":"2024-04-26T12:38:21.493301+0000","last_fullsized":"2024-04-26T12:38:21.493301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.538310+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:38:21.538310+0000","last_peered":"2024-04-26T12:38:21.538310+0000","last_clean":"2024-04-26T12:38:21.538310+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:38:21.538310+0000","last_undegraded":"2024-04-26T12:38:21.538310+0000","last_fullsized":"2024-04-26T12:38:21.538310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494188+0000","last_change":"2024-04-26T12:38:12.452715+0000","last_active":"2024-04-26T12:38:21.494188+0000","last_peered":"2024-04-26T12:38:21.494188+0000","last_clean":"2024-04-26T12:38:21.494188+0000","last_became_active":"2024-04-26T12:38:12.451136+0000","last_became_peered":"2024-04-26T12:38:12.451136+0000","last_unstale":"2024-04-26T12:38:21.494188+0000","last_undegraded":"2024-04-26T12:38:21.494188+0000","last_fullsized":"2024-04-26T12:38:21.494188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513740+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:38:21.513740+0000","last_peered":"2024-04-26T12:38:21.513740+0000","last_clean":"2024-04-26T12:38:21.513740+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:38:21.513740+0000","last_undegraded":"2024-04-26T12:38:21.513740+0000","last_fullsized":"2024-04-26T12:38:21.513740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511947+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:38:21.511947+0000","last_peered":"2024-04-26T12:38:21.511947+0000","last_clean":"2024-04-26T12:38:21.511947+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:38:21.511947+0000","last_undegraded":"2024-04-26T12:38:21.511947+0000","last_fullsized":"2024-04-26T12:38:21.511947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.523979+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:38:21.523979+0000","last_peered":"2024-04-26T12:38:21.523979+0000","last_clean":"2024-04-26T12:38:21.523979+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:38:21.523979+0000","last_undegraded":"2024-04-26T12:38:21.523979+0000","last_fullsized":"2024-04-26T12:38:21.523979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503147+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:38:21.503147+0000","last_peered":"2024-04-26T12:38:21.503147+0000","last_clean":"2024-04-26T12:38:21.503147+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:38:21.503147+0000","last_undegraded":"2024-04-26T12:38:21.503147+0000","last_fullsized":"2024-04-26T12:38:21.503147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524089+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:38:21.524089+0000","last_peered":"2024-04-26T12:38:21.524089+0000","last_clean":"2024-04-26T12:38:21.524089+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:38:21.524089+0000","last_undegraded":"2024-04-26T12:38:21.524089+0000","last_fullsized":"2024-04-26T12:38:21.524089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536949+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:38:21.536949+0000","last_peered":"2024-04-26T12:38:21.536949+0000","last_clean":"2024-04-26T12:38:21.536949+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:38:21.536949+0000","last_undegraded":"2024-04-26T12:38:21.536949+0000","last_fullsized":"2024-04-26T12:38:21.536949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495339+0000","last_change":"2024-04-26T12:38:10.455020+0000","last_active":"2024-04-26T12:38:21.495339+0000","last_peered":"2024-04-26T12:38:21.495339+0000","last_clean":"2024-04-26T12:38:21.495339+0000","last_became_active":"2024-04-26T12:38:10.454255+0000","last_became_peered":"2024-04-26T12:38:10.454255+0000","last_unstale":"2024-04-26T12:38:21.495339+0000","last_undegraded":"2024-04-26T12:38:21.495339+0000","last_fullsized":"2024-04-26T12:38:21.495339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.149264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537779+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:38:21.537779+0000","last_peered":"2024-04-26T12:38:21.537779+0000","last_clean":"2024-04-26T12:38:21.537779+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:38:21.537779+0000","last_undegraded":"2024-04-26T12:38:21.537779+0000","last_fullsized":"2024-04-26T12:38:21.537779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494259+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:38:21.494259+0000","last_peered":"2024-04-26T12:38:21.494259+0000","last_clean":"2024-04-26T12:38:21.494259+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:38:21.494259+0000","last_undegraded":"2024-04-26T12:38:21.494259+0000","last_fullsized":"2024-04-26T12:38:21.494259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496054+0000","last_change":"2024-04-26T12:38:12.448918+0000","last_active":"2024-04-26T12:38:21.496054+0000","last_peered":"2024-04-26T12:38:21.496054+0000","last_clean":"2024-04-26T12:38:21.496054+0000","last_became_active":"2024-04-26T12:38:12.448093+0000","last_became_peered":"2024-04-26T12:38:12.448093+0000","last_unstale":"2024-04-26T12:38:21.496054+0000","last_undegraded":"2024-04-26T12:38:21.496054+0000","last_fullsized":"2024-04-26T12:38:21.496054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507290+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:38:21.507290+0000","last_peered":"2024-04-26T12:38:21.507290+0000","last_clean":"2024-04-26T12:38:21.507290+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:38:21.507290+0000","last_undegraded":"2024-04-26T12:38:21.507290+0000","last_fullsized":"2024-04-26T12:38:21.507290+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494006+0000","last_change":"2024-04-26T12:38:20.512422+0000","last_active":"2024-04-26T12:38:21.494006+0000","last_peered":"2024-04-26T12:38:21.494006+0000","last_clean":"2024-04-26T12:38:21.494006+0000","last_became_active":"2024-04-26T12:38:20.512129+0000","last_became_peered":"2024-04-26T12:38:20.512129+0000","last_unstale":"2024-04-26T12:38:21.494006+0000","last_undegraded":"2024-04-26T12:38:21.494006+0000","last_fullsized":"2024-04-26T12:38:21.494006+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495627+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:38:21.495627+0000","last_peered":"2024-04-26T12:38:21.495627+0000","last_clean":"2024-04-26T12:38:21.495627+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:38:21.495627+0000","last_undegraded":"2024-04-26T12:38:21.495627+0000","last_fullsized":"2024-04-26T12:38:21.495627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512370+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:38:21.512370+0000","last_peered":"2024-04-26T12:38:21.512370+0000","last_clean":"2024-04-26T12:38:21.512370+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:38:21.512370+0000","last_undegraded":"2024-04-26T12:38:21.512370+0000","last_fullsized":"2024-04-26T12:38:21.512370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503707+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:38:21.503707+0000","last_peered":"2024-04-26T12:38:21.503707+0000","last_clean":"2024-04-26T12:38:21.503707+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:38:21.503707+0000","last_undegraded":"2024-04-26T12:38:21.503707+0000","last_fullsized":"2024-04-26T12:38:21.503707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.895753+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:38:21.895753+0000","last_peered":"2024-04-26T12:38:21.895753+0000","last_clean":"2024-04-26T12:38:21.895753+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:38:21.895753+0000","last_undegraded":"2024-04-26T12:38:21.895753+0000","last_fullsized":"2024-04-26T12:38:21.895753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513057+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:38:21.513057+0000","last_peered":"2024-04-26T12:38:21.513057+0000","last_clean":"2024-04-26T12:38:21.513057+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:38:21.513057+0000","last_undegraded":"2024-04-26T12:38:21.513057+0000","last_fullsized":"2024-04-26T12:38:21.513057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502369+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:38:21.502369+0000","last_peered":"2024-04-26T12:38:21.502369+0000","last_clean":"2024-04-26T12:38:21.502369+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:38:21.502369+0000","last_undegraded":"2024-04-26T12:38:21.502369+0000","last_fullsized":"2024-04-26T12:38:21.502369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504557+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:38:21.504557+0000","last_peered":"2024-04-26T12:38:21.504557+0000","last_clean":"2024-04-26T12:38:21.504557+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:38:21.504557+0000","last_undegraded":"2024-04-26T12:38:21.504557+0000","last_fullsized":"2024-04-26T12:38:21.504557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507300+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:38:21.507300+0000","last_peered":"2024-04-26T12:38:21.507300+0000","last_clean":"2024-04-26T12:38:21.507300+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:38:21.507300+0000","last_undegraded":"2024-04-26T12:38:21.507300+0000","last_fullsized":"2024-04-26T12:38:21.507300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495219+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:38:21.495219+0000","last_peered":"2024-04-26T12:38:21.495219+0000","last_clean":"2024-04-26T12:38:21.495219+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:38:21.495219+0000","last_undegraded":"2024-04-26T12:38:21.495219+0000","last_fullsized":"2024-04-26T12:38:21.495219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.295172+0000","last_change":"2024-04-26T12:38:16.458863+0000","last_active":"2024-04-26T12:38:22.295172+0000","last_peered":"2024-04-26T12:38:22.295172+0000","last_clean":"2024-04-26T12:38:22.295172+0000","last_became_active":"2024-04-26T12:38:16.458097+0000","last_became_peered":"2024-04-26T12:38:16.458097+0000","last_unstale":"2024-04-26T12:38:22.295172+0000","last_undegraded":"2024-04-26T12:38:22.295172+0000","last_fullsized":"2024-04-26T12:38:22.295172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495852+0000","last_change":"2024-04-26T12:38:18.498229+0000","last_active":"2024-04-26T12:38:21.495852+0000","last_peered":"2024-04-26T12:38:21.495852+0000","last_clean":"2024-04-26T12:38:21.495852+0000","last_became_active":"2024-04-26T12:38:18.497486+0000","last_became_peered":"2024-04-26T12:38:18.497486+0000","last_unstale":"2024-04-26T12:38:21.495852+0000","last_undegraded":"2024-04-26T12:38:21.495852+0000","last_fullsized":"2024-04-26T12:38:21.495852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.506818+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:38:21.506818+0000","last_peered":"2024-04-26T12:38:21.506818+0000","last_clean":"2024-04-26T12:38:21.506818+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:38:21.506818+0000","last_undegraded":"2024-04-26T12:38:21.506818+0000","last_fullsized":"2024-04-26T12:38:21.506818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511965+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:38:21.511965+0000","last_peered":"2024-04-26T12:38:21.511965+0000","last_clean":"2024-04-26T12:38:21.511965+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:38:21.511965+0000","last_undegraded":"2024-04-26T12:38:21.511965+0000","last_fullsized":"2024-04-26T12:38:21.511965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512190+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:38:21.512190+0000","last_peered":"2024-04-26T12:38:21.512190+0000","last_clean":"2024-04-26T12:38:21.512190+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:38:21.512190+0000","last_undegraded":"2024-04-26T12:38:21.512190+0000","last_fullsized":"2024-04-26T12:38:21.512190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.498954+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:38:21.498954+0000","last_peered":"2024-04-26T12:38:21.498954+0000","last_clean":"2024-04-26T12:38:21.498954+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:38:21.498954+0000","last_undegraded":"2024-04-26T12:38:21.498954+0000","last_fullsized":"2024-04-26T12:38:21.498954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.350584+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:38:22.350584+0000","last_peered":"2024-04-26T12:38:22.350584+0000","last_clean":"2024-04-26T12:38:22.350584+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:38:22.350584+0000","last_undegraded":"2024-04-26T12:38:22.350584+0000","last_fullsized":"2024-04-26T12:38:22.350584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511938+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:38:21.511938+0000","last_peered":"2024-04-26T12:38:21.511938+0000","last_clean":"2024-04-26T12:38:21.511938+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:38:21.511938+0000","last_undegraded":"2024-04-26T12:38:21.511938+0000","last_fullsized":"2024-04-26T12:38:21.511938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494842+0000","last_change":"2024-04-26T12:38:20.713393+0000","last_active":"2024-04-26T12:38:21.494842+0000","last_peered":"2024-04-26T12:38:21.494842+0000","last_clean":"2024-04-26T12:38:21.494842+0000","last_became_active":"2024-04-26T12:38:20.712649+0000","last_became_peered":"2024-04-26T12:38:20.712649+0000","last_unstale":"2024-04-26T12:38:21.494842+0000","last_undegraded":"2024-04-26T12:38:21.494842+0000","last_fullsized":"2024-04-26T12:38:21.494842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495199+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:38:21.495199+0000","last_peered":"2024-04-26T12:38:21.495199+0000","last_clean":"2024-04-26T12:38:21.495199+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:38:21.495199+0000","last_undegraded":"2024-04-26T12:38:21.495199+0000","last_fullsized":"2024-04-26T12:38:21.495199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521264+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:38:21.521264+0000","last_peered":"2024-04-26T12:38:21.521264+0000","last_clean":"2024-04-26T12:38:21.521264+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:38:21.521264+0000","last_undegraded":"2024-04-26T12:38:21.521264+0000","last_fullsized":"2024-04-26T12:38:21.521264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503644+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:38:21.503644+0000","last_peered":"2024-04-26T12:38:21.503644+0000","last_clean":"2024-04-26T12:38:21.503644+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:38:21.503644+0000","last_undegraded":"2024-04-26T12:38:21.503644+0000","last_fullsized":"2024-04-26T12:38:21.503644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.358883+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:38:22.358883+0000","last_peered":"2024-04-26T12:38:22.358883+0000","last_clean":"2024-04-26T12:38:22.358883+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:38:22.358883+0000","last_undegraded":"2024-04-26T12:38:22.358883+0000","last_fullsized":"2024-04-26T12:38:22.358883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494474+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:38:21.494474+0000","last_peered":"2024-04-26T12:38:21.494474+0000","last_clean":"2024-04-26T12:38:21.494474+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:38:21.494474+0000","last_undegraded":"2024-04-26T12:38:21.494474+0000","last_fullsized":"2024-04-26T12:38:21.494474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503488+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:38:21.503488+0000","last_peered":"2024-04-26T12:38:21.503488+0000","last_clean":"2024-04-26T12:38:21.503488+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:38:21.503488+0000","last_undegraded":"2024-04-26T12:38:21.503488+0000","last_fullsized":"2024-04-26T12:38:21.503488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513985+0000","last_change":"2024-04-26T12:38:10.472878+0000","last_active":"2024-04-26T12:38:21.513985+0000","last_peered":"2024-04-26T12:38:21.513985+0000","last_clean":"2024-04-26T12:38:21.513985+0000","last_became_active":"2024-04-26T12:38:10.471901+0000","last_became_peered":"2024-04-26T12:38:10.471901+0000","last_unstale":"2024-04-26T12:38:21.513985+0000","last_undegraded":"2024-04-26T12:38:21.513985+0000","last_fullsized":"2024-04-26T12:38:21.513985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511030+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:38:21.511030+0000","last_peered":"2024-04-26T12:38:21.511030+0000","last_clean":"2024-04-26T12:38:21.511030+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:38:21.511030+0000","last_undegraded":"2024-04-26T12:38:21.511030+0000","last_fullsized":"2024-04-26T12:38:21.511030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"29'19","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.457877+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:38:22.457877+0000","last_peered":"2024-04-26T12:38:22.457877+0000","last_clean":"2024-04-26T12:38:22.457877+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:38:22.457877+0000","last_undegraded":"2024-04-26T12:38:22.457877+0000","last_fullsized":"2024-04-26T12:38:22.457877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492862+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:38:21.492862+0000","last_peered":"2024-04-26T12:38:21.492862+0000","last_clean":"2024-04-26T12:38:21.492862+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:38:21.492862+0000","last_undegraded":"2024-04-26T12:38:21.492862+0000","last_fullsized":"2024-04-26T12:38:21.492862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503222+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:38:21.503222+0000","last_peered":"2024-04-26T12:38:21.503222+0000","last_clean":"2024-04-26T12:38:21.503222+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:38:21.503222+0000","last_undegraded":"2024-04-26T12:38:21.503222+0000","last_fullsized":"2024-04-26T12:38:21.503222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494295+0000","last_change":"2024-04-26T12:38:12.451622+0000","last_active":"2024-04-26T12:38:21.494295+0000","last_peered":"2024-04-26T12:38:21.494295+0000","last_clean":"2024-04-26T12:38:21.494295+0000","last_became_active":"2024-04-26T12:38:12.449737+0000","last_became_peered":"2024-04-26T12:38:12.449737+0000","last_unstale":"2024-04-26T12:38:21.494295+0000","last_undegraded":"2024-04-26T12:38:21.494295+0000","last_fullsized":"2024-04-26T12:38:21.494295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513305+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:38:21.513305+0000","last_peered":"2024-04-26T12:38:21.513305+0000","last_clean":"2024-04-26T12:38:21.513305+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:38:21.513305+0000","last_undegraded":"2024-04-26T12:38:21.513305+0000","last_fullsized":"2024-04-26T12:38:21.513305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536524+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:38:21.536524+0000","last_peered":"2024-04-26T12:38:21.536524+0000","last_clean":"2024-04-26T12:38:21.536524+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:38:21.536524+0000","last_undegraded":"2024-04-26T12:38:21.536524+0000","last_fullsized":"2024-04-26T12:38:21.536524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.329717+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:38:22.329717+0000","last_peered":"2024-04-26T12:38:22.329717+0000","last_clean":"2024-04-26T12:38:22.329717+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:38:22.329717+0000","last_undegraded":"2024-04-26T12:38:22.329717+0000","last_fullsized":"2024-04-26T12:38:22.329717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492897+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:38:21.492897+0000","last_peered":"2024-04-26T12:38:21.492897+0000","last_clean":"2024-04-26T12:38:21.492897+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:38:21.492897+0000","last_undegraded":"2024-04-26T12:38:21.492897+0000","last_fullsized":"2024-04-26T12:38:21.492897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.522768+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:38:21.522768+0000","last_peered":"2024-04-26T12:38:21.522768+0000","last_clean":"2024-04-26T12:38:21.522768+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:38:21.522768+0000","last_undegraded":"2024-04-26T12:38:21.522768+0000","last_fullsized":"2024-04-26T12:38:21.522768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521974+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:38:21.521974+0000","last_peered":"2024-04-26T12:38:21.521974+0000","last_clean":"2024-04-26T12:38:21.521974+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:38:21.521974+0000","last_undegraded":"2024-04-26T12:38:21.521974+0000","last_fullsized":"2024-04-26T12:38:21.521974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513197+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:38:21.513197+0000","last_peered":"2024-04-26T12:38:21.513197+0000","last_clean":"2024-04-26T12:38:21.513197+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:38:21.513197+0000","last_undegraded":"2024-04-26T12:38:21.513197+0000","last_fullsized":"2024-04-26T12:38:21.513197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537349+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:38:21.537349+0000","last_peered":"2024-04-26T12:38:21.537349+0000","last_clean":"2024-04-26T12:38:21.537349+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:38:21.537349+0000","last_undegraded":"2024-04-26T12:38:21.537349+0000","last_fullsized":"2024-04-26T12:38:21.537349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.244659+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:38:22.244659+0000","last_peered":"2024-04-26T12:38:22.244659+0000","last_clean":"2024-04-26T12:38:22.244659+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:38:22.244659+0000","last_undegraded":"2024-04-26T12:38:22.244659+0000","last_fullsized":"2024-04-26T12:38:22.244659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.506138+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:38:21.506138+0000","last_peered":"2024-04-26T12:38:21.506138+0000","last_clean":"2024-04-26T12:38:21.506138+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:38:21.506138+0000","last_undegraded":"2024-04-26T12:38:21.506138+0000","last_fullsized":"2024-04-26T12:38:21.506138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.509854+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:38:21.509854+0000","last_peered":"2024-04-26T12:38:21.509854+0000","last_clean":"2024-04-26T12:38:21.509854+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:38:21.509854+0000","last_undegraded":"2024-04-26T12:38:21.509854+0000","last_fullsized":"2024-04-26T12:38:21.509854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508736+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:38:21.508736+0000","last_peered":"2024-04-26T12:38:21.508736+0000","last_clean":"2024-04-26T12:38:21.508736+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:38:21.508736+0000","last_undegraded":"2024-04-26T12:38:21.508736+0000","last_fullsized":"2024-04-26T12:38:21.508736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504248+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:38:21.504248+0000","last_peered":"2024-04-26T12:38:21.504248+0000","last_clean":"2024-04-26T12:38:21.504248+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:38:21.504248+0000","last_undegraded":"2024-04-26T12:38:21.504248+0000","last_fullsized":"2024-04-26T12:38:21.504248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536832+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:38:21.536832+0000","last_peered":"2024-04-26T12:38:21.536832+0000","last_clean":"2024-04-26T12:38:21.536832+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:38:21.536832+0000","last_undegraded":"2024-04-26T12:38:21.536832+0000","last_fullsized":"2024-04-26T12:38:21.536832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.857199+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:38:21.857199+0000","last_peered":"2024-04-26T12:38:21.857199+0000","last_clean":"2024-04-26T12:38:21.857199+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:38:21.857199+0000","last_undegraded":"2024-04-26T12:38:21.857199+0000","last_fullsized":"2024-04-26T12:38:21.857199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536322+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:38:21.536322+0000","last_peered":"2024-04-26T12:38:21.536322+0000","last_clean":"2024-04-26T12:38:21.536322+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:38:21.536322+0000","last_undegraded":"2024-04-26T12:38:21.536322+0000","last_fullsized":"2024-04-26T12:38:21.536322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497930+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:38:21.497930+0000","last_peered":"2024-04-26T12:38:21.497930+0000","last_clean":"2024-04-26T12:38:21.497930+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:38:21.497930+0000","last_undegraded":"2024-04-26T12:38:21.497930+0000","last_fullsized":"2024-04-26T12:38:21.497930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496008+0000","last_change":"2024-04-26T12:38:12.437210+0000","last_active":"2024-04-26T12:38:21.496008+0000","last_peered":"2024-04-26T12:38:21.496008+0000","last_clean":"2024-04-26T12:38:21.496008+0000","last_became_active":"2024-04-26T12:38:12.436501+0000","last_became_peered":"2024-04-26T12:38:12.436501+0000","last_unstale":"2024-04-26T12:38:21.496008+0000","last_undegraded":"2024-04-26T12:38:21.496008+0000","last_fullsized":"2024-04-26T12:38:21.496008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493561+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:38:21.493561+0000","last_peered":"2024-04-26T12:38:21.493561+0000","last_clean":"2024-04-26T12:38:21.493561+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:38:21.493561+0000","last_undegraded":"2024-04-26T12:38:21.493561+0000","last_fullsized":"2024-04-26T12:38:21.493561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537610+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:38:21.537610+0000","last_peered":"2024-04-26T12:38:21.537610+0000","last_clean":"2024-04-26T12:38:21.537610+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:38:21.537610+0000","last_undegraded":"2024-04-26T12:38:21.537610+0000","last_fullsized":"2024-04-26T12:38:21.537610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.394619+0000","last_change":"2024-04-26T12:38:16.478219+0000","last_active":"2024-04-26T12:38:22.394619+0000","last_peered":"2024-04-26T12:38:22.394619+0000","last_clean":"2024-04-26T12:38:22.394619+0000","last_became_active":"2024-04-26T12:38:16.477536+0000","last_became_peered":"2024-04-26T12:38:16.477536+0000","last_unstale":"2024-04-26T12:38:22.394619+0000","last_undegraded":"2024-04-26T12:38:22.394619+0000","last_fullsized":"2024-04-26T12:38:22.394619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.509512+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:38:21.509512+0000","last_peered":"2024-04-26T12:38:21.509512+0000","last_clean":"2024-04-26T12:38:21.509512+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:38:21.509512+0000","last_undegraded":"2024-04-26T12:38:21.509512+0000","last_fullsized":"2024-04-26T12:38:21.509512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491797+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:38:21.491797+0000","last_peered":"2024-04-26T12:38:21.491797+0000","last_clean":"2024-04-26T12:38:21.491797+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:38:21.491797+0000","last_undegraded":"2024-04-26T12:38:21.491797+0000","last_fullsized":"2024-04-26T12:38:21.491797+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496486+0000","last_change":"2024-04-26T12:38:12.448475+0000","last_active":"2024-04-26T12:38:21.496486+0000","last_peered":"2024-04-26T12:38:21.496486+0000","last_clean":"2024-04-26T12:38:21.496486+0000","last_became_active":"2024-04-26T12:38:12.446234+0000","last_became_peered":"2024-04-26T12:38:12.446234+0000","last_unstale":"2024-04-26T12:38:21.496486+0000","last_undegraded":"2024-04-26T12:38:21.496486+0000","last_fullsized":"2024-04-26T12:38:21.496486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.522240+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:38:21.522240+0000","last_peered":"2024-04-26T12:38:21.522240+0000","last_clean":"2024-04-26T12:38:21.522240+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:38:21.522240+0000","last_undegraded":"2024-04-26T12:38:21.522240+0000","last_fullsized":"2024-04-26T12:38:21.522240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494191+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:38:21.494191+0000","last_peered":"2024-04-26T12:38:21.494191+0000","last_clean":"2024-04-26T12:38:21.494191+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:38:21.494191+0000","last_undegraded":"2024-04-26T12:38:21.494191+0000","last_fullsized":"2024-04-26T12:38:21.494191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.464410+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:38:22.464410+0000","last_peered":"2024-04-26T12:38:22.464410+0000","last_clean":"2024-04-26T12:38:22.464410+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:38:22.464410+0000","last_undegraded":"2024-04-26T12:38:22.464410+0000","last_fullsized":"2024-04-26T12:38:22.464410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.538064+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:38:21.538064+0000","last_peered":"2024-04-26T12:38:21.538064+0000","last_clean":"2024-04-26T12:38:21.538064+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:38:21.538064+0000","last_undegraded":"2024-04-26T12:38:21.538064+0000","last_fullsized":"2024-04-26T12:38:21.538064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491879+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:38:21.491879+0000","last_peered":"2024-04-26T12:38:21.491879+0000","last_clean":"2024-04-26T12:38:21.491879+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:38:21.491879+0000","last_undegraded":"2024-04-26T12:38:21.491879+0000","last_fullsized":"2024-04-26T12:38:21.491879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496531+0000","last_change":"2024-04-26T12:38:12.455790+0000","last_active":"2024-04-26T12:38:21.496531+0000","last_peered":"2024-04-26T12:38:21.496531+0000","last_clean":"2024-04-26T12:38:21.496531+0000","last_became_active":"2024-04-26T12:38:12.454940+0000","last_became_peered":"2024-04-26T12:38:12.454940+0000","last_unstale":"2024-04-26T12:38:21.496531+0000","last_undegraded":"2024-04-26T12:38:21.496531+0000","last_fullsized":"2024-04-26T12:38:21.496531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494913+0000","last_change":"2024-04-26T12:38:10.439940+0000","last_active":"2024-04-26T12:38:21.494913+0000","last_peered":"2024-04-26T12:38:21.494913+0000","last_clean":"2024-04-26T12:38:21.494913+0000","last_became_active":"2024-04-26T12:38:10.439126+0000","last_became_peered":"2024-04-26T12:38:10.439126+0000","last_unstale":"2024-04-26T12:38:21.494913+0000","last_undegraded":"2024-04-26T12:38:21.494913+0000","last_fullsized":"2024-04-26T12:38:21.494913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:07.267189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503931+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:38:21.503931+0000","last_peered":"2024-04-26T12:38:21.503931+0000","last_clean":"2024-04-26T12:38:21.503931+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:38:21.503931+0000","last_undegraded":"2024-04-26T12:38:21.503931+0000","last_fullsized":"2024-04-26T12:38:21.503931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.250292+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:38:22.250292+0000","last_peered":"2024-04-26T12:38:22.250292+0000","last_clean":"2024-04-26T12:38:22.250292+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:38:22.250292+0000","last_undegraded":"2024-04-26T12:38:22.250292+0000","last_fullsized":"2024-04-26T12:38:22.250292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.523743+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:38:21.523743+0000","last_peered":"2024-04-26T12:38:21.523743+0000","last_clean":"2024-04-26T12:38:21.523743+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:38:21.523743+0000","last_undegraded":"2024-04-26T12:38:21.523743+0000","last_fullsized":"2024-04-26T12:38:21.523743+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494898+0000","last_change":"2024-04-26T12:38:20.506311+0000","last_active":"2024-04-26T12:38:21.494898+0000","last_peered":"2024-04-26T12:38:21.494898+0000","last_clean":"2024-04-26T12:38:21.494898+0000","last_became_active":"2024-04-26T12:38:20.505525+0000","last_became_peered":"2024-04-26T12:38:20.505525+0000","last_unstale":"2024-04-26T12:38:21.494898+0000","last_undegraded":"2024-04-26T12:38:21.494898+0000","last_fullsized":"2024-04-26T12:38:21.494898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.498061+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:38:21.498061+0000","last_peered":"2024-04-26T12:38:21.498061+0000","last_clean":"2024-04-26T12:38:21.498061+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:38:21.498061+0000","last_undegraded":"2024-04-26T12:38:21.498061+0000","last_fullsized":"2024-04-26T12:38:21.498061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493645+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:38:21.493645+0000","last_peered":"2024-04-26T12:38:21.493645+0000","last_clean":"2024-04-26T12:38:21.493645+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:38:21.493645+0000","last_undegraded":"2024-04-26T12:38:21.493645+0000","last_fullsized":"2024-04-26T12:38:21.493645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496157+0000","last_change":"2024-04-26T12:38:14.450109+0000","last_active":"2024-04-26T12:38:21.496157+0000","last_peered":"2024-04-26T12:38:21.496157+0000","last_clean":"2024-04-26T12:38:21.496157+0000","last_became_active":"2024-04-26T12:38:14.449387+0000","last_became_peered":"2024-04-26T12:38:14.449387+0000","last_unstale":"2024-04-26T12:38:21.496157+0000","last_undegraded":"2024-04-26T12:38:21.496157+0000","last_fullsized":"2024-04-26T12:38:21.496157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"29'17","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.387691+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:38:22.387691+0000","last_peered":"2024-04-26T12:38:22.387691+0000","last_clean":"2024-04-26T12:38:22.387691+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:38:22.387691+0000","last_undegraded":"2024-04-26T12:38:22.387691+0000","last_fullsized":"2024-04-26T12:38:22.387691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.522456+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:38:21.522456+0000","last_peered":"2024-04-26T12:38:21.522456+0000","last_clean":"2024-04-26T12:38:21.522456+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:38:21.522456+0000","last_undegraded":"2024-04-26T12:38:21.522456+0000","last_fullsized":"2024-04-26T12:38:21.522456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492715+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:38:21.492715+0000","last_peered":"2024-04-26T12:38:21.492715+0000","last_clean":"2024-04-26T12:38:21.492715+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:38:21.492715+0000","last_undegraded":"2024-04-26T12:38:21.492715+0000","last_fullsized":"2024-04-26T12:38:21.492715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.523935+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:38:21.523935+0000","last_peered":"2024-04-26T12:38:21.523935+0000","last_clean":"2024-04-26T12:38:21.523935+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:38:21.523935+0000","last_undegraded":"2024-04-26T12:38:21.523935+0000","last_fullsized":"2024-04-26T12:38:21.523935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511362+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:38:21.511362+0000","last_peered":"2024-04-26T12:38:21.511362+0000","last_clean":"2024-04-26T12:38:21.511362+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:38:21.511362+0000","last_undegraded":"2024-04-26T12:38:21.511362+0000","last_fullsized":"2024-04-26T12:38:21.511362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503104+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:38:21.503104+0000","last_peered":"2024-04-26T12:38:21.503104+0000","last_clean":"2024-04-26T12:38:21.503104+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:38:21.503104+0000","last_undegraded":"2024-04-26T12:38:21.503104+0000","last_fullsized":"2024-04-26T12:38:21.503104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493615+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:38:21.493615+0000","last_peered":"2024-04-26T12:38:21.493615+0000","last_clean":"2024-04-26T12:38:21.493615+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:38:21.493615+0000","last_undegraded":"2024-04-26T12:38:21.493615+0000","last_fullsized":"2024-04-26T12:38:21.493615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511988+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:38:21.511988+0000","last_peered":"2024-04-26T12:38:21.511988+0000","last_clean":"2024-04-26T12:38:21.511988+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:38:21.511988+0000","last_undegraded":"2024-04-26T12:38:21.511988+0000","last_fullsized":"2024-04-26T12:38:21.511988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"29'13","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.178104+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:38:22.178104+0000","last_peered":"2024-04-26T12:38:22.178104+0000","last_clean":"2024-04-26T12:38:22.178104+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:38:22.178104+0000","last_undegraded":"2024-04-26T12:38:22.178104+0000","last_fullsized":"2024-04-26T12:38:22.178104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511139+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:38:21.511139+0000","last_peered":"2024-04-26T12:38:21.511139+0000","last_clean":"2024-04-26T12:38:21.511139+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:38:21.511139+0000","last_undegraded":"2024-04-26T12:38:21.511139+0000","last_fullsized":"2024-04-26T12:38:21.511139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521300+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:38:21.521300+0000","last_peered":"2024-04-26T12:38:21.521300+0000","last_clean":"2024-04-26T12:38:21.521300+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:38:21.521300+0000","last_undegraded":"2024-04-26T12:38:21.521300+0000","last_fullsized":"2024-04-26T12:38:21.521300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511770+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:38:21.511770+0000","last_peered":"2024-04-26T12:38:21.511770+0000","last_clean":"2024-04-26T12:38:21.511770+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:38:21.511770+0000","last_undegraded":"2024-04-26T12:38:21.511770+0000","last_fullsized":"2024-04-26T12:38:21.511770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511082+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:38:21.511082+0000","last_peered":"2024-04-26T12:38:21.511082+0000","last_clean":"2024-04-26T12:38:21.511082+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:38:21.511082+0000","last_undegraded":"2024-04-26T12:38:21.511082+0000","last_fullsized":"2024-04-26T12:38:21.511082+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.506799+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:38:21.506799+0000","last_peered":"2024-04-26T12:38:21.506799+0000","last_clean":"2024-04-26T12:38:21.506799+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:38:21.506799+0000","last_undegraded":"2024-04-26T12:38:21.506799+0000","last_fullsized":"2024-04-26T12:38:21.506799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504663+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:38:21.504663+0000","last_peered":"2024-04-26T12:38:21.504663+0000","last_clean":"2024-04-26T12:38:21.504663+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:38:21.504663+0000","last_undegraded":"2024-04-26T12:38:21.504663+0000","last_fullsized":"2024-04-26T12:38:21.504663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"29'23","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.375873+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:38:22.375873+0000","last_peered":"2024-04-26T12:38:22.375873+0000","last_clean":"2024-04-26T12:38:22.375873+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:38:22.375873+0000","last_undegraded":"2024-04-26T12:38:22.375873+0000","last_fullsized":"2024-04-26T12:38:22.375873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512432+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:38:21.512432+0000","last_peered":"2024-04-26T12:38:21.512432+0000","last_clean":"2024-04-26T12:38:21.512432+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:38:21.512432+0000","last_undegraded":"2024-04-26T12:38:21.512432+0000","last_fullsized":"2024-04-26T12:38:21.512432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491837+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:38:21.491837+0000","last_peered":"2024-04-26T12:38:21.491837+0000","last_clean":"2024-04-26T12:38:21.491837+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:38:21.491837+0000","last_undegraded":"2024-04-26T12:38:21.491837+0000","last_fullsized":"2024-04-26T12:38:21.491837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.498212+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:38:21.498212+0000","last_peered":"2024-04-26T12:38:21.498212+0000","last_clean":"2024-04-26T12:38:21.498212+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:38:21.498212+0000","last_undegraded":"2024-04-26T12:38:21.498212+0000","last_fullsized":"2024-04-26T12:38:21.498212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536791+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:38:21.536791+0000","last_peered":"2024-04-26T12:38:21.536791+0000","last_clean":"2024-04-26T12:38:21.536791+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:38:21.536791+0000","last_undegraded":"2024-04-26T12:38:21.536791+0000","last_fullsized":"2024-04-26T12:38:21.536791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.490960+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:38:21.490960+0000","last_peered":"2024-04-26T12:38:21.490960+0000","last_clean":"2024-04-26T12:38:21.490960+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:38:21.490960+0000","last_undegraded":"2024-04-26T12:38:21.490960+0000","last_fullsized":"2024-04-26T12:38:21.490960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.538248+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:38:21.538248+0000","last_peered":"2024-04-26T12:38:21.538248+0000","last_clean":"2024-04-26T12:38:21.538248+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:38:21.538248+0000","last_undegraded":"2024-04-26T12:38:21.538248+0000","last_fullsized":"2024-04-26T12:38:21.538248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'15","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.383639+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:38:22.383639+0000","last_peered":"2024-04-26T12:38:22.383639+0000","last_clean":"2024-04-26T12:38:22.383639+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:38:22.383639+0000","last_undegraded":"2024-04-26T12:38:22.383639+0000","last_fullsized":"2024-04-26T12:38:22.383639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507840+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:38:21.507840+0000","last_peered":"2024-04-26T12:38:21.507840+0000","last_clean":"2024-04-26T12:38:21.507840+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:38:21.507840+0000","last_undegraded":"2024-04-26T12:38:21.507840+0000","last_fullsized":"2024-04-26T12:38:21.507840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495152+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:38:21.495152+0000","last_peered":"2024-04-26T12:38:21.495152+0000","last_clean":"2024-04-26T12:38:21.495152+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:38:21.495152+0000","last_undegraded":"2024-04-26T12:38:21.495152+0000","last_fullsized":"2024-04-26T12:38:21.495152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494447+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:38:21.494447+0000","last_peered":"2024-04-26T12:38:21.494447+0000","last_clean":"2024-04-26T12:38:21.494447+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:38:21.494447+0000","last_undegraded":"2024-04-26T12:38:21.494447+0000","last_fullsized":"2024-04-26T12:38:21.494447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503559+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:38:21.503559+0000","last_peered":"2024-04-26T12:38:21.503559+0000","last_clean":"2024-04-26T12:38:21.503559+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:38:21.503559+0000","last_undegraded":"2024-04-26T12:38:21.503559+0000","last_fullsized":"2024-04-26T12:38:21.503559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495252+0000","last_change":"2024-04-26T12:38:10.462754+0000","last_active":"2024-04-26T12:38:21.495252+0000","last_peered":"2024-04-26T12:38:21.495252+0000","last_clean":"2024-04-26T12:38:21.495252+0000","last_became_active":"2024-04-26T12:38:10.461697+0000","last_became_peered":"2024-04-26T12:38:10.461697+0000","last_unstale":"2024-04-26T12:38:21.495252+0000","last_undegraded":"2024-04-26T12:38:21.495252+0000","last_fullsized":"2024-04-26T12:38:21.495252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:40.556384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507901+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:38:21.507901+0000","last_peered":"2024-04-26T12:38:21.507901+0000","last_clean":"2024-04-26T12:38:21.507901+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:38:21.507901+0000","last_undegraded":"2024-04-26T12:38:21.507901+0000","last_fullsized":"2024-04-26T12:38:21.507901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.213171+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:38:22.213171+0000","last_peered":"2024-04-26T12:38:22.213171+0000","last_clean":"2024-04-26T12:38:22.213171+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:38:22.213171+0000","last_undegraded":"2024-04-26T12:38:22.213171+0000","last_fullsized":"2024-04-26T12:38:22.213171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524472+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:38:21.524472+0000","last_peered":"2024-04-26T12:38:21.524472+0000","last_clean":"2024-04-26T12:38:21.524472+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:38:21.524472+0000","last_undegraded":"2024-04-26T12:38:21.524472+0000","last_fullsized":"2024-04-26T12:38:21.524472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502339+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:38:21.502339+0000","last_peered":"2024-04-26T12:38:21.502339+0000","last_clean":"2024-04-26T12:38:21.502339+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:38:21.502339+0000","last_undegraded":"2024-04-26T12:38:21.502339+0000","last_fullsized":"2024-04-26T12:38:21.502339+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492488+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:38:21.492488+0000","last_peered":"2024-04-26T12:38:21.492488+0000","last_clean":"2024-04-26T12:38:21.492488+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:38:21.492488+0000","last_undegraded":"2024-04-26T12:38:21.492488+0000","last_fullsized":"2024-04-26T12:38:21.492488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504799+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:38:21.504799+0000","last_peered":"2024-04-26T12:38:21.504799+0000","last_clean":"2024-04-26T12:38:21.504799+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:38:21.504799+0000","last_undegraded":"2024-04-26T12:38:21.504799+0000","last_fullsized":"2024-04-26T12:38:21.504799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494789+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:38:21.494789+0000","last_peered":"2024-04-26T12:38:21.494789+0000","last_clean":"2024-04-26T12:38:21.494789+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:38:21.494789+0000","last_undegraded":"2024-04-26T12:38:21.494789+0000","last_fullsized":"2024-04-26T12:38:21.494789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507971+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:38:21.507971+0000","last_peered":"2024-04-26T12:38:21.507971+0000","last_clean":"2024-04-26T12:38:21.507971+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:38:21.507971+0000","last_undegraded":"2024-04-26T12:38:21.507971+0000","last_fullsized":"2024-04-26T12:38:21.507971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'18","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.307945+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:38:22.307945+0000","last_peered":"2024-04-26T12:38:22.307945+0000","last_clean":"2024-04-26T12:38:22.307945+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:38:22.307945+0000","last_undegraded":"2024-04-26T12:38:22.307945+0000","last_fullsized":"2024-04-26T12:38:22.307945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493912+0000","last_change":"2024-04-26T12:38:18.479417+0000","last_active":"2024-04-26T12:38:21.493912+0000","last_peered":"2024-04-26T12:38:21.493912+0000","last_clean":"2024-04-26T12:38:21.493912+0000","last_became_active":"2024-04-26T12:38:18.478693+0000","last_became_peered":"2024-04-26T12:38:18.478693+0000","last_unstale":"2024-04-26T12:38:21.493912+0000","last_undegraded":"2024-04-26T12:38:21.493912+0000","last_fullsized":"2024-04-26T12:38:21.493912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508801+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:38:21.508801+0000","last_peered":"2024-04-26T12:38:21.508801+0000","last_clean":"2024-04-26T12:38:21.508801+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:38:21.508801+0000","last_undegraded":"2024-04-26T12:38:21.508801+0000","last_fullsized":"2024-04-26T12:38:21.508801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508676+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:38:21.508676+0000","last_peered":"2024-04-26T12:38:21.508676+0000","last_clean":"2024-04-26T12:38:21.508676+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:38:21.508676+0000","last_undegraded":"2024-04-26T12:38:21.508676+0000","last_fullsized":"2024-04-26T12:38:21.508676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494539+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:38:21.494539+0000","last_peered":"2024-04-26T12:38:21.494539+0000","last_clean":"2024-04-26T12:38:21.494539+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:38:21.494539+0000","last_undegraded":"2024-04-26T12:38:21.494539+0000","last_fullsized":"2024-04-26T12:38:21.494539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513507+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:38:21.513507+0000","last_peered":"2024-04-26T12:38:21.513507+0000","last_clean":"2024-04-26T12:38:21.513507+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:38:21.513507+0000","last_undegraded":"2024-04-26T12:38:21.513507+0000","last_fullsized":"2024-04-26T12:38:21.513507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521762+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:38:21.521762+0000","last_peered":"2024-04-26T12:38:21.521762+0000","last_clean":"2024-04-26T12:38:21.521762+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:38:21.521762+0000","last_undegraded":"2024-04-26T12:38:21.521762+0000","last_fullsized":"2024-04-26T12:38:21.521762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.408269+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:38:22.408269+0000","last_peered":"2024-04-26T12:38:22.408269+0000","last_clean":"2024-04-26T12:38:22.408269+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:38:22.408269+0000","last_undegraded":"2024-04-26T12:38:22.408269+0000","last_fullsized":"2024-04-26T12:38:22.408269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502778+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:38:21.502778+0000","last_peered":"2024-04-26T12:38:21.502778+0000","last_clean":"2024-04-26T12:38:21.502778+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:38:21.502778+0000","last_undegraded":"2024-04-26T12:38:21.502778+0000","last_fullsized":"2024-04-26T12:38:21.502778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495702+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:38:21.495702+0000","last_peered":"2024-04-26T12:38:21.495702+0000","last_clean":"2024-04-26T12:38:21.495702+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:38:21.495702+0000","last_undegraded":"2024-04-26T12:38:21.495702+0000","last_fullsized":"2024-04-26T12:38:21.495702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492675+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:38:21.492675+0000","last_peered":"2024-04-26T12:38:21.492675+0000","last_clean":"2024-04-26T12:38:21.492675+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:38:21.492675+0000","last_undegraded":"2024-04-26T12:38:21.492675+0000","last_fullsized":"2024-04-26T12:38:21.492675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494868+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:38:21.494868+0000","last_peered":"2024-04-26T12:38:21.494868+0000","last_clean":"2024-04-26T12:38:21.494868+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:38:21.494868+0000","last_undegraded":"2024-04-26T12:38:21.494868+0000","last_fullsized":"2024-04-26T12:38:21.494868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.498023+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:38:21.498023+0000","last_peered":"2024-04-26T12:38:21.498023+0000","last_clean":"2024-04-26T12:38:21.498023+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:38:21.498023+0000","last_undegraded":"2024-04-26T12:38:21.498023+0000","last_fullsized":"2024-04-26T12:38:21.498023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494193+0000","last_change":"2024-04-26T12:38:14.446941+0000","last_active":"2024-04-26T12:38:21.494193+0000","last_peered":"2024-04-26T12:38:21.494193+0000","last_clean":"2024-04-26T12:38:21.494193+0000","last_became_active":"2024-04-26T12:38:14.446196+0000","last_became_peered":"2024-04-26T12:38:14.446196+0000","last_unstale":"2024-04-26T12:38:21.494193+0000","last_undegraded":"2024-04-26T12:38:21.494193+0000","last_fullsized":"2024-04-26T12:38:21.494193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.366185+0000","last_change":"2024-04-26T12:38:16.468798+0000","last_active":"2024-04-26T12:38:22.366185+0000","last_peered":"2024-04-26T12:38:22.366185+0000","last_clean":"2024-04-26T12:38:22.366185+0000","last_became_active":"2024-04-26T12:38:16.468104+0000","last_became_peered":"2024-04-26T12:38:16.468104+0000","last_unstale":"2024-04-26T12:38:22.366185+0000","last_undegraded":"2024-04-26T12:38:22.366185+0000","last_fullsized":"2024-04-26T12:38:22.366185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.499353+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:38:21.499353+0000","last_peered":"2024-04-26T12:38:21.499353+0000","last_clean":"2024-04-26T12:38:21.499353+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:38:21.499353+0000","last_undegraded":"2024-04-26T12:38:21.499353+0000","last_fullsized":"2024-04-26T12:38:21.499353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508444+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:38:21.508444+0000","last_peered":"2024-04-26T12:38:21.508444+0000","last_clean":"2024-04-26T12:38:21.508444+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:38:21.508444+0000","last_undegraded":"2024-04-26T12:38:21.508444+0000","last_fullsized":"2024-04-26T12:38:21.508444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494501+0000","last_change":"2024-04-26T12:38:12.457737+0000","last_active":"2024-04-26T12:38:21.494501+0000","last_peered":"2024-04-26T12:38:21.494501+0000","last_clean":"2024-04-26T12:38:21.494501+0000","last_became_active":"2024-04-26T12:38:12.457046+0000","last_became_peered":"2024-04-26T12:38:12.457046+0000","last_unstale":"2024-04-26T12:38:21.494501+0000","last_undegraded":"2024-04-26T12:38:21.494501+0000","last_fullsized":"2024-04-26T12:38:21.494501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512192+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:38:21.512192+0000","last_peered":"2024-04-26T12:38:21.512192+0000","last_clean":"2024-04-26T12:38:21.512192+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:38:21.512192+0000","last_undegraded":"2024-04-26T12:38:21.512192+0000","last_fullsized":"2024-04-26T12:38:21.512192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.525166+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:38:21.525166+0000","last_peered":"2024-04-26T12:38:21.525166+0000","last_clean":"2024-04-26T12:38:21.525166+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:38:21.525166+0000","last_undegraded":"2024-04-26T12:38:21.525166+0000","last_fullsized":"2024-04-26T12:38:21.525166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492293+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:38:21.492293+0000","last_peered":"2024-04-26T12:38:21.492293+0000","last_clean":"2024-04-26T12:38:21.492293+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:38:21.492293+0000","last_undegraded":"2024-04-26T12:38:21.492293+0000","last_fullsized":"2024-04-26T12:38:21.492293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'19","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.344336+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:38:22.344336+0000","last_peered":"2024-04-26T12:38:22.344336+0000","last_clean":"2024-04-26T12:38:22.344336+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:38:22.344336+0000","last_undegraded":"2024-04-26T12:38:22.344336+0000","last_fullsized":"2024-04-26T12:38:22.344336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493152+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:38:21.493152+0000","last_peered":"2024-04-26T12:38:21.493152+0000","last_clean":"2024-04-26T12:38:21.493152+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:38:21.493152+0000","last_undegraded":"2024-04-26T12:38:21.493152+0000","last_fullsized":"2024-04-26T12:38:21.493152+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503557+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:38:21.503557+0000","last_peered":"2024-04-26T12:38:21.503557+0000","last_clean":"2024-04-26T12:38:21.503557+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:38:21.503557+0000","last_undegraded":"2024-04-26T12:38:21.503557+0000","last_fullsized":"2024-04-26T12:38:21.503557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.509567+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:38:21.509567+0000","last_peered":"2024-04-26T12:38:21.509567+0000","last_clean":"2024-04-26T12:38:21.509567+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:38:21.509567+0000","last_undegraded":"2024-04-26T12:38:21.509567+0000","last_fullsized":"2024-04-26T12:38:21.509567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494805+0000","last_change":"2024-04-26T12:38:12.442031+0000","last_active":"2024-04-26T12:38:21.494805+0000","last_peered":"2024-04-26T12:38:21.494805+0000","last_clean":"2024-04-26T12:38:21.494805+0000","last_became_active":"2024-04-26T12:38:12.436985+0000","last_became_peered":"2024-04-26T12:38:12.436985+0000","last_unstale":"2024-04-26T12:38:21.494805+0000","last_undegraded":"2024-04-26T12:38:21.494805+0000","last_fullsized":"2024-04-26T12:38:21.494805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495332+0000","last_change":"2024-04-26T12:38:10.440637+0000","last_active":"2024-04-26T12:38:21.495332+0000","last_peered":"2024-04-26T12:38:21.495332+0000","last_clean":"2024-04-26T12:38:21.495332+0000","last_became_active":"2024-04-26T12:38:10.438246+0000","last_became_peered":"2024-04-26T12:38:10.438246+0000","last_unstale":"2024-04-26T12:38:21.495332+0000","last_undegraded":"2024-04-26T12:38:21.495332+0000","last_fullsized":"2024-04-26T12:38:21.495332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492757+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:38:21.492757+0000","last_peered":"2024-04-26T12:38:21.492757+0000","last_clean":"2024-04-26T12:38:21.492757+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:38:21.492757+0000","last_undegraded":"2024-04-26T12:38:21.492757+0000","last_fullsized":"2024-04-26T12:38:21.492757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.414961+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:38:22.414961+0000","last_peered":"2024-04-26T12:38:22.414961+0000","last_clean":"2024-04-26T12:38:22.414961+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:38:22.414961+0000","last_undegraded":"2024-04-26T12:38:22.414961+0000","last_fullsized":"2024-04-26T12:38:22.414961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491931+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:38:21.491931+0000","last_peered":"2024-04-26T12:38:21.491931+0000","last_clean":"2024-04-26T12:38:21.491931+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:38:21.491931+0000","last_undegraded":"2024-04-26T12:38:21.491931+0000","last_fullsized":"2024-04-26T12:38:21.491931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494921+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:38:21.494921+0000","last_peered":"2024-04-26T12:38:21.494921+0000","last_clean":"2024-04-26T12:38:21.494921+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:38:21.494921+0000","last_undegraded":"2024-04-26T12:38:21.494921+0000","last_fullsized":"2024-04-26T12:38:21.494921+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492925+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:38:21.492925+0000","last_peered":"2024-04-26T12:38:21.492925+0000","last_clean":"2024-04-26T12:38:21.492925+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:38:21.492925+0000","last_undegraded":"2024-04-26T12:38:21.492925+0000","last_fullsized":"2024-04-26T12:38:21.492925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513138+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:38:21.513138+0000","last_peered":"2024-04-26T12:38:21.513138+0000","last_clean":"2024-04-26T12:38:21.513138+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:38:21.513138+0000","last_undegraded":"2024-04-26T12:38:21.513138+0000","last_fullsized":"2024-04-26T12:38:21.513138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494505+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:38:21.494505+0000","last_peered":"2024-04-26T12:38:21.494505+0000","last_clean":"2024-04-26T12:38:21.494505+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:38:21.494505+0000","last_undegraded":"2024-04-26T12:38:21.494505+0000","last_fullsized":"2024-04-26T12:38:21.494505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.862833+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:38:21.862833+0000","last_peered":"2024-04-26T12:38:21.862833+0000","last_clean":"2024-04-26T12:38:21.862833+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:38:21.862833+0000","last_undegraded":"2024-04-26T12:38:21.862833+0000","last_fullsized":"2024-04-26T12:38:21.862833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511300+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:38:21.511300+0000","last_peered":"2024-04-26T12:38:21.511300+0000","last_clean":"2024-04-26T12:38:21.511300+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:38:21.511300+0000","last_undegraded":"2024-04-26T12:38:21.511300+0000","last_fullsized":"2024-04-26T12:38:21.511300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508207+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:38:21.508207+0000","last_peered":"2024-04-26T12:38:21.508207+0000","last_clean":"2024-04-26T12:38:21.508207+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:38:21.508207+0000","last_undegraded":"2024-04-26T12:38:21.508207+0000","last_fullsized":"2024-04-26T12:38:21.508207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492746+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:38:21.492746+0000","last_peered":"2024-04-26T12:38:21.492746+0000","last_clean":"2024-04-26T12:38:21.492746+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:38:21.492746+0000","last_undegraded":"2024-04-26T12:38:21.492746+0000","last_fullsized":"2024-04-26T12:38:21.492746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504442+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:38:21.504442+0000","last_peered":"2024-04-26T12:38:21.504442+0000","last_clean":"2024-04-26T12:38:21.504442+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:38:21.504442+0000","last_undegraded":"2024-04-26T12:38:21.504442+0000","last_fullsized":"2024-04-26T12:38:21.504442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.510613+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:38:21.510613+0000","last_peered":"2024-04-26T12:38:21.510613+0000","last_clean":"2024-04-26T12:38:21.510613+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:38:21.510613+0000","last_undegraded":"2024-04-26T12:38:21.510613+0000","last_fullsized":"2024-04-26T12:38:21.510613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.322468+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:38:22.322468+0000","last_peered":"2024-04-26T12:38:22.322468+0000","last_clean":"2024-04-26T12:38:22.322468+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:38:22.322468+0000","last_undegraded":"2024-04-26T12:38:22.322468+0000","last_fullsized":"2024-04-26T12:38:22.322468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521522+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:38:21.521522+0000","last_peered":"2024-04-26T12:38:21.521522+0000","last_clean":"2024-04-26T12:38:21.521522+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:38:21.521522+0000","last_undegraded":"2024-04-26T12:38:21.521522+0000","last_fullsized":"2024-04-26T12:38:21.521522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503061+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:38:21.503061+0000","last_peered":"2024-04-26T12:38:21.503061+0000","last_clean":"2024-04-26T12:38:21.503061+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:38:21.503061+0000","last_undegraded":"2024-04-26T12:38:21.503061+0000","last_fullsized":"2024-04-26T12:38:21.503061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493075+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:38:21.493075+0000","last_peered":"2024-04-26T12:38:21.493075+0000","last_clean":"2024-04-26T12:38:21.493075+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:38:21.493075+0000","last_undegraded":"2024-04-26T12:38:21.493075+0000","last_fullsized":"2024-04-26T12:38:21.493075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511466+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:38:21.511466+0000","last_peered":"2024-04-26T12:38:21.511466+0000","last_clean":"2024-04-26T12:38:21.511466+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:38:21.511466+0000","last_undegraded":"2024-04-26T12:38:21.511466+0000","last_fullsized":"2024-04-26T12:38:21.511466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521609+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:38:21.521609+0000","last_peered":"2024-04-26T12:38:21.521609+0000","last_clean":"2024-04-26T12:38:21.521609+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:38:21.521609+0000","last_undegraded":"2024-04-26T12:38:21.521609+0000","last_fullsized":"2024-04-26T12:38:21.521609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.096359+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:38:22.096359+0000","last_peered":"2024-04-26T12:38:22.096359+0000","last_clean":"2024-04-26T12:38:22.096359+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:38:22.096359+0000","last_undegraded":"2024-04-26T12:38:22.096359+0000","last_fullsized":"2024-04-26T12:38:22.096359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507246+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:38:21.507246+0000","last_peered":"2024-04-26T12:38:21.507246+0000","last_clean":"2024-04-26T12:38:21.507246+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:38:21.507246+0000","last_undegraded":"2024-04-26T12:38:21.507246+0000","last_fullsized":"2024-04-26T12:38:21.507246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524792+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:38:21.524792+0000","last_peered":"2024-04-26T12:38:21.524792+0000","last_clean":"2024-04-26T12:38:21.524792+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:38:21.524792+0000","last_undegraded":"2024-04-26T12:38:21.524792+0000","last_fullsized":"2024-04-26T12:38:21.524792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493440+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:38:21.493440+0000","last_peered":"2024-04-26T12:38:21.493440+0000","last_clean":"2024-04-26T12:38:21.493440+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:38:21.493440+0000","last_undegraded":"2024-04-26T12:38:21.493440+0000","last_fullsized":"2024-04-26T12:38:21.493440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511404+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:38:21.511404+0000","last_peered":"2024-04-26T12:38:21.511404+0000","last_clean":"2024-04-26T12:38:21.511404+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:38:21.511404+0000","last_undegraded":"2024-04-26T12:38:21.511404+0000","last_fullsized":"2024-04-26T12:38:21.511404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.442415+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:38:22.442415+0000","last_peered":"2024-04-26T12:38:22.442415+0000","last_clean":"2024-04-26T12:38:22.442415+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:38:22.442415+0000","last_undegraded":"2024-04-26T12:38:22.442415+0000","last_fullsized":"2024-04-26T12:38:22.442415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503241+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:38:21.503241+0000","last_peered":"2024-04-26T12:38:21.503241+0000","last_clean":"2024-04-26T12:38:21.503241+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:38:21.503241+0000","last_undegraded":"2024-04-26T12:38:21.503241+0000","last_fullsized":"2024-04-26T12:38:21.503241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493230+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:38:21.493230+0000","last_peered":"2024-04-26T12:38:21.493230+0000","last_clean":"2024-04-26T12:38:21.493230+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:38:21.493230+0000","last_undegraded":"2024-04-26T12:38:21.493230+0000","last_fullsized":"2024-04-26T12:38:21.493230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511659+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:38:21.511659+0000","last_peered":"2024-04-26T12:38:21.511659+0000","last_clean":"2024-04-26T12:38:21.511659+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:38:21.511659+0000","last_undegraded":"2024-04-26T12:38:21.511659+0000","last_fullsized":"2024-04-26T12:38:21.511659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492195+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:38:21.492195+0000","last_peered":"2024-04-26T12:38:21.492195+0000","last_clean":"2024-04-26T12:38:21.492195+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:38:21.492195+0000","last_undegraded":"2024-04-26T12:38:21.492195+0000","last_fullsized":"2024-04-26T12:38:21.492195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524584+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:38:21.524584+0000","last_peered":"2024-04-26T12:38:21.524584+0000","last_clean":"2024-04-26T12:38:21.524584+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:38:21.524584+0000","last_undegraded":"2024-04-26T12:38:21.524584+0000","last_fullsized":"2024-04-26T12:38:21.524584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.220910+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:38:22.220910+0000","last_peered":"2024-04-26T12:38:22.220910+0000","last_clean":"2024-04-26T12:38:22.220910+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:38:22.220910+0000","last_undegraded":"2024-04-26T12:38:22.220910+0000","last_fullsized":"2024-04-26T12:38:22.220910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495635+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:38:21.495635+0000","last_peered":"2024-04-26T12:38:21.495635+0000","last_clean":"2024-04-26T12:38:21.495635+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:38:21.495635+0000","last_undegraded":"2024-04-26T12:38:21.495635+0000","last_fullsized":"2024-04-26T12:38:21.495635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521616+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:38:21.521616+0000","last_peered":"2024-04-26T12:38:21.521616+0000","last_clean":"2024-04-26T12:38:21.521616+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:38:21.521616+0000","last_undegraded":"2024-04-26T12:38:21.521616+0000","last_fullsized":"2024-04-26T12:38:21.521616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494558+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:38:21.494558+0000","last_peered":"2024-04-26T12:38:21.494558+0000","last_clean":"2024-04-26T12:38:21.494558+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:38:21.494558+0000","last_undegraded":"2024-04-26T12:38:21.494558+0000","last_fullsized":"2024-04-26T12:38:21.494558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495583+0000","last_change":"2024-04-26T12:38:10.432447+0000","last_active":"2024-04-26T12:38:21.495583+0000","last_peered":"2024-04-26T12:38:21.495583+0000","last_clean":"2024-04-26T12:38:21.495583+0000","last_became_active":"2024-04-26T12:38:10.431629+0000","last_became_peered":"2024-04-26T12:38:10.431629+0000","last_unstale":"2024-04-26T12:38:21.495583+0000","last_undegraded":"2024-04-26T12:38:21.495583+0000","last_fullsized":"2024-04-26T12:38:21.495583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496523+0000","last_change":"2024-04-26T12:38:14.443557+0000","last_active":"2024-04-26T12:38:21.496523+0000","last_peered":"2024-04-26T12:38:21.496523+0000","last_clean":"2024-04-26T12:38:21.496523+0000","last_became_active":"2024-04-26T12:38:14.442780+0000","last_became_peered":"2024-04-26T12:38:14.442780+0000","last_unstale":"2024-04-26T12:38:21.496523+0000","last_undegraded":"2024-04-26T12:38:21.496523+0000","last_fullsized":"2024-04-26T12:38:21.496523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"29'11","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.421725+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:38:22.421725+0000","last_peered":"2024-04-26T12:38:22.421725+0000","last_clean":"2024-04-26T12:38:22.421725+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:38:22.421725+0000","last_undegraded":"2024-04-26T12:38:22.421725+0000","last_fullsized":"2024-04-26T12:38:22.421725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495398+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:38:21.495398+0000","last_peered":"2024-04-26T12:38:21.495398+0000","last_clean":"2024-04-26T12:38:21.495398+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:38:21.495398+0000","last_undegraded":"2024-04-26T12:38:21.495398+0000","last_fullsized":"2024-04-26T12:38:21.495398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502568+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:38:21.502568+0000","last_peered":"2024-04-26T12:38:21.502568+0000","last_clean":"2024-04-26T12:38:21.502568+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:38:21.502568+0000","last_undegraded":"2024-04-26T12:38:21.502568+0000","last_fullsized":"2024-04-26T12:38:21.502568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537854+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:38:21.537854+0000","last_peered":"2024-04-26T12:38:21.537854+0000","last_clean":"2024-04-26T12:38:21.537854+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:38:21.537854+0000","last_undegraded":"2024-04-26T12:38:21.537854+0000","last_fullsized":"2024-04-26T12:38:21.537854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507581+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:38:21.507581+0000","last_peered":"2024-04-26T12:38:21.507581+0000","last_clean":"2024-04-26T12:38:21.507581+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:38:21.507581+0000","last_undegraded":"2024-04-26T12:38:21.507581+0000","last_fullsized":"2024-04-26T12:38:21.507581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496463+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:38:21.496463+0000","last_peered":"2024-04-26T12:38:21.496463+0000","last_clean":"2024-04-26T12:38:21.496463+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:38:21.496463+0000","last_undegraded":"2024-04-26T12:38:21.496463+0000","last_fullsized":"2024-04-26T12:38:21.496463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.402397+0000","last_change":"2024-04-26T12:38:16.531118+0000","last_active":"2024-04-26T12:38:22.402397+0000","last_peered":"2024-04-26T12:38:22.402397+0000","last_clean":"2024-04-26T12:38:22.402397+0000","last_became_active":"2024-04-26T12:38:16.530342+0000","last_became_peered":"2024-04-26T12:38:16.530342+0000","last_unstale":"2024-04-26T12:38:22.402397+0000","last_undegraded":"2024-04-26T12:38:22.402397+0000","last_fullsized":"2024-04-26T12:38:22.402397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"26'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524333+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:38:21.524333+0000","last_peered":"2024-04-26T12:38:21.524333+0000","last_clean":"2024-04-26T12:38:21.524333+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:38:21.524333+0000","last_undegraded":"2024-04-26T12:38:21.524333+0000","last_fullsized":"2024-04-26T12:38:21.524333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.510703+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:38:21.510703+0000","last_peered":"2024-04-26T12:38:21.510703+0000","last_clean":"2024-04-26T12:38:21.510703+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:38:21.510703+0000","last_undegraded":"2024-04-26T12:38:21.510703+0000","last_fullsized":"2024-04-26T12:38:21.510703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494507+0000","last_change":"2024-04-26T12:38:12.449983+0000","last_active":"2024-04-26T12:38:21.494507+0000","last_peered":"2024-04-26T12:38:21.494507+0000","last_clean":"2024-04-26T12:38:21.494507+0000","last_became_active":"2024-04-26T12:38:12.445024+0000","last_became_peered":"2024-04-26T12:38:12.445024+0000","last_unstale":"2024-04-26T12:38:21.494507+0000","last_undegraded":"2024-04-26T12:38:21.494507+0000","last_fullsized":"2024-04-26T12:38:21.494507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504001+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:38:21.504001+0000","last_peered":"2024-04-26T12:38:21.504001+0000","last_clean":"2024-04-26T12:38:21.504001+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:38:21.504001+0000","last_undegraded":"2024-04-26T12:38:21.504001+0000","last_fullsized":"2024-04-26T12:38:21.504001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511495+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:38:21.511495+0000","last_peered":"2024-04-26T12:38:21.511495+0000","last_clean":"2024-04-26T12:38:21.511495+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:38:21.511495+0000","last_undegraded":"2024-04-26T12:38:21.511495+0000","last_fullsized":"2024-04-26T12:38:21.511495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"29'15","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.436526+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:38:22.436526+0000","last_peered":"2024-04-26T12:38:22.436526+0000","last_clean":"2024-04-26T12:38:22.436526+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:38:22.436526+0000","last_undegraded":"2024-04-26T12:38:22.436526+0000","last_fullsized":"2024-04-26T12:38:22.436526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.505519+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:38:21.505519+0000","last_peered":"2024-04-26T12:38:21.505519+0000","last_clean":"2024-04-26T12:38:21.505519+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:38:21.505519+0000","last_undegraded":"2024-04-26T12:38:21.505519+0000","last_fullsized":"2024-04-26T12:38:21.505519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.514265+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:38:21.514265+0000","last_peered":"2024-04-26T12:38:21.514265+0000","last_clean":"2024-04-26T12:38:21.514265+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:38:21.514265+0000","last_undegraded":"2024-04-26T12:38:21.514265+0000","last_fullsized":"2024-04-26T12:38:21.514265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495330+0000","last_change":"2024-04-26T12:38:12.439866+0000","last_active":"2024-04-26T12:38:21.495330+0000","last_peered":"2024-04-26T12:38:21.495330+0000","last_clean":"2024-04-26T12:38:21.495330+0000","last_became_active":"2024-04-26T12:38:12.439091+0000","last_became_peered":"2024-04-26T12:38:12.439091+0000","last_unstale":"2024-04-26T12:38:21.495330+0000","last_undegraded":"2024-04-26T12:38:21.495330+0000","last_fullsized":"2024-04-26T12:38:21.495330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504697+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:38:21.504697+0000","last_peered":"2024-04-26T12:38:21.504697+0000","last_clean":"2024-04-26T12:38:21.504697+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:38:21.504697+0000","last_undegraded":"2024-04-26T12:38:21.504697+0000","last_fullsized":"2024-04-26T12:38:21.504697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.502774+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:38:21.502774+0000","last_peered":"2024-04-26T12:38:21.502774+0000","last_clean":"2024-04-26T12:38:21.502774+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:38:21.502774+0000","last_undegraded":"2024-04-26T12:38:21.502774+0000","last_fullsized":"2024-04-26T12:38:21.502774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.812758+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:38:21.812758+0000","last_peered":"2024-04-26T12:38:21.812758+0000","last_clean":"2024-04-26T12:38:21.812758+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:38:21.812758+0000","last_undegraded":"2024-04-26T12:38:21.812758+0000","last_fullsized":"2024-04-26T12:38:21.812758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521239+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:38:21.521239+0000","last_peered":"2024-04-26T12:38:21.521239+0000","last_clean":"2024-04-26T12:38:21.521239+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:38:21.521239+0000","last_undegraded":"2024-04-26T12:38:21.521239+0000","last_fullsized":"2024-04-26T12:38:21.521239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495362+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:38:21.495362+0000","last_peered":"2024-04-26T12:38:21.495362+0000","last_clean":"2024-04-26T12:38:21.495362+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:38:21.495362+0000","last_undegraded":"2024-04-26T12:38:21.495362+0000","last_fullsized":"2024-04-26T12:38:21.495362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492951+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:38:21.492951+0000","last_peered":"2024-04-26T12:38:21.492951+0000","last_clean":"2024-04-26T12:38:21.492951+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:38:21.492951+0000","last_undegraded":"2024-04-26T12:38:21.492951+0000","last_fullsized":"2024-04-26T12:38:21.492951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495974+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:38:21.495974+0000","last_peered":"2024-04-26T12:38:21.495974+0000","last_clean":"2024-04-26T12:38:21.495974+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:38:21.495974+0000","last_undegraded":"2024-04-26T12:38:21.495974+0000","last_fullsized":"2024-04-26T12:38:21.495974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493758+0000","last_change":"2024-04-26T12:38:14.454833+0000","last_active":"2024-04-26T12:38:21.493758+0000","last_peered":"2024-04-26T12:38:21.493758+0000","last_clean":"2024-04-26T12:38:21.493758+0000","last_became_active":"2024-04-26T12:38:14.454109+0000","last_became_peered":"2024-04-26T12:38:14.454109+0000","last_unstale":"2024-04-26T12:38:21.493758+0000","last_undegraded":"2024-04-26T12:38:21.493758+0000","last_fullsized":"2024-04-26T12:38:21.493758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"29'5","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.044462+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:38:22.044462+0000","last_peered":"2024-04-26T12:38:22.044462+0000","last_clean":"2024-04-26T12:38:22.044462+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:38:22.044462+0000","last_undegraded":"2024-04-26T12:38:22.044462+0000","last_fullsized":"2024-04-26T12:38:22.044462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494113+0000","last_change":"2024-04-26T12:38:18.476037+0000","last_active":"2024-04-26T12:38:21.494113+0000","last_peered":"2024-04-26T12:38:21.494113+0000","last_clean":"2024-04-26T12:38:21.494113+0000","last_became_active":"2024-04-26T12:38:18.475286+0000","last_became_peered":"2024-04-26T12:38:18.475286+0000","last_unstale":"2024-04-26T12:38:21.494113+0000","last_undegraded":"2024-04-26T12:38:21.494113+0000","last_fullsized":"2024-04-26T12:38:21.494113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.512848+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:38:21.512848+0000","last_peered":"2024-04-26T12:38:21.512848+0000","last_clean":"2024-04-26T12:38:21.512848+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:38:21.512848+0000","last_undegraded":"2024-04-26T12:38:21.512848+0000","last_fullsized":"2024-04-26T12:38:21.512848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494341+0000","last_change":"2024-04-26T12:38:12.438062+0000","last_active":"2024-04-26T12:38:21.494341+0000","last_peered":"2024-04-26T12:38:21.494341+0000","last_clean":"2024-04-26T12:38:21.494341+0000","last_became_active":"2024-04-26T12:38:12.437302+0000","last_became_peered":"2024-04-26T12:38:12.437302+0000","last_unstale":"2024-04-26T12:38:21.494341+0000","last_undegraded":"2024-04-26T12:38:21.494341+0000","last_fullsized":"2024-04-26T12:38:21.494341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511133+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:38:21.511133+0000","last_peered":"2024-04-26T12:38:21.511133+0000","last_clean":"2024-04-26T12:38:21.511133+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:38:21.511133+0000","last_undegraded":"2024-04-26T12:38:21.511133+0000","last_fullsized":"2024-04-26T12:38:21.511133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491337+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:38:21.491337+0000","last_peered":"2024-04-26T12:38:21.491337+0000","last_clean":"2024-04-26T12:38:21.491337+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:38:21.491337+0000","last_undegraded":"2024-04-26T12:38:21.491337+0000","last_fullsized":"2024-04-26T12:38:21.491337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'9","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:22.117019+0000","last_change":"2024-04-26T12:38:16.464070+0000","last_active":"2024-04-26T12:38:22.117019+0000","last_peered":"2024-04-26T12:38:22.117019+0000","last_clean":"2024-04-26T12:38:22.117019+0000","last_became_active":"2024-04-26T12:38:16.463281+0000","last_became_peered":"2024-04-26T12:38:16.463281+0000","last_unstale":"2024-04-26T12:38:22.117019+0000","last_undegraded":"2024-04-26T12:38:22.117019+0000","last_fullsized":"2024-04-26T12:38:22.117019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:58.107169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507266+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:38:21.507266+0000","last_peered":"2024-04-26T12:38:21.507266+0000","last_clean":"2024-04-26T12:38:21.507266+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:38:21.507266+0000","last_undegraded":"2024-04-26T12:38:21.507266+0000","last_fullsized":"2024-04-26T12:38:21.507266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496957+0000","last_change":"2024-04-26T12:38:20.503205+0000","last_active":"2024-04-26T12:38:21.496957+0000","last_peered":"2024-04-26T12:38:21.496957+0000","last_clean":"2024-04-26T12:38:21.496957+0000","last_became_active":"2024-04-26T12:38:20.502345+0000","last_became_peered":"2024-04-26T12:38:20.502345+0000","last_unstale":"2024-04-26T12:38:21.496957+0000","last_undegraded":"2024-04-26T12:38:21.496957+0000","last_fullsized":"2024-04-26T12:38:21.496957+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497950+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:38:21.497950+0000","last_peered":"2024-04-26T12:38:21.497950+0000","last_clean":"2024-04-26T12:38:21.497950+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:38:21.497950+0000","last_undegraded":"2024-04-26T12:38:21.497950+0000","last_fullsized":"2024-04-26T12:38:21.497950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521143+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:38:21.521143+0000","last_peered":"2024-04-26T12:38:21.521143+0000","last_clean":"2024-04-26T12:38:21.521143+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:38:21.521143+0000","last_undegraded":"2024-04-26T12:38:21.521143+0000","last_fullsized":"2024-04-26T12:38:21.521143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497563+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:38:21.497563+0000","last_peered":"2024-04-26T12:38:21.497563+0000","last_clean":"2024-04-26T12:38:21.497563+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:38:21.497563+0000","last_undegraded":"2024-04-26T12:38:21.497563+0000","last_fullsized":"2024-04-26T12:38:21.497563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.536523+0000","last_change":"2024-04-26T12:38:10.436330+0000","last_active":"2024-04-26T12:38:21.536523+0000","last_peered":"2024-04-26T12:38:21.536523+0000","last_clean":"2024-04-26T12:38:21.536523+0000","last_became_active":"2024-04-26T12:38:10.435576+0000","last_became_peered":"2024-04-26T12:38:10.435576+0000","last_unstale":"2024-04-26T12:38:21.536523+0000","last_undegraded":"2024-04-26T12:38:21.536523+0000","last_fullsized":"2024-04-26T12:38:21.536523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.428203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503906+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:38:21.503906+0000","last_peered":"2024-04-26T12:38:21.503906+0000","last_clean":"2024-04-26T12:38:21.503906+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:38:21.503906+0000","last_undegraded":"2024-04-26T12:38:21.503906+0000","last_fullsized":"2024-04-26T12:38:21.503906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503397+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:38:21.503397+0000","last_peered":"2024-04-26T12:38:21.503397+0000","last_clean":"2024-04-26T12:38:21.503397+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:38:21.503397+0000","last_undegraded":"2024-04-26T12:38:21.503397+0000","last_fullsized":"2024-04-26T12:38:21.503397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.494703+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:38:21.494703+0000","last_peered":"2024-04-26T12:38:21.494703+0000","last_clean":"2024-04-26T12:38:21.494703+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:38:21.494703+0000","last_undegraded":"2024-04-26T12:38:21.494703+0000","last_fullsized":"2024-04-26T12:38:21.494703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.507957+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:38:21.507957+0000","last_peered":"2024-04-26T12:38:21.507957+0000","last_clean":"2024-04-26T12:38:21.507957+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:38:21.507957+0000","last_undegraded":"2024-04-26T12:38:21.507957+0000","last_fullsized":"2024-04-26T12:38:21.507957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495480+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:38:21.495480+0000","last_peered":"2024-04-26T12:38:21.495480+0000","last_clean":"2024-04-26T12:38:21.495480+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:38:21.495480+0000","last_undegraded":"2024-04-26T12:38:21.495480+0000","last_fullsized":"2024-04-26T12:38:21.495480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496230+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:38:21.496230+0000","last_peered":"2024-04-26T12:38:21.496230+0000","last_clean":"2024-04-26T12:38:21.496230+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:38:21.496230+0000","last_undegraded":"2024-04-26T12:38:21.496230+0000","last_fullsized":"2024-04-26T12:38:21.496230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495507+0000","last_change":"2024-04-26T12:38:12.457598+0000","last_active":"2024-04-26T12:38:21.495507+0000","last_peered":"2024-04-26T12:38:21.495507+0000","last_clean":"2024-04-26T12:38:21.495507+0000","last_became_active":"2024-04-26T12:38:12.456792+0000","last_became_peered":"2024-04-26T12:38:12.456792+0000","last_unstale":"2024-04-26T12:38:21.495507+0000","last_undegraded":"2024-04-26T12:38:21.495507+0000","last_fullsized":"2024-04-26T12:38:21.495507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.497091+0000","last_change":"2024-04-26T12:38:10.446304+0000","last_active":"2024-04-26T12:38:21.497091+0000","last_peered":"2024-04-26T12:38:21.497091+0000","last_clean":"2024-04-26T12:38:21.497091+0000","last_became_active":"2024-04-26T12:38:10.445526+0000","last_became_peered":"2024-04-26T12:38:10.445526+0000","last_unstale":"2024-04-26T12:38:21.497091+0000","last_undegraded":"2024-04-26T12:38:21.497091+0000","last_fullsized":"2024-04-26T12:38:21.497091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492543+0000","last_change":"2024-04-26T12:38:12.448125+0000","last_active":"2024-04-26T12:38:21.492543+0000","last_peered":"2024-04-26T12:38:21.492543+0000","last_clean":"2024-04-26T12:38:21.492543+0000","last_became_active":"2024-04-26T12:38:12.444323+0000","last_became_peered":"2024-04-26T12:38:12.444323+0000","last_unstale":"2024-04-26T12:38:21.492543+0000","last_undegraded":"2024-04-26T12:38:21.492543+0000","last_fullsized":"2024-04-26T12:38:21.492543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.524186+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:38:21.524186+0000","last_peered":"2024-04-26T12:38:21.524186+0000","last_clean":"2024-04-26T12:38:21.524186+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:38:21.524186+0000","last_undegraded":"2024-04-26T12:38:21.524186+0000","last_fullsized":"2024-04-26T12:38:21.524186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.521013+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:38:21.521013+0000","last_peered":"2024-04-26T12:38:21.521013+0000","last_clean":"2024-04-26T12:38:21.521013+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:38:21.521013+0000","last_undegraded":"2024-04-26T12:38:21.521013+0000","last_fullsized":"2024-04-26T12:38:21.521013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.495338+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:38:21.495338+0000","last_peered":"2024-04-26T12:38:21.495338+0000","last_clean":"2024-04-26T12:38:21.495338+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:38:21.495338+0000","last_undegraded":"2024-04-26T12:38:21.495338+0000","last_fullsized":"2024-04-26T12:38:21.495338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511310+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:38:21.511310+0000","last_peered":"2024-04-26T12:38:21.511310+0000","last_clean":"2024-04-26T12:38:21.511310+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:38:21.511310+0000","last_undegraded":"2024-04-26T12:38:21.511310+0000","last_fullsized":"2024-04-26T12:38:21.511310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504010+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:38:21.504010+0000","last_peered":"2024-04-26T12:38:21.504010+0000","last_clean":"2024-04-26T12:38:21.504010+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:38:21.504010+0000","last_undegraded":"2024-04-26T12:38:21.504010+0000","last_fullsized":"2024-04-26T12:38:21.504010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496519+0000","last_change":"2024-04-26T12:38:12.447248+0000","last_active":"2024-04-26T12:38:21.496519+0000","last_peered":"2024-04-26T12:38:21.496519+0000","last_clean":"2024-04-26T12:38:21.496519+0000","last_became_active":"2024-04-26T12:38:12.446444+0000","last_became_peered":"2024-04-26T12:38:12.446444+0000","last_unstale":"2024-04-26T12:38:21.496519+0000","last_undegraded":"2024-04-26T12:38:21.496519+0000","last_fullsized":"2024-04-26T12:38:21.496519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.493001+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:38:21.493001+0000","last_peered":"2024-04-26T12:38:21.493001+0000","last_clean":"2024-04-26T12:38:21.493001+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:38:21.493001+0000","last_undegraded":"2024-04-26T12:38:21.493001+0000","last_fullsized":"2024-04-26T12:38:21.493001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.537873+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:38:21.537873+0000","last_peered":"2024-04-26T12:38:21.537873+0000","last_clean":"2024-04-26T12:38:21.537873+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:38:21.537873+0000","last_undegraded":"2024-04-26T12:38:21.537873+0000","last_fullsized":"2024-04-26T12:38:21.537873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503305+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:38:21.503305+0000","last_peered":"2024-04-26T12:38:21.503305+0000","last_clean":"2024-04-26T12:38:21.503305+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:38:21.503305+0000","last_undegraded":"2024-04-26T12:38:21.503305+0000","last_fullsized":"2024-04-26T12:38:21.503305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.496150+0000","last_change":"2024-04-26T12:38:12.455971+0000","last_active":"2024-04-26T12:38:21.496150+0000","last_peered":"2024-04-26T12:38:21.496150+0000","last_clean":"2024-04-26T12:38:21.496150+0000","last_became_active":"2024-04-26T12:38:12.455261+0000","last_became_peered":"2024-04-26T12:38:12.455261+0000","last_unstale":"2024-04-26T12:38:21.496150+0000","last_undegraded":"2024-04-26T12:38:21.496150+0000","last_fullsized":"2024-04-26T12:38:21.496150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.508246+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:38:21.508246+0000","last_peered":"2024-04-26T12:38:21.508246+0000","last_clean":"2024-04-26T12:38:21.508246+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:38:21.508246+0000","last_undegraded":"2024-04-26T12:38:21.508246+0000","last_fullsized":"2024-04-26T12:38:21.508246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.511798+0000","last_change":"2024-04-26T12:38:12.464343+0000","last_active":"2024-04-26T12:38:21.511798+0000","last_peered":"2024-04-26T12:38:21.511798+0000","last_clean":"2024-04-26T12:38:21.511798+0000","last_became_active":"2024-04-26T12:38:12.463599+0000","last_became_peered":"2024-04-26T12:38:12.463599+0000","last_unstale":"2024-04-26T12:38:21.511798+0000","last_undegraded":"2024-04-26T12:38:21.511798+0000","last_fullsized":"2024-04-26T12:38:21.511798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.523244+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:38:21.523244+0000","last_peered":"2024-04-26T12:38:21.523244+0000","last_clean":"2024-04-26T12:38:21.523244+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:38:21.523244+0000","last_undegraded":"2024-04-26T12:38:21.523244+0000","last_fullsized":"2024-04-26T12:38:21.523244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.506266+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:38:21.506266+0000","last_peered":"2024-04-26T12:38:21.506266+0000","last_clean":"2024-04-26T12:38:21.506266+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:38:21.506266+0000","last_undegraded":"2024-04-26T12:38:21.506266+0000","last_fullsized":"2024-04-26T12:38:21.506266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.513431+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:38:21.513431+0000","last_peered":"2024-04-26T12:38:21.513431+0000","last_clean":"2024-04-26T12:38:21.513431+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:38:21.513431+0000","last_undegraded":"2024-04-26T12:38:21.513431+0000","last_fullsized":"2024-04-26T12:38:21.513431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.492462+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:38:21.492462+0000","last_peered":"2024-04-26T12:38:21.492462+0000","last_clean":"2024-04-26T12:38:21.492462+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:38:21.492462+0000","last_undegraded":"2024-04-26T12:38:21.492462+0000","last_fullsized":"2024-04-26T12:38:21.492462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.538533+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:38:21.538533+0000","last_peered":"2024-04-26T12:38:21.538533+0000","last_clean":"2024-04-26T12:38:21.538533+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:38:21.538533+0000","last_undegraded":"2024-04-26T12:38:21.538533+0000","last_fullsized":"2024-04-26T12:38:21.538533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.510882+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:38:21.510882+0000","last_peered":"2024-04-26T12:38:21.510882+0000","last_clean":"2024-04-26T12:38:21.510882+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:38:21.510882+0000","last_undegraded":"2024-04-26T12:38:21.510882+0000","last_fullsized":"2024-04-26T12:38:21.510882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504825+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:38:21.504825+0000","last_peered":"2024-04-26T12:38:21.504825+0000","last_clean":"2024-04-26T12:38:21.504825+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:38:21.504825+0000","last_undegraded":"2024-04-26T12:38:21.504825+0000","last_fullsized":"2024-04-26T12:38:21.504825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.503759+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:38:21.503759+0000","last_peered":"2024-04-26T12:38:21.503759+0000","last_clean":"2024-04-26T12:38:21.503759+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:38:21.503759+0000","last_undegraded":"2024-04-26T12:38:21.503759+0000","last_fullsized":"2024-04-26T12:38:21.503759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.509739+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:38:21.509739+0000","last_peered":"2024-04-26T12:38:21.509739+0000","last_clean":"2024-04-26T12:38:21.509739+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:38:21.509739+0000","last_undegraded":"2024-04-26T12:38:21.509739+0000","last_fullsized":"2024-04-26T12:38:21.509739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.491993+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:38:21.491993+0000","last_peered":"2024-04-26T12:38:21.491993+0000","last_clean":"2024-04-26T12:38:21.491993+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:38:21.491993+0000","last_undegraded":"2024-04-26T12:38:21.491993+0000","last_fullsized":"2024-04-26T12:38:21.491993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-26T12:38:21.504228+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:38:21.504228+0000","last_peered":"2024-04-26T12:38:21.504228+0000","last_clean":"2024-04-26T12:38:21.504228+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:38:21.504228+0000","last_undegraded":"2024-04-26T12:38:21.504228+0000","last_fullsized":"2024-04-26T12:38:21.504228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":962560,"data_stored":734425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":143397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":145654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":142895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":360448,"data_stored":143793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":335872,"data_stored":143395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":144640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":942080,"data_stored":733831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:38:28.836 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:38:28.836 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T12:38:29.171 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 29 2024-04-26T12:38:29.171 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 4374a7a0-1dca-4b47-945f-16be0ea888cb 2024-04-26T12:38:29.171 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-04-26T12:37:51.731809+0000 2024-04-26T12:38:29.171 INFO:teuthology.orchestra.run.smithi016.stdout:modified 2024-04-26T12:38:21.483187+0000 2024-04-26T12:38:29.171 INFO:teuthology.orchestra.run.smithi016.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T12:38:29.171 INFO:teuthology.orchestra.run.smithi016.stdout:crush_version 4 2024-04-26T12:38:29.171 INFO:teuthology.orchestra.run.smithi016.stdout:full_ratio 0.95 2024-04-26T12:38:29.171 INFO:teuthology.orchestra.run.smithi016.stdout:backfillfull_ratio 0.9 2024-04-26T12:38:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:nearfull_ratio 0.85 2024-04-26T12:38:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:require_min_compat_client luminous 2024-04-26T12:38:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:min_compat_client jewel 2024-04-26T12:38:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:require_osd_release squid 2024-04-26T12:38:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:stretch_mode_enabled false 2024-04-26T12:38:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-04-26T12:38:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-04-26T12:38:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-04-26T12:38:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-04-26T12:38:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-04-26T12:38:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-26T12:38:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 27 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-26T12:38:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 29 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-04-26T12:38:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:max_osd 8 2024-04-26T12:38:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6808/389368420,v1:172.21.15.16:6809/389368420] [v2:172.21.15.16:6810/389368420,v1:172.21.15.16:6811/389368420] exists,up 90a13ba3-26fb-4d53-bc0e-3583fa4cb8db 2024-04-26T12:38:29.173 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6800/1763484355,v1:172.21.15.16:6801/1763484355] [v2:172.21.15.16:6802/1763484355,v1:172.21.15.16:6803/1763484355] exists,up 60315ae7-75f7-42f0-ab6b-f0fe033f1b55 2024-04-26T12:38:29.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2 up in weight 1 up_from 13 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6824/732776315,v1:172.21.15.16:6825/732776315] [v2:172.21.15.16:6826/732776315,v1:172.21.15.16:6827/732776315] exists,up e28bef44-fbf9-4f45-b0da-c32cf691116c 2024-04-26T12:38:29.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6816/979309964,v1:172.21.15.16:6817/979309964] [v2:172.21.15.16:6818/979309964,v1:172.21.15.16:6819/979309964] exists,up 70916512-1197-4640-9b97-8347d50bf4ec 2024-04-26T12:38:29.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6800/4277454900,v1:172.21.15.131:6801/4277454900] [v2:172.21.15.131:6802/4277454900,v1:172.21.15.131:6803/4277454900] exists,up 15c55012-eac6-4672-b905-d5cc0bf1979c 2024-04-26T12:38:29.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6808/1890605084,v1:172.21.15.131:6809/1890605084] [v2:172.21.15.131:6810/1890605084,v1:172.21.15.131:6811/1890605084] exists,up 7d4bbd49-33e4-43b2-a28b-891d83bf482a 2024-04-26T12:38:29.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6824/2862642741,v1:172.21.15.131:6825/2862642741] [v2:172.21.15.131:6826/2862642741,v1:172.21.15.131:6827/2862642741] exists,up 3f455889-5a74-491d-b799-9703cfeed14a 2024-04-26T12:38:29.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6816/2576109125,v1:172.21.15.131:6817/2576109125] [v2:172.21.15.131:6818/2576109125,v1:172.21.15.131:6819/2576109125] exists,up 22f42260-a14c-4667-95d6-b6392596f262 2024-04-26T12:38:29.190 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6808/389368420,v1:172.21.15.16:6809/389368420] [v2:172.21.15.16:6810/389368420,v1:172.21.15.16:6811/389368420] exists,up 90a13ba3-26fb-4d53-bc0e-3583fa4cb8db', 'osd.1 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6800/1763484355,v1:172.21.15.16:6801/1763484355] [v2:172.21.15.16:6802/1763484355,v1:172.21.15.16:6803/1763484355] exists,up 60315ae7-75f7-42f0-ab6b-f0fe033f1b55', 'osd.2 up in weight 1 up_from 13 up_thru 25 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6824/732776315,v1:172.21.15.16:6825/732776315] [v2:172.21.15.16:6826/732776315,v1:172.21.15.16:6827/732776315] exists,up e28bef44-fbf9-4f45-b0da-c32cf691116c', 'osd.3 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.16:6816/979309964,v1:172.21.15.16:6817/979309964] [v2:172.21.15.16:6818/979309964,v1:172.21.15.16:6819/979309964] exists,up 70916512-1197-4640-9b97-8347d50bf4ec', 'osd.4 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6800/4277454900,v1:172.21.15.131:6801/4277454900] [v2:172.21.15.131:6802/4277454900,v1:172.21.15.131:6803/4277454900] exists,up 15c55012-eac6-4672-b905-d5cc0bf1979c', 'osd.5 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6808/1890605084,v1:172.21.15.131:6809/1890605084] [v2:172.21.15.131:6810/1890605084,v1:172.21.15.131:6811/1890605084] exists,up 7d4bbd49-33e4-43b2-a28b-891d83bf482a', 'osd.6 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6824/2862642741,v1:172.21.15.131:6825/2862642741] [v2:172.21.15.131:6826/2862642741,v1:172.21.15.131:6827/2862642741] exists,up 3f455889-5a74-491d-b799-9703cfeed14a', 'osd.7 up in weight 1 up_from 13 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6816/2576109125,v1:172.21.15.131:6817/2576109125] [v2:172.21.15.131:6818/2576109125,v1:172.21.15.131:6819/2576109125] exists,up 22f42260-a14c-4667-95d6-b6392596f262'] 2024-04-26T12:38:29.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T12:38:29.312 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:29.312 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "mon.a", 2024-04-26T12:38:29.312 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster": "ceph", 2024-04-26T12:38:29.312 INFO:teuthology.orchestra.run.smithi016.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T12:38:29.312 INFO:teuthology.orchestra.run.smithi016.stdout: "admin_socket_mode": "", 2024-04-26T12:38:29.313 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T12:38:29.313 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_client_required": "cephx, none", 2024-04-26T12:38:29.313 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_cluster_required": "cephx", 2024-04-26T12:38:29.313 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_debug": "true", 2024-04-26T12:38:29.313 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T12:38:29.313 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T12:38:29.313 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_service_required": "cephx", 2024-04-26T12:38:29.314 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T12:38:29.314 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_supported": "cephx", 2024-04-26T12:38:29.314 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_aio": "true", 2024-04-26T12:38:29.314 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T12:38:29.314 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T12:38:29.314 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_aio_reap_max": "16", 2024-04-26T12:38:29.315 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_async_discard": "false", 2024-04-26T12:38:29.315 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_block_size": "4096", 2024-04-26T12:38:29.315 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_debug_aio": "false", 2024-04-26T12:38:29.315 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T12:38:29.315 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T12:38:29.315 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T12:38:29.316 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_enable_discard": "false", 2024-04-26T12:38:29.316 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_flock_retry": "3", 2024-04-26T12:38:29.316 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T12:38:29.316 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_inject_crash": "0", 2024-04-26T12:38:29.316 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T12:38:29.316 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_ioring": "false", 2024-04-26T12:38:29.317 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_ioring_hipri": "false", 2024-04-26T12:38:29.317 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T12:38:29.317 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T12:38:29.317 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T12:38:29.317 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T12:38:29.317 INFO:teuthology.orchestra.run.smithi016.stdout: "bdev_type": "", 2024-04-26T12:38:29.317 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T12:38:29.318 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_allocator": "hybrid", 2024-04-26T12:38:29.318 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_buffered_io": "true", 2024-04-26T12:38:29.318 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T12:38:29.318 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T12:38:29.318 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T12:38:29.318 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T12:38:29.318 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T12:38:29.318 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T12:38:29.319 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T12:38:29.319 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T12:38:29.319 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T12:38:29.319 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T12:38:29.319 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T12:38:29.319 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T12:38:29.319 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_replay_recovery": "false", 2024-04-26T12:38:29.319 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T12:38:29.319 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T12:38:29.320 INFO:teuthology.orchestra.run.smithi016.stdout: "bluefs_sync_write": "false", 2024-04-26T12:38:29.320 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T12:38:29.320 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T12:38:29.320 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T12:38:29.320 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T12:38:29.320 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_allocator": "hybrid", 2024-04-26T12:38:29.320 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T12:38:29.320 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T12:38:29.321 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T12:38:29.321 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T12:38:29.321 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T12:38:29.321 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T12:38:29.321 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T12:38:29.321 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_create": "true", 2024-04-26T12:38:29.321 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_db_create": "false", 2024-04-26T12:38:29.322 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_db_path": "", 2024-04-26T12:38:29.322 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_db_size": "0", 2024-04-26T12:38:29.322 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_path": "", 2024-04-26T12:38:29.322 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T12:38:29.322 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_size": "107374182400", 2024-04-26T12:38:29.322 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_wal_create": "false", 2024-04-26T12:38:29.322 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_wal_path": "", 2024-04-26T12:38:29.323 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T12:38:29.323 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bluefs": "true", 2024-04-26T12:38:29.323 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T12:38:29.323 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T12:38:29.323 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T12:38:29.323 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T12:38:29.324 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:38:29.324 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:38:29.324 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T12:38:29.324 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T12:38:29.324 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_autotune": "true", 2024-04-26T12:38:29.324 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T12:38:29.324 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T12:38:29.325 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T12:38:29.325 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T12:38:29.325 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_size": "0", 2024-04-26T12:38:29.325 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T12:38:29.325 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T12:38:29.325 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T12:38:29.326 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T12:38:29.326 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cache_type": "2q", 2024-04-26T12:38:29.326 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T12:38:29.326 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_clone_cow": "true", 2024-04-26T12:38:29.326 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T12:38:29.326 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T12:38:29.327 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T12:38:29.327 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T12:38:29.327 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T12:38:29.327 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T12:38:29.327 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T12:38:29.327 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_mode": "none", 2024-04-26T12:38:29.327 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T12:38:29.327 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T12:38:29.327 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_freelist": "false", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T12:38:29.328 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T12:38:29.329 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fail_eio": "false", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T12:38:29.330 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T12:38:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_blob_size": "0", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T12:38:29.332 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_spdk_mem": "512", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T12:38:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_tracing": "false", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T12:38:29.334 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T12:38:29.335 INFO:teuthology.orchestra.run.smithi016.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T12:38:29.335 INFO:teuthology.orchestra.run.smithi016.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T12:38:29.335 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T12:38:29.335 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T12:38:29.335 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T12:38:29.335 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T12:38:29.335 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T12:38:29.335 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T12:38:29.336 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T12:38:29.336 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T12:38:29.336 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T12:38:29.336 INFO:teuthology.orchestra.run.smithi016.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T12:38:29.336 INFO:teuthology.orchestra.run.smithi016.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T12:38:29.336 INFO:teuthology.orchestra.run.smithi016.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T12:38:29.336 INFO:teuthology.orchestra.run.smithi016.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_cluster_require_version": "2", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_require_signatures": "false", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_require_version": "2", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_service_require_signatures": "false", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_service_require_version": "2", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "cephx_sign_messages": "true", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "chdir": "", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client_acl_type": "", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client_asio_thread_count": "2", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client_cache_mid": "0.750000", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client_cache_size": "16384", 2024-04-26T12:38:29.337 INFO:teuthology.orchestra.run.smithi016.stdout: "client_caps_release_delay": "5", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_check_pool_perm": "true", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_debug_force_sync_read": "false", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_debug_getattr_caps": "false", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_die_on_failed_remount": "false", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_dirsize_rbytes": "true", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_force_lazyio": "false", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_fs": "", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_inject_release_failure": "false", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_max_inline_size": "4096", 2024-04-26T12:38:29.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T12:38:29.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mds_namespace": "", 2024-04-26T12:38:29.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_metadata": "", 2024-04-26T12:38:29.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mount_gid": "-1", 2024-04-26T12:38:29.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mount_timeout": "300", 2024-04-26T12:38:29.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mount_uid": "-1", 2024-04-26T12:38:29.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_mountpoint": "/", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_notify_timeout": "10", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc": "true", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_max_objects": "1000", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_size": "209715200", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_permissions": "true", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_quota": "true", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_quota_df": "true", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_readahead_max_bytes": "0", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_readahead_max_periods": "4", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_readahead_min": "131072", 2024-04-26T12:38:29.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_reconnect_stale": "false", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_shutdown_timeout": "30", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_snapdir": ".snap", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_tick_interval": "1", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_trace": "", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_use_faked_inos": "false", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "client_use_random_mds": "false", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_graylog": "false", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_graylog_port": "12201", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_monitors": "default=true", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_syslog": "false", 2024-04-26T12:38:29.341 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "clog_to_syslog_level": "info", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_addr": "-", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_network": "", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_network_interface": "", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "compressor_zlib_isal": "false", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "compressor_zlib_level": "5", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "compressor_zstd_level": "1", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T12:38:29.342 INFO:teuthology.orchestra.run.smithi016.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "crimson_seastar_cpu_cores": "", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_location": "", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_location_hook": "", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "crush_location_hook_timeout": "10", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "daemonize": "false", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "daos_pool": "tank", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_alienstore": "0/5", 2024-04-26T12:38:29.343 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_asok": "1/5", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_asok_assert_abort": "false", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_auth": "20/20", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_bdev": "1/3", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_bluefs": "1/5", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_bluestore": "1/5", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_buffer": "0/1", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_cephsqlite": "0/5", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_client": "0/5", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_compressor": "1/5", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_context": "0/1", 2024-04-26T12:38:29.344 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_crimson_interrupt": "0/5", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_crush": "1/1", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_crypto": "1/5", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_cyanstore": "0/5", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_dpdk": "1/5", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_eventtrace": "1/5", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_filer": "0/1", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_filestore": "1/3", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_finisher": "1/1", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_fuse": "1/5", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T12:38:29.345 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_javaclient": "1/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_journal": "1/3", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_journaler": "0/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_kstore": "1/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_lockdep": "0/1", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mclock": "1/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds": "1/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_balancer": "1/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_locker": "1/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_log": "1/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_migrator": "1/5", 2024-04-26T12:38:29.346 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mds_quiesce": "3/5", 2024-04-26T12:38:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_memstore": "1/5", 2024-04-26T12:38:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mgr": "2/5", 2024-04-26T12:38:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mgrc": "1/5", 2024-04-26T12:38:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_mon": "20/20", 2024-04-26T12:38:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_monc": "0/10", 2024-04-26T12:38:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_ms": "1/1", 2024-04-26T12:38:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_none": "0/5", 2024-04-26T12:38:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_objclass": "0/5", 2024-04-26T12:38:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_objectcacher": "0/5", 2024-04-26T12:38:29.348 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_objecter": "0/1", 2024-04-26T12:38:29.348 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_optracker": "0/5", 2024-04-26T12:38:29.348 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_osd": "1/5", 2024-04-26T12:38:29.348 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_paxos": "20/20", 2024-04-26T12:38:29.348 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_perfcounter": "1/5", 2024-04-26T12:38:29.348 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_prioritycache": "1/5", 2024-04-26T12:38:29.348 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rados": "0/5", 2024-04-26T12:38:29.349 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rbd": "0/5", 2024-04-26T12:38:29.349 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T12:38:29.349 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T12:38:29.349 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rbd_replay": "0/5", 2024-04-26T12:38:29.349 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_refs": "0/0", 2024-04-26T12:38:29.350 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_reserver": "1/1", 2024-04-26T12:38:29.350 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw": "1/5", 2024-04-26T12:38:29.350 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_access": "1/5", 2024-04-26T12:38:29.350 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T12:38:29.350 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T12:38:29.350 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_flight": "1/5", 2024-04-26T12:38:29.350 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-26T12:38:29.350 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rgw_sync": "1/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_rocksdb": "4/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore": "0/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_backref": "0/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_cache": "0/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_device": "0/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_epm": "0/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_journal": "0/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_lba": "0/5", 2024-04-26T12:38:29.351 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_odata": "0/5", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_omap": "0/5", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_onode": "0/5", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_t": "0/5", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_seastore_tm": "0/5", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_striper": "0/1", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_test": "0/5", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_throttle": "1/1", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_timer": "0/1", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_tp": "0/5", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "debug_trace": "1/5", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "device_failure_prediction_mode": "none", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T12:38:29.352 INFO:teuthology.orchestra.run.smithi016.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "err_to_graylog": "false", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "err_to_journald": "false", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "err_to_stderr": "true", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "err_to_syslog": "false", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event_tracing": "false", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_http_port": "9926", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_prio_limit": "5", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_sort_metrics": "true", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "exporter_stats_period": "5", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "fake_statfs_for_testing": "0", 2024-04-26T12:38:29.353 INFO:teuthology.orchestra.run.smithi016.stdout: "fatal_signal_handlers": "true", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filer_max_purge_ops": "10", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filer_max_truncate_ops": "128", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_blackhole": "false", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_btrfs_snap": "true", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_caller_concurrency": "10", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_debug_omap_check": "false", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T12:38:29.354 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_debug_verify_split": "false", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_dump_file": "", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fadvise": "true", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fail_eio": "true", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fd_cache_size": "128", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fiemap": "false", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_inject_stall": "0", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_journal_parallel": "false", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_journal_trailing": "false", 2024-04-26T12:38:29.355 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_journal_writeahead": "false", 2024-04-26T12:38:29.356 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_kill_at": "0", 2024-04-26T12:38:29.356 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T12:38:29.356 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T12:38:29.356 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T12:38:29.356 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T12:38:29.356 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T12:38:29.356 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T12:38:29.356 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T12:38:29.357 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T12:38:29.357 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T12:38:29.357 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T12:38:29.357 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T12:38:29.357 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T12:38:29.357 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T12:38:29.357 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_merge_threshold": "-10", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_odsync_write": "false", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_omap_backend_path": "", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T12:38:29.358 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_op_threads": "2", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_punch_hole": "false", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T12:38:29.359 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T12:38:29.360 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_queue_max_ops": "50", 2024-04-26T12:38:29.360 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T12:38:29.360 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_seek_data_hole": "false", 2024-04-26T12:38:29.360 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_sloppy_crc": "false", 2024-04-26T12:38:29.360 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T12:38:29.360 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_splice": "false", 2024-04-26T12:38:29.360 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_split_multiple": "2", 2024-04-26T12:38:29.360 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_split_rand_factor": "20", 2024-04-26T12:38:29.360 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_update_to": "1000", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_xfs_extsize": "false", 2024-04-26T12:38:29.361 INFO:teuthology.orchestra.run.smithi016.stdout: "filestore_zfs_snap": "false", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fio_dir": "/tmp/fio", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fsid": "4374a7a0-1dca-4b47-945f-16be0ea888cb", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_allow_other": "true", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_big_writes": "true", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_debug": "false", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_default_permissions": "false", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_disable_pagecache": "false", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_max_write": "0", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_multithreaded": "true", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_require_active_mds": "true", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_set_user_groups": "true", 2024-04-26T12:38:29.362 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_splice_move": "true", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_splice_read": "true", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_splice_write": "true", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "gss_target_name": "ceph", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "heartbeat_file": "", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "heartbeat_inject_failure": "0", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "heartbeat_interval": "5", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "host": "smithi016", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T12:38:29.363 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "inject_early_sigterm": "false", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "jaeger_agent_port": "6799", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "jaeger_tracing_enable": "false", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_aio": "true", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_align_min_size": "65536", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_block_align": "true", 2024-04-26T12:38:29.364 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_block_size": "4096", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_dio": "true", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_discard": "false", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_force_aio": "false", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_ignore_corruption": "false", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_max_write_entries": "100", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_replay_from": "0", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_write_header_frequency": "0", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journal_zero_on_create": "false", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journaler_prefetch_periods": "10", 2024-04-26T12:38:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: "journaler_prezero_periods": "5", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "journaler_write_head_interval": "15", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "keyfile": "", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_backend": "rocksdb", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_max_bytes": "67108864", 2024-04-26T12:38:29.366 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_max_ops": "512", 2024-04-26T12:38:29.367 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T12:38:29.367 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_onode_map_size": "1024", 2024-04-26T12:38:29.367 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T12:38:29.367 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T12:38:29.367 INFO:teuthology.orchestra.run.smithi016.stdout: "kstore_sync_transaction": "false", 2024-04-26T12:38:29.367 INFO:teuthology.orchestra.run.smithi016.stdout: "librados_thread_count": "2", 2024-04-26T12:38:29.367 INFO:teuthology.orchestra.run.smithi016.stdout: "lockdep": "false", 2024-04-26T12:38:29.367 INFO:teuthology.orchestra.run.smithi016.stdout: "lockdep_force_backtrace": "false", 2024-04-26T12:38:29.367 INFO:teuthology.orchestra.run.smithi016.stdout: "log_coarse_timestamps": "true", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_flush_on_exit": "false", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_graylog_port": "12201", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_max_new": "1000", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_max_recent": "10000", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_stderr_prefix": "", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_file": "true", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_graylog": "false", 2024-04-26T12:38:29.368 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_journald": "false", 2024-04-26T12:38:29.369 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_stderr": "false", 2024-04-26T12:38:29.369 INFO:teuthology.orchestra.run.smithi016.stdout: "log_to_syslog": "false", 2024-04-26T12:38:29.369 INFO:teuthology.orchestra.run.smithi016.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T12:38:29.369 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T12:38:29.369 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_action_on_write_error": "1", 2024-04-26T12:38:29.369 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_alternate_name_max": "8192", 2024-04-26T12:38:29.369 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_asio_thread_count": "2", 2024-04-26T12:38:29.369 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_export_pin": "true", 2024-04-26T12:38:29.370 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T12:38:29.370 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T12:38:29.370 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T12:38:29.370 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T12:38:29.370 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T12:38:29.370 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_interval": "10", 2024-04-26T12:38:29.370 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_max": "-1", 2024-04-26T12:38:29.370 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_max_until": "-1", 2024-04-26T12:38:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_merge_size": "50", 2024-04-26T12:38:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T12:38:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T12:38:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T12:38:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T12:38:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_mode": "0", 2024-04-26T12:38:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T12:38:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T12:38:29.371 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_overload_epochs": "2", 2024-04-26T12:38:29.372 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T12:38:29.372 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T12:38:29.372 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_split_bits": "3", 2024-04-26T12:38:29.372 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T12:38:29.372 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_split_size": "10000", 2024-04-26T12:38:29.372 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T12:38:29.372 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T12:38:29.372 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T12:38:29.373 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T12:38:29.373 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T12:38:29.373 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T12:38:29.373 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T12:38:29.373 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_mid": "0.700000", 2024-04-26T12:38:29.373 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-26T12:38:29.373 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_delay": "0", 2024-04-26T12:38:29.373 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-26T12:38:29.373 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_trim_interval": "1", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T12:38:29.374 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_debug_auth_pins": "false", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_debug_frag": "false", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_debug_scatterstat": "false", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_debug_subtrees": "false", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_default_dir_hash": "2", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_defer_session_stale": "true", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T12:38:29.375 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dir_max_entries": "0", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dir_prefetch": "true", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_early_reply": "true", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_enable_op_tracker": "true", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_enforce_unique_name": "true", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T12:38:29.376 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T12:38:29.377 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T12:38:29.377 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T12:38:29.377 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T12:38:29.377 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T12:38:29.377 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T12:38:29.377 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T12:38:29.377 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T12:38:29.378 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T12:38:29.378 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T12:38:29.378 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T12:38:29.378 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T12:38:29.378 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T12:38:29.378 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_health_dummy": "false", 2024-04-26T12:38:29.378 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T12:38:29.378 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_join_fs": "", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_journal_format": "1", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_create_at": "0", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_export_at": "0", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_import_at": "0", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_journal_at": "0", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_link_at": "0", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T12:38:29.379 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_openc_at": "0", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_rename_at": "0", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_shutdown_at": "0", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_event_large_threshold": "524288", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_max_events": "-1", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_max_segments": "128", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_pause": "false", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_segment_size": "0", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_trim_threshold": "128", 2024-04-26T12:38:29.380 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_completed_requests": "100000", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_export_size": "20971520", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_file_recover": "32", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_purge_files": "64", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_purge_ops": "8192", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_metrics_update_interval": "2", 2024-04-26T12:38:29.381 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_min_caps_per_client": "100", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_numa_node": "-1", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_history_duration": "600", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_history_size": "20", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_op_log_threshold": "5", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_ping_grace": "15", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_ping_interval": "5", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T12:38:29.382 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_max_caps": "30000", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_replay_interval": "1.000000", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_root_ino_gid": "0", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_root_ino_uid": "0", 2024-04-26T12:38:29.383 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_shutdown_check": "0", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_skip_ino": "0", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T12:38:29.384 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_snap_min_uid": "0", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_snap_rstat": "false", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_symlink_recovery": "true", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_thrash_exports": "0", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_thrash_fragments": "0", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_tick_interval": "5.000000", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_valgrind_exit": "false", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_verify_backtrace": "1", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_verify_scatter": "false", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_wipe_sessions": "false", 2024-04-26T12:38:29.385 INFO:teuthology.orchestra.run.smithi016.stdout: "mempool_debug": "false", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "memstore_page_set": "false", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "memstore_page_size": "65536", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_client_bytes": "134217728", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_client_messages": "512", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_disabled_modules": "", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T12:38:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_mds_messages": "128", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_mon_messages": "128", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_osd_messages": "8192", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_pool": "true", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T12:38:29.387 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_standby_modules": "true", 2024-04-26T12:38:29.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_stats_period": "5", 2024-04-26T12:38:29.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_stats_threshold": "5", 2024-04-26T12:38:29.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_tick_period": "2", 2024-04-26T12:38:29.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T12:38:29.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T12:38:29.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_allow_pool_delete": "true", 2024-04-26T12:38:29.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T12:38:29.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T12:38:29.388 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_bytes": "104857600", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T12:38:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_client_target_rank": "-1", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T12:38:29.390 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_compact_on_start": "false", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_compact_on_trim": "true", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_cpu_threads": "4", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T12:38:29.391 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_data_avail_crit": "5", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_data_avail_warn": "5", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_dump_json": "false", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_extra_checks": "false", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_no_require_squid": "false", 2024-04-26T12:38:29.392 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_down_uptime_grace": "60", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_election_default_strategy": "1", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_election_timeout": "5.000000", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_enable_op_tracker": "true", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_fake_pool_delete": "false", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_force_quorum_join": "false", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T12:38:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_log_update_period": "5", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_max_detail": "50", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_to_clog": "true", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_host": "172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790],172.21.15.131", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_host_override": "", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_initial_members": "", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T12:38:29.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_lease": "5.000000", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_log_full_interval": "50", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_log_max": "10000", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_log_max_summary": "50", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_log_epochs": "500", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_osd": "10000", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T12:38:29.395 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_memory_autotune": "true", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_memory_target": "2147483648", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_digest_period": "5", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_complaint_time": "30", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_history_duration": "600", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_history_size": "20", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T12:38:29.396 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_op_log_threshold": "5", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_cache_size": "500", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T12:38:29.397 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T12:38:29.398 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_report_timeout": "900", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T12:38:29.399 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_reweight_max_osds": "4", 2024-04-26T12:38:29.400 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_interval": "86400", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_max_keys": "100", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_scrub_timeout": "300", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_session_timeout": "300", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_smart_report_timeout": "5", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stretch_pool_size": "4", 2024-04-26T12:38:29.401 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T12:38:29.402 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T12:38:29.402 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_debug": "false", 2024-04-26T12:38:29.402 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T12:38:29.402 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T12:38:29.402 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T12:38:29.402 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_tick_interval": "5", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T12:38:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_older_version": "true", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T12:38:29.404 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "monmap": "", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "motr_tracing_enabled": "false", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_op_threads": "3", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_cm": "false", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_device_name": "", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T12:38:29.405 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_sl": "3", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_rdma_type": "ib", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_async_reap_threshold": "5", 2024-04-26T12:38:29.406 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_before_connect": "false", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_ipv4": "true", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_ipv6": "false", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_msgr1": "true", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_msgr2": "true", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_port_max": "7568", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_port_min": "6800", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_retry_count": "3", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_bind_retry_delay": "5", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_client": "false", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_mds": "false", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_mgr": "false", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_mon": "false", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_blackhole_osd": "false", 2024-04-26T12:38:29.407 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_client_mode": "crc secure", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_cluster_type": "", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_compress_secure": "false", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_crc_data": "true", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_crc_header": "true", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_bug": "true", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_old_message": "true", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T12:38:29.408 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_hugepages": "", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_lro": "true", 2024-04-26T12:38:29.409 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_pmd": "", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_port_id": "0", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_dump_on_send": "false", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_delay_type": "", 2024-04-26T12:38:29.410 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_network_congestion": "0", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_inject_socket_failures": "0", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_max_accept_failures": "4", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_max_backoff": "15.000000", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_osd_compress_mode": "none", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_pq_min_cost": "65536", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_public_type": "", 2024-04-26T12:38:29.411 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_service_mode": "crc secure", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_tcp_nodelay": "true", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "ms_type": "async+posix", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "no_config_file": "false", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_inflight_ops": "1024", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "objecter_timeout": "10.000000", 2024-04-26T12:38:29.412 INFO:teuthology.orchestra.run.smithi016.stdout: "objectstore_blackhole": "false", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "openssl_engine_opts": "", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_max_ops": "4", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_agent_slop": "0.020000", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_asio_thread_count": "2", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T12:38:29.413 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backfill_scan_max": "512", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backfill_scan_min": "64", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backoff_on_peering": "false", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_beacon_report_interval": "300", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bench_duration": "30", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_blkin_trace_all": "false", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T12:38:29.414 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_class_update_on_start": "true", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_client_message_cap": "256", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_client_op_priority": "63", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_client_watch_timeout": "30", 2024-04-26T12:38:29.415 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_command_max_records": "256", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_compact_on_start": "false", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_crush_update_on_start": "true", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T12:38:29.416 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_op_order": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_shutdown": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T12:38:29.417 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_trim_objects": "false", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_default_notify_timeout": "30", 2024-04-26T12:38:29.418 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_enable_op_tracker": "true", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_info": "true", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_shutdown": "true", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T12:38:29.419 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T12:38:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T12:38:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T12:38:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_function_tracing": "false", 2024-04-26T12:38:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_grace": "20", 2024-04-26T12:38:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_interval": "6", 2024-04-26T12:38:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T12:38:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T12:38:29.420 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T12:38:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_stale": "600", 2024-04-26T12:38:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T12:38:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T12:38:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T12:38:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T12:38:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T12:38:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T12:38:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T12:38:29.421 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_journal_size": "5120", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_kill_backfill_at": "0", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_cache_size": "50", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_dedup": "true", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_message_max": "40", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_attr_name_len": "100", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_attr_size": "0", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_backfills": "1", 2024-04-26T12:38:29.422 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_markdown_count": "5", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_markdown_period": "600", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_object_name_len": "2048", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_object_size": "134217728", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_pgls": "1024", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_push_cost": "8388608", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_push_objects": "10", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_scrubs": "3", 2024-04-26T12:38:29.423 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_max_write_size": "90", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_profile": "balanced", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T12:38:29.424 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_base": "805306368", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_target": "4294967296", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_target_autotune": "false", 2024-04-26T12:38:29.425 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_min_recovery_priority": "0", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_report_interval": "5", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_num_cache_shards": "32", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_numa_node": "-1", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T12:38:29.426 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_objecter_finishers": "1", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_objectstore": "bluestore", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_objectstore_fuse": "false", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_objectstore_tracing": "false", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_history_duration": "600", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_history_size": "20", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_log_threshold": "5", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_shards": "0", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T12:38:29.427 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_op_thread_timeout": "15", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_open_classes_on_start": "true", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_os_flags": "0", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_peering_op_priority": "255", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_delete_priority": "5", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T12:38:29.428 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_crimson": "false", 2024-04-26T12:38:29.429 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_flags": "0", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_min_size": "0", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T12:38:29.430 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_read_ratio": "70", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_size": "2", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_default_type": "replicated", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T12:38:29.431 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_cost": "20971520", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_active": "0", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_op_priority": "3", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_priority": "5", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T12:38:29.432 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_repair_during_recovery": "false", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T12:38:29.433 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_cost": "52428800", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_end_hour": "0", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_priority": "5", 2024-04-26T12:38:29.434 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_skip_data_digest": "false", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_smart_report_timeout": "5", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_priority": "5", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T12:38:29.435 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_target_transaction_size": "30", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_tracing": "false", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_use_stale_snap": "false", 2024-04-26T12:38:29.436 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_kill_at": "0", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_max_join_drift": "10", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_min": "500", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_min_wait": "0.050000", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_service_trim_max": "500", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_service_trim_min": "250", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_stash_full_interval": "25", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_trim_max": "500", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "paxos_trim_min": "250", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "perf": "true", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T12:38:29.437 INFO:teuthology.orchestra.run.smithi016.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "public_addr": "-", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "public_addrv": "", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "public_bind_addr": "-", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "public_network": "", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "public_network_interface": "", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "qat_compressor_enabled": "false", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "rados_mon_op_timeout": "0", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "rados_osd_op_timeout": "0", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "rados_tracing": "false", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_atime_update_interval": "60", 2024-04-26T12:38:29.438 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache": "true", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_policy": "writearound", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_size": "33554432", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T12:38:29.439 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_compression_hint": "none", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_clone_format": "auto", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_data_pool": "", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_features": "61", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_format": "2", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_map_options": "", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_order": "22", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_pool": "rbd", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T12:38:29.440 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_stripe_count": "0", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_io_scheduler": "simple", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T12:38:29.441 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T12:38:29.442 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T12:38:29.442 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_order": "24", 2024-04-26T12:38:29.442 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_pool": "", 2024-04-26T12:38:29.442 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_journal_splay_width": "4", 2024-04-26T12:38:29.442 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T12:38:29.442 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T12:38:29.442 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T12:38:29.442 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T12:38:29.442 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T12:38:29.443 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T12:38:29.444 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_op_threads": "1", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_plugins": "", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T12:38:29.445 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T12:38:29.446 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_tracing": "false", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_validate_names": "true", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rbd_validate_pool": "true", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "restapi_base_url": "", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "restapi_log_level": "", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_account_default_quota_max_size": "-1", 2024-04-26T12:38:29.447 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T12:38:29.448 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_admin_entry": "admin", 2024-04-26T12:38:29.448 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T12:38:29.448 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_backend_store": "rados", 2024-04-26T12:38:29.448 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_barbican_url": "", 2024-04-26T12:38:29.448 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_beast_enable_async": "true", 2024-04-26T12:38:29.448 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_counters_cache": "false", 2024-04-26T12:38:29.448 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-26T12:38:29.448 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T12:38:29.448 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cache_enabled": "true", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cache_lru_size": "25000", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_config_store": "rados", 2024-04-26T12:38:29.449 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_content_length_compat": "false", 2024-04-26T12:38:29.450 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T12:38:29.450 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T12:38:29.450 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T12:38:29.450 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_cross_domain_policy": "", 2024-04-26T12:38:29.450 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T12:38:29.450 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T12:38:29.450 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T12:38:29.450 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T12:38:29.451 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T12:38:29.451 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T12:38:29.451 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T12:38:29.451 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T12:38:29.451 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T12:38:29.451 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T12:38:29.451 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T12:38:29.451 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T12:38:29.452 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T12:38:29.453 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T12:38:29.453 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T12:38:29.453 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T12:38:29.453 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T12:38:29.453 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T12:38:29.453 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T12:38:29.453 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T12:38:29.453 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T12:38:29.454 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_d4n_port": "6379", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_log_window": "30", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-26T12:38:29.455 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T12:38:29.456 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dns_name": "", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dns_s3website_name": "", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_ops_log": "false", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T12:38:29.457 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_static_website": "false", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enable_usage_log": "false", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_expose_bucket": "false", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_extended_http_attrs": "", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_filter": "none", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_objs": "32", 2024-04-26T12:38:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_init_timeout": "300", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_kafka_connection_idle": "300", 2024-04-26T12:38:29.459 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_password": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_project": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_token": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_admin_user": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_api_version": "2", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T12:38:29.460 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_url": "", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_max_objs": "32", 2024-04-26T12:38:29.461 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_max_worker": "3", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ldap_uri": "", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_log_http_headers": "", 2024-04-26T12:38:29.462 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_attr_size": "0", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T12:38:29.463 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T12:38:29.464 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T12:38:29.464 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_listing_results": "1000", 2024-04-26T12:38:29.464 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_notify_retries": "10", 2024-04-26T12:38:29.464 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T12:38:29.464 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T12:38:29.464 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T12:38:29.464 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T12:38:29.464 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T12:38:29.464 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T12:38:29.465 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_num_control_oids": "8", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_numa_node": "-1", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T12:38:29.466 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_op_tracing": "false", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_opa_token": "", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_opa_url": "", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ops_log_rados": "false", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T12:38:29.467 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_cache_lanes": "3", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_cache_partitions": "3", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_print_continue": "true", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T12:38:29.468 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_rados_tracing": "false", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_realm": "", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_realm_id": "", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_region": "", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_request_uri": "", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T12:38:29.469 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_resolve_cname": "false", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_run_sync_thread": "true", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T12:38:29.470 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_script_uri": "", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_service_provider_name": "", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_client_id": "", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_client_secret": "", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_entry": "sts", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_key": "sts", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_auth_url": "", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_custom_header": "", 2024-04-26T12:38:29.471 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_need_stats": "true", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_tenant_name": "", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_url": "", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_lease_period": "120", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T12:38:29.472 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_thread_pool_size": "512", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_comment": "", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_createby": "", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_encoding": "", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_flag": "false", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-26T12:38:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_origin": "", 2024-04-26T12:38:29.474 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T12:38:29.474 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_torrent_tracker": "", 2024-04-26T12:38:29.474 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T12:38:29.474 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T12:38:29.474 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T12:38:29.474 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_usage_max_shards": "32", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_use_opa_authz": "false", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_counters_cache": "false", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_user_unique_email": "true", 2024-04-26T12:38:29.475 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_verify_ssl": "true", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zone": "", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zone_id": "", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zonegroup": "", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zonegroup_id": "", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T12:38:29.476 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_block_size": "4096", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T12:38:29.477 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_partition_filters": "false", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_perf": "false", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T12:38:29.478 INFO:teuthology.orchestra.run.smithi016.stdout: "run_dir": "/var/run/ceph", 2024-04-26T12:38:29.479 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_block_create": "true", 2024-04-26T12:38:29.479 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T12:38:29.479 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T12:38:29.479 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-26T12:38:29.479 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T12:38:29.479 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T12:38:29.479 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_device_size": "53687091200", 2024-04-26T12:38:29.479 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T12:38:29.479 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_main_device_type": "SSD", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "seastore_segment_size": "67108864", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "set_keepcaps": "false", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "setgroup": "", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "setuser": "", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "setuser_match_path": "", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T12:38:29.480 INFO:teuthology.orchestra.run.smithi016.stdout: "thp": "false", 2024-04-26T12:38:29.481 INFO:teuthology.orchestra.run.smithi016.stdout: "threadpool_default_timeout": "60", 2024-04-26T12:38:29.481 INFO:teuthology.orchestra.run.smithi016.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T12:38:29.481 INFO:teuthology.orchestra.run.smithi016.stdout: "throttler_perf_counter": "true" 2024-04-26T12:38:29.481 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:29.483 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T12:38:29.630 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a: {} 2024-04-26T12:38:29.631 INFO:teuthology.orchestra.run.smithi016.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:38:29.645 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b: {} 2024-04-26T12:38:29.645 INFO:teuthology.orchestra.run.smithi016.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:38:29.655 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c: {} 2024-04-26T12:38:29.655 INFO:teuthology.orchestra.run.smithi016.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:38:29.672 DEBUG:teuthology.orchestra.run.smithi016:> type ceph-objectstore-tool 2024-04-26T12:38:29.676 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T12:38:29.677 DEBUG:teuthology.orchestra.run.smithi131:> type ceph-objectstore-tool 2024-04-26T12:38:29.683 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T12:38:29.683 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T12:38:29.699 INFO:tasks.workunit:Pulling workunits from ref 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:38:29.699 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T12:38:29.699 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T12:38:29.700 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T12:38:29.700 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T12:38:29.700 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T12:38:29.701 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T12:38:29.701 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.000000 2024-04-26T12:38:29.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0 2024-04-26T12:38:29.701 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T12:38:29.702 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T12:38:29.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:38:29.703 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T12:38:29.703 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:38:29.703 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T12:38:29.703 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:38:29.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:38:29.725 INFO:teuthology.orchestra.run.smithi016.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-26T12:38:29.725 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-26T12:38:29.727 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:29.725+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:29.775 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-26T12:38:29.775 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-26T12:38:29.818 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:29.815+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:29.823 INFO:tasks.workunit:timeout=3h 2024-04-26T12:38:29.823 INFO:tasks.workunit:cleanup=True 2024-04-26T12:38:29.823 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 2024-04-26T12:38:29.845 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:29.845 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:29.845 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:29.845 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:29.849 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T12:38:29.867 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:29.867 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:29.868 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:38:29.899 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:29.899 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:29.905 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:29.905+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:29.916 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:29.916 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:29.935 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:29.935 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:29.955 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:29.956 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:29.976 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:29.976 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:30.006 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:30.001+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:30.010 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:30.010 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:30.015 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:30.015 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:30.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:38:30.038 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:30.038 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:30.058 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:38:30.107 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:30.105+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:30.165 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:30.166 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:30.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:38:30.226 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:30.223+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:30.291 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:30.291 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:30.304 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:38:30.350 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:30.347+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:30.410 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:30.407+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:30.461 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:30.461 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:30.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:38:30.511 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:30.509+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:30.612 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:30.613+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:30.641 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:30.641 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:30.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:38:30.714 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:30.709+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:30.781 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:30.782 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:30.795 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:38:30.842 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:30.839+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:30.915 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:30.911+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:30.917 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:30.918 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:30.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:38:31.022 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:31.019+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.4 primary-affinity to 0 (802) 2024-04-26T12:38:31.111 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:31.111 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:31.116 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:31.111+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:31.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:38:31.218 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:31.217+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:31.283 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:31.283 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:31.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:38:31.319 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:31.317+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:31.420 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:31.415+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:31.422 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:31.422 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:31.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:38:31.521 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:31.517+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:31.604 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:31.604 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:31.618 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:38:31.621 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:31.619+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:31.723 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:31.719+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:31.750 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:31.750 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:31.764 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:38:31.824 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:31.821+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:31.882 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:31.882 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:31.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:38:31.939 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:31.937+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:32.026 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:32.021+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:32.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:38:32.063 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:32.063 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:32.080 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:38:32.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:38:32.127 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:32.125+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:32.220 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:32.221 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:32.227 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:32.225+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:32.238 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:32.244 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:32.244 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:32.255 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:32.255 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:32.257 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:38:32.271 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:32.272 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:32.290 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:32.290 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:32.310 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:32.329 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:32.329 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:32.343 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:32.341+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:32.350 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:32.350 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:32.416 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:32.416 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:32.416 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:38:32.416 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:38:32.416 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:32.431 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:38:32.431 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:32.427+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:32.532 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:32.529+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:32.598 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:38:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:38:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:38:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:38:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.108631956, 2024-04-26T12:38:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:38:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:38:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.091935320999999, 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:38:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:38:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:38:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:38:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.088128833000001, 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:38:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:38:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.099881867000001, 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:38:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:38:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.037932294999999, 2024-04-26T12:38:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:38:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:38:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.027055319, 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:38:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:38:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:38:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:38:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.015666713, 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:38:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:38:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:38:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.922412583, 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:38:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.920391046000001, 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:38:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:38:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:38:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:38:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.917470461000001, 2024-04-26T12:38:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:38:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.917190033000001, 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.912464993, 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:38:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.909242943000001, 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.669 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:38:32.673 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.907761083, 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.677 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.906522452000001, 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.678 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:38:32.683 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.903537745, 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.687 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.901446893999999, 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.688 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.693 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.889279866000001, 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:38:32.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.880683321999999, 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:38:32.699 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:38:32.704 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.868523835, 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:32.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:32.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:38:32.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:38:32.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:32.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:38:32.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:38:32.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.709 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:32.710 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:32.710 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:32.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:38:32.711 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:32.709+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:32.812 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:32.811+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:32.882 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:32.882 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:32.882 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:38:32.882 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:32.895 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:38:32.939 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:32.937+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:33.014 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:33.011+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:33.017 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:33.017 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:33.018 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:38:33.018 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:38:33.018 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:33.032 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:38:33.115 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:38:33.118 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:33.111+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:33.204 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:38:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:38:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:38:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.728000633000001, 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:38:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:38:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.713008402, 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:38:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:38:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:38:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:38:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:38:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:38:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.68821196, 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:38:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:38:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:38:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:38:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.685533161, 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:38:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.684061128, 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:38:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.563162235, 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:38:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:38:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:38:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.545827482, 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:38:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:38:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:38:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:38:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.545155204, 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:38:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:38:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.5158939, 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.501994977000001, 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:38:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:38:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:38:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.496542392, 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:38:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.494421975, 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.492459401, 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:38:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:38:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:38:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:38:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:38:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:38:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:38:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:38:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.492007210000001, 2024-04-26T12:38:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:38:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:38:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:38:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:38:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:38:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:38:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:38:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:38:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:38:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:38:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:38:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.489647287, 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:38:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:38:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:38:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:38:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:38:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:38:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.483948746999999, 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.322785, 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:38:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:38:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:38:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.114036935, 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:38:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.96524602, 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.883952643000001, 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:38:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:38:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:38:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:38:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:38:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.305 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:33.306 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:38:33.307 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:33.303+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:33.408 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:33.405+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:33.433 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:38:33.433 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:33.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:38:33.509 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:33.503+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:33.609 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:33.609 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:33.609 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:38:33.609 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:38:33.609 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:33.610 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:33.605+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:33.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:38:33.710 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:33.707+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:33.796 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:33.796 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.405148517000001, 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.797 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:38:33.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:38:33.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:38:33.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.331692661000002, 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.804 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:38:33.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:38:33.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.331505895999999, 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.810 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:38:33.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:38:33.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.331463409000001, 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.816 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:33.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:38:33.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:38:33.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.249677386999998, 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.822 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:38:33.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:38:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.249559968, 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:38:33.828 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:38:33.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.101698741, 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.834 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:38:33.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:38:33.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.101502406000002, 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.840 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:33.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:38:33.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:38:33.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:38:33.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.846 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.101466799000001, 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:33.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:38:33.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:38:33.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:38:33.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.101429017000001, 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:38:33.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:38:33.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:38:33.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:38:33.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:38:33.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:38:33.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:38:33.859 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.859 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.859 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.861 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.861 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:33.862 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.101228257999999, 2024-04-26T12:38:33.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:38:33.862 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.862 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.862 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.862 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.862 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.862 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.863 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:38:33.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.863 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:33.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:33.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:38:33.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:38:33.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:38:33.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:38:33.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:38:33.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:38:33.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:38:33.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:38:33.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:38:33.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:38:33.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:38:33.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:38:33.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:38:33.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:38:33.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:38:33.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:38:33.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:38:33.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:38:33.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.101121369000001, 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.873 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:38:33.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:38:33.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:38:33.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:38:33.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:38:33.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:38:33.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:38:33.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:38:33.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.879 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.101081302000001, 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:38:33.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.885 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.100886083999999, 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:33.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:33.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:38:33.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:38:33.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.100849007000001, 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.892 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:33.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.898 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.649371562999999, 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:38:33.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:33.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:38:33.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:38:33.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:38:33.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:38:33.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:38:33.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:38:33.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:38:33.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.906 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.649226380999998, 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.843231625000001, 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.912 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:38:33.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:38:33.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:38:33.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.843154023, 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.918 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:38:33.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:38:33.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.842863827999999, 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:33.924 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:33.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:38:33.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:33.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.929 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.930 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:33.930 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:33.930 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:33.931 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:33.929+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:33.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:38:34.032 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:34.033+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:34.066 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:34.066 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:34.066 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:34.066 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:34.081 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:38:34.133 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:34.127+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:34.210 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:34.211 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:34.211 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:34.211 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:34.211 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:34.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:38:34.234 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:34.229+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:34.335 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:34.337+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:34.369 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:38:34.399 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:34.399 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.87625212, 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:38:34.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:34.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:34.405 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.872860586, 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.897043529999999, 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.411 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:34.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.416 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.878034224, 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.417 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.422 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.846112527000001, 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:38:34.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.832014485, 2024-04-26T12:38:34.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:38:34.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:38:34.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.802290361000001, 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:38:34.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:38:34.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:38:34.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.783355424, 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.440 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:38:34.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:34.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:34.445 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.732445326000001, 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:38:34.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:38:34.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:38:34.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:38:34.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.732034454000001, 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:38:34.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:38:34.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:38:34.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:421 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.726861810000001, 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025968440000000001, 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 421 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670483+0000", 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4109999999999999e-06 2024-04-26T12:38:34.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670491+0000", 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670507+0000", 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6030000000000001e-05 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670518+0000", 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0631e-05 2024-04-26T12:38:34.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670575+0000", 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7518000000000001e-05 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670674+0000", 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8998000000000003e-05 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670858+0000", 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018376199999999999 2024-04-26T12:38:34.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.671491+0000", 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063290099999999995 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.672995+0000", 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015041329999999999 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673031+0000", 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5790000000000001e-05 2024-04-26T12:38:34.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673078+0000", 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7681e-05 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.656450667, 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:38:34.462 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:38:34.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:38:34.467 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.649625330999999, 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026409879999999999, 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.468 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 527 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747719+0000", 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.282e-06 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747727+0000", 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747745+0000", 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7847999999999999e-05 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747754+0000", 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747815+0000", 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1057999999999997e-05 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747915+0000", 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748134+0000", 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021918799999999999 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748691+0000", 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000557414 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750284+0000", 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015928889999999999 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750317+0000", 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2447000000000003e-05 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750359+0000", 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2256000000000003e-05 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.473 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.537678948, 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.474 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:38:34.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:38:34.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:38:34.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.335460788000001, 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.482 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:34.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:38:34.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:38:34.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.331637871, 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002533764, 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065707+0000", 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.37e-06 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065715+0000", 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9240000000000007e-06 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065736+0000", 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0903e-05 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065746+0000", 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0817e-05 2024-04-26T12:38:34.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065851+0000", 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104202 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065981+0000", 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013002900000000001 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.066255+0000", 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394099999999998 2024-04-26T12:38:34.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.067330+0000", 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010755960000000001 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068086+0000", 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075542399999999998 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068170+0000", 2024-04-26T12:38:34.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4258999999999994e-05 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068239+0000", 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9299000000000002e-05 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.278166359, 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:38:34.493 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:38:34.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:38:34.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:38:34.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:38:34.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.274334306, 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026710560000000002, 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123011+0000", 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.643e-06 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123023+0000", 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1824000000000001e-05 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123048+0000", 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5392999999999999e-05 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123067+0000", 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9236e-05 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123185+0000", 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011799299999999999 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123336+0000", 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150698 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123600+0000", 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026369799999999998 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.124967+0000", 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013678399999999999 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125536+0000", 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056819499999999996 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125621+0000", 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5320000000000003e-05 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125680+0000", 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9215999999999997e-05 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.504 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.092770001, 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:34.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:38:34.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:38:34.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.089007413999999, 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:34.510 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:34.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:38:34.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:38:34.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:38:34.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:34.515 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:34.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:38:34.517 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:34.511+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:34.521 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:34.522 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:34.539 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:34.539 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:34.557 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:34.557 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:34.573 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:34.574 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:34.594 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:34.595 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:34.616 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:34.616 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:34.617 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:34.613+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:34.637 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:34.638 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:34.643 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:34.643 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:34.658 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:38:34.659 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:34.719 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:34.717+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:34.778 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:34.778 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:34.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:38:34.820 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:34.821+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:34.918 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:34.918 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:34.922 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:34.921+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:34.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:38:35.022 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:35.017+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:35.059 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:35.060 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:35.074 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:38:35.123 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:35.121+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:35.139 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:38:35.204 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:35.205 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:35.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:38:35.224 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:35.221+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:35.325 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:35.325+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:35.343 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:35.343 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:35.358 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:38:35.426 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:35.419+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:35.475 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:35.475 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:35.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:38:35.527 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:35.525+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:35.628 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:35.625+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:35.648 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:35.648 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:35.662 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:38:35.729 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:35.725+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:35.790 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:35.790 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:35.805 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:38:35.851 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:35.849+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:35.931 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:35.929+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:35.936 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:35.936 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:35.950 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:38:36.032 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:36.030+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:36.115 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:36.117 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:36.126 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:38:36.129 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:38:36.175 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:36.173+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:36.234 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:36.230+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:36.250 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:36.251 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:36.266 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:38:36.335 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:36.334+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:36.435 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:36.435 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:36.436 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:36.433+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:36.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:38:36.536 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:36.530+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:36.614 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:36.615 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:36.628 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:38:36.637 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:36.630+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:36.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:38:36.738 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:36.733+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:36.750 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:36.750 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:36.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:38:36.843 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:36.843 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:36.851 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:36.849+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:36.859 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:36.860 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:36.876 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:36.876 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:36.893 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:36.893 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:36.914 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:36.932 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:36.933 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:36.935 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:36.935 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:36.941 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:36.937+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:36.947 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:38:36.955 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:36.955 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:36.977 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:36.977 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:37.041 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:37.034+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:37.113 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:37.113 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:37.113 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:38:37.113 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:38:37.113 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:37.127 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:38:37.142 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:37.138+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:37.244 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:37.241+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:37.245 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 18.770717507000001, 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.246 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:38:37.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:38:37.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:38:37.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.252 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 18.755725276, 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.253 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:38:37.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:38:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:38:37.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 18.730928834, 2024-04-26T12:38:37.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:38:37.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:38:37.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:38:37.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:38:37.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:38:37.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 18.728250034999999, 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:38:37.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:38:37.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:38:37.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:38:37.270 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.270 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.270 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.726778002, 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:38:37.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:38:37.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.275 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.605879109, 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:38:37.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:38:37.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.588544356, 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.280 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:38:37.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:38:37.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.587872078, 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:38:37.288 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.558610774, 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:38:37.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:38:37.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:38:37.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.544711851000001, 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.297 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.539259266, 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.537138849, 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.302 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:38:37.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:38:37.306 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.535176275, 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:38:37.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.310 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.534724084, 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:38:37.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:38:37.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.532364161, 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:38:37.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.526665620999999, 2024-04-26T12:38:37.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:38:37.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:38:37.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.323 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.365501874, 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.156753809, 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:38:37.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.007962894, 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:38:37.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:38:37.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:38:37.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.926669517000001, 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.336 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.340 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:37.342 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:38:37.345 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:37.338+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:37.446 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:37.441+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:37.510 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:37.510 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:37.510 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:38:37.510 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:37.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:38:37.567 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:37.565+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:37.648 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:37.645+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:37.691 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:37.691 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:37.692 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:38:37.692 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:38:37.692 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:37.706 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:38:37.749 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:37.742+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:37.849 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:37.845+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.487768774999999, 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.879 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:38:37.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:38:37.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:38:37.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.414312918999997, 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.887 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:37.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:38:37.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.414126154000002, 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.894 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:38:37.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:38:37.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:38:37.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:38:37.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.900 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.414083667, 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.901 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:38:37.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.332297644999997, 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.907 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:37.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:38:37.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:38:37.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:38:37.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.332180225999998, 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:37.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:38:37.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:38:37.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.919 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.184318998999998, 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.920 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:38:37.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.184122664, 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:38:37.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:38:37.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:38:37.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.184087056999999, 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.934 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:37.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:38:37.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:38:37.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:38:37.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.184049275, 2024-04-26T12:38:37.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:38:37.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:38:37.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:38:37.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:38:37.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.183848515999998, 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.945 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:37.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:38:37.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:38:37.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:38:37.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:38:37.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:38:37.953 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.953 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.953 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.953 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.953 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.183741627000003, 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:38:37.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:38:37.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.183701560000003, 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:38:37.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:38:37.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:38:37.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.183506342000001, 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.967 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:38:37.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:38:37.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:38:37.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.183469264999999, 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:38:37.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:38:37.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.731991821000001, 2024-04-26T12:38:37.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:38:37.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:38:37.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.731846638999997, 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.985 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:38:37.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:38:37.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.991 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 31.925851883, 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:37.992 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:37.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:38:37.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:37.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:38:37.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 31.925774280999999, 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:37.999 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:38.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:38.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:38:38.004 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 31.925484086000001, 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:38.005 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:38:38.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:38.010 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:38.012 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:38.009+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:38.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:38:38.113 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:38.106+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:38.147 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:38.147 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:38.147 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:38.147 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:38.158 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:38:38.161 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:38:38.246 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:38.242+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:38.314 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:38.310+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:38.328 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:38.328 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:38.328 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:38.329 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:38.329 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:38.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:38:38.416 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:38.417+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:38.517 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:38.517 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.992990529, 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:38:38.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:38:38.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.989598995000001, 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.524 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:38:38.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:38:38.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:38:38.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.013781939000001, 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:38.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:38:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:38.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.994772633, 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:38:38.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:38.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:38:38.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:38:38.543 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.962850935999999, 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.544 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.948752893999998, 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.551 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:38:38.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:38:38.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.919028770000001, 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:38:38.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.900093833, 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:38:38.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:38:38.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:38:38.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.570 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.849183735, 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.571 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:38:38.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.577 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.848772863000001, 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:38:38.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:38:38.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:38:38.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:421 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.843600218999999, 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025968440000000001, 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 421 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670483+0000", 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4109999999999999e-06 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670491+0000", 2024-04-26T12:38:38.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670507+0000", 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6030000000000001e-05 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670518+0000", 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0631e-05 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670575+0000", 2024-04-26T12:38:38.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7518000000000001e-05 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670674+0000", 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8998000000000003e-05 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670858+0000", 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018376199999999999 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.671491+0000", 2024-04-26T12:38:38.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063290099999999995 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.672995+0000", 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015041329999999999 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673031+0000", 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5790000000000001e-05 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673078+0000", 2024-04-26T12:38:38.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7681e-05 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.773189076000001, 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.590 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:38:38.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:38:38.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.596 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.766363739999999, 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026409879999999999, 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 527 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747719+0000", 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.282e-06 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747727+0000", 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747745+0000", 2024-04-26T12:38:38.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7847999999999999e-05 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747754+0000", 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747815+0000", 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1057999999999997e-05 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747915+0000", 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748134+0000", 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021918799999999999 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748691+0000", 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000557414 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750284+0000", 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015928889999999999 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750317+0000", 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2447000000000003e-05 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750359+0000", 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2256000000000003e-05 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.602 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.654417357, 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.603 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:38:38.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:38:38.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.452199196999999, 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:38:38.610 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:38:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.611 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:38:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:38:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:38:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:38:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:38:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:38:38.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:38:38.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:38:38.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.448376280000002, 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002533764, 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.618 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065707+0000", 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.37e-06 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065715+0000", 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9240000000000007e-06 2024-04-26T12:38:38.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065736+0000", 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0903e-05 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065746+0000", 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0817e-05 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065851+0000", 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104202 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065981+0000", 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013002900000000001 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.066255+0000", 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394099999999998 2024-04-26T12:38:38.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.067330+0000", 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010755960000000001 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068086+0000", 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075542399999999998 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068170+0000", 2024-04-26T12:38:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4258999999999994e-05 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068239+0000", 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9299000000000002e-05 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:38.624 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.394904768, 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:38:38.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:38:38.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.391072715, 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026710560000000002, 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123011+0000", 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.643e-06 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123023+0000", 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1824000000000001e-05 2024-04-26T12:38:38.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123048+0000", 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5392999999999999e-05 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123067+0000", 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9236e-05 2024-04-26T12:38:38.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123185+0000", 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011799299999999999 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123336+0000", 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150698 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123600+0000", 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026369799999999998 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.124967+0000", 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013678399999999999 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125536+0000", 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056819499999999996 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125621+0000", 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5320000000000003e-05 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125680+0000", 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9215999999999997e-05 2024-04-26T12:38:38.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.209508410000002, 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.638 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:38.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:38:38.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:38:38.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:38.645 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.205745823000001, 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:38:38.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:38:38.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:38.651 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:38.652 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:38.510+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:38.652 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:38:38.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:38:38.655 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:38.656+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:38.756 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:38.752+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:38.831 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:38.831 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:38.831 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:38.831 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:38.845 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:38:38.890 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:38.886+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:38.958 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:38.954+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:38.965 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:38.965 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:38.965 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:38.966 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:38.966 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:38.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:38:38.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:38:39.074 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:39.070+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:39.150 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:39.150 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:39.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:39.150 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:39.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.150 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:38:39.150 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:39.150 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.706654126, 2024-04-26T12:38:39.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:38:39.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.649415942000001, 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:38:39.155 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:39.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:38:39.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:38:39.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:39.160 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.530273668, 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:39.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:38:39.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.639388907000001, 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:38:39.166 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:38:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:38:39.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.621265897000001, 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:39.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.177 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.594171282000001, 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.178 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:38:39.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.575364607000001, 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.184 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:38:39.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.189 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.541861263000001, 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:38:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:38:39.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.512122335000001, 2024-04-26T12:38:39.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:38:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.506382573, 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.201 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:38:39.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.462350024999999, 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:38:39.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.460691604000001, 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:38:39.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.218 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.456459167999999, 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:38:39.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.169444560999999, 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:38:39.224 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:38:39.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:38:39.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:38:39.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.165352341999998, 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.230 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:39.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:38:39.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:38:39.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.066912232, 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028684980000000001, 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.236 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081977+0000", 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081989+0000", 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1663e-05 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082020+0000", 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0746e-05 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082035+0000", 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5647000000000001e-05 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082174+0000", 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013828899999999999 2024-04-26T12:38:39.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082387+0000", 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021377500000000001 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082704+0000", 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000316934 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.083853+0000", 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001148388 2024-04-26T12:38:39.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084695+0000", 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084224699999999996 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084779+0000", 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3652999999999993e-05 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084844+0000", 2024-04-26T12:38:39.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4808999999999996e-05 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.063119688, 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:38:39.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:38:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.247 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.780171324000001, 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:38:39.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:38:39.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:38:39.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:38:39.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:39.255 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.775865352, 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:38:39.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:39.262 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.710120992, 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029228000000000001, 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-04-26T12:38:39.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438769+0000", 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3499999999999999e-06 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438781+0000", 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2027e-05 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438812+0000", 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1238999999999997e-05 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438830+0000", 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7677e-05 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438969+0000", 2024-04-26T12:38:39.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013923200000000001 2024-04-26T12:38:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439175+0000", 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020586199999999999 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439538+0000", 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036342699999999999 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.440591+0000", 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010524390000000001 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441533+0000", 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094222499999999999 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441621+0000", 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8399999999999994e-05 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441689+0000", 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7922000000000005e-05 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.269 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.270 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.270 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:39.270 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:39.270 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:39.271 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:38:39.272 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:39.272 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:39.272 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:39.273 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:39.274 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:39.274 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:39.274 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:39.274 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:39.275 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:39.268+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:39.295 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:39.295 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:39.320 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:39.320 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:39.344 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:39.372 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:39.372+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:39.415 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:39.416 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:39.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:38:39.474 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:39.470+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:39.559 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:39.559 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:39.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:38:39.575 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:39.570+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:39.675 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:39.670+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:39.741 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:39.741 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:39.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:38:39.798 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:39.794+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:39.877 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:39.876+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:39.928 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:39.929 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:39.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:38:39.990 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:39.986+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:40.064 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:40.064 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:40.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:38:40.079 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:40.080+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:40.180 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:40.180+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:40.252 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:40.252 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:40.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:38:40.313 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:40.312+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:40.382 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:40.380+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:40.396 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:40.397 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:40.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:38:40.499 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:40.500+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:40.581 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:40.581 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:40.583 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:40.578+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:40.594 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:38:40.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:38:40.684 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:40.684+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:40.761 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:40.761 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:40.777 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:38:40.784 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:40.778+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:40.885 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:40.884+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:40.945 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:40.945 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:40.959 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:38:41.003 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:41.004+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:41.088 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:41.088+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:41.127 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:41.127 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:41.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:38:41.188 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:41.186+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:41.290 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:41.286+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:41.304 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:41.305 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:41.320 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:38:41.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:38:41.410 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:41.406+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:41.438 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:41.438 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:41.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:38:41.499 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:41.500+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:41.521 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:41.521 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:41.538 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:41.554 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:41.555 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:41.571 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:41.571 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:41.574 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:41.574 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:41.588 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:38:41.590 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:41.590 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:41.609 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:41.609 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:41.627 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:41.628 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:41.639 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:41.640+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:41.647 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:41.648 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:41.710 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:41.706+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:41.753 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:38:41.768 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:41.768 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.293456970000001, 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:38:41.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:38:41.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:38:41.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.278464739, 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:38:41.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:38:41.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:38:41.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.253668297000001, 2024-04-26T12:38:41.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:38:41.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.787 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.250989497999999, 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:38:41.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.794 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:38:41.794 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:38:41.794 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.249517465, 2024-04-26T12:38:41.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:38:41.794 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.794 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.794 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:38:41.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:38:41.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:38:41.799 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.128618572000001, 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.803 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.111283819000001, 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:38:41.808 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.110611541000001, 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:38:41.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:38:41.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.813 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:38:41.813 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:38:41.813 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.081350236999999, 2024-04-26T12:38:41.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:38:41.813 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.813 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.813 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.813 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:38:41.817 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.067451313999999, 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:38:41.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:38:41.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:38:41.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.061998728999999, 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:38:41.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.825 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.059878311999999, 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.057915737999998, 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.830 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:38:41.834 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.057463547000001, 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:38:41.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:38:41.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:38:41.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.838 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.055103624000001, 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.839 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:38:41.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:38:41.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.844 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.049405084, 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:38:41.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:38:41.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:38:41.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.888241337, 2024-04-26T12:38:41.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:38:41.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.679493271999998, 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.858 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.530702356999999, 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:38:41.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:38:41.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:38:41.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:38:41.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:38:41.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:38:41.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:38:41.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:38:41.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:38:41.863 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.863 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.864 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:38:41.864 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:38:41.864 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.449408980000001, 2024-04-26T12:38:41.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:38:41.864 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:41.864 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:41.865 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:41.865 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:41.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:41.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:38:41.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:41.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:38:41.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:41.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:41.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:38:41.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:38:41.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:41.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:41.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:41.870 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:41.872 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:41.866+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:41.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:38:41.973 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:41.972+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:41.999 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:42.000 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:42.000 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:38:42.000 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:42.014 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:38:42.073 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:42.070+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:42.174 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:42.174+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:42.178 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:42.178 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:42.178 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:38:42.178 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:38:42.178 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:42.192 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:38:42.275 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:42.270+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:42.314 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:42.314 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:38:42.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:38:42.314 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:38:42.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.922917091000002, 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:38:42.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:38:42.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:38:42.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.849461235, 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.321 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:38:42.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:38:42.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.849274469999997, 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.327 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:38:42.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:38:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.849231983000003, 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:42.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:38:42.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:38:42.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.767445961, 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:38:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:38:42.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:38:42.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.767328542000001, 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:38:42.344 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:42.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:38:42.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:38:42.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:38:42.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:38:42.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:38:42.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.619467315000001, 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.351 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:38:42.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:38:42.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.619270980000003, 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.357 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:38:42.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:38:42.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:38:42.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:38:42.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.619235373000002, 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:38:42.363 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:38:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.619197591000002, 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:38:42.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:38:42.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:38:42.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.618996832000001, 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.618889942999999, 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.380 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:38:42.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:38:42.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.385 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.618849875999999, 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.386 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:38:42.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:38:42.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:42.391 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.618654657999997, 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:42.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:38:42.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.618617581000002, 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.397 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:38:42.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:38:42.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.167140136999997, 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.403 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:42.408 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.166994955, 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:42.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:38:42.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.414 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.361000199000003, 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.360922596999998, 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:38:42.420 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:38:42.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:38:42.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:38:42.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:38:42.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.360632402, 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:42.426 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:42.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:42.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:38:42.431 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.432 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:42.432 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:42.432 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:42.433 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:42.432+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:42.434 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:38:42.534 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:42.532+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:42.571 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:42.571 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:42.571 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:42.571 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:42.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:38:42.635 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:42.636+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:42.714 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:42.714 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:42.714 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:42.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:38:42.778 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:42.774+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:42.837 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:42.830+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:42.855 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:42.855 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:42.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:42.855 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:42.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.330941342999999, 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:38:42.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:38:42.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:42.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:38:42.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.327549809000001, 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.862 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.351732753, 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:38:42.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:38:42.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:38:42.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:38:42.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:38:42.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.332723446999999, 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.874 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:38:42.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:38:42.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:38:42.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:38:42.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:38:42.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:38:42.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.880 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.300801750000002, 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:38:42.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:38:42.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:38:42.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:38:42.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:38:42.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:38:42.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:38:42.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:42.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:38:42.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:38:42.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:38:42.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:38:42.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:38:42.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:38:42.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:38:42.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:38:42.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.286703708000001, 2024-04-26T12:38:42.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:38:42.892 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.892 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.892 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:38:42.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:38:42.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:38:42.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:38:42.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:38:42.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:38:42.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:38:42.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:38:42.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.899 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.256979584, 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.900 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:38:42.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:38:42.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:38:42.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:38:42.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.238044646999999, 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.907 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:38:42.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:38:42.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:42.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:38:42.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:38:42.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:38:42.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:38:42.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:38:42.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:38:42.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:38:42.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:38:42.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:38:42.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:38:42.915 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.915 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.915 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.187134549, 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:38:42.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:38:42.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:38:42.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:38:42.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:38:42.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:38:42.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:38:42.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:38:42.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:38:42.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:42.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:38:42.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:38:42.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:38:42.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:38:42.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:38:42.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:38:42.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:38:42.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:38:42.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:38:42.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:38:42.923 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.923 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.923 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.924 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.924 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:42.924 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.186723677, 2024-04-26T12:38:42.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:38:42.924 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.924 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.924 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.925 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:38:42.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.925 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:42.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:42.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:38:42.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:38:42.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:38:42.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:38:42.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:38:42.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:38:42.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:38:42.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:38:42.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:38:42.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:38:42.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:38:42.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:38:42.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:42.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:38:42.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:38:42.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:38:42.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:38:42.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:38:42.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:38:42.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:38:42.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:38:42.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:421 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.181551033000002, 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025968440000000001, 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 421 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670483+0000", 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4109999999999999e-06 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670491+0000", 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:38:42.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670507+0000", 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6030000000000001e-05 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670518+0000", 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0631e-05 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670575+0000", 2024-04-26T12:38:42.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7518000000000001e-05 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670674+0000", 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8998000000000003e-05 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670858+0000", 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018376199999999999 2024-04-26T12:38:42.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.671491+0000", 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063290099999999995 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.672995+0000", 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015041329999999999 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673031+0000", 2024-04-26T12:38:42.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5790000000000001e-05 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673078+0000", 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7681e-05 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:42.939 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.11113989, 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:38:42.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:38:42.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:38:42.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:38:42.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:38:42.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:38:42.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:42.946 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.104314553999998, 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026409879999999999, 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 527 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:42.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747719+0000", 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.282e-06 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747727+0000", 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747745+0000", 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7847999999999999e-05 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747754+0000", 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747815+0000", 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1057999999999997e-05 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747915+0000", 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748134+0000", 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021918799999999999 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748691+0000", 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000557414 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750284+0000", 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015928889999999999 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750317+0000", 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2447000000000003e-05 2024-04-26T12:38:42.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750359+0000", 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2256000000000003e-05 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.992368170999999, 2024-04-26T12:38:42.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:38:42.953 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.953 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.953 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.953 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.953 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.953 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.954 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:38:42.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.954 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:42.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:42.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:38:42.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:42.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:38:42.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:38:42.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:38:42.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:38:42.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:38:42.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:38:42.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.790150011000001, 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:38:42.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:38:42.966 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.786327094000001, 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002533764, 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.967 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065707+0000", 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.37e-06 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065715+0000", 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9240000000000007e-06 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065736+0000", 2024-04-26T12:38:42.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0903e-05 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065746+0000", 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0817e-05 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065851+0000", 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104202 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065981+0000", 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013002900000000001 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.066255+0000", 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394099999999998 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.067330+0000", 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010755960000000001 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068086+0000", 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075542399999999998 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068170+0000", 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4258999999999994e-05 2024-04-26T12:38:42.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068239+0000", 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9299000000000002e-05 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.732855581999999, 2024-04-26T12:38:42.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:38:42.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:38:42.979 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.980 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.980 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.980 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.980 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:42.980 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.729023528999999, 2024-04-26T12:38:42.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026710560000000002, 2024-04-26T12:38:42.981 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.981 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.981 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.982 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-04-26T12:38:42.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.982 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:42.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:42.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123011+0000", 2024-04-26T12:38:42.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.643e-06 2024-04-26T12:38:42.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123023+0000", 2024-04-26T12:38:42.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1824000000000001e-05 2024-04-26T12:38:42.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123048+0000", 2024-04-26T12:38:42.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5392999999999999e-05 2024-04-26T12:38:42.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123067+0000", 2024-04-26T12:38:42.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9236e-05 2024-04-26T12:38:42.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123185+0000", 2024-04-26T12:38:42.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011799299999999999 2024-04-26T12:38:42.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123336+0000", 2024-04-26T12:38:42.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150698 2024-04-26T12:38:42.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:42.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123600+0000", 2024-04-26T12:38:42.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026369799999999998 2024-04-26T12:38:42.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.124967+0000", 2024-04-26T12:38:42.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013678399999999999 2024-04-26T12:38:42.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:42.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125536+0000", 2024-04-26T12:38:42.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056819499999999996 2024-04-26T12:38:42.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:42.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125621+0000", 2024-04-26T12:38:42.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5320000000000003e-05 2024-04-26T12:38:42.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:42.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125680+0000", 2024-04-26T12:38:42.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9215999999999997e-05 2024-04-26T12:38:42.991 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.991 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:42.991 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:42.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.991 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:42.991 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:42.992 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.547459224000001, 2024-04-26T12:38:42.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:38:42.992 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:42.992 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:42.992 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:42.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:42.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:42.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:42.993 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:38:42.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.993 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:42.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:42.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:42.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:42.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:42.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:42.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:42.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:42.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:38:42.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:38:42.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:42.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:38:42.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:38:42.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:42.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:38:42.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:38:42.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:42.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:38:42.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:38:42.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:42.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:38:42.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:38:42.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:42.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:42.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:38:43.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:38:43.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:38:43.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:38:43.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:38:43.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:38:43.001 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.002 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.002 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.002 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.002 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:43.003 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.543696637, 2024-04-26T12:38:43.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:38:43.003 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.003 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.003 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.003 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.004 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:38:43.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.004 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:43.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:43.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:38:43.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:38:43.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:38:43.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:38:43.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:38:43.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:38:43.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:38:43.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:38:43.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:38:43.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:38:43.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:38:43.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:38:43.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:43.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:38:43.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:38:43.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:38:43.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:38:43.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:38:43.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:38:43.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:38:43.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:38:43.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:38:43.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:38:43.015 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.015 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.015 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.015 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.015 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.015 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:43.018 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:38:43.019 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:43.010+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:43.118 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:43.114+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:43.197 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:43.198 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:43.198 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:43.198 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:43.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:38:43.219 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:43.220+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:43.320 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:43.314+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:43.380 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:43.380 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:43.380 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:43.394 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:38:43.421 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:43.420+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:43.522 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:43.518+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:43.570 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.125243801, 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.571 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:38:43.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:38:43.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.068005617000001, 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:43.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:38:43.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:38:43.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:38:43.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:38:43.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.580 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.948863342999999, 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.581 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:43.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:38:43.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:43.588 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.057978582000001, 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:43.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:38:43.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:38:43.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:38:43.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.039855572, 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.595 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:43.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:38:43.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:38:43.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:38:43.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:38:43.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:38:43.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:38:43.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.012760957000001, 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:43.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:38:43.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:38:43.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.993954282000001, 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.614 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.960450938000001, 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:43.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:38:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.930712010000001, 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.620 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.924972248, 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:38:43.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:43.631 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.880939699999999, 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:38:43.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:38:43.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:38:43.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.879281279000001, 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:38:43.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:38:43.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:38:43.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.643 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.643 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:43.643 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.875048842999998, 2024-04-26T12:38:43.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:38:43.643 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.643 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.643 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:38:43.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:38:43.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:38:43.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.588034235999999, 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.649 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:38:43.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.583942016999998, 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:38:43.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:38:43.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.485501907, 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028684980000000001, 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.660 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081977+0000", 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081989+0000", 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1663e-05 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082020+0000", 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0746e-05 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082035+0000", 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5647000000000001e-05 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082174+0000", 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013828899999999999 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082387+0000", 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021377500000000001 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082704+0000", 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000316934 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.083853+0000", 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001148388 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084695+0000", 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084224699999999996 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084779+0000", 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3652999999999993e-05 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084844+0000", 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4808999999999996e-05 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.481709363, 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.198760999000001, 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.671 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:43.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:38:43.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.194455027, 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.128710667, 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029228000000000001, 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:43.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:43.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:43.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:43.683 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-04-26T12:38:43.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.683 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:43.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:43.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:43.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438769+0000", 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3499999999999999e-06 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438781+0000", 2024-04-26T12:38:43.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2027e-05 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438812+0000", 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1238999999999997e-05 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438830+0000", 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7677e-05 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438969+0000", 2024-04-26T12:38:43.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013923200000000001 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439175+0000", 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020586199999999999 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439538+0000", 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036342699999999999 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.440591+0000", 2024-04-26T12:38:43.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010524390000000001 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441533+0000", 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094222499999999999 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441621+0000", 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8399999999999994e-05 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441689+0000", 2024-04-26T12:38:43.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7922000000000005e-05 2024-04-26T12:38:43.690 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.690 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.690 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.690 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:43.690 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:43.690 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:43.691 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:38:43.692 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:43.692+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:43.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:38:43.793 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:43.792+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:43.866 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:43.866 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:43.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:38:43.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:38:43.884 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:43.901 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:43.902 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:43.902 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:43.898+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:43.918 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:43.919 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:43.937 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:43.937 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:43.958 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:43.959 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:43.979 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:43.979 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:43.995 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:43.996+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:44.003 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:44.019 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:38:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:44.024 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:44.096 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:44.090+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:44.140 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:44.140 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:44.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:38:44.198 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:44.194+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:44.299 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:44.296+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:44.318 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:44.319 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:44.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:38:44.399 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:44.400+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:44.462 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:44.462 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:44.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:38:44.522 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:44.518+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:44.601 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:44.600+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:44.604 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:44.604 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:44.619 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:38:44.702 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:44.698+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:44.752 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:38:44.753 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:44.753 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:44.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:38:44.826 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:44.822+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:44.892 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:44.893 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:44.904 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:44.902+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:44.906 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:38:45.005 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:44.998+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:45.031 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:45.031 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:45.045 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:38:45.106 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:45.102+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:45.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:45.167 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:45.183 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:38:45.227 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:45.228+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:45.301 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:45.301 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:45.307 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:45.308+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:45.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:38:45.408 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:45.408+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:45.482 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:45.482 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:45.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:38:45.510 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:45.510+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:45.611 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:45.608+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:45.661 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:45.662 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:45.676 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:38:45.719 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:45.720+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:45.812 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:45.812+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:45.844 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:45.844 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:45.859 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:38:45.947 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:45.948+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:46.014 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:46.010+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:46.023 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:46.023 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:46.039 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:38:46.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:38:46.115 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:46.110+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:46.203 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:46.203 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:46.207 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:46.207 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:46.216 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:46.210+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:46.220 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:46.222 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:38:46.237 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:46.237 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:46.253 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:46.254 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:46.272 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:46.272 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:46.291 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:46.291 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:46.311 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:46.311 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:46.318 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:46.316+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:46.333 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:46.333 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:46.342 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:46.342 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:38:46.342 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:38:46.342 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:38:46.342 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:46.356 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:38:46.418 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:46.418+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:46.519 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:46.514+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:46.525 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:46.525 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:38:46.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:38:46.525 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:38:46.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.134209163999998, 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.526 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:38:46.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:38:46.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:38:46.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:38:46.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:38:46.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.060753308000002, 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.532 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:46.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:38:46.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:38:46.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:38:46.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:38:46.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:38:46.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:38:46.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.060566543, 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.538 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:38:46.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.060524055999998, 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.978738034000003, 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.549 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:46.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:38:46.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:38:46.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:38:46.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.556 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.556 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:46.556 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.978620614999997, 2024-04-26T12:38:46.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:38:46.556 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.556 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.556 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.556 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.557 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.557 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.557 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:38:46.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.557 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:38:46.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:38:46.562 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.563 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.563 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.563 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.563 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:46.563 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.830759387999997, 2024-04-26T12:38:46.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:46.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:38:46.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:38:46.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.830563052999999, 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.570 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:38:46.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:38:46.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.575 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.830527445999998, 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:38:46.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:38:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:38:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:38:46.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.830489663999998, 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.582 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:38:46.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:38:46.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.587 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.830288905000003, 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.588 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:38:46.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:38:46.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:38:46.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:38:46.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:38:46.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.595 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.830182016000002, 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:38:46.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:38:46.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:38:46.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.601 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.830141949000001, 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.602 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:38:46.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:38:46.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:38:46.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:38:46.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:38:46.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:38:46.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:38:46.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.829946731, 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.609 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:38:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:46.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:38:46.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:38:46.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:38:46.615 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.615 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.829909653999998, 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.616 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:38:46.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:38:46.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:38:46.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:38:46.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:38:46.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:38:46.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:38:46.622 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.622 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.622 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.37843221, 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:38:46.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:38:46.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.628 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.378287028000003, 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:46.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.572292271999999, 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.635 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:38:46.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.572214670000001, 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:38:46.641 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:38:46.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:38:46.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.571924475000003, 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:38:46.647 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:46.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:46.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:46.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:46.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:46.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:38:46.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:38:46.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:46.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:38:46.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:38:46.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:46.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:46.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:46.654 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:46.656 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:46.656+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:46.656 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:38:46.757 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:46.750+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:46.784 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:38:46.795 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:46.795 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:46.796 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:46.796 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:46.812 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:38:46.858 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:46.856+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:46.960 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:46.954+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:46.982 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:46.982 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:46.982 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:46.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:38:47.086 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:47.082+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:47.163 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:47.158+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:47.171 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:47.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.646614263, 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:38:47.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:38:47.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.643222729000001, 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:38:47.178 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:47.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:38:47.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:38:47.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.184 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.667405673000001, 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:38:47.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:38:47.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.648396367, 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:38:47.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:38:47.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:38:47.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:38:47.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.616474669999999, 2024-04-26T12:38:47.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:47.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:38:47.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.602376628000002, 2024-04-26T12:38:47.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:38:47.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:38:47.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:38:47.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.572652504000001, 2024-04-26T12:38:47.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:38:47.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:38:47.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:38:47.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:38:47.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.217 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.553717567, 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:38:47.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:38:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:38:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:38:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:38:47.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.502807469, 2024-04-26T12:38:47.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:38:47.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:38:47.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.502396597000001, 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:38:47.231 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:38:47.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:421 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.497223952999999, 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025968440000000001, 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.237 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 421 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670483+0000", 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4109999999999999e-06 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670491+0000", 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670507+0000", 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6030000000000001e-05 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670518+0000", 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0631e-05 2024-04-26T12:38:47.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670575+0000", 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7518000000000001e-05 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670674+0000", 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8998000000000003e-05 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:47.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670858+0000", 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018376199999999999 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.671491+0000", 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063290099999999995 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.672995+0000", 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015041329999999999 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673031+0000", 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5790000000000001e-05 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673078+0000", 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7681e-05 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.243 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.426812810000001, 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.244 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:38:47.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:38:47.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:38:47.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.419987473999999, 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026409879999999999, 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 527 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747719+0000", 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.282e-06 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747727+0000", 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747745+0000", 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7847999999999999e-05 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747754+0000", 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747815+0000", 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1057999999999997e-05 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747915+0000", 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748134+0000", 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021918799999999999 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748691+0000", 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000557414 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750284+0000", 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015928889999999999 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750317+0000", 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2447000000000003e-05 2024-04-26T12:38:47.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750359+0000", 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2256000000000003e-05 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.308041091, 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:38:47.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:38:47.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.105822930999999, 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.264 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:38:47.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:38:47.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.102000014000001, 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002533764, 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.270 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:47.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065707+0000", 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.37e-06 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065715+0000", 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9240000000000007e-06 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065736+0000", 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0903e-05 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065746+0000", 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0817e-05 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065851+0000", 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104202 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065981+0000", 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013002900000000001 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.066255+0000", 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394099999999998 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.067330+0000", 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010755960000000001 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068086+0000", 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075542399999999998 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068170+0000", 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4258999999999994e-05 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068239+0000", 2024-04-26T12:38:47.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9299000000000002e-05 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.048528502, 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.276 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:38:47.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:38:47.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.044696449, 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026710560000000002, 2024-04-26T12:38:47.283 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123011+0000", 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.643e-06 2024-04-26T12:38:47.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123023+0000", 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1824000000000001e-05 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123048+0000", 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5392999999999999e-05 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123067+0000", 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9236e-05 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123185+0000", 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011799299999999999 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123336+0000", 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150698 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123600+0000", 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026369799999999998 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.124967+0000", 2024-04-26T12:38:47.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013678399999999999 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125536+0000", 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056819499999999996 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125621+0000", 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5320000000000003e-05 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125680+0000", 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9215999999999997e-05 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:47.290 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.863132144000001, 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:38:47.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:38:47.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:38:47.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.859369557000001, 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:38:47.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:38:47.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:38:47.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:38:47.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.302 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.302 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.302 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:47.304 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:38:47.304 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:47.302+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:47.404 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:47.404+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:47.478 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:47.479 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:47.479 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:47.479 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:47.494 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:38:47.505 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:47.504+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:47.606 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:47.602+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:47.623 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:47.623 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:47.623 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:47.638 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:38:47.730 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:47.726+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:47.774 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:38:47.823 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.379304691000002, 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.824 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:47.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.828 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.322066506999999, 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:47.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:38:47.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:38:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:38:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:38:47.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.202924233000001, 2024-04-26T12:38:47.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:47.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:38:47.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:38:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:38:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.841 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.312039471999999, 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:38:47.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:38:47.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.293916461999999, 2024-04-26T12:38:47.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:47.853 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.266821846999999, 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:38:47.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.248015171999999, 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:38:47.859 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.864 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.214511827999999, 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:38:47.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.870 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.184772899999999, 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:47.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.179033138000001, 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.876 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:38:47.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.135000590000001, 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.882 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:38:47.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:38:47.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.887 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.133342168999999, 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.888 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:38:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.129109733, 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.894 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:38:47.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:38:47.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.842095126, 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:38:47.900 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:38:47.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:38:47.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.906 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.838002907, 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:38:47.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:38:47.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.912 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.739562797000001, 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028684980000000001, 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.913 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081977+0000", 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081989+0000", 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1663e-05 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082020+0000", 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0746e-05 2024-04-26T12:38:47.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082035+0000", 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5647000000000001e-05 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082174+0000", 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013828899999999999 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082387+0000", 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021377500000000001 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082704+0000", 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000316934 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.083853+0000", 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001148388 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084695+0000", 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084224699999999996 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084779+0000", 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3652999999999993e-05 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084844+0000", 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4808999999999996e-05 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.918 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.735770252999998, 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:47.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:38:47.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:38:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.452821888999999, 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:38:47.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.448515917000002, 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:38:47.931 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:47.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.382771557000002, 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029228000000000001, 2024-04-26T12:38:47.937 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438769+0000", 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3499999999999999e-06 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438781+0000", 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2027e-05 2024-04-26T12:38:47.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438812+0000", 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1238999999999997e-05 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438830+0000", 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7677e-05 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438969+0000", 2024-04-26T12:38:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013923200000000001 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439175+0000", 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020586199999999999 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439538+0000", 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036342699999999999 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.440591+0000", 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010524390000000001 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441533+0000", 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094222499999999999 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441621+0000", 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8399999999999994e-05 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:47.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:47.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:47.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441689+0000", 2024-04-26T12:38:47.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7922000000000005e-05 2024-04-26T12:38:47.943 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.943 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.943 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.943 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:47.943 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:47.943 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:47.943 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:47.818+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:47.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:38:47.946 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:47.944+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:48.047 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:48.042+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:48.117 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:48.118 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:48.118 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:48.118 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:48.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:38:48.148 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:48.148+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:48.249 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:48.248+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:48.298 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:48.298 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:48.298 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:48.298 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:48.298 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:48.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:38:48.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:38:48.362 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:48.358+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:48.444 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:48.444 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:48.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:48.444 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:48.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.444 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:40 5.6 5:66d44ff0:::zonegroup_info.6cf2425f-74db-47a8-896e-35ab7b9def6a:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:38:48.444 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.943176561999998, 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031402079999999998, 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497958+0000", 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.922e-06 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497970+0000", 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.136e-05 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497995+0000", 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5279999999999999e-05 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498009+0000", 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3872e-05 2024-04-26T12:38:48.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498111+0000", 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101927 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498303+0000", 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019180600000000001 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498553+0000", 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024977300000000001 2024-04-26T12:38:48.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.499918+0000", 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001365003 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500885+0000", 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00096762599999999997 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500997+0000", 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111742 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.501097+0000", 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9896999999999996e-05 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:38:48.450 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.933811126999998, 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047946860000000003, 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 52 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:38:48.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507325+0000", 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.717e-06 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507336+0000", 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1182999999999999e-05 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507370+0000", 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4230000000000003e-05 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507388+0000", 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7453e-05 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507508+0000", 2024-04-26T12:38:48.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012033599999999999 2024-04-26T12:38:48.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507749+0000", 2024-04-26T12:38:48.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024146700000000001 2024-04-26T12:38:48.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507923+0000", 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017378700000000001 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.508980+0000", 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056707 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.511982+0000", 2024-04-26T12:38:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030022809999999999 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512050+0000", 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7457000000000001e-05 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512117+0000", 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7068000000000002e-05 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.457 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.457 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:38:48.457 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.823644252000001, 2024-04-26T12:38:48.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036369689999999999, 2024-04-26T12:38:48.457 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617492+0000", 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617505+0000", 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.306e-05 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617536+0000", 2024-04-26T12:38:48.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1007000000000003e-05 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617553+0000", 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7629999999999999e-05 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617719+0000", 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016533800000000001 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618065+0000", 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034657399999999999 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618778+0000", 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071317099999999997 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620613+0000", 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018347260000000001 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620980+0000", 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036717100000000001 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621062+0000", 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1442999999999999e-05 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621126+0000", 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4085999999999996e-05 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.810000924000001, 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026109499999999999, 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 281 2024-04-26T12:38:48.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631133+0000", 2024-04-26T12:38:48.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0559999999999999e-06 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631139+0000", 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1419999999999998e-06 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631154+0000", 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4893e-05 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631161+0000", 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9179999999999997e-06 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631234+0000", 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2976000000000001e-05 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631374+0000", 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140218 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631555+0000", 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018107600000000001 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.632139+0000", 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058337700000000005 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633653+0000", 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001514123 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633695+0000", 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2208e-05 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633743+0000", 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7963000000000001e-05 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.468 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.481289540999999, 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035079099999999999, 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959846+0000", 2024-04-26T12:38:48.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959860+0000", 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3329999999999999e-05 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959891+0000", 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1576999999999999e-05 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959906+0000", 2024-04-26T12:38:48.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4912999999999999e-05 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960018+0000", 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011209600000000001 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960260+0000", 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024201100000000001 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:48.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960602+0000", 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034149700000000001 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.961961+0000", 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013591230000000001 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963193+0000", 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012322399999999999 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963281+0000", 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8306000000000005e-05 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963352+0000", 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0216999999999995e-05 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:38:48.474 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.440482183, 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002916901, 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:38:48.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000653+0000", 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000665+0000", 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.187e-05 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000696+0000", 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0607e-05 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000712+0000", 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6192999999999999e-05 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000825+0000", 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113213 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001039+0000", 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021364100000000001 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001352+0000", 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000313071 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.002433+0000", 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010811779999999999 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003365+0000", 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093210299999999999 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003449+0000", 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3973000000000004e-05 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003568+0000", 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118542 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.436704355, 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027713579999999998, 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.480 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 762 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:38:48.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004431+0000", 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.77e-06 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004441+0000", 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0523000000000001e-05 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004467+0000", 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5522999999999999e-05 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004479+0000", 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2486999999999999e-05 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004586+0000", 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106926 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004721+0000", 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013467199999999999 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004986+0000", 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026559100000000003 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006110+0000", 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123995 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006998+0000", 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088729 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007083+0000", 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5871999999999994e-05 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007200+0000", 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116709 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.30819954, 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028708179999999998, 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-04-26T12:38:48.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132936+0000", 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132949+0000", 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2533e-05 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132980+0000", 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1423000000000001e-05 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132995+0000", 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5e-05 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133125+0000", 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012975899999999999 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133349+0000", 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223842 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:48.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133698+0000", 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034930699999999998 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.134765+0000", 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001066808 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135647+0000", 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088210700000000003 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135735+0000", 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8206000000000002e-05 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135804+0000", 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9103000000000006e-05 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:38:48.491 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.304370858999999, 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028524739999999998, 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:38:48.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136764+0000", 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9759999999999998e-06 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136776+0000", 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.133e-05 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136802+0000", 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136822+0000", 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9247000000000001e-05 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136933+0000", 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110946 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137069+0000", 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013615200000000001 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137342+0000", 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027280099999999998 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.138318+0000", 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00097641000000000004 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139458+0000", 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011402669999999999 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139545+0000", 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6948999999999997e-05 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139615+0000", 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9560000000000005e-05 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.254205917, 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028263889999999999, 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.497 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186930+0000", 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186944+0000", 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4e-05 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186974+0000", 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0332999999999999e-05 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186989+0000", 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4776e-05 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187122+0000", 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013347599999999999 2024-04-26T12:38:48.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187343+0000", 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022082499999999999 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187668+0000", 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032438699999999998 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.188757+0000", 2024-04-26T12:38:48.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001089565 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189604+0000", 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084688799999999996 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189689+0000", 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5348999999999999e-05 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189754+0000", 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4159999999999996e-05 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.250162198000002, 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031280219999999998, 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.503 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190973+0000", 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8199999999999999e-06 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190982+0000", 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1530000000000003e-06 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191006+0000", 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191018+0000", 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191149+0000", 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013097200000000001 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191397+0000", 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024733099999999999 2024-04-26T12:38:48.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191899+0000", 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050217600000000001 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193371+0000", 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014719959999999999 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193942+0000", 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000571475 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194031+0000", 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8696000000000006e-05 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194099+0000", 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.239703481999999, 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034761900000000001, 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201432+0000", 2024-04-26T12:38:48.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3630000000000001e-06 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201445+0000", 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3016999999999999e-05 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201475+0000", 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9719000000000001e-05 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201490+0000", 2024-04-26T12:38:48.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201647+0000", 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156909 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202024+0000", 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037773100000000002 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:48.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202591+0000", 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000566992 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.203991+0000", 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013995290000000001 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204629+0000", 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063768500000000003 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204786+0000", 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015742600000000001 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204906+0000", 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119869 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.514 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.235017578000001, 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034202299999999998, 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:38:48.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206117+0000", 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.68e-06 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206126+0000", 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5900000000000008e-06 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206151+0000", 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4939e-05 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206163+0000", 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2597e-05 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206291+0000", 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012768600000000001 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206539+0000", 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000248061 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.207052+0000", 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051334299999999998 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.208330+0000", 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012775060000000001 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209262+0000", 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093203999999999997 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209418+0000", 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015631900000000001 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209536+0000", 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117469 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.187732830000002, 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027845690000000002, 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253402+0000", 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1830000000000001e-06 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253414+0000", 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1223000000000001e-05 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253444+0000", 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0300000000000001e-05 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253459+0000", 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4749999999999999e-05 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253585+0000", 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126379 2024-04-26T12:38:48.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253813+0000", 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000227498 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.254131+0000", 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031848800000000002 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.255218+0000", 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010869180000000001 2024-04-26T12:38:48.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256027+0000", 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080942099999999995 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256114+0000", 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6599000000000002e-05 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256185+0000", 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0809999999999995e-05 2024-04-26T12:38:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.094673417999999, 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035106930000000001, 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.526 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346462+0000", 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5459999999999998e-06 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346475+0000", 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2764e-05 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346506+0000", 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1266000000000002e-05 2024-04-26T12:38:48.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346521+0000", 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4887e-05 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346676+0000", 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015471800000000001 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347095+0000", 2024-04-26T12:38:48.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041862399999999998 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347690+0000", 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059590499999999998 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349002+0000", 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00131185 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349697+0000", 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069428800000000004 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349855+0000", 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015838899999999999 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349970+0000", 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115456 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.531 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.090202046000002, 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003318194, 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-04-26T12:38:48.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350933+0000", 2024-04-26T12:38:48.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350942+0000", 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2429999999999994e-06 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350967+0000", 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4239999999999998e-05 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350981+0000", 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4093e-05 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351122+0000", 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014118299999999999 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351371+0000", 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000249604 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351883+0000", 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051186600000000004 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.353068+0000", 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011850980000000001 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354094+0000", 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010259290000000001 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354181+0000", 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6812999999999997e-05 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354249+0000", 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8162000000000002e-05 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.537 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.995226113000001, 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028482690000000001, 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445910+0000", 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6570000000000001e-06 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445922+0000", 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2806000000000001e-05 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445955+0000", 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2036999999999998e-05 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445970+0000", 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446092+0000", 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121523 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446313+0000", 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022160800000000001 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446651+0000", 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000338074 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.447983+0000", 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013322029999999999 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448614+0000", 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063038899999999997 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448695+0000", 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1348999999999997e-05 2024-04-26T12:38:48.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448755+0000", 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0139999999999997e-05 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.991493421000001, 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003146959, 2024-04-26T12:38:48.543 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 951 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449641+0000", 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3230000000000001e-06 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449648+0000", 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1300000000000003e-06 2024-04-26T12:38:48.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449669+0000", 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0809999999999999e-05 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449680+0000", 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1416999999999999e-05 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449805+0000", 2024-04-26T12:38:48.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012442200000000001 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449942+0000", 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013762299999999999 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.450223+0000", 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028021699999999998 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.451636+0000", 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001413573 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452587+0000", 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000950799 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452672+0000", 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4735999999999996e-05 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452787+0000", 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011490899999999999 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.981043785000001, 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035247389999999998, 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:38:48.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460092+0000", 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460105+0000", 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3730000000000001e-05 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460135+0000", 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9649e-05 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460154+0000", 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8953e-05 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460270+0000", 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011612600000000001 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460494+0000", 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022413199999999999 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460813+0000", 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031844700000000002 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.462087+0000", 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273927 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463222+0000", 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354080000000001 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463434+0000", 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021214500000000001 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463614+0000", 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017984199999999999 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.554 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.976434798, 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002995798, 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:48.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464700+0000", 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.844e-06 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464712+0000", 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1763000000000001e-05 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464738+0000", 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5829999999999998e-05 2024-04-26T12:38:48.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464751+0000", 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3456e-05 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464895+0000", 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143399 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465152+0000", 2024-04-26T12:38:48.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025729799999999999 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465636+0000", 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048426300000000002 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.466751+0000", 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011144550000000001 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:48.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467488+0000", 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000737501 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467576+0000", 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8252999999999997e-05 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467694+0000", 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117736 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:48.561 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:48.561 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:48.562 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:38:48.563 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:48.563 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:48.563 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:48.563 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:48.564 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:48.564 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:48.564 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:48.565 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:48.565 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:48.560+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:48.579 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:48.579 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:48.600 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:48.600 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:48.621 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:48.622 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:48.643 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:48.643 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:48.663 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:48.660+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:48.694 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:48.694 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:48.709 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:38:48.794 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:48.790+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:48.865 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:48.864+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:48.873 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:48.873 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:48.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:38:48.966 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:48.964+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:49.061 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:49.062 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:49.067 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:49.064+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:49.076 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:38:49.169 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:49.166+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:49.209 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:49.209 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:49.224 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:38:49.270 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:49.270+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:49.347 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:49.347 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:49.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:38:49.371 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:49.370+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:49.472 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:49.470+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:49.481 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:49.481 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:49.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:38:49.573 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:49.572+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:49.617 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:49.617 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:49.631 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:38:49.674 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:49.674+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:49.775 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:49.772+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:49.800 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:49.801 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:49.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:38:49.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:38:49.904 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:49.904+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:49.977 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:49.976+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:49.982 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:49.982 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:49.997 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:38:50.078 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:50.074+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:50.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:50.161 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:50.175 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:38:50.220 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:50.220+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:50.280 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:50.274+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:50.297 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:50.297 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:50.312 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:38:50.382 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:50.378+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:50.482 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:50.483 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:50.483 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:50.480+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:50.498 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:38:50.584 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:50.582+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:50.662 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:50.662 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:50.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:38:50.676 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:38:50.723 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:50.724+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:50.785 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:50.782+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:50.802 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:38:50.802 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:50.802 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:50.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:38:50.824 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:50.824 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:50.842 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:50.842 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:50.857 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:50.857 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:50.874 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:50.874 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:50.886 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:50.886+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:50.892 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:50.892 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:50.910 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:50.911 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:50.929 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:50.946 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:50.946 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:50.986 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:38:50.986 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:38:50.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:38:50.986 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:38:50.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.594464379999998, 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:38:50.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:38:50.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:38:50.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:50.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:50.993 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.521008524000003, 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:50.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:50.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:50.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:38:50.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:38:50.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:50.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:38:50.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:38:50.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:50.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:38:50.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:38:50.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:50.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:38:50.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:38:50.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:50.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:38:50.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:38:50.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:50.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:50.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:38:51.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:38:51.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:38:51.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:38:51.000 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.000 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.001 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.001 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.001 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:51.001 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.520821759, 2024-04-26T12:38:51.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:38:51.001 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.002 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.002 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.002 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.002 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.002 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.002 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:38:51.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.003 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:51.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:38:51.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:38:51.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:38:51.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:38:51.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:38:51.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:38:51.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:38:51.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:38:51.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:38:51.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:38:51.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:38:51.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:38:51.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:38:51.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:38:51.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:38:51.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:38:51.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:38:51.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:38:51.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:38:51.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.010 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.520779271999999, 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.011 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.016 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.438993250000003, 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.017 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:38:51.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:38:51.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:38:51.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:38:51.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:38:51.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:38:51.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:38:51.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:38:51.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.438875830999997, 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.024 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:38:51.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:38:51.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.030 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.291014603999997, 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.031 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:38:51.036 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.290818268999999, 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.037 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:38:51.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:38:51.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:38:51.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:38:51.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:38:51.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:38:51.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:38:51.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:38:51.043 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.043 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.043 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.046 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.046 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.046 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:51.046 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.290782661999998, 2024-04-26T12:38:51.046 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:38:51.046 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:51.047 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:38:51.051 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.052 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.052 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.052 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:38:51.052 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:38:51.052 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.052 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.052 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:51.053 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.290744879999998, 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:51.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.057 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:38:51.057 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:38:51.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.057 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.057 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:38:51.057 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:38:51.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.058 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:38:51.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:38:51.058 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:38:51.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:38:51.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.061 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.061 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:38:51.061 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:38:51.061 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.061 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.061 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.061 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:38:51.061 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:38:51.062 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.062 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.062 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.062 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.062 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.062 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.063 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:51.063 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.290544121000003, 2024-04-26T12:38:51.063 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:38:51.063 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.063 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.063 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.064 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.064 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.064 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.064 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:38:51.064 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.064 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.065 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.065 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.065 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:51.065 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.066 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.066 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.066 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.066 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:38:51.066 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.066 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.066 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:38:51.067 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.068 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.068 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.068 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:38:51.068 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:38:51.068 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.068 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.068 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.068 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:38:51.068 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:38:51.069 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:38:51.070 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:38:51.071 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.071 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.071 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.071 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:38:51.071 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:38:51.071 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.072 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.072 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.072 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:38:51.072 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:38:51.072 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.072 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.073 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.073 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.073 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.073 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.073 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:51.073 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.290437232000002, 2024-04-26T12:38:51.074 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:38:51.074 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.074 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.074 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.074 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.074 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.075 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.075 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:38:51.075 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.075 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.075 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.075 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.076 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:51.076 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.076 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.076 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.076 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.076 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:38:51.077 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.077 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.077 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.077 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.077 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:38:51.077 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:38:51.078 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.078 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.078 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.078 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:38:51.078 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:38:51.078 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.079 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.079 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.079 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:38:51.079 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:38:51.079 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.079 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.080 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.080 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:38:51.080 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:38:51.080 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.080 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.081 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.081 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:38:51.081 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:38:51.081 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.081 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.081 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.081 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:38:51.081 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:38:51.081 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:38:51.082 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:38:51.083 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.083 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.083 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.083 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:38:51.083 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:38:51.083 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.083 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.083 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.083 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.290397165000002, 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.085 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.085 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.085 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.085 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.085 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:38:51.085 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.085 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.085 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.085 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.086 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:51.086 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.086 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.086 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.086 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.086 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:38:51.087 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.087 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.087 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.087 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.087 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:38:51.087 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:38:51.087 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.088 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:38:51.089 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:38:51.090 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.091 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.290201947, 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.092 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.093 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.094 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.094 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.094 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:38:51.094 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.094 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.094 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.095 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.096 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:38:51.097 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.098 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.099 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:38:51.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:38:51.099 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.099 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.099 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.099 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:38:51.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:38:51.099 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.290164869999998, 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.100 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.101 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.101 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.101 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.101 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:38:51.101 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.101 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.102 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:51.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.102 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.102 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:38:51.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:38:51.106 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.106 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.106 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.106 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:38:51.106 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:38:51.106 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.106 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.106 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.106 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:38:51.107 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:38:51.107 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.107 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.107 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.107 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:38:51.107 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:38:51.107 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.108 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:38:51.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:38:51.108 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.108 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.108 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.109 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.109 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:51.109 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.838687426, 2024-04-26T12:38:51.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:38:51.109 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.109 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.109 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.109 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:38:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:51.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:51.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:38:51.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:38:51.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.112 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.112 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:38:51.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:38:51.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:38:51.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:38:51.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:38:51.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:38:51.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.114 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.114 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:38:51.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:38:51.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.114 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.114 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:38:51.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:38:51.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:38:51.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:38:51.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:38:51.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:38:51.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:38:51.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:38:51.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:38:51.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:38:51.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:38:51.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:38:51.117 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.838542244000003, 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.118 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:38:51.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:38:51.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:38:51.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:38:51.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:38:51.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.124 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.032547487999999, 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:38:51.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.032469886000001, 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:38:51.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.136 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.032179691000003, 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:38:51.137 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:38:51.142 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:38:51.143 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:38:51.144 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:38:51.145 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:51.138+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:51.245 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:51.244+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:51.281 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:51.282 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:51.282 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:51.282 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:51.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:38:51.346 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:51.346+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:51.422 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:51.423 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:51.423 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:51.438 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:38:51.448 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:51.447+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:51.549 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:51.546+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:51.612 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:51.612 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:51.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:51.612 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:51.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.089401350999999, 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:38:51.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:38:51.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.086009816999997, 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:38:51.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:38:51.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.110192761, 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:51.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:38:51.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:38:51.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:38:51.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:38:51.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:38:51.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:38:51.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:38:51.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:38:51.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:51.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:38:51.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:38:51.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:38:51.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.091183454999999, 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.633 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:38:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.059261758000002, 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.639 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:38:51.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.045163716000001, 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.645 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:38:51.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:38:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:38:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:51.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:38:51.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:38:51.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:38:51.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:38:51.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:38:51.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:38:51.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.652 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.015439592, 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:38:51.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:38:51.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:38:51.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:51.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:38:51.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:38:51.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:38:51.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:38:51.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:38:51.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:38:51.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:38:51.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:38:51.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:38:51.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:38:51.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.660 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.661 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.661 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:51.661 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.996504654999999, 2024-04-26T12:38:51.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:38:51.661 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.661 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.661 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.662 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.662 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.662 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.662 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:38:51.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.662 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:51.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:51.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:38:51.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:38:51.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:38:51.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:38:51.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:38:51.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:38:51.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:38:51.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:38:51.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:38:51.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.945594557, 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.670 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.670 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.670 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.670 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:38:51.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.670 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:51.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:51.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:38:51.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:38:51.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:38:51.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:38:51.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:38:51.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.945183685, 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:38:51.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:421 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.940011040999998, 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025968440000000001, 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 421 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.683 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:51.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:51.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670483+0000", 2024-04-26T12:38:51.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4109999999999999e-06 2024-04-26T12:38:51.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670491+0000", 2024-04-26T12:38:51.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:38:51.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670507+0000", 2024-04-26T12:38:51.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6030000000000001e-05 2024-04-26T12:38:51.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670518+0000", 2024-04-26T12:38:51.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0631e-05 2024-04-26T12:38:51.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670575+0000", 2024-04-26T12:38:51.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7518000000000001e-05 2024-04-26T12:38:51.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670674+0000", 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8998000000000003e-05 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670858+0000", 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018376199999999999 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.671491+0000", 2024-04-26T12:38:51.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063290099999999995 2024-04-26T12:38:51.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.672995+0000", 2024-04-26T12:38:51.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015041329999999999 2024-04-26T12:38:51.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673031+0000", 2024-04-26T12:38:51.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5790000000000001e-05 2024-04-26T12:38:51.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673078+0000", 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7681e-05 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.869599898000001, 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.692 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:51.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:38:51.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:38:51.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.862774561999998, 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026409879999999999, 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.698 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 527 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:51.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747719+0000", 2024-04-26T12:38:51.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.282e-06 2024-04-26T12:38:51.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747727+0000", 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747745+0000", 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7847999999999999e-05 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747754+0000", 2024-04-26T12:38:51.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:38:51.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747815+0000", 2024-04-26T12:38:51.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1057999999999997e-05 2024-04-26T12:38:51.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747915+0000", 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748134+0000", 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021918799999999999 2024-04-26T12:38:51.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748691+0000", 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000557414 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750284+0000", 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015928889999999999 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750317+0000", 2024-04-26T12:38:51.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2447000000000003e-05 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750359+0000", 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2256000000000003e-05 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.750828178999999, 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:38:51.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:38:51.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:38:51.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:38:51.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.712 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.712 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.712 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.712 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:51.712 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.548610019000002, 2024-04-26T12:38:51.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:38:51.713 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.713 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.713 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.714 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:38:51.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.714 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:51.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:38:51.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:38:51.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:789 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.544787102000001, 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002533764, 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 789 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065705+0000", 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065707+0000", 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.37e-06 2024-04-26T12:38:51.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065715+0000", 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9240000000000007e-06 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065736+0000", 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0903e-05 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065746+0000", 2024-04-26T12:38:51.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0817e-05 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065851+0000", 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104202 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.065981+0000", 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013002900000000001 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.066255+0000", 2024-04-26T12:38:51.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394099999999998 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.067330+0000", 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010755960000000001 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068086+0000", 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00075542399999999998 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068170+0000", 2024-04-26T12:38:51.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4258999999999994e-05 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.068239+0000", 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9299000000000002e-05 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.491315589999999, 2024-04-26T12:38:51.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:51.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:38:51.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.487483536999999, 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026710560000000002, 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.733 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123011+0000", 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.643e-06 2024-04-26T12:38:51.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123023+0000", 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1824000000000001e-05 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123048+0000", 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5392999999999999e-05 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123067+0000", 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9236e-05 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123185+0000", 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011799299999999999 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123336+0000", 2024-04-26T12:38:51.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150698 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123600+0000", 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026369799999999998 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.124967+0000", 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013678399999999999 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125536+0000", 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056819499999999996 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125621+0000", 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5320000000000003e-05 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125680+0000", 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9215999999999997e-05 2024-04-26T12:38:51.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.305919232000001, 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:38:51.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.302156645, 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:51.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:38:51.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:51.751 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:51.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:38:51.753 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:51.751+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:51.853 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:51.850+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:51.930 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:51.930 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:51.930 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:51.930 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:51.945 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:38:51.986 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:51.986+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:52.055 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:52.050+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:52.114 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:52.114 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:52.114 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:52.114 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:52.114 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:52.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:38:52.155 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:52.151+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:52.256 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:52.250+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.855494114999999, 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.301 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:38:52.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.798255931, 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.679113657000002, 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:52.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:38:52.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:38:52.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:38:52.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.788228896, 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.770105886, 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.321 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:38:52.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.743011271, 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:38:52.327 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.332 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.724204596, 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:38:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:38:52.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:38:52.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:38:52.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.690701252, 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:38:52.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:38:52.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.660962324, 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.345 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:38:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.350 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.655222561999999, 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:38:52.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:38:52.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:38:52.356 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.611190014000002, 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.357 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:38:52.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.358 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:52.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:52.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:38:52.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:38:52.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:38:52.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:38:52.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:38:52.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:38:52.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:38:52.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:38:52.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.609531593, 2024-04-26T12:38:52.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:38:52.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:38:52.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:38:52.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:38:52.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.605299157000001, 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.370 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:38:52.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:38:52.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:38:52.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:38:52.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.318284550000001, 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.376 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:38:52.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:38:52.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:38:52.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.314192331000001, 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.382 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:38:52.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.388 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.215752220999999, 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028684980000000001, 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:52.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:52.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081977+0000", 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081989+0000", 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1663e-05 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082020+0000", 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0746e-05 2024-04-26T12:38:52.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082035+0000", 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5647000000000001e-05 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082174+0000", 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013828899999999999 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082387+0000", 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021377500000000001 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082704+0000", 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000316934 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.083853+0000", 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001148388 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084695+0000", 2024-04-26T12:38:52.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084224699999999996 2024-04-26T12:38:52.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084779+0000", 2024-04-26T12:38:52.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3652999999999993e-05 2024-04-26T12:38:52.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084844+0000", 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4808999999999996e-05 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.211959676999999, 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:38:52.395 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:38:52.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:38:52.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.929011313, 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:38:52.401 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:38:52.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.407 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.924705340999999, 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:52.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:38:52.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.858960980999999, 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029228000000000001, 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:52.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438769+0000", 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3499999999999999e-06 2024-04-26T12:38:52.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438781+0000", 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2027e-05 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438812+0000", 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1238999999999997e-05 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438830+0000", 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7677e-05 2024-04-26T12:38:52.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438969+0000", 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013923200000000001 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439175+0000", 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020586199999999999 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439538+0000", 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036342699999999999 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.440591+0000", 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010524390000000001 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441533+0000", 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094222499999999999 2024-04-26T12:38:52.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441621+0000", 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8399999999999994e-05 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441689+0000", 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7922000000000005e-05 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.419 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:52.421 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:38:52.421 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:52.419+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:52.522 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:52.519+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:52.594 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:52.594 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:52.595 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:52.595 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:52.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:38:52.623 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:52.623+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:52.724 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:52.723+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:52.728 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:52.728 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:52.728 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:52.728 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:52.728 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:52.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:38:52.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:38:52.866 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:52.862+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:52.868 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:52.868 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:52.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:52.868 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:52.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.868 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:40 5.6 5:66d44ff0:::zonegroup_info.6cf2425f-74db-47a8-896e-35ab7b9def6a:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:38:52.868 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.368955284000002, 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031402079999999998, 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-04-26T12:38:52.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497958+0000", 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.922e-06 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497970+0000", 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.136e-05 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497995+0000", 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5279999999999999e-05 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498009+0000", 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3872e-05 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498111+0000", 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101927 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498303+0000", 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019180600000000001 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498553+0000", 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024977300000000001 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.499918+0000", 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001365003 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500885+0000", 2024-04-26T12:38:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00096762599999999997 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500997+0000", 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111742 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.501097+0000", 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9896999999999996e-05 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.359589849000002, 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047946860000000003, 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 52 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507325+0000", 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.717e-06 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507336+0000", 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1182999999999999e-05 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507370+0000", 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4230000000000003e-05 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507388+0000", 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7453e-05 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507508+0000", 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012033599999999999 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507749+0000", 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024146700000000001 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507923+0000", 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017378700000000001 2024-04-26T12:38:52.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.508980+0000", 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056707 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.511982+0000", 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030022809999999999 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512050+0000", 2024-04-26T12:38:52.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7457000000000001e-05 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512117+0000", 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7068000000000002e-05 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.249422974000002, 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036369689999999999, 2024-04-26T12:38:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617492+0000", 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617505+0000", 2024-04-26T12:38:52.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.306e-05 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617536+0000", 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1007000000000003e-05 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617553+0000", 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7629999999999999e-05 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617719+0000", 2024-04-26T12:38:52.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016533800000000001 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618065+0000", 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034657399999999999 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618778+0000", 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071317099999999997 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620613+0000", 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018347260000000001 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620980+0000", 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036717100000000001 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621062+0000", 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1442999999999999e-05 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621126+0000", 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4085999999999996e-05 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.235779646000001, 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026109499999999999, 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.886 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 281 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631133+0000", 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0559999999999999e-06 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631139+0000", 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1419999999999998e-06 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631154+0000", 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4893e-05 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631161+0000", 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9179999999999997e-06 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631234+0000", 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2976000000000001e-05 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631374+0000", 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140218 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631555+0000", 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018107600000000001 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.632139+0000", 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058337700000000005 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633653+0000", 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001514123 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633695+0000", 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2208e-05 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633743+0000", 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7963000000000001e-05 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.891 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.907068262999999, 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035079099999999999, 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.892 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959846+0000", 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959860+0000", 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3329999999999999e-05 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959891+0000", 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1576999999999999e-05 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959906+0000", 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4912999999999999e-05 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960018+0000", 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011209600000000001 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960260+0000", 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024201100000000001 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960602+0000", 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034149700000000001 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.961961+0000", 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013591230000000001 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963193+0000", 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012322399999999999 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963281+0000", 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8306000000000005e-05 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963352+0000", 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0216999999999995e-05 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.897 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.866260905000001, 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002916901, 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000653+0000", 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000665+0000", 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.187e-05 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000696+0000", 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0607e-05 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000712+0000", 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6192999999999999e-05 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000825+0000", 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113213 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001039+0000", 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021364100000000001 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001352+0000", 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000313071 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.002433+0000", 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010811779999999999 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003365+0000", 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093210299999999999 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003449+0000", 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3973000000000004e-05 2024-04-26T12:38:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003568+0000", 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118542 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.862483077, 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027713579999999998, 2024-04-26T12:38:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 762 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004431+0000", 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.77e-06 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004441+0000", 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0523000000000001e-05 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004467+0000", 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5522999999999999e-05 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004479+0000", 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2486999999999999e-05 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004586+0000", 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106926 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004721+0000", 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013467199999999999 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004986+0000", 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026559100000000003 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006110+0000", 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123995 2024-04-26T12:38:52.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006998+0000", 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088729 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007083+0000", 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5871999999999994e-05 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007200+0000", 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116709 2024-04-26T12:38:52.908 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.733978262000001, 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028708179999999998, 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132936+0000", 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132949+0000", 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2533e-05 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132980+0000", 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1423000000000001e-05 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132995+0000", 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5e-05 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133125+0000", 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012975899999999999 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133349+0000", 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223842 2024-04-26T12:38:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133698+0000", 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034930699999999998 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.134765+0000", 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001066808 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135647+0000", 2024-04-26T12:38:52.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088210700000000003 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135735+0000", 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8206000000000002e-05 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135804+0000", 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9103000000000006e-05 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.730149580999999, 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028524739999999998, 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136764+0000", 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9759999999999998e-06 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136776+0000", 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.133e-05 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136802+0000", 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136822+0000", 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9247000000000001e-05 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136933+0000", 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110946 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137069+0000", 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013615200000000001 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137342+0000", 2024-04-26T12:38:52.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027280099999999998 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.138318+0000", 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00097641000000000004 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139458+0000", 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011402669999999999 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139545+0000", 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6948999999999997e-05 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139615+0000", 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9560000000000005e-05 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.679984639000001, 2024-04-26T12:38:52.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028263889999999999, 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186930+0000", 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186944+0000", 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4e-05 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186974+0000", 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0332999999999999e-05 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186989+0000", 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4776e-05 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187122+0000", 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013347599999999999 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187343+0000", 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022082499999999999 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187668+0000", 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032438699999999998 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.188757+0000", 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001089565 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189604+0000", 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084688799999999996 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189689+0000", 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5348999999999999e-05 2024-04-26T12:38:52.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189754+0000", 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4159999999999996e-05 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.675940919999999, 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031280219999999998, 2024-04-26T12:38:52.926 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190973+0000", 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8199999999999999e-06 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190982+0000", 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1530000000000003e-06 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191006+0000", 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191018+0000", 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191149+0000", 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013097200000000001 2024-04-26T12:38:52.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191397+0000", 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024733099999999999 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191899+0000", 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050217600000000001 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193371+0000", 2024-04-26T12:38:52.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014719959999999999 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193942+0000", 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000571475 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194031+0000", 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8696000000000006e-05 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194099+0000", 2024-04-26T12:38:52.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.665482204, 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034761900000000001, 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.932 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201432+0000", 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3630000000000001e-06 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201445+0000", 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3016999999999999e-05 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201475+0000", 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9719000000000001e-05 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201490+0000", 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201647+0000", 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156909 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202024+0000", 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037773100000000002 2024-04-26T12:38:52.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202591+0000", 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000566992 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.203991+0000", 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013995290000000001 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204629+0000", 2024-04-26T12:38:52.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063768500000000003 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204786+0000", 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015742600000000001 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204906+0000", 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119869 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.660796300000001, 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034202299999999998, 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206117+0000", 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.68e-06 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206126+0000", 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5900000000000008e-06 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206151+0000", 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4939e-05 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206163+0000", 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2597e-05 2024-04-26T12:38:52.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206291+0000", 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012768600000000001 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206539+0000", 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000248061 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.207052+0000", 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051334299999999998 2024-04-26T12:38:52.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.208330+0000", 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012775060000000001 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209262+0000", 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093203999999999997 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209418+0000", 2024-04-26T12:38:52.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015631900000000001 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209536+0000", 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117469 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.613511551999999, 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027845690000000002, 2024-04-26T12:38:52.943 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253402+0000", 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1830000000000001e-06 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253414+0000", 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1223000000000001e-05 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253444+0000", 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0300000000000001e-05 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253459+0000", 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4749999999999999e-05 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253585+0000", 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126379 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253813+0000", 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000227498 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.254131+0000", 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031848800000000002 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.255218+0000", 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010869180000000001 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256027+0000", 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080942099999999995 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256114+0000", 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6599000000000002e-05 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256185+0000", 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0809999999999995e-05 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.948 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.52045214, 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035106930000000001, 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.949 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346462+0000", 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5459999999999998e-06 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346475+0000", 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2764e-05 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346506+0000", 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1266000000000002e-05 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346521+0000", 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4887e-05 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346676+0000", 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015471800000000001 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347095+0000", 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041862399999999998 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347690+0000", 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059590499999999998 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349002+0000", 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00131185 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349697+0000", 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069428800000000004 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349855+0000", 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015838899999999999 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349970+0000", 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115456 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.954 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.515980767999999, 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003318194, 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:38:52.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350933+0000", 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350942+0000", 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2429999999999994e-06 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350967+0000", 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4239999999999998e-05 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350981+0000", 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4093e-05 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351122+0000", 2024-04-26T12:38:52.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014118299999999999 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351371+0000", 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000249604 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351883+0000", 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051186600000000004 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.353068+0000", 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011850980000000001 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354094+0000", 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010259290000000001 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354181+0000", 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6812999999999997e-05 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354249+0000", 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8162000000000002e-05 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.421004835000002, 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028482690000000001, 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445910+0000", 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6570000000000001e-06 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445922+0000", 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2806000000000001e-05 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445955+0000", 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2036999999999998e-05 2024-04-26T12:38:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445970+0000", 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446092+0000", 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121523 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446313+0000", 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022160800000000001 2024-04-26T12:38:52.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446651+0000", 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000338074 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.447983+0000", 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013322029999999999 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448614+0000", 2024-04-26T12:38:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063038899999999997 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448695+0000", 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1348999999999997e-05 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448755+0000", 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0139999999999997e-05 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.417272143000002, 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003146959, 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 951 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449641+0000", 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3230000000000001e-06 2024-04-26T12:38:52.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449648+0000", 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1300000000000003e-06 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449669+0000", 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0809999999999999e-05 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449680+0000", 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1416999999999999e-05 2024-04-26T12:38:52.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449805+0000", 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012442200000000001 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449942+0000", 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013762299999999999 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.450223+0000", 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028021699999999998 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.451636+0000", 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001413573 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452587+0000", 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000950799 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452672+0000", 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4735999999999996e-05 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452787+0000", 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011490899999999999 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.406822507000001, 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035247389999999998, 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:38:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460092+0000", 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460105+0000", 2024-04-26T12:38:52.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3730000000000001e-05 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460135+0000", 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9649e-05 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460154+0000", 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8953e-05 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460270+0000", 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011612600000000001 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460494+0000", 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022413199999999999 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460813+0000", 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031844700000000002 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.462087+0000", 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273927 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463222+0000", 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354080000000001 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463434+0000", 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021214500000000001 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463614+0000", 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017984199999999999 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.40221352, 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002995798, 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:52.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:52.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464700+0000", 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.844e-06 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464712+0000", 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1763000000000001e-05 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464738+0000", 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5829999999999998e-05 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464751+0000", 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3456e-05 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464895+0000", 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143399 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465152+0000", 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025729799999999999 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465636+0000", 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048426300000000002 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.466751+0000", 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011144550000000001 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467488+0000", 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000737501 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467576+0000", 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8252999999999997e-05 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467694+0000", 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117736 2024-04-26T12:38:52.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.983 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.983 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.983 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:52.983 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:52.983 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:52.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:38:52.984 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:52.983+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:52.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:38:53.085 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:53.082+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:53.148 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:53.148 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:53.148 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:53.148 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:53.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:38:53.169 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:53.170 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:53.187 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:53.187 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:53.188 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:53.186+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:53.204 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:53.204 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:53.220 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:53.220 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:53.241 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:53.241 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:53.261 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:53.262 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:53.283 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:53.284 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:53.285 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:53.286 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:53.286 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:53.283+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:53.301 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:38:53.305 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:53.305 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:53.388 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:53.387+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:53.437 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:53.437 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:53.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:38:53.496 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:53.495+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:53.581 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:53.581 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:53.588 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:53.587+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:53.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:38:53.689 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:53.686+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:53.757 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:53.758 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:53.772 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:38:53.791 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:53.790+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:53.824 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:38:53.892 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:53.890+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:53.893 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:53.893 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:53.908 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:38:53.992 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:53.990+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:54.029 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:54.029 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:54.043 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:38:54.094 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:54.094+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:54.180 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:38:54.194 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:54.194+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:54.296 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:54.294+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:54.304 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:54.304 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:54.318 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:38:54.397 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:54.395+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:54.436 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:54.436 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:54.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:38:54.536 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:54.535+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:54.599 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:54.598+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:54.609 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:54.609 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:54.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:38:54.700 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:54.698+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:54.786 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:54.786 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:54.800 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:38:54.801 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:54.799+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:54.902 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:54.899+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:54.966 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:54.966 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:54.980 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:38:55.025 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:55.023+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:55.103 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:55.102+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:55.141 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:55.141 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:55.154 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:38:55.204 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:55.203+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:55.274 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:55.274 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:55.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:38:55.325 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:38:55.334 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:55.334+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:55.406 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:55.406+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:55.419 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:55.419 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:55.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:38:55.485 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:55.485 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:55.503 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:55.503 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:55.507 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:55.507+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:55.520 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:55.520 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:55.537 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:55.537 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:55.557 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:55.557 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:55.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:55.578 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:55.596 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:55.596 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:55.597 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:55.598 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:55.599 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:55.608 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:55.606+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:55.611 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:38:55.620 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:55.620 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:55.709 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:55.710+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:55.760 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:55.761 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:55.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:55.761 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:55.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.761 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:55.761 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:55.761 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.235949046999998, 2024-04-26T12:38:55.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:38:55.762 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.762 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:38:55.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.763 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:55.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:38:55.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:38:55.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:38:55.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:38:55.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:38:55.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:38:55.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:38:55.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:38:55.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:38:55.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:38:55.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:55.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:38:55.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:38:55.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:38:55.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:38:55.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:38:55.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:38:55.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:38:55.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:38:55.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:38:55.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:38:55.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.771 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.771 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.232557513000003, 2024-04-26T12:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:38:55.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.773 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:55.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:38:55.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:38:55.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:38:55.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:38:55.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:38:55.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:38:55.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:38:55.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:38:55.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:38:55.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:55.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:38:55.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:38:55.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:38:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:38:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:38:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:38:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:38:55.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:38:55.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:38:55.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:38:55.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.781 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.782 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:38:55.782 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:55.782 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.256740456999999, 2024-04-26T12:38:55.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:38:55.782 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:55.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:38:55.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:38:55.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.237731150999998, 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:38:55.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:38:55.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:55.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.205809453999997, 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.796 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:38:55.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:38:55.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:38:55.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:38:55.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:38:55.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:38:55.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.191711411999997, 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:38:55.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:55.811 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.161987287999999, 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:38:55.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.143052351000001, 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:38:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:38:55.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:38:55.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:38:55.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.823 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.092142252999999, 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:38:55.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.091731381000002, 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:38:55.831 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:38:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:38:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:38:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:38:55.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:38:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:38:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:38:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:38:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:38:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:38:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:38:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:38:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:38:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:38:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:38:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:38:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:38:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:38:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:421 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.086558736999997, 2024-04-26T12:38:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025968440000000001, 2024-04-26T12:38:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.841 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 421 2024-04-26T12:38:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:38:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670483+0000", 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4109999999999999e-06 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670491+0000", 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670507+0000", 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6030000000000001e-05 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670518+0000", 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0631e-05 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670575+0000", 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7518000000000001e-05 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670674+0000", 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8998000000000003e-05 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:55.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670858+0000", 2024-04-26T12:38:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018376199999999999 2024-04-26T12:38:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.671491+0000", 2024-04-26T12:38:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063290099999999995 2024-04-26T12:38:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.672995+0000", 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015041329999999999 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673031+0000", 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5790000000000001e-05 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673078+0000", 2024-04-26T12:38:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7681e-05 2024-04-26T12:38:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.016147594000003, 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.850 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:55.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.009322257999997, 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026409879999999999, 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 527 2024-04-26T12:38:55.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747719+0000", 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.282e-06 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747727+0000", 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747745+0000", 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7847999999999999e-05 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747754+0000", 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747815+0000", 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1057999999999997e-05 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747915+0000", 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748134+0000", 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021918799999999999 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748691+0000", 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000557414 2024-04-26T12:38:55.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750284+0000", 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015928889999999999 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750317+0000", 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2447000000000003e-05 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750359+0000", 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2256000000000003e-05 2024-04-26T12:38:55.862 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.897375875000002, 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.863 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:55.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.868 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.695157715000001, 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.637863285999998, 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.874 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:38:55.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:38:55.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:38:55.879 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.634031233000002, 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026710560000000002, 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-04-26T12:38:55.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123011+0000", 2024-04-26T12:38:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.643e-06 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123023+0000", 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1824000000000001e-05 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123048+0000", 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5392999999999999e-05 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123067+0000", 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9236e-05 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123185+0000", 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011799299999999999 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123336+0000", 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150698 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123600+0000", 2024-04-26T12:38:55.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026369799999999998 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.124967+0000", 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013678399999999999 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125536+0000", 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056819499999999996 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125621+0000", 2024-04-26T12:38:55.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5320000000000003e-05 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125680+0000", 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9215999999999997e-05 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.452466928, 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:38:55.885 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:38:55.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:38:55.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:38:55.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.448704341000003, 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.891 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:38:55.896 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.0978434320000003, 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002673173, 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659200+0000", 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7580000000000001e-06 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659212+0000", 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2096000000000001e-05 2024-04-26T12:38:55.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659235+0000", 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3626999999999999e-05 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659246+0000", 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0943e-05 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659381+0000", 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013473900000000001 2024-04-26T12:38:55.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659544+0000", 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016267500000000001 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659716+0000", 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258700000000001 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.660569+0000", 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085223700000000005 2024-04-26T12:38:55.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661768+0000", 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011995770000000001 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661810+0000", 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1866999999999997e-05 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661870+0000", 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0066999999999999e-05 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.901 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:55.902 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:55.902 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:55.902 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:38:55.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:38:55.904 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:55.902+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:56.004 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:56.002+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:56.073 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:56.073 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:56.073 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:56.073 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:56.090 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:38:56.105 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:56.103+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:56.206 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:56.206+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:56.250 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:56.250 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:56.250 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:56.250 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:56.250 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:56.264 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:38:56.307 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:56.303+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:56.408 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:56.406+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:56.428 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.985187500000002, 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.429 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:38:56.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.927949316000003, 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:38:56.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.808807041999998, 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:38:56.440 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:38:56.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:38:56.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.917922281000003, 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:38:56.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:38:56.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.899799270999999, 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:38:56.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:38:56.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:38:56.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.460 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.872704656000003, 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:38:56.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:38:56.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.853897981000003, 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:38:56.467 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:38:56.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.473 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.820394637, 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.474 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:38:56.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:38:56.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:38:56.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.790655708999999, 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:38:56.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:38:56.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:56.487 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.784915947000002, 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:38:56.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:38:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:38:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:38:56.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.740883398999998, 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:38:56.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:38:56.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:38:56.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.739224978000003, 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:38:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:38:56.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.734992542000001, 2024-04-26T12:38:56.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:38:56.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:38:56.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.447977934999997, 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:38:56.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:38:56.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.521 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.443885715999997, 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.522 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:38:56.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:38:56.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.345445605999998, 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028684980000000001, 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.529 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081977+0000", 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081989+0000", 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1663e-05 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082020+0000", 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0746e-05 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082035+0000", 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5647000000000001e-05 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082174+0000", 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013828899999999999 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082387+0000", 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021377500000000001 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082704+0000", 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000316934 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.083853+0000", 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001148388 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084695+0000", 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084224699999999996 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084779+0000", 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3652999999999993e-05 2024-04-26T12:38:56.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084844+0000", 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4808999999999996e-05 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.341653061999999, 2024-04-26T12:38:56.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:38:56.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:38:56.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:38:56.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.058704698, 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.542 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:38:56.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:38:56.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.548 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.054398726000002, 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:38:56.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:38:56.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:56.555 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.988654365999999, 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029228000000000001, 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438769+0000", 2024-04-26T12:38:56.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3499999999999999e-06 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438781+0000", 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2027e-05 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438812+0000", 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1238999999999997e-05 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438830+0000", 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7677e-05 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438969+0000", 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013923200000000001 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439175+0000", 2024-04-26T12:38:56.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020586199999999999 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439538+0000", 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036342699999999999 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.440591+0000", 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010524390000000001 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441533+0000", 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094222499999999999 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441621+0000", 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8399999999999994e-05 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441689+0000", 2024-04-26T12:38:56.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7922000000000005e-05 2024-04-26T12:38:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:56.562 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:56.562 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:56.564 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:38:56.564 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:56.562+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:56.665 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:56.663+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:56.740 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:56.740 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:56.741 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:56.741 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:56.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:38:56.802 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:56.802+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:56.834 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:38:56.868 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:56.867+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:56.886 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:56.886 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:56.886 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:56.886 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:56.886 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:56.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:38:56.971 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:56.971+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:57.068 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:40 5.6 5:66d44ff0:::zonegroup_info.6cf2425f-74db-47a8-896e-35ab7b9def6a:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.567058455999998, 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031402079999999998, 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:38:57.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:38:57.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497958+0000", 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.922e-06 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497970+0000", 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.136e-05 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497995+0000", 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5279999999999999e-05 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498009+0000", 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3872e-05 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498111+0000", 2024-04-26T12:38:57.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101927 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498303+0000", 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019180600000000001 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498553+0000", 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024977300000000001 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.499918+0000", 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001365003 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500885+0000", 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00096762599999999997 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500997+0000", 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111742 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.501097+0000", 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9896999999999996e-05 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.557693020999999, 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047946860000000003, 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.075 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 52 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:38:57.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507325+0000", 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.717e-06 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507336+0000", 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1182999999999999e-05 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507370+0000", 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4230000000000003e-05 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507388+0000", 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7453e-05 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507508+0000", 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012033599999999999 2024-04-26T12:38:57.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507749+0000", 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024146700000000001 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507923+0000", 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017378700000000001 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.508980+0000", 2024-04-26T12:38:57.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056707 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.511982+0000", 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030022809999999999 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512050+0000", 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7457000000000001e-05 2024-04-26T12:38:57.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512117+0000", 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7068000000000002e-05 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:38:57.081 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.447526146000001, 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036369689999999999, 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617492+0000", 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617505+0000", 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.306e-05 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617536+0000", 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1007000000000003e-05 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617553+0000", 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7629999999999999e-05 2024-04-26T12:38:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617719+0000", 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016533800000000001 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618065+0000", 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034657399999999999 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618778+0000", 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071317099999999997 2024-04-26T12:38:57.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620613+0000", 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018347260000000001 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620980+0000", 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036717100000000001 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621062+0000", 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1442999999999999e-05 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621126+0000", 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4085999999999996e-05 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:38:57.087 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.433882818000001, 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026109499999999999, 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 281 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631133+0000", 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0559999999999999e-06 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631139+0000", 2024-04-26T12:38:57.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1419999999999998e-06 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631154+0000", 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4893e-05 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631161+0000", 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9179999999999997e-06 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631234+0000", 2024-04-26T12:38:57.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2976000000000001e-05 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631374+0000", 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140218 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631555+0000", 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018107600000000001 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.632139+0000", 2024-04-26T12:38:57.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058337700000000005 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633653+0000", 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001514123 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633695+0000", 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2208e-05 2024-04-26T12:38:57.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633743+0000", 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7963000000000001e-05 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.105171435000003, 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035079099999999999, 2024-04-26T12:38:57.093 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959846+0000", 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959860+0000", 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3329999999999999e-05 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959891+0000", 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1576999999999999e-05 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959906+0000", 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4912999999999999e-05 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960018+0000", 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011209600000000001 2024-04-26T12:38:57.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960260+0000", 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024201100000000001 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960602+0000", 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034149700000000001 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.961961+0000", 2024-04-26T12:38:57.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013591230000000001 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963193+0000", 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012322399999999999 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963281+0000", 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8306000000000005e-05 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963352+0000", 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0216999999999995e-05 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.064364077, 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002916901, 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.099 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:38:57.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000653+0000", 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000665+0000", 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.187e-05 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000696+0000", 2024-04-26T12:38:57.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0607e-05 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000712+0000", 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6192999999999999e-05 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000825+0000", 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113213 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001039+0000", 2024-04-26T12:38:57.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021364100000000001 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001352+0000", 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000313071 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.002433+0000", 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010811779999999999 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003365+0000", 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093210299999999999 2024-04-26T12:38:57.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003449+0000", 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3973000000000004e-05 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003568+0000", 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118542 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.104 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.060586249000004, 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027713579999999998, 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 762 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004431+0000", 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.77e-06 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004441+0000", 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0523000000000001e-05 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004467+0000", 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5522999999999999e-05 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004479+0000", 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2486999999999999e-05 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004586+0000", 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106926 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004721+0000", 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013467199999999999 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004986+0000", 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026559100000000003 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006110+0000", 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123995 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006998+0000", 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088729 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007083+0000", 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5871999999999994e-05 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007200+0000", 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116709 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.932081433999997, 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028708179999999998, 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.110 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132936+0000", 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132949+0000", 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2533e-05 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132980+0000", 2024-04-26T12:38:57.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1423000000000001e-05 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132995+0000", 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5e-05 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133125+0000", 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012975899999999999 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133349+0000", 2024-04-26T12:38:57.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223842 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133698+0000", 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034930699999999998 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.134765+0000", 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001066808 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135647+0000", 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088210700000000003 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135735+0000", 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8206000000000002e-05 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135804+0000", 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9103000000000006e-05 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.115 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.928252753000002, 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028524739999999998, 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-04-26T12:38:57.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136764+0000", 2024-04-26T12:38:57.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9759999999999998e-06 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136776+0000", 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.133e-05 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136802+0000", 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136822+0000", 2024-04-26T12:38:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9247000000000001e-05 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136933+0000", 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110946 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137069+0000", 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013615200000000001 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137342+0000", 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027280099999999998 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.138318+0000", 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00097641000000000004 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139458+0000", 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011402669999999999 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139545+0000", 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6948999999999997e-05 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139615+0000", 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9560000000000005e-05 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.121 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.878087811, 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028263889999999999, 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.122 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186930+0000", 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186944+0000", 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4e-05 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186974+0000", 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0332999999999999e-05 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186989+0000", 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4776e-05 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187122+0000", 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013347599999999999 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187343+0000", 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022082499999999999 2024-04-26T12:38:57.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187668+0000", 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032438699999999998 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.188757+0000", 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001089565 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189604+0000", 2024-04-26T12:38:57.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084688799999999996 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189689+0000", 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5348999999999999e-05 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189754+0000", 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4159999999999996e-05 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.127 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.874044091999998, 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031280219999999998, 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.128 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190973+0000", 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8199999999999999e-06 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190982+0000", 2024-04-26T12:38:57.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1530000000000003e-06 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191006+0000", 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191018+0000", 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191149+0000", 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013097200000000001 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191397+0000", 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024733099999999999 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191899+0000", 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050217600000000001 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193371+0000", 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014719959999999999 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193942+0000", 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000571475 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194031+0000", 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8696000000000006e-05 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194099+0000", 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.863585376000003, 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034761900000000001, 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201432+0000", 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3630000000000001e-06 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201445+0000", 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3016999999999999e-05 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201475+0000", 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9719000000000001e-05 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201490+0000", 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201647+0000", 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156909 2024-04-26T12:38:57.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202024+0000", 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037773100000000002 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202591+0000", 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000566992 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.203991+0000", 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013995290000000001 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204629+0000", 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063768500000000003 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204786+0000", 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015742600000000001 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204906+0000", 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119869 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.858899471999997, 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034202299999999998, 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.140 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206117+0000", 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.68e-06 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206126+0000", 2024-04-26T12:38:57.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5900000000000008e-06 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206151+0000", 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4939e-05 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206163+0000", 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2597e-05 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206291+0000", 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012768600000000001 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206539+0000", 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000248061 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.207052+0000", 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051334299999999998 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.208330+0000", 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012775060000000001 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209262+0000", 2024-04-26T12:38:57.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093203999999999997 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209418+0000", 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015631900000000001 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209536+0000", 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117469 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.146 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.811614724000002, 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027845690000000002, 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253402+0000", 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1830000000000001e-06 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253414+0000", 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1223000000000001e-05 2024-04-26T12:38:57.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253444+0000", 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0300000000000001e-05 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253459+0000", 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4749999999999999e-05 2024-04-26T12:38:57.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253585+0000", 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126379 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253813+0000", 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000227498 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.254131+0000", 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031848800000000002 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.255218+0000", 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010869180000000001 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256027+0000", 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080942099999999995 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256114+0000", 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6599000000000002e-05 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256185+0000", 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0809999999999995e-05 2024-04-26T12:38:57.153 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.718555311999999, 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035106930000000001, 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346462+0000", 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5459999999999998e-06 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346475+0000", 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2764e-05 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346506+0000", 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1266000000000002e-05 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346521+0000", 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4887e-05 2024-04-26T12:38:57.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346676+0000", 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015471800000000001 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347095+0000", 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041862399999999998 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347690+0000", 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059590499999999998 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349002+0000", 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00131185 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349697+0000", 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069428800000000004 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349855+0000", 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015838899999999999 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349970+0000", 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115456 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.160 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:38:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.714083940000002, 2024-04-26T12:38:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003318194, 2024-04-26T12:38:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-04-26T12:38:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350933+0000", 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:38:57.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350942+0000", 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2429999999999994e-06 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350967+0000", 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4239999999999998e-05 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350981+0000", 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4093e-05 2024-04-26T12:38:57.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351122+0000", 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014118299999999999 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351371+0000", 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000249604 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351883+0000", 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051186600000000004 2024-04-26T12:38:57.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.353068+0000", 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011850980000000001 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354094+0000", 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010259290000000001 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354181+0000", 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6812999999999997e-05 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354249+0000", 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8162000000000002e-05 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.619108007000001, 2024-04-26T12:38:57.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028482690000000001, 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:38:57.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445910+0000", 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6570000000000001e-06 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445922+0000", 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2806000000000001e-05 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445955+0000", 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2036999999999998e-05 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445970+0000", 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446092+0000", 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121523 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446313+0000", 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022160800000000001 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446651+0000", 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000338074 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.447983+0000", 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013322029999999999 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448614+0000", 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063038899999999997 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448695+0000", 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1348999999999997e-05 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448755+0000", 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0139999999999997e-05 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.615375315000001, 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003146959, 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.173 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 951 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449641+0000", 2024-04-26T12:38:57.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3230000000000001e-06 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449648+0000", 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1300000000000003e-06 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449669+0000", 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0809999999999999e-05 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449680+0000", 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1416999999999999e-05 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449805+0000", 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012442200000000001 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449942+0000", 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013762299999999999 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.450223+0000", 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028021699999999998 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.451636+0000", 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001413573 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452587+0000", 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000950799 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452672+0000", 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4735999999999996e-05 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452787+0000", 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011490899999999999 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.179 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.604925678999997, 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035247389999999998, 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:38:57.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460092+0000", 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460105+0000", 2024-04-26T12:38:57.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3730000000000001e-05 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460135+0000", 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9649e-05 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460154+0000", 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8953e-05 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460270+0000", 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011612600000000001 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460494+0000", 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022413199999999999 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460813+0000", 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031844700000000002 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.462087+0000", 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273927 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463222+0000", 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354080000000001 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463434+0000", 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021214500000000001 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463614+0000", 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017984199999999999 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.600316692, 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002995798, 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.185 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464700+0000", 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.844e-06 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464712+0000", 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1763000000000001e-05 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464738+0000", 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5829999999999998e-05 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464751+0000", 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3456e-05 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464895+0000", 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143399 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465152+0000", 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025729799999999999 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465636+0000", 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048426300000000002 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.466751+0000", 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011144550000000001 2024-04-26T12:38:57.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467488+0000", 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000737501 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467576+0000", 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8252999999999997e-05 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467694+0000", 2024-04-26T12:38:57.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117736 2024-04-26T12:38:57.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.191 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.191 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.191 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:57.192 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:38:57.193 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:57.191+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:57.293 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:57.290+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:57.325 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:57.325 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:38:57.325 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:57.339 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:38:57.426 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:57.426+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:57.495 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:57.495+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:57.502 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:38:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:38:57.502 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:38:57.502 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:57.518 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:38:57.597 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:57.595+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:57.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:38:57.693 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:38:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:38:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:38:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:38:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:57.693 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.176314275999999, 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002983332, 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 56 2024-04-26T12:38:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515116+0000", 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5550000000000001e-06 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515127+0000", 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0899e-05 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515152+0000", 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.561e-05 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515165+0000", 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2727e-05 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515291+0000", 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000125628 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515490+0000", 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000199452 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:38:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515690+0000", 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000200189 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517095+0000", 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014043860000000001 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517890+0000", 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079524999999999995 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518006+0000", 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011569 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518097+0000", 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0946000000000006e-05 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.699 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889461985664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.173197752, 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030541930000000002, 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518232+0000", 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7430000000000001e-06 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518239+0000", 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1670000000000002e-06 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518263+0000", 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4786e-05 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518276+0000", 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2394e-05 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518374+0000", 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8544999999999999e-05 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518533+0000", 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000158763 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518836+0000", 2024-04-26T12:38:57.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030328000000000001 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.520242+0000", 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001405643 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521076+0000", 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083431100000000002 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521187+0000", 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110714 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521284+0000", 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6847000000000003e-05 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889461986816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.170366444000003, 2024-04-26T12:38:57.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003156112, 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 59 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:38:57.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521063+0000", 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9599999999999999e-06 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521074+0000", 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521105+0000", 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1199999999999999e-05 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521125+0000", 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9806999999999999e-05 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521260+0000", 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013498500000000001 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521472+0000", 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021194900000000001 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521908+0000", 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043670900000000002 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523344+0000", 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001435579 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524086+0000", 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000741805 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524148+0000", 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2408000000000003e-05 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524217+0000", 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9016999999999993e-05 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 36.187011067, 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046495770000000002, 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504420+0000", 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504437+0000", 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6926e-05 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504481+0000", 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3946999999999998e-05 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504506+0000", 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4986000000000001e-05 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504777+0000", 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027106100000000001 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505020+0000", 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024332499999999999 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505444+0000", 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000423783 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.507435+0000", 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019909950000000002 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508814+0000", 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001378799 2024-04-26T12:38:57.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508964+0000", 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014972600000000001 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509066+0000", 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010223200000000001 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.716 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 36.147672540000002, 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003567382, 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:38:57.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543758+0000", 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.286e-06 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543774+0000", 2024-04-26T12:38:57.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.571e-05 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543813+0000", 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9110000000000003e-05 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543831+0000", 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8139999999999999e-05 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543962+0000", 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130832 2024-04-26T12:38:57.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544216+0000", 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025436099999999999 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544648+0000", 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043157999999999998 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.546300+0000", 2024-04-26T12:38:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001651661 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547173+0000", 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087328999999999998 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547258+0000", 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4878999999999998e-05 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547322+0000", 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4533e-05 2024-04-26T12:38:57.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 36.106972388000003, 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035366059999999999, 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584458+0000", 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999999e-06 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584469+0000", 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.165e-05 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584501+0000", 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2005999999999998e-05 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584526+0000", 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4683000000000001e-05 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584654+0000", 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012805299999999999 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584869+0000", 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021525400000000001 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.585275+0000", 2024-04-26T12:38:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00040564399999999998 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.586816+0000", 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015407579999999999 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587844+0000", 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010284020000000001 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587927+0000", 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3286000000000002e-05 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587992+0000", 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4323000000000001e-05 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 36.099672640999998, 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029981999999999999, 2024-04-26T12:38:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591757+0000", 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591769+0000", 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1600000000000001e-05 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591799+0000", 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0543000000000002e-05 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591825+0000", 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5752e-05 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591941+0000", 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116143 2024-04-26T12:38:57.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592156+0000", 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021444899999999999 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592548+0000", 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039236700000000002 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594185+0000", 2024-04-26T12:38:57.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016373469999999999 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594615+0000", 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042984300000000001 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594692+0000", 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.695e-05 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594753+0000", 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0869000000000003e-05 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 36.092137309000002, 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033442010000000002, 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599292+0000", 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9769999999999999e-06 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599303+0000", 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0386e-05 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599334+0000", 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1087000000000002e-05 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599356+0000", 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2138999999999999e-05 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599475+0000", 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119589 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599696+0000", 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022040199999999999 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.600100+0000", 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000404044 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.601568+0000", 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001468001 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602489+0000", 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092147699999999997 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602571+0000", 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1818999999999997e-05 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602634+0000", 2024-04-26T12:38:57.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3280000000000004e-05 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.793286315000003, 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034449799999999998, 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898143+0000", 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898153+0000", 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0176999999999999e-05 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898180+0000", 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6781999999999999e-05 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898202+0000", 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1605000000000001e-05 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898329+0000", 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127367 2024-04-26T12:38:57.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898546+0000", 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021638199999999999 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898892+0000", 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034662799999999998 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.900063+0000", 2024-04-26T12:38:57.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171184 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901429+0000", 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013658990000000001 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901525+0000", 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5433000000000006e-05 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901586+0000", 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1463000000000004e-05 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.745858454999997, 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030447159999999998, 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 736 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945571+0000", 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945585+0000", 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3766e-05 2024-04-26T12:38:57.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945616+0000", 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1254000000000003e-05 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945632+0000", 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5296000000000001e-05 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945745+0000", 2024-04-26T12:38:57.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011295599999999999 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945978+0000", 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023348800000000001 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.946293+0000", 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000314958 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.947440+0000", 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011467440000000001 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948328+0000", 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088776000000000002 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948494+0000", 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016587899999999999 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948614+0000", 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012025500000000001 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.741897952999999, 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003238646, 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.751 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 738 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:38:57.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949531+0000", 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7069999999999999e-06 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949541+0000", 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949566+0000", 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5533000000000001e-05 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949579+0000", 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.236e-05 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949722+0000", 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014327200000000001 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949970+0000", 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024837500000000001 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.950482+0000", 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051128299999999996 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.951825+0000", 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013431630000000001 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952625+0000", 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080046700000000002 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952705+0000", 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9869000000000004e-05 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952768+0000", 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3057000000000003e-05 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.756 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:774 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.660077610999998, 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029121680000000001, 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 774 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:38:57.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031352+0000", 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9700000000000002e-06 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031361+0000", 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.414e-06 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031387+0000", 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031399+0000", 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2377e-05 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031574+0000", 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017496800000000001 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031715+0000", 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014111199999999999 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031989+0000", 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027419800000000002 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.033007+0000", 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010173319999999999 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034110+0000", 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001102879 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034192+0000", 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2346000000000001e-05 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034262+0000", 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0185999999999995e-05 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.762 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.650460170999999, 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028610879999999999, 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 778 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.763 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040970+0000", 2024-04-26T12:38:57.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040981+0000", 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1703e-05 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041013+0000", 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1303000000000002e-05 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041030+0000", 2024-04-26T12:38:57.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7493e-05 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041206+0000", 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017595499999999999 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041420+0000", 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021373200000000001 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:57.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041722+0000", 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030209799999999999 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.042818+0000", 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001095738 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043676+0000", 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085838699999999995 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043762+0000", 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6521999999999996e-05 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043828+0000", 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5957000000000006e-05 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.768 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.646476151999998, 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032202580000000001, 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 780 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044954+0000", 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-04-26T12:38:57.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045055+0000", 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010158900000000001 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045427+0000", 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037136100000000001 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045461+0000", 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4193000000000003e-05 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045615+0000", 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000153652 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045815+0000", 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020044799999999999 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:57.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.046189+0000", 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037399699999999999 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.047313+0000", 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123899 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048021+0000", 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070842099999999999 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048105+0000", 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3152999999999995e-05 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048172+0000", 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7012000000000001e-05 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.774 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.592240517, 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028409210000000002, 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099190+0000", 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099202+0000", 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2019e-05 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099233+0000", 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1093000000000002e-05 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099247+0000", 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4579999999999999e-05 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099361+0000", 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113723 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099573+0000", 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021191499999999999 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099895+0000", 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032170099999999997 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101037+0000", 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011427270000000001 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101880+0000", 2024-04-26T12:38:57.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084234700000000002 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101964+0000", 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3856000000000005e-05 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.102028+0000", 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4220000000000005e-05 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.780 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.431551843999998, 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028492639999999998, 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 871 2024-04-26T12:38:57.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259878+0000", 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0930000000000001e-06 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259888+0000", 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0713999999999999e-05 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259917+0000", 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8276000000000002e-05 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259931+0000", 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4032999999999999e-05 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260072+0000", 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141326 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260299+0000", 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022688799999999999 2024-04-26T12:38:57.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260617+0000", 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031782099999999998 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.261683+0000", 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001065812 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262584+0000", 2024-04-26T12:38:57.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00090090600000000004 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262665+0000", 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1578999999999999e-05 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262725+0000", 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9815999999999998e-05 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.368627840000002, 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028604580000000002, 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.790 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 897 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322801+0000", 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.536e-06 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322810+0000", 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3340000000000002e-06 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322835+0000", 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5136000000000001e-05 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322854+0000", 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8853000000000001e-05 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322990+0000", 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000136169 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323117+0000", 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012680600000000001 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323392+0000", 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027538500000000001 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.324484+0000", 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001092462 2024-04-26T12:38:57.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325508+0000", 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001023272 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325595+0000", 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6889000000000001e-05 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325660+0000", 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5616000000000003e-05 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.365549819999998, 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003075749, 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.796 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325880+0000", 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9259999999999999e-06 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325889+0000", 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8600000000000005e-06 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325918+0000", 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9006999999999999e-05 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325939+0000", 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0863e-05 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326058+0000", 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011906899999999999 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326273+0000", 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000214355 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326585+0000", 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031177800000000002 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.327864+0000", 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012790430000000001 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328808+0000", 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094398300000000002 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328893+0000", 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5263e-05 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328953+0000", 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0602e-05 2024-04-26T12:38:57.801 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.273278038999997, 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002915997, 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.802 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:38:57.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418151+0000", 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.75e-06 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418161+0000", 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418187+0000", 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6417000000000001e-05 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418207+0000", 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9902999999999999e-05 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418335+0000", 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127892 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418570+0000", 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023533500000000001 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418956+0000", 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038606699999999997 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420042+0000", 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001086175 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420918+0000", 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087580700000000004 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421002+0000", 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4239000000000004e-05 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421065+0000", 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.807 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.269365549, 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028511209999999999, 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 939 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.808 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422063+0000", 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5200000000000001e-06 2024-04-26T12:38:57.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422074+0000", 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0407e-05 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422100+0000", 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5848999999999999e-05 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422119+0000", 2024-04-26T12:38:57.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422268+0000", 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148899 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422392+0000", 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012443900000000001 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422672+0000", 2024-04-26T12:38:57.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000279368 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.423773+0000", 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001101582 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424766+0000", 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099285499999999995 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424852+0000", 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5913000000000002e-05 2024-04-26T12:38:57.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424913+0000", 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1136000000000006e-05 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:38:57.813 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:38:57.815 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:38:57.815 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:38:57.816 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:38:57.816 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:38:57.816 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:38:57.817 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:57.811+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:57.817 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:38:57.817 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:38:57.838 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:38:57.838 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:38:57.860 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:38:57.861 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:38:57.881 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:38:57.881 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:38:57.899 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:38:57.900 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:38:57.915 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:57.914+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:57.920 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:38:57.920 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:38:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:57.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:38:58.016 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:58.014+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:58.086 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:58.086 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:58.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:38:58.118 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:58.118+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:58.218 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:58.218 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:58.219 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:38:58.218+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:38:58.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:38:58.320 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:38:58.318+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:38:58.355 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:58.355 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:58.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:38:58.421 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:38:58.419+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:38:58.497 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:58.497 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:58.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:38:58.552 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:58.551+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:58.623 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:58.622+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:58.676 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:58.676 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:58.689 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:38:58.723 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:58.722+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:58.824 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:58.822+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:58.829 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:38:58.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:38:58.924 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:38:58.923+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:38:58.951 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:58.951 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:58.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:38:59.052 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:59.051+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:59.127 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:59.126+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:59.129 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:59.129 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:59.143 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:38:59.228 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:59.226+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:59.321 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:38:59.329 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:59.326+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:59.430 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:59.430+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:59.445 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:59.445 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:59.459 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:38:59.531 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:38:59.530+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:38:59.582 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:59.582 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:59.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:38:59.632 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:59.631+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:59.731 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:59.731 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:59.732 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:38:59.731+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:38:59.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:38:59.833 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:38:59.830+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:38:59.869 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:38:59.880 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:38:59.880 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:38:59.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:38:59.934 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:38:59.931+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:38:59.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:00.035 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:00.031+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:00.057 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:00.057 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:00.072 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:00.132 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:00.132 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:00.139 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:00.135+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:00.149 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:00.149 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:00.166 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:00.166 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:00.182 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:00.183 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:00.193 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:00.194 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:00.203 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:00.203 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:00.208 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:00.223 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:00.224 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:00.237 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:00.235+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:00.242 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:00.242 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:00.262 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:00.263 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:00.330 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:00.330 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:00.330 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:00.330 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:00.330 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:00.337 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:00.335+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:00.345 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:00.439 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:00.438+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:00.470 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 46.025431365999999, 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:39:00.471 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:00.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:39:00.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.968193182, 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:39:00.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.849050908000002, 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:39:00.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:39:00.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.958166147, 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:39:00.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:39:00.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:39:00.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:39:00.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:39:00.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.492 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.940043137000004, 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:00.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.499 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.912948522000001, 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:39:00.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.894141847, 2024-04-26T12:39:00.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:39:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:39:00.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:39:00.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.860638502999997, 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.513 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:39:00.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.830899574999997, 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:39:00.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:00.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.825159812999999, 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:39:00.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:39:00.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:39:00.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:00.533 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.781127265000002, 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:39:00.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:39:00.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:39:00.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.779468844, 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.540 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:39:00.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.775236407999998, 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.547 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:39:00.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:39:00.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.553 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.488221801000002, 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:39:00.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.560 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.484129582000001, 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:39:00.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.385689472000003, 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028684980000000001, 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.567 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081977+0000", 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081989+0000", 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1663e-05 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082020+0000", 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0746e-05 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082035+0000", 2024-04-26T12:39:00.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5647000000000001e-05 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082174+0000", 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013828899999999999 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082387+0000", 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021377500000000001 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082704+0000", 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000316934 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.083853+0000", 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001148388 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084695+0000", 2024-04-26T12:39:00.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084224699999999996 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084779+0000", 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3652999999999993e-05 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084844+0000", 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4808999999999996e-05 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.381896928000003, 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:00.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:39:00.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.098948563999997, 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:39:00.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:39:00.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:39:00.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.094642592, 2024-04-26T12:39:00.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:39:00.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.593 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.028898232000003, 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029228000000000001, 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:00.594 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:00.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438769+0000", 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3499999999999999e-06 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438781+0000", 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2027e-05 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:00.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438812+0000", 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1238999999999997e-05 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438830+0000", 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7677e-05 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438969+0000", 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013923200000000001 2024-04-26T12:39:00.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439175+0000", 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020586199999999999 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439538+0000", 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036342699999999999 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.440591+0000", 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010524390000000001 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441533+0000", 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094222499999999999 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441621+0000", 2024-04-26T12:39:00.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8399999999999994e-05 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441689+0000", 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7922000000000005e-05 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:00.600 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:00.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:00.603 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:00.599+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:00.703 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:00.699+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:00.782 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:00.782 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:00.782 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:00.797 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:00.842 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:00.842+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:00.904 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:00.903+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:00.919 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:01.037 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:01.037 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:01.037 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:01.037 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:01.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:01.040 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:01.038+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:01.102 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T12:39:01.102 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T12:39:01.102 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-04-26T12:39:01.102 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:39:01.103 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:39:01.103 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-04-26T12:39:01.146 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:01.142+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:01.231 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:01.231 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:01.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:01.231 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:01.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:40 5.6 5:66d44ff0:::zonegroup_info.6cf2425f-74db-47a8-896e-35ab7b9def6a:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 46.729902846999998, 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031402079999999998, 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:39:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:39:01.233 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-04-26T12:39:01.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.233 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:01.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497958+0000", 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.922e-06 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497970+0000", 2024-04-26T12:39:01.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.136e-05 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497995+0000", 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5279999999999999e-05 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498009+0000", 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3872e-05 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498111+0000", 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101927 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498303+0000", 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019180600000000001 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498553+0000", 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024977300000000001 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.499918+0000", 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001365003 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500885+0000", 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00096762599999999997 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500997+0000", 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111742 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.501097+0000", 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9896999999999996e-05 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.720537411999999, 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047946860000000003, 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 52 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507325+0000", 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.717e-06 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507336+0000", 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1182999999999999e-05 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507370+0000", 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4230000000000003e-05 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507388+0000", 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7453e-05 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507508+0000", 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012033599999999999 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507749+0000", 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024146700000000001 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507923+0000", 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017378700000000001 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.508980+0000", 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056707 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.511982+0000", 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030022809999999999 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512050+0000", 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7457000000000001e-05 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512117+0000", 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7068000000000002e-05 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.610370537000001, 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036369689999999999, 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.244 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617492+0000", 2024-04-26T12:39:01.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617505+0000", 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.306e-05 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617536+0000", 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1007000000000003e-05 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617553+0000", 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7629999999999999e-05 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617719+0000", 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016533800000000001 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618065+0000", 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034657399999999999 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:01.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618778+0000", 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071317099999999997 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620613+0000", 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018347260000000001 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620980+0000", 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036717100000000001 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621062+0000", 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1442999999999999e-05 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621126+0000", 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4085999999999996e-05 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.596727209000001, 2024-04-26T12:39:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026109499999999999, 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 281 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631133+0000", 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0559999999999999e-06 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631139+0000", 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1419999999999998e-06 2024-04-26T12:39:01.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631154+0000", 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4893e-05 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631161+0000", 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9179999999999997e-06 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631234+0000", 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2976000000000001e-05 2024-04-26T12:39:01.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631374+0000", 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140218 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631555+0000", 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018107600000000001 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.632139+0000", 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058337700000000005 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633653+0000", 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001514123 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633695+0000", 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2208e-05 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633743+0000", 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7963000000000001e-05 2024-04-26T12:39:01.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.268015826000003, 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035079099999999999, 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.255 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959846+0000", 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959860+0000", 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3329999999999999e-05 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959891+0000", 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1576999999999999e-05 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959906+0000", 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4912999999999999e-05 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960018+0000", 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011209600000000001 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960260+0000", 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024201100000000001 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960602+0000", 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034149700000000001 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.961961+0000", 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013591230000000001 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963193+0000", 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012322399999999999 2024-04-26T12:39:01.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963281+0000", 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8306000000000005e-05 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963352+0000", 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0216999999999995e-05 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.227208468000001, 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002916901, 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000653+0000", 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000665+0000", 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.187e-05 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000696+0000", 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0607e-05 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000712+0000", 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6192999999999999e-05 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000825+0000", 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113213 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001039+0000", 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021364100000000001 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001352+0000", 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000313071 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.002433+0000", 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010811779999999999 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003365+0000", 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093210299999999999 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003449+0000", 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3973000000000004e-05 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003568+0000", 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118542 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.223430639999997, 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027713579999999998, 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.266 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 762 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:01.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004431+0000", 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.77e-06 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004441+0000", 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0523000000000001e-05 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004467+0000", 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5522999999999999e-05 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004479+0000", 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2486999999999999e-05 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004586+0000", 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106926 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004721+0000", 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013467199999999999 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004986+0000", 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026559100000000003 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006110+0000", 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123995 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006998+0000", 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088729 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007083+0000", 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5871999999999994e-05 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007200+0000", 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116709 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.094925824999997, 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028708179999999998, 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.272 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132936+0000", 2024-04-26T12:39:01.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132949+0000", 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2533e-05 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132980+0000", 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1423000000000001e-05 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132995+0000", 2024-04-26T12:39:01.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5e-05 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133125+0000", 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012975899999999999 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133349+0000", 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223842 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133698+0000", 2024-04-26T12:39:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034930699999999998 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.134765+0000", 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001066808 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135647+0000", 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088210700000000003 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135735+0000", 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8206000000000002e-05 2024-04-26T12:39:01.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135804+0000", 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9103000000000006e-05 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.091097144000003, 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028524739999999998, 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.277 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136764+0000", 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9759999999999998e-06 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136776+0000", 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.133e-05 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136802+0000", 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136822+0000", 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9247000000000001e-05 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136933+0000", 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110946 2024-04-26T12:39:01.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137069+0000", 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013615200000000001 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137342+0000", 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027280099999999998 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.138318+0000", 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00097641000000000004 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139458+0000", 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011402669999999999 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139545+0000", 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6948999999999997e-05 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139615+0000", 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9560000000000005e-05 2024-04-26T12:39:01.282 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.040932202, 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028263889999999999, 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.283 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186930+0000", 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186944+0000", 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4e-05 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186974+0000", 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0332999999999999e-05 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186989+0000", 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4776e-05 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187122+0000", 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013347599999999999 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187343+0000", 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022082499999999999 2024-04-26T12:39:01.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187668+0000", 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032438699999999998 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.188757+0000", 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001089565 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189604+0000", 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084688799999999996 2024-04-26T12:39:01.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189689+0000", 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5348999999999999e-05 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189754+0000", 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4159999999999996e-05 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.036888482999998, 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031280219999999998, 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190973+0000", 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8199999999999999e-06 2024-04-26T12:39:01.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190982+0000", 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1530000000000003e-06 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191006+0000", 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191018+0000", 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191149+0000", 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013097200000000001 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191397+0000", 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024733099999999999 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191899+0000", 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050217600000000001 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193371+0000", 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014719959999999999 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193942+0000", 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000571475 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194031+0000", 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8696000000000006e-05 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194099+0000", 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.294 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.026429767000003, 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034761900000000001, 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201432+0000", 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3630000000000001e-06 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201445+0000", 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3016999999999999e-05 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201475+0000", 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9719000000000001e-05 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201490+0000", 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201647+0000", 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156909 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202024+0000", 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037773100000000002 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202591+0000", 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000566992 2024-04-26T12:39:01.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.203991+0000", 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013995290000000001 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204629+0000", 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063768500000000003 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204786+0000", 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015742600000000001 2024-04-26T12:39:01.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204906+0000", 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119869 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.021743862999998, 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034202299999999998, 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.300 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206117+0000", 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.68e-06 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206126+0000", 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5900000000000008e-06 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206151+0000", 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4939e-05 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206163+0000", 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2597e-05 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206291+0000", 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012768600000000001 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206539+0000", 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000248061 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.207052+0000", 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051334299999999998 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.208330+0000", 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012775060000000001 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209262+0000", 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093203999999999997 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209418+0000", 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015631900000000001 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209536+0000", 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117469 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.974459115000002, 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027845690000000002, 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.306 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253402+0000", 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1830000000000001e-06 2024-04-26T12:39:01.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253414+0000", 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1223000000000001e-05 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253444+0000", 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0300000000000001e-05 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253459+0000", 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4749999999999999e-05 2024-04-26T12:39:01.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253585+0000", 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126379 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253813+0000", 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000227498 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.254131+0000", 2024-04-26T12:39:01.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031848800000000002 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.255218+0000", 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010869180000000001 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256027+0000", 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080942099999999995 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256114+0000", 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6599000000000002e-05 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256185+0000", 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0809999999999995e-05 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.311 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.881399703, 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035106930000000001, 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:01.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346462+0000", 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5459999999999998e-06 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346475+0000", 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2764e-05 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346506+0000", 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1266000000000002e-05 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346521+0000", 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4887e-05 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346676+0000", 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015471800000000001 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347095+0000", 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041862399999999998 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347690+0000", 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059590499999999998 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349002+0000", 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00131185 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349697+0000", 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069428800000000004 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349855+0000", 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015838899999999999 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349970+0000", 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115456 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.876928331000002, 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003318194, 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.317 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:01.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350933+0000", 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350942+0000", 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2429999999999994e-06 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350967+0000", 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4239999999999998e-05 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350981+0000", 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4093e-05 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351122+0000", 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014118299999999999 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351371+0000", 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000249604 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351883+0000", 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051186600000000004 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.353068+0000", 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011850980000000001 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354094+0000", 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010259290000000001 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354181+0000", 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6812999999999997e-05 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354249+0000", 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8162000000000002e-05 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.322 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.781952398000001, 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028482690000000001, 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-04-26T12:39:01.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445910+0000", 2024-04-26T12:39:01.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6570000000000001e-06 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445922+0000", 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2806000000000001e-05 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445955+0000", 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2036999999999998e-05 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445970+0000", 2024-04-26T12:39:01.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446092+0000", 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121523 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446313+0000", 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022160800000000001 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:01.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446651+0000", 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000338074 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.447983+0000", 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013322029999999999 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448614+0000", 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063038899999999997 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448695+0000", 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1348999999999997e-05 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448755+0000", 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0139999999999997e-05 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.778219706000002, 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003146959, 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 951 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449641+0000", 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3230000000000001e-06 2024-04-26T12:39:01.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449648+0000", 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1300000000000003e-06 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449669+0000", 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0809999999999999e-05 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449680+0000", 2024-04-26T12:39:01.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1416999999999999e-05 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449805+0000", 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012442200000000001 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449942+0000", 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013762299999999999 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:01.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.450223+0000", 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028021699999999998 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.451636+0000", 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001413573 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452587+0000", 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000950799 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452672+0000", 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4735999999999996e-05 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452787+0000", 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011490899999999999 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:01.334 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.767770069999997, 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035247389999999998, 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460092+0000", 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460105+0000", 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3730000000000001e-05 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460135+0000", 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9649e-05 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460154+0000", 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8953e-05 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460270+0000", 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011612600000000001 2024-04-26T12:39:01.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460494+0000", 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022413199999999999 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460813+0000", 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031844700000000002 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.462087+0000", 2024-04-26T12:39:01.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273927 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463222+0000", 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354080000000001 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463434+0000", 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021214500000000001 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463614+0000", 2024-04-26T12:39:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017984199999999999 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.763161083, 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002995798, 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.340 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464700+0000", 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.844e-06 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464712+0000", 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1763000000000001e-05 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464738+0000", 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5829999999999998e-05 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464751+0000", 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3456e-05 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464895+0000", 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143399 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465152+0000", 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025729799999999999 2024-04-26T12:39:01.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465636+0000", 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048426300000000002 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.466751+0000", 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011144550000000001 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467488+0000", 2024-04-26T12:39:01.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000737501 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467576+0000", 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8252999999999997e-05 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467694+0000", 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117736 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.345 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.346 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:01.347 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:39:01.348 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:01.348 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:01.348 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:01.347+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:01.448 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:01.446+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:01.525 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:01.525 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:01.526 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:01.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:01.587 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:01.586+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:01.650 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:01.650+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:01.718 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:01.719 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:01.719 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:01.719 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:01.719 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:01.733 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:01.780 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:01.778+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:01.852 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:01.850+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:01.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:39:01.911 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.394901476000001, 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002983332, 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.912 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 56 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:01.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515116+0000", 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5550000000000001e-06 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515127+0000", 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0899e-05 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515152+0000", 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.561e-05 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515165+0000", 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2727e-05 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515291+0000", 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000125628 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515490+0000", 2024-04-26T12:39:01.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000199452 2024-04-26T12:39:01.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:01.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515690+0000", 2024-04-26T12:39:01.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000200189 2024-04-26T12:39:01.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517095+0000", 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014043860000000001 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517890+0000", 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079524999999999995 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518006+0000", 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011569 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518097+0000", 2024-04-26T12:39:01.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0946000000000006e-05 2024-04-26T12:39:01.918 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.918 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.918 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.918 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889461985664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.391784952000002, 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030541930000000002, 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518232+0000", 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7430000000000001e-06 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518239+0000", 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1670000000000002e-06 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518263+0000", 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4786e-05 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518276+0000", 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2394e-05 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518374+0000", 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8544999999999999e-05 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518533+0000", 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000158763 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518836+0000", 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030328000000000001 2024-04-26T12:39:01.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.520242+0000", 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001405643 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521076+0000", 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083431100000000002 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521187+0000", 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110714 2024-04-26T12:39:01.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521284+0000", 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6847000000000003e-05 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889461986816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.388953643999997, 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003156112, 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.924 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 59 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521063+0000", 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9599999999999999e-06 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521074+0000", 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:01.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521105+0000", 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1199999999999999e-05 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521125+0000", 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9806999999999999e-05 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521260+0000", 2024-04-26T12:39:01.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013498500000000001 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521472+0000", 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021194900000000001 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521908+0000", 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043670900000000002 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523344+0000", 2024-04-26T12:39:01.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001435579 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524086+0000", 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000741805 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524148+0000", 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2408000000000003e-05 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524217+0000", 2024-04-26T12:39:01.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9016999999999993e-05 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.405598267000002, 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046495770000000002, 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.930 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504420+0000", 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504437+0000", 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6926e-05 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504481+0000", 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3946999999999998e-05 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504506+0000", 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4986000000000001e-05 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504777+0000", 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027106100000000001 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505020+0000", 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024332499999999999 2024-04-26T12:39:01.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505444+0000", 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000423783 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.507435+0000", 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019909950000000002 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508814+0000", 2024-04-26T12:39:01.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001378799 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508964+0000", 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014972600000000001 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509066+0000", 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010223200000000001 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.366259739999997, 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003567382, 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543758+0000", 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.286e-06 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543774+0000", 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.571e-05 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543813+0000", 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9110000000000003e-05 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543831+0000", 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8139999999999999e-05 2024-04-26T12:39:01.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543962+0000", 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130832 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544216+0000", 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025436099999999999 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544648+0000", 2024-04-26T12:39:01.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043157999999999998 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.546300+0000", 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001651661 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547173+0000", 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087328999999999998 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547258+0000", 2024-04-26T12:39:01.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4878999999999998e-05 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547322+0000", 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4533e-05 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.325559587999997, 2024-04-26T12:39:01.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035366059999999999, 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584458+0000", 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999999e-06 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584469+0000", 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.165e-05 2024-04-26T12:39:01.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584501+0000", 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2005999999999998e-05 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584526+0000", 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4683000000000001e-05 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584654+0000", 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012805299999999999 2024-04-26T12:39:01.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584869+0000", 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021525400000000001 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.585275+0000", 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00040564399999999998 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.586816+0000", 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015407579999999999 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587844+0000", 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010284020000000001 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587927+0000", 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3286000000000002e-05 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587992+0000", 2024-04-26T12:39:01.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4323000000000001e-05 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.318259841, 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029981999999999999, 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.947 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591757+0000", 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591769+0000", 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1600000000000001e-05 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591799+0000", 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0543000000000002e-05 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591825+0000", 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5752e-05 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591941+0000", 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116143 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592156+0000", 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021444899999999999 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592548+0000", 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039236700000000002 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594185+0000", 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016373469999999999 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594615+0000", 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042984300000000001 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594692+0000", 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.695e-05 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594753+0000", 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0869000000000003e-05 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.952 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.310724509000003, 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033442010000000002, 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.953 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599292+0000", 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9769999999999999e-06 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599303+0000", 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0386e-05 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599334+0000", 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1087000000000002e-05 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599356+0000", 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2138999999999999e-05 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599475+0000", 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119589 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599696+0000", 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022040199999999999 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.600100+0000", 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000404044 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.601568+0000", 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001468001 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602489+0000", 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092147699999999997 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602571+0000", 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1818999999999997e-05 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602634+0000", 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3280000000000004e-05 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.958 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 40.011873514999998, 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034449799999999998, 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898143+0000", 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898153+0000", 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0176999999999999e-05 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898180+0000", 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6781999999999999e-05 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898202+0000", 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1605000000000001e-05 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898329+0000", 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127367 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898546+0000", 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021638199999999999 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898892+0000", 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034662799999999998 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.900063+0000", 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171184 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901429+0000", 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013658990000000001 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901525+0000", 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5433000000000006e-05 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901586+0000", 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1463000000000004e-05 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.964445654999999, 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030447159999999998, 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 736 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:01.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945571+0000", 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945585+0000", 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3766e-05 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945616+0000", 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1254000000000003e-05 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945632+0000", 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5296000000000001e-05 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945745+0000", 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011295599999999999 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945978+0000", 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023348800000000001 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.946293+0000", 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000314958 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.947440+0000", 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011467440000000001 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948328+0000", 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088776000000000002 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948494+0000", 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016587899999999999 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948614+0000", 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012025500000000001 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.960485153, 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003238646, 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 738 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.970 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949531+0000", 2024-04-26T12:39:01.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7069999999999999e-06 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949541+0000", 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949566+0000", 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5533000000000001e-05 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949579+0000", 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.236e-05 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949722+0000", 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014327200000000001 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949970+0000", 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024837500000000001 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.950482+0000", 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051128299999999996 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.951825+0000", 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013431630000000001 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952625+0000", 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080046700000000002 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952705+0000", 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9869000000000004e-05 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952768+0000", 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3057000000000003e-05 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:774 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.975 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.878664811, 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029121680000000001, 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 774 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031352+0000", 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9700000000000002e-06 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031361+0000", 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.414e-06 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031387+0000", 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031399+0000", 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2377e-05 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031574+0000", 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017496800000000001 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031715+0000", 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031989+0000", 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027419800000000002 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.033007+0000", 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010173319999999999 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034110+0000", 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001102879 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034192+0000", 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2346000000000001e-05 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034262+0000", 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0185999999999995e-05 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.869047371000001, 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028610879999999999, 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 778 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:01.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040970+0000", 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040981+0000", 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1703e-05 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041013+0000", 2024-04-26T12:39:01.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1303000000000002e-05 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041030+0000", 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7493e-05 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041206+0000", 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017595499999999999 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041420+0000", 2024-04-26T12:39:01.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021373200000000001 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041722+0000", 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030209799999999999 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.042818+0000", 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001095738 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043676+0000", 2024-04-26T12:39:01.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085838699999999995 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043762+0000", 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6521999999999996e-05 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043828+0000", 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5957000000000006e-05 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.865063352, 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032202580000000001, 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 780 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044954+0000", 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045055+0000", 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010158900000000001 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045427+0000", 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037136100000000001 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045461+0000", 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4193000000000003e-05 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045615+0000", 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000153652 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045815+0000", 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020044799999999999 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.046189+0000", 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037399699999999999 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.047313+0000", 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123899 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048021+0000", 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070842099999999999 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048105+0000", 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3152999999999995e-05 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048172+0000", 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7012000000000001e-05 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.810827717000002, 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028409210000000002, 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099190+0000", 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099202+0000", 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2019e-05 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099233+0000", 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1093000000000002e-05 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099247+0000", 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4579999999999999e-05 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099361+0000", 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113723 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099573+0000", 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021191499999999999 2024-04-26T12:39:01.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099895+0000", 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032170099999999997 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101037+0000", 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011427270000000001 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101880+0000", 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084234700000000002 2024-04-26T12:39:01.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101964+0000", 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3856000000000005e-05 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.102028+0000", 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4220000000000005e-05 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.650139043999999, 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028492639999999998, 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 871 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:01.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259878+0000", 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0930000000000001e-06 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:01.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259888+0000", 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0713999999999999e-05 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259917+0000", 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8276000000000002e-05 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259931+0000", 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4032999999999999e-05 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260072+0000", 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141326 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260299+0000", 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022688799999999999 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260617+0000", 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031782099999999998 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.261683+0000", 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001065812 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262584+0000", 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00090090600000000004 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262665+0000", 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1578999999999999e-05 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262725+0000", 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9815999999999998e-05 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.587215039999997, 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028604580000000002, 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.003 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 897 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322801+0000", 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.536e-06 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322810+0000", 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3340000000000002e-06 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:02.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322835+0000", 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5136000000000001e-05 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322854+0000", 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8853000000000001e-05 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322990+0000", 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000136169 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323117+0000", 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012680600000000001 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323392+0000", 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027538500000000001 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.324484+0000", 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001092462 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325508+0000", 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001023272 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325595+0000", 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6889000000000001e-05 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325660+0000", 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5616000000000003e-05 2024-04-26T12:39:02.008 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.58413702, 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003075749, 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:02.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325880+0000", 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9259999999999999e-06 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325889+0000", 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8600000000000005e-06 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325918+0000", 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9006999999999999e-05 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325939+0000", 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0863e-05 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326058+0000", 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011906899999999999 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326273+0000", 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000214355 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326585+0000", 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031177800000000002 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.327864+0000", 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012790430000000001 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328808+0000", 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094398300000000002 2024-04-26T12:39:02.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328893+0000", 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5263e-05 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328953+0000", 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0602e-05 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.491865238999999, 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002915997, 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418151+0000", 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.75e-06 2024-04-26T12:39:02.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418161+0000", 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418187+0000", 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6417000000000001e-05 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418207+0000", 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9902999999999999e-05 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418335+0000", 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127892 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418570+0000", 2024-04-26T12:39:02.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023533500000000001 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418956+0000", 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038606699999999997 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420042+0000", 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001086175 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420918+0000", 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087580700000000004 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421002+0000", 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4239000000000004e-05 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421065+0000", 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 39.487952749000002, 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028511209999999999, 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 939 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422063+0000", 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5200000000000001e-06 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422074+0000", 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0407e-05 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422100+0000", 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5848999999999999e-05 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422119+0000", 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422268+0000", 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148899 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422392+0000", 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012443900000000001 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422672+0000", 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000279368 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.423773+0000", 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001101582 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424766+0000", 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099285499999999995 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424852+0000", 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5913000000000002e-05 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:02.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:02.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424913+0000", 2024-04-26T12:39:02.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1136000000000006e-05 2024-04-26T12:39:02.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.026 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:02.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:02.026 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:02.026 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:02.027 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:02.028 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:02.023+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:02.129 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:02.126+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:02.153 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:02.153 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:02.167 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:02.230 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:02.230+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:02.263 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:39:02.283 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:02.296 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:02.296 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:02.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:02.356 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:02.355+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:02.423 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:02.423 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:02.430 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.971828496000001, 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011918331000000001, 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.431 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "reached pg", 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 43 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457566+0000", 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5530000000000001e-06 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457583+0000", 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7654000000000001e-05 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457626+0000", 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2110000000000002e-05 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457652+0000", 2024-04-26T12:39:02.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6789000000000001e-05 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457863+0000", 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000210225 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457885+0000", 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2456999999999999e-05 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469169+0000", 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011284343 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469481+0000", 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031119999999999997 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.904628657000003, 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003553853, 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.437 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 211 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:02.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524766+0000", 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0829999999999997e-06 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524786+0000", 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9494e-05 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524830+0000", 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4240000000000003e-05 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524856+0000", 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5703000000000001e-05 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525044+0000", 2024-04-26T12:39:02.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018797799999999999 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525374+0000", 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033005099999999999 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525827+0000", 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045309000000000001 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.527234+0000", 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014076259999999999 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528147+0000", 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091301299999999995 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528241+0000", 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3466000000000003e-05 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528316+0000", 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.443 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.825402805000003, 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003758815, 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 232 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603990+0000", 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.357e-06 2024-04-26T12:39:02.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604002+0000", 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.154e-05 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604033+0000", 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1136999999999997e-05 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604049+0000", 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5869e-05 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604216+0000", 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167615 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604567+0000", 2024-04-26T12:39:02.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035053100000000001 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.605359+0000", 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079155700000000002 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607196+0000", 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018378699999999999 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607588+0000", 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039154700000000001 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607677+0000", 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9319000000000003e-05 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607747+0000", 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9473000000000004e-05 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:243 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.804070469000003, 2024-04-26T12:39:02.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032017550000000001, 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 243 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625323+0000", 2024-04-26T12:39:02.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8399999999999999e-06 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625338+0000", 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4637000000000001e-05 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625375+0000", 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7648999999999998e-05 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625396+0000", 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1047e-05 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625563+0000", 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016640900000000001 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625966+0000", 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040301699999999998 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.626371+0000", 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040509600000000003 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.627764+0000", 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001393266 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628199+0000", 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043461599999999997 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628404+0000", 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020512899999999999 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628522+0000", 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011804899999999999 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.798873456000003, 2024-04-26T12:39:02.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032314010000000001, 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 276 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630519+0000", 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1459999999999999e-06 2024-04-26T12:39:02.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630532+0000", 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2604e-05 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630558+0000", 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630576+0000", 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630750+0000", 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173392 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631068+0000", 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031842099999999999 2024-04-26T12:39:02.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631575+0000", 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00050638899999999999 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.632975+0000", 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001400486 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633495+0000", 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051948900000000004 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633635+0000", 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000140972 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633749+0000", 2024-04-26T12:39:02.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113239 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:295 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.794509142999999, 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032101120000000002, 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.464 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 295 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634883+0000", 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.204e-06 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634891+0000", 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0830000000000004e-06 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634905+0000", 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.382e-05 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634926+0000", 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1243e-05 2024-04-26T12:39:02.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635316+0000", 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039014699999999998 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635549+0000", 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023250500000000001 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:02.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.636038+0000", 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048965300000000005 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637344+0000", 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001305683 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637862+0000", 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051851600000000001 2024-04-26T12:39:02.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637977+0000", 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114926 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638092+0000", 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114332 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:355 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.785648137999999, 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003073569, 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 355 2024-04-26T12:39:02.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643745+0000", 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2859999999999998e-06 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643758+0000", 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2644e-05 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643805+0000", 2024-04-26T12:39:02.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7763000000000003e-05 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643825+0000", 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9375999999999999e-05 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643970+0000", 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014545199999999999 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644263+0000", 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029315800000000001 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644807+0000", 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054336300000000005 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646108+0000", 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001300896 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646628+0000", 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052052000000000001 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646730+0000", 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102229 2024-04-26T12:39:02.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646816+0000", 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5882000000000002e-05 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.477 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:408 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.478 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:02.478 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.764499817999997, 2024-04-26T12:39:02.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029401380000000001, 2024-04-26T12:39:02.478 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.478 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.478 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.478 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.478 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.478 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 408 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664894+0000", 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664906+0000", 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2323e-05 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664953+0000", 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6594000000000001e-05 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664967+0000", 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4813e-05 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665094+0000", 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012636200000000001 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665327+0000", 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233172 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665786+0000", 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045890599999999997 2024-04-26T12:39:02.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667078+0000", 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012926400000000001 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667564+0000", 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048546700000000001 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667708+0000", 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014418800000000001 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667831+0000", 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123013 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:497 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.703576196, 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046691349999999996, 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 497 2024-04-26T12:39:02.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725817+0000", 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725830+0000", 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2672e-05 2024-04-26T12:39:02.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725862+0000", 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2042000000000003e-05 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725930+0000", 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7731000000000006e-05 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726082+0000", 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152929 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726313+0000", 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023097499999999999 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726729+0000", 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041546699999999998 2024-04-26T12:39:02.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729760+0000", 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003031083 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730288+0000", 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052804299999999996 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730419+0000", 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013093499999999999 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730484+0000", 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4772999999999998e-05 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.609777719, 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002976111, 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 633 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819615+0000", 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7269999999999999e-06 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819626+0000", 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819660+0000", 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4079999999999999e-05 2024-04-26T12:39:02.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819679+0000", 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9103e-05 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819807+0000", 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012822899999999999 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820044+0000", 2024-04-26T12:39:02.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023652800000000001 2024-04-26T12:39:02.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:02.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820418+0000", 2024-04-26T12:39:02.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037437400000000002 2024-04-26T12:39:02.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.821605+0000", 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011867939999999999 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822310+0000", 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070503099999999995 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822480+0000", 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170089 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822589+0000", 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010892599999999999 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.498 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.503166837999999, 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030753500000000001, 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 727 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.499 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926226+0000", 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1129999999999999e-06 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926237+0000", 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926265+0000", 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.864e-05 2024-04-26T12:39:02.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926283+0000", 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7949999999999999e-05 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926378+0000", 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5081999999999995e-05 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926590+0000", 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021203500000000001 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926950+0000", 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035924399999999999 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.928069+0000", 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001119302 2024-04-26T12:39:02.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929136+0000", 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001066542 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929227+0000", 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1142000000000003e-05 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929299+0000", 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2620000000000006e-05 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.316059201999998, 2024-04-26T12:39:02.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029575529999999999, 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 808 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113334+0000", 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:02.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113347+0000", 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.288e-05 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113378+0000", 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1056000000000002e-05 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113394+0000", 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5616000000000001e-05 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113541+0000", 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147412 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113767+0000", 2024-04-26T12:39:02.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225372 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.114085+0000", 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031803799999999998 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.115306+0000", 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012213 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116132+0000", 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00082585700000000005 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116224+0000", 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2392999999999994e-05 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116289+0000", 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4999000000000006e-05 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.512 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.298565521, 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028474419999999999, 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 816 2024-04-26T12:39:02.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130827+0000", 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7239999999999999e-06 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130836+0000", 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0729999999999994e-06 2024-04-26T12:39:02.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130857+0000", 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1396999999999999e-05 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130870+0000", 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2363e-05 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130982+0000", 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112509 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131114+0000", 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131779 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:02.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131385+0000", 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027119500000000001 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.132710+0000", 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013251059999999999 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133474+0000", 2024-04-26T12:39:02.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00076380800000000004 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133565+0000", 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0785000000000006e-05 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133673+0000", 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107703 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.519 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.147798250999998, 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029548180000000001, 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.520 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 880 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281595+0000", 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.92e-06 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281608+0000", 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:02.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281639+0000", 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0263000000000001e-05 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281654+0000", 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5613000000000001e-05 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281790+0000", 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013560300000000001 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282021+0000", 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023109399999999999 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282352+0000", 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033127100000000001 2024-04-26T12:39:02.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.283508+0000", 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011555820000000001 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284259+0000", 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075111399999999999 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.525 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284429+0000", 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017024499999999999 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284547+0000", 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118193 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.143422524000002, 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049047079999999998, 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 882 2024-04-26T12:39:02.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285970+0000", 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285981+0000", 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0993e-05 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286015+0000", 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3309999999999998e-05 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286034+0000", 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8936e-05 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286154+0000", 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011998900000000001 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286385+0000", 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000231585 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286882+0000", 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000496763 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.288886+0000", 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002004207 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290664+0000", 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017773800000000001 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290757+0000", 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3616000000000006e-05 2024-04-26T12:39:02.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290873+0000", 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011579899999999999 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:02.533 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.138170178999999, 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030718659999999999, 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 883 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291223+0000", 2024-04-26T12:39:02.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2869999999999999e-06 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291234+0000", 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1596999999999999e-05 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291265+0000", 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.044e-05 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291283+0000", 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7878999999999999e-05 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291402+0000", 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119406 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291649+0000", 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024725499999999999 2024-04-26T12:39:02.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291980+0000", 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033056999999999997 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.293099+0000", 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011188979999999999 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294018+0000", 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091867000000000001 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294175+0000", 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015740200000000001 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294292+0000", 2024-04-26T12:39:02.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011746199999999999 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.133880787999999, 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032575410000000001, 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.540 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 885 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295511+0000", 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3060000000000001e-06 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295518+0000", 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295538+0000", 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9409999999999999e-05 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295549+0000", 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1328999999999999e-05 2024-04-26T12:39:02.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295669+0000", 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119616 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295892+0000", 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223799 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.296415+0000", 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052249900000000005 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.297588+0000", 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011734740000000001 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298501+0000", 2024-04-26T12:39:02.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091317000000000004 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298652+0000", 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015026199999999999 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298768+0000", 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115779 2024-04-26T12:39:02.546 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.067002334000001, 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030403560000000001, 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.547 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 913 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362391+0000", 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362407+0000", 2024-04-26T12:39:02.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6066000000000002e-05 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362437+0000", 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9728999999999999e-05 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362452+0000", 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5147000000000001e-05 2024-04-26T12:39:02.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362568+0000", 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116172 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362806+0000", 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023781900000000001 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.363150+0000", 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000344144 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.364211+0000", 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010614979999999999 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365228+0000", 2024-04-26T12:39:02.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001016669 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365315+0000", 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6496000000000007e-05 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365429+0000", 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114226 2024-04-26T12:39:02.553 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.034275010999998, 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003220929, 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 927 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395118+0000", 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4099999999999998e-06 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395130+0000", 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1487e-05 2024-04-26T12:39:02.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395161+0000", 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1152999999999998e-05 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395181+0000", 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0273999999999999e-05 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395306+0000", 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124805 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395534+0000", 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000228085 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.396011+0000", 2024-04-26T12:39:02.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000477493 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.397356+0000", 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013446199999999999 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398060+0000", 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070440100000000001 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398223+0000", 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000162855 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398337+0000", 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113346 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.560 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.030711668000002, 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030649560000000002, 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:02.561 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 928 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398682+0000", 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.43e-06 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398693+0000", 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1324e-05 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:02.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398724+0000", 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0926000000000002e-05 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398742+0000", 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398865+0000", 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123542 2024-04-26T12:39:02.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399201+0000", 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033574800000000003 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399744+0000", 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054293600000000005 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401070+0000", 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013257360000000001 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401546+0000", 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047601000000000002 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:02.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401633+0000", 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7225999999999995e-05 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401744+0000", 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000111195 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:02.567 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:02.568 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:02.570 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:02.570 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:02.571 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:02.567+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:02.571 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:02.571 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:02.572 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:02.572 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:02.572 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:02.573 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:02.573 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:02.574 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:02.670 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:02.670+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:02.742 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:02.742 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:02.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:02.772 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:02.770+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:02.872 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:02.871+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:02.874 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:02.874 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:02.889 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:02.976 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:02.975+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:03.053 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:03.053 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:03.067 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:03.074 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:03.074+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:03.175 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:03.174+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:03.231 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:03.231 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:03.246 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:03.292 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:03.291+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:03.368 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:03.369 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:03.377 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:03.375+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:03.382 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:03.478 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:03.475+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:03.548 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:03.548 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:03.563 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:03.608 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:03.607+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:03.680 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:03.678+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:03.732 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:03.732 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:03.746 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:03.780 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:03.778+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:03.868 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:03.868 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:03.881 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:03.879+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:03.883 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:03.982 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:03.982+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:04.051 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:04.052 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:04.066 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:04.082 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:04.079+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:04.183 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:04.182+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:04.203 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:04.203 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:04.219 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:04.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:39:04.310 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:04.310+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:04.385 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:04.383+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:04.387 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:04.387 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:04.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:04.486 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:04.486+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:04.539 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:04.539 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:04.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:04.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:04.598 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:04.598+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:04.676 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:39:04.688 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:04.686+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:04.728 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:04.729 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:04.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:04.746 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:04.747 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:04.764 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:04.765 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:04.781 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:04.782 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:04.789 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:04.786+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:04.798 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:04.799 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:04.819 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:04.820 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:04.840 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:04.840 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:04.861 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:04.861 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:04.864 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:04.864 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:04.865 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:04.865 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:04.865 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:04.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:04.883 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:04.883 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:04.903 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:04.902+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:04.991 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:04.990+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 50.557849253999997, 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.001 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:39:05.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:05.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 46.500611069999998, 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 46.381468796, 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:39:05.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.490584034999998, 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.015 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:39:05.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:39:05.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:39:05.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.472461025000001, 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.021 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.026 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.445366409999998, 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.426559734999998, 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.032 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:39:05.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:39:05.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:39:05.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.037 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.393056391000002, 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.363317463000001, 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:39:05.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.357577700999997, 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.313545153, 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.054 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:05.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:39:05.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.311886731999998, 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.060 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:39:05.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:39:05.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:39:05.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:39:05.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.307654296000003, 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:39:05.065 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.070 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.020639688999999, 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.071 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:39:05.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.016547469999999, 2024-04-26T12:39:05.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.081 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.91810736, 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028684980000000001, 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.082 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081977+0000", 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081989+0000", 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1663e-05 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082020+0000", 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0746e-05 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082035+0000", 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5647000000000001e-05 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082174+0000", 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013828899999999999 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082387+0000", 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021377500000000001 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082704+0000", 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000316934 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.083853+0000", 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001148388 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084695+0000", 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084224699999999996 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084779+0000", 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3652999999999993e-05 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084844+0000", 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4808999999999996e-05 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.087 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.914314816000001, 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:05.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.631366452000002, 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.093 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.627060479999997, 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:39:05.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:39:05.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:39:05.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:39:05.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.561316120000001, 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029228000000000001, 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.104 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438769+0000", 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3499999999999999e-06 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438781+0000", 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2027e-05 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438812+0000", 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1238999999999997e-05 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438830+0000", 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7677e-05 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438969+0000", 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013923200000000001 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439175+0000", 2024-04-26T12:39:05.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020586199999999999 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439538+0000", 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036342699999999999 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.440591+0000", 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010524390000000001 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441533+0000", 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094222499999999999 2024-04-26T12:39:05.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441621+0000", 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8399999999999994e-05 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441689+0000", 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7922000000000005e-05 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.109 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:05.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:05.111 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:05.110+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:05.212 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:05.210+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:05.283 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:05.283 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:05.283 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:05.284 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:05.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:05.342 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:05.342+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:05.413 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:05.411+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:05.470 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:05.470 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:05.470 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:05.470 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:05.470 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:05.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:05.514 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:05.511+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:05.615 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:05.611+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:40 5.6 5:66d44ff0:::zonegroup_info.6cf2425f-74db-47a8-896e-35ab7b9def6a:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.117021242, 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031402079999999998, 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497958+0000", 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.922e-06 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497970+0000", 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.136e-05 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497995+0000", 2024-04-26T12:39:05.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5279999999999999e-05 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498009+0000", 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3872e-05 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498111+0000", 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101927 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498303+0000", 2024-04-26T12:39:05.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019180600000000001 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498553+0000", 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024977300000000001 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.499918+0000", 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001365003 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500885+0000", 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00096762599999999997 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500997+0000", 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111742 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.501097+0000", 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9896999999999996e-05 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.107655807, 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047946860000000003, 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 52 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507325+0000", 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.717e-06 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507336+0000", 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1182999999999999e-05 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507370+0000", 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4230000000000003e-05 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507388+0000", 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7453e-05 2024-04-26T12:39:05.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507508+0000", 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012033599999999999 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507749+0000", 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024146700000000001 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507923+0000", 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017378700000000001 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.508980+0000", 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056707 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.511982+0000", 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030022809999999999 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512050+0000", 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7457000000000001e-05 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512117+0000", 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7068000000000002e-05 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.997488932000003, 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036369689999999999, 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617492+0000", 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617505+0000", 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.306e-05 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617536+0000", 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1007000000000003e-05 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617553+0000", 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7629999999999999e-05 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617719+0000", 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016533800000000001 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618065+0000", 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034657399999999999 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618778+0000", 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071317099999999997 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620613+0000", 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018347260000000001 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620980+0000", 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036717100000000001 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621062+0000", 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1442999999999999e-05 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621126+0000", 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4085999999999996e-05 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.983845604000003, 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026109499999999999, 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 281 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.635 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631133+0000", 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0559999999999999e-06 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631139+0000", 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1419999999999998e-06 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631154+0000", 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4893e-05 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631161+0000", 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9179999999999997e-06 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631234+0000", 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2976000000000001e-05 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631374+0000", 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140218 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631555+0000", 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018107600000000001 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.632139+0000", 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058337700000000005 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633653+0000", 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001514123 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633695+0000", 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2208e-05 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633743+0000", 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7963000000000001e-05 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.655134220999997, 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035079099999999999, 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959846+0000", 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959860+0000", 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3329999999999999e-05 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959891+0000", 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1576999999999999e-05 2024-04-26T12:39:05.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959906+0000", 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4912999999999999e-05 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960018+0000", 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011209600000000001 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960260+0000", 2024-04-26T12:39:05.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024201100000000001 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960602+0000", 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034149700000000001 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.961961+0000", 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013591230000000001 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963193+0000", 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012322399999999999 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963281+0000", 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8306000000000005e-05 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963352+0000", 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0216999999999995e-05 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.614326863000002, 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002916901, 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000653+0000", 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000665+0000", 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.187e-05 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000696+0000", 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0607e-05 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000712+0000", 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6192999999999999e-05 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000825+0000", 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113213 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001039+0000", 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021364100000000001 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001352+0000", 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000313071 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.002433+0000", 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010811779999999999 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003365+0000", 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093210299999999999 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003449+0000", 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3973000000000004e-05 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003568+0000", 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118542 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.610549034999998, 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027713579999999998, 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.651 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 762 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004431+0000", 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.77e-06 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004441+0000", 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0523000000000001e-05 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004467+0000", 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5522999999999999e-05 2024-04-26T12:39:05.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004479+0000", 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2486999999999999e-05 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004586+0000", 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106926 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004721+0000", 2024-04-26T12:39:05.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013467199999999999 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004986+0000", 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026559100000000003 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006110+0000", 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123995 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006998+0000", 2024-04-26T12:39:05.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088729 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007083+0000", 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5871999999999994e-05 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007200+0000", 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116709 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.482044219999999, 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028708179999999998, 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.657 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132936+0000", 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:39:05.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132949+0000", 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2533e-05 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132980+0000", 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1423000000000001e-05 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132995+0000", 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5e-05 2024-04-26T12:39:05.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133125+0000", 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012975899999999999 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133349+0000", 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223842 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133698+0000", 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034930699999999998 2024-04-26T12:39:05.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.134765+0000", 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001066808 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135647+0000", 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088210700000000003 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135735+0000", 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8206000000000002e-05 2024-04-26T12:39:05.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135804+0000", 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9103000000000006e-05 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.478215538999997, 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028524739999999998, 2024-04-26T12:39:05.662 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136764+0000", 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9759999999999998e-06 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136776+0000", 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.133e-05 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136802+0000", 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136822+0000", 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9247000000000001e-05 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136933+0000", 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110946 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137069+0000", 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013615200000000001 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137342+0000", 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027280099999999998 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.138318+0000", 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00097641000000000004 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139458+0000", 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011402669999999999 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139545+0000", 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6948999999999997e-05 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139615+0000", 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9560000000000005e-05 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.428050597000002, 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028263889999999999, 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186930+0000", 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:05.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186944+0000", 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4e-05 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186974+0000", 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0332999999999999e-05 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186989+0000", 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4776e-05 2024-04-26T12:39:05.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187122+0000", 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013347599999999999 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187343+0000", 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022082499999999999 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187668+0000", 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032438699999999998 2024-04-26T12:39:05.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.188757+0000", 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001089565 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189604+0000", 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084688799999999996 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189689+0000", 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5348999999999999e-05 2024-04-26T12:39:05.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189754+0000", 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4159999999999996e-05 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.424006878, 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031280219999999998, 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.673 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190973+0000", 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8199999999999999e-06 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190982+0000", 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1530000000000003e-06 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191006+0000", 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191018+0000", 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191149+0000", 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013097200000000001 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191397+0000", 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024733099999999999 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191899+0000", 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050217600000000001 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193371+0000", 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014719959999999999 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193942+0000", 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000571475 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194031+0000", 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8696000000000006e-05 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194099+0000", 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.413548161999998, 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034761900000000001, 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.679 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201432+0000", 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3630000000000001e-06 2024-04-26T12:39:05.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201445+0000", 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3016999999999999e-05 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201475+0000", 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9719000000000001e-05 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201490+0000", 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:39:05.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201647+0000", 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156909 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202024+0000", 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037773100000000002 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202591+0000", 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000566992 2024-04-26T12:39:05.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.203991+0000", 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013995290000000001 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204629+0000", 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063768500000000003 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204786+0000", 2024-04-26T12:39:05.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015742600000000001 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204906+0000", 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119869 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.408862257999999, 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034202299999999998, 2024-04-26T12:39:05.684 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206117+0000", 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.68e-06 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206126+0000", 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5900000000000008e-06 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206151+0000", 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4939e-05 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206163+0000", 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2597e-05 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206291+0000", 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012768600000000001 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206539+0000", 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000248061 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.207052+0000", 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051334299999999998 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.208330+0000", 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012775060000000001 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209262+0000", 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093203999999999997 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209418+0000", 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015631900000000001 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209536+0000", 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117469 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.361577509999996, 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027845690000000002, 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-04-26T12:39:05.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253402+0000", 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1830000000000001e-06 2024-04-26T12:39:05.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253414+0000", 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1223000000000001e-05 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253444+0000", 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0300000000000001e-05 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253459+0000", 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4749999999999999e-05 2024-04-26T12:39:05.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253585+0000", 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126379 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253813+0000", 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000227498 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.254131+0000", 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031848800000000002 2024-04-26T12:39:05.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.255218+0000", 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010869180000000001 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256027+0000", 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080942099999999995 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256114+0000", 2024-04-26T12:39:05.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6599000000000002e-05 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256185+0000", 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0809999999999995e-05 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.268518098000001, 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035106930000000001, 2024-04-26T12:39:05.695 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346462+0000", 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5459999999999998e-06 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346475+0000", 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2764e-05 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346506+0000", 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1266000000000002e-05 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346521+0000", 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4887e-05 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346676+0000", 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015471800000000001 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347095+0000", 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041862399999999998 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347690+0000", 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059590499999999998 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349002+0000", 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00131185 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349697+0000", 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069428800000000004 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349855+0000", 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015838899999999999 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349970+0000", 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115456 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.700 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.264046725999997, 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003318194, 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-04-26T12:39:05.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350933+0000", 2024-04-26T12:39:05.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350942+0000", 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2429999999999994e-06 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350967+0000", 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4239999999999998e-05 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350981+0000", 2024-04-26T12:39:05.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4093e-05 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351122+0000", 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014118299999999999 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351371+0000", 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000249604 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351883+0000", 2024-04-26T12:39:05.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051186600000000004 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.353068+0000", 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011850980000000001 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354094+0000", 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010259290000000001 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354181+0000", 2024-04-26T12:39:05.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6812999999999997e-05 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354249+0000", 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8162000000000002e-05 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.169070793000003, 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028482690000000001, 2024-04-26T12:39:05.706 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445910+0000", 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6570000000000001e-06 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445922+0000", 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2806000000000001e-05 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445955+0000", 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2036999999999998e-05 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445970+0000", 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446092+0000", 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121523 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446313+0000", 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022160800000000001 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446651+0000", 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000338074 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.447983+0000", 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013322029999999999 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448614+0000", 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063038899999999997 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448695+0000", 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1348999999999997e-05 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448755+0000", 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0139999999999997e-05 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.711 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.165338101000003, 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003146959, 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 951 2024-04-26T12:39:05.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449641+0000", 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3230000000000001e-06 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449648+0000", 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1300000000000003e-06 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449669+0000", 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0809999999999999e-05 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449680+0000", 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1416999999999999e-05 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449805+0000", 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012442200000000001 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449942+0000", 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013762299999999999 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.450223+0000", 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028021699999999998 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.451636+0000", 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001413573 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452587+0000", 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000950799 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452672+0000", 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4735999999999996e-05 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452787+0000", 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011490899999999999 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.154888464999999, 2024-04-26T12:39:05.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035247389999999998, 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460092+0000", 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460105+0000", 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3730000000000001e-05 2024-04-26T12:39:05.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460135+0000", 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9649e-05 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460154+0000", 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8953e-05 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460270+0000", 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011612600000000001 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460494+0000", 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022413199999999999 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460813+0000", 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031844700000000002 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.462087+0000", 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273927 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463222+0000", 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354080000000001 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463434+0000", 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021214500000000001 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463614+0000", 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017984199999999999 2024-04-26T12:39:05.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.150279478000002, 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002995798, 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-04-26T12:39:05.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464700+0000", 2024-04-26T12:39:05.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.844e-06 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464712+0000", 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1763000000000001e-05 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464738+0000", 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5829999999999998e-05 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464751+0000", 2024-04-26T12:39:05.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3456e-05 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464895+0000", 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143399 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465152+0000", 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025729799999999999 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465636+0000", 2024-04-26T12:39:05.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048426300000000002 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.466751+0000", 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011144550000000001 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467488+0000", 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000737501 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467576+0000", 2024-04-26T12:39:05.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8252999999999997e-05 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467694+0000", 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117736 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:05.728 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:05.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:05.730 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:05.727+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:05.831 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:05.830+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:05.861 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:05.861 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:05.861 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:05.876 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:05.962 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:05.962+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:06.033 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:06.031+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:06.045 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:06.045 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:06.045 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:06.045 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:06.045 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:06.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:06.146 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:06.146+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:06.235 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:06.235 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:06.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:06.235 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:06.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.235 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:06.235 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:06.235 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.716900144999997, 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002983332, 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 56 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:06.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515116+0000", 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5550000000000001e-06 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515127+0000", 2024-04-26T12:39:06.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0899e-05 2024-04-26T12:39:06.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515152+0000", 2024-04-26T12:39:06.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.561e-05 2024-04-26T12:39:06.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515165+0000", 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2727e-05 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515291+0000", 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000125628 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515490+0000", 2024-04-26T12:39:06.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000199452 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515690+0000", 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000200189 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517095+0000", 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014043860000000001 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517890+0000", 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079524999999999995 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518006+0000", 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011569 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518097+0000", 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0946000000000006e-05 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889461985664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.713783620999997, 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030541930000000002, 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.242 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518232+0000", 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7430000000000001e-06 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518239+0000", 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1670000000000002e-06 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518263+0000", 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4786e-05 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518276+0000", 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2394e-05 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518374+0000", 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8544999999999999e-05 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518533+0000", 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000158763 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:06.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518836+0000", 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030328000000000001 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.520242+0000", 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001405643 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521076+0000", 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083431100000000002 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521187+0000", 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110714 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521284+0000", 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6847000000000003e-05 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889461986816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:06.247 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.710952313, 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003156112, 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 59 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:06.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521063+0000", 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9599999999999999e-06 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521074+0000", 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521105+0000", 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1199999999999999e-05 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521125+0000", 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9806999999999999e-05 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521260+0000", 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013498500000000001 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521472+0000", 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021194900000000001 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521908+0000", 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043670900000000002 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523344+0000", 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001435579 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524086+0000", 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000741805 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524148+0000", 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2408000000000003e-05 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524217+0000", 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9016999999999993e-05 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.727596935999998, 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046495770000000002, 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.253 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504420+0000", 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504437+0000", 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6926e-05 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504481+0000", 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3946999999999998e-05 2024-04-26T12:39:06.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504506+0000", 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4986000000000001e-05 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504777+0000", 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027106100000000001 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505020+0000", 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024332499999999999 2024-04-26T12:39:06.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505444+0000", 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000423783 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.507435+0000", 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019909950000000002 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508814+0000", 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001378799 2024-04-26T12:39:06.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508964+0000", 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014972600000000001 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509066+0000", 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010223200000000001 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.688258408999999, 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003567382, 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543758+0000", 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.286e-06 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543774+0000", 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.571e-05 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543813+0000", 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9110000000000003e-05 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543831+0000", 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8139999999999999e-05 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543962+0000", 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130832 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544216+0000", 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025436099999999999 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544648+0000", 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043157999999999998 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.546300+0000", 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001651661 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547173+0000", 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087328999999999998 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547258+0000", 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4878999999999998e-05 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547322+0000", 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4533e-05 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.647558257, 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035366059999999999, 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.264 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584458+0000", 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999999e-06 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584469+0000", 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.165e-05 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584501+0000", 2024-04-26T12:39:06.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2005999999999998e-05 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584526+0000", 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4683000000000001e-05 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584654+0000", 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012805299999999999 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584869+0000", 2024-04-26T12:39:06.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021525400000000001 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.585275+0000", 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00040564399999999998 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.586816+0000", 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015407579999999999 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587844+0000", 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010284020000000001 2024-04-26T12:39:06.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587927+0000", 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3286000000000002e-05 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587992+0000", 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4323000000000001e-05 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.269 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.640258510000002, 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029981999999999999, 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591757+0000", 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591769+0000", 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1600000000000001e-05 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591799+0000", 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0543000000000002e-05 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591825+0000", 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5752e-05 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591941+0000", 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116143 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592156+0000", 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021444899999999999 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592548+0000", 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039236700000000002 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594185+0000", 2024-04-26T12:39:06.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016373469999999999 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594615+0000", 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042984300000000001 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594692+0000", 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.695e-05 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594753+0000", 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0869000000000003e-05 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.632723177999999, 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033442010000000002, 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599292+0000", 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9769999999999999e-06 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599303+0000", 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0386e-05 2024-04-26T12:39:06.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599334+0000", 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1087000000000002e-05 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599356+0000", 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2138999999999999e-05 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599475+0000", 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119589 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599696+0000", 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022040199999999999 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.600100+0000", 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000404044 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.601568+0000", 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001468001 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602489+0000", 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092147699999999997 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602571+0000", 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1818999999999997e-05 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602634+0000", 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3280000000000004e-05 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.333872184000001, 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034449799999999998, 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898143+0000", 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898153+0000", 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0176999999999999e-05 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898180+0000", 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6781999999999999e-05 2024-04-26T12:39:06.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898202+0000", 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1605000000000001e-05 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898329+0000", 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127367 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898546+0000", 2024-04-26T12:39:06.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021638199999999999 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898892+0000", 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034662799999999998 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.900063+0000", 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171184 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901429+0000", 2024-04-26T12:39:06.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013658990000000001 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901525+0000", 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5433000000000006e-05 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901586+0000", 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1463000000000004e-05 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.286444324000001, 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030447159999999998, 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 736 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945571+0000", 2024-04-26T12:39:06.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945585+0000", 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3766e-05 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945616+0000", 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1254000000000003e-05 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945632+0000", 2024-04-26T12:39:06.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5296000000000001e-05 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945745+0000", 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011295599999999999 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945978+0000", 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023348800000000001 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:06.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.946293+0000", 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000314958 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.947440+0000", 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011467440000000001 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948328+0000", 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088776000000000002 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948494+0000", 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016587899999999999 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948614+0000", 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012025500000000001 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:06.292 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.282483822000003, 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003238646, 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 738 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949531+0000", 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7069999999999999e-06 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949541+0000", 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949566+0000", 2024-04-26T12:39:06.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5533000000000001e-05 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949579+0000", 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.236e-05 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949722+0000", 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014327200000000001 2024-04-26T12:39:06.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949970+0000", 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024837500000000001 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.950482+0000", 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051128299999999996 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.951825+0000", 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013431630000000001 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952625+0000", 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080046700000000002 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952705+0000", 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9869000000000004e-05 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952768+0000", 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3057000000000003e-05 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.299 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:774 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.200663480000003, 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029121680000000001, 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.300 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 774 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031352+0000", 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9700000000000002e-06 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031361+0000", 2024-04-26T12:39:06.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.414e-06 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031387+0000", 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031399+0000", 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2377e-05 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031574+0000", 2024-04-26T12:39:06.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017496800000000001 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031715+0000", 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031989+0000", 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027419800000000002 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.033007+0000", 2024-04-26T12:39:06.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010173319999999999 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034110+0000", 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001102879 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034192+0000", 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2346000000000001e-05 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034262+0000", 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0185999999999995e-05 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.191046040000003, 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028610879999999999, 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.306 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 778 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040970+0000", 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040981+0000", 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1703e-05 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041013+0000", 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1303000000000002e-05 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041030+0000", 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7493e-05 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041206+0000", 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017595499999999999 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041420+0000", 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021373200000000001 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041722+0000", 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030209799999999999 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.042818+0000", 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001095738 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043676+0000", 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085838699999999995 2024-04-26T12:39:06.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043762+0000", 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6521999999999996e-05 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043828+0000", 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5957000000000006e-05 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.311 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.187062021000003, 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032202580000000001, 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 780 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044954+0000", 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045055+0000", 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010158900000000001 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045427+0000", 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037136100000000001 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045461+0000", 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4193000000000003e-05 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045615+0000", 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000153652 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045815+0000", 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020044799999999999 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.046189+0000", 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037399699999999999 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.047313+0000", 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123899 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048021+0000", 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070842099999999999 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048105+0000", 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3152999999999995e-05 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048172+0000", 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7012000000000001e-05 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 44.132826385999998, 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028409210000000002, 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.317 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099190+0000", 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099202+0000", 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2019e-05 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099233+0000", 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1093000000000002e-05 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099247+0000", 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4579999999999999e-05 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099361+0000", 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113723 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099573+0000", 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021191499999999999 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099895+0000", 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032170099999999997 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101037+0000", 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011427270000000001 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101880+0000", 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084234700000000002 2024-04-26T12:39:06.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101964+0000", 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3856000000000005e-05 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.102028+0000", 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4220000000000005e-05 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.972137713000002, 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028492639999999998, 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 871 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259878+0000", 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0930000000000001e-06 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259888+0000", 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0713999999999999e-05 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259917+0000", 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8276000000000002e-05 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259931+0000", 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4032999999999999e-05 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260072+0000", 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141326 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260299+0000", 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022688799999999999 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260617+0000", 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031782099999999998 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.261683+0000", 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001065812 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262584+0000", 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00090090600000000004 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262665+0000", 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1578999999999999e-05 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262725+0000", 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9815999999999998e-05 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.909213708999999, 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028604580000000002, 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.328 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 897 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322801+0000", 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.536e-06 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322810+0000", 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3340000000000002e-06 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322835+0000", 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5136000000000001e-05 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322854+0000", 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8853000000000001e-05 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322990+0000", 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000136169 2024-04-26T12:39:06.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323117+0000", 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012680600000000001 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323392+0000", 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027538500000000001 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.324484+0000", 2024-04-26T12:39:06.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001092462 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325508+0000", 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001023272 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325595+0000", 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6889000000000001e-05 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325660+0000", 2024-04-26T12:39:06.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5616000000000003e-05 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.906135689000003, 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003075749, 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.334 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325880+0000", 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9259999999999999e-06 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325889+0000", 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8600000000000005e-06 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325918+0000", 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9006999999999999e-05 2024-04-26T12:39:06.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325939+0000", 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0863e-05 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326058+0000", 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011906899999999999 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326273+0000", 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000214355 2024-04-26T12:39:06.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326585+0000", 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031177800000000002 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.327864+0000", 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012790430000000001 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328808+0000", 2024-04-26T12:39:06.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094398300000000002 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328893+0000", 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5263e-05 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328953+0000", 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0602e-05 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.813863908000002, 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002915997, 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418151+0000", 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.75e-06 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418161+0000", 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418187+0000", 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6417000000000001e-05 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418207+0000", 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9902999999999999e-05 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418335+0000", 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127892 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418570+0000", 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023533500000000001 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418956+0000", 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038606699999999997 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420042+0000", 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001086175 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420918+0000", 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087580700000000004 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421002+0000", 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4239000000000004e-05 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421065+0000", 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.809951417999997, 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028511209999999999, 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 939 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:06.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422063+0000", 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5200000000000001e-06 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422074+0000", 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0407e-05 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422100+0000", 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5848999999999999e-05 2024-04-26T12:39:06.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422119+0000", 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422268+0000", 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148899 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422392+0000", 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012443900000000001 2024-04-26T12:39:06.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422672+0000", 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000279368 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.423773+0000", 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001101582 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424766+0000", 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099285499999999995 2024-04-26T12:39:06.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424852+0000", 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5913000000000002e-05 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424913+0000", 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1136000000000006e-05 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:06.350 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:06.351 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:06.351 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:06.231+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:06.352 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:06.353 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:06.350+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:06.453 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:06.451+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:06.486 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:06.486 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:06.486 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:06.486 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:06.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:06.588 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:06.587+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:06.655 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:06.651+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:06.667 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:06.667 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:06.667 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:06.667 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:06.667 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:06.681 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:06.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:39:06.756 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:06.754+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:06.850 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:06.850 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:06.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:06.850 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:06.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.389046878999999, 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011918331000000001, 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "reached pg", 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.851 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 43 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457566+0000", 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5530000000000001e-06 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457583+0000", 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7654000000000001e-05 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457626+0000", 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2110000000000002e-05 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457652+0000", 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6789000000000001e-05 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457863+0000", 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000210225 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457885+0000", 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2456999999999999e-05 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469169+0000", 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011284343 2024-04-26T12:39:06.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469481+0000", 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031119999999999997 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:06.856 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.321847040000002, 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003553853, 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 211 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:06.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:06.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524766+0000", 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0829999999999997e-06 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524786+0000", 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9494e-05 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524830+0000", 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4240000000000003e-05 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524856+0000", 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5703000000000001e-05 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525044+0000", 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018797799999999999 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525374+0000", 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033005099999999999 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525827+0000", 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045309000000000001 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.527234+0000", 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014076259999999999 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528147+0000", 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091301299999999995 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528241+0000", 2024-04-26T12:39:06.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3466000000000003e-05 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528316+0000", 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.863 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.242621188000001, 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003758815, 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 232 2024-04-26T12:39:06.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.865 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:06.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603990+0000", 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.357e-06 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604002+0000", 2024-04-26T12:39:06.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.154e-05 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604033+0000", 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1136999999999997e-05 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604049+0000", 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5869e-05 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604216+0000", 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167615 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604567+0000", 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035053100000000001 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:06.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.605359+0000", 2024-04-26T12:39:06.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079155700000000002 2024-04-26T12:39:06.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607196+0000", 2024-04-26T12:39:06.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018378699999999999 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607588+0000", 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039154700000000001 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607677+0000", 2024-04-26T12:39:06.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9319000000000003e-05 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607747+0000", 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9473000000000004e-05 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:243 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.871 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.221288852000001, 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032017550000000001, 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 243 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:06.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:06.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625323+0000", 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8399999999999999e-06 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625338+0000", 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4637000000000001e-05 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625375+0000", 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7648999999999998e-05 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625396+0000", 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1047e-05 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625563+0000", 2024-04-26T12:39:06.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016640900000000001 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625966+0000", 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040301699999999998 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.626371+0000", 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040509600000000003 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.627764+0000", 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001393266 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628199+0000", 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043461599999999997 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628404+0000", 2024-04-26T12:39:06.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020512899999999999 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628522+0000", 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011804899999999999 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.878 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.216091839000001, 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032314010000000001, 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 276 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630519+0000", 2024-04-26T12:39:06.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1459999999999999e-06 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630532+0000", 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2604e-05 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630558+0000", 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630576+0000", 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630750+0000", 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173392 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631068+0000", 2024-04-26T12:39:06.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031842099999999999 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631575+0000", 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00050638899999999999 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.632975+0000", 2024-04-26T12:39:06.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001400486 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633495+0000", 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051948900000000004 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633635+0000", 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000140972 2024-04-26T12:39:06.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633749+0000", 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113239 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.885 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:295 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.886 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:06.886 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.211727525999997, 2024-04-26T12:39:06.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032101120000000002, 2024-04-26T12:39:06.886 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.886 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.886 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.886 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.886 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.886 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 295 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634883+0000", 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.204e-06 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634891+0000", 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0830000000000004e-06 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634905+0000", 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.382e-05 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634926+0000", 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1243e-05 2024-04-26T12:39:06.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635316+0000", 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039014699999999998 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635549+0000", 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023250500000000001 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.636038+0000", 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048965300000000005 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637344+0000", 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001305683 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637862+0000", 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051851600000000001 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637977+0000", 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114926 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638092+0000", 2024-04-26T12:39:06.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114332 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:355 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.202866520999997, 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003073569, 2024-04-26T12:39:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 355 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643745+0000", 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2859999999999998e-06 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643758+0000", 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2644e-05 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643805+0000", 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7763000000000003e-05 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643825+0000", 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9375999999999999e-05 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643970+0000", 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014545199999999999 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644263+0000", 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029315800000000001 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644807+0000", 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054336300000000005 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646108+0000", 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001300896 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646628+0000", 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052052000000000001 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646730+0000", 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102229 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646816+0000", 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5882000000000002e-05 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:408 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.181718201000002, 2024-04-26T12:39:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029401380000000001, 2024-04-26T12:39:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 408 2024-04-26T12:39:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664894+0000", 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664906+0000", 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2323e-05 2024-04-26T12:39:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664953+0000", 2024-04-26T12:39:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6594000000000001e-05 2024-04-26T12:39:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664967+0000", 2024-04-26T12:39:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4813e-05 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665094+0000", 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012636200000000001 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665327+0000", 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233172 2024-04-26T12:39:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665786+0000", 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045890599999999997 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667078+0000", 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012926400000000001 2024-04-26T12:39:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667564+0000", 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048546700000000001 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667708+0000", 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014418800000000001 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667831+0000", 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123013 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:497 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.120794578999998, 2024-04-26T12:39:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046691349999999996, 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 497 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725817+0000", 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725830+0000", 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2672e-05 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725862+0000", 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2042000000000003e-05 2024-04-26T12:39:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725930+0000", 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7731000000000006e-05 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726082+0000", 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152929 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726313+0000", 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023097499999999999 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726729+0000", 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041546699999999998 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729760+0000", 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003031083 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730288+0000", 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052804299999999996 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730419+0000", 2024-04-26T12:39:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013093499999999999 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730484+0000", 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4772999999999998e-05 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.026996101999998, 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002976111, 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 633 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819615+0000", 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7269999999999999e-06 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819626+0000", 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819660+0000", 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4079999999999999e-05 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819679+0000", 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9103e-05 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819807+0000", 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012822899999999999 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820044+0000", 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023652800000000001 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820418+0000", 2024-04-26T12:39:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037437400000000002 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.821605+0000", 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011867939999999999 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822310+0000", 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070503099999999995 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822480+0000", 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170089 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822589+0000", 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010892599999999999 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.920385220999997, 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030753500000000001, 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 727 2024-04-26T12:39:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926226+0000", 2024-04-26T12:39:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1129999999999999e-06 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926237+0000", 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926265+0000", 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.864e-05 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926283+0000", 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7949999999999999e-05 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926378+0000", 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5081999999999995e-05 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926590+0000", 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021203500000000001 2024-04-26T12:39:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926950+0000", 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035924399999999999 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.928069+0000", 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001119302 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929136+0000", 2024-04-26T12:39:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001066542 2024-04-26T12:39:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929227+0000", 2024-04-26T12:39:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1142000000000003e-05 2024-04-26T12:39:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929299+0000", 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2620000000000006e-05 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.733277585000003, 2024-04-26T12:39:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029575529999999999, 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 808 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113334+0000", 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113347+0000", 2024-04-26T12:39:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.288e-05 2024-04-26T12:39:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113378+0000", 2024-04-26T12:39:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1056000000000002e-05 2024-04-26T12:39:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113394+0000", 2024-04-26T12:39:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5616000000000001e-05 2024-04-26T12:39:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113541+0000", 2024-04-26T12:39:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147412 2024-04-26T12:39:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113767+0000", 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225372 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.114085+0000", 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031803799999999998 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.115306+0000", 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012213 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116132+0000", 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00082585700000000005 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116224+0000", 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2392999999999994e-05 2024-04-26T12:39:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116289+0000", 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4999000000000006e-05 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.715783903999998, 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028474419999999999, 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 816 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130827+0000", 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7239999999999999e-06 2024-04-26T12:39:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130836+0000", 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0729999999999994e-06 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130857+0000", 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1396999999999999e-05 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130870+0000", 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2363e-05 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130982+0000", 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112509 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131114+0000", 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131779 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131385+0000", 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027119500000000001 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.132710+0000", 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013251059999999999 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133474+0000", 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00076380800000000004 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133565+0000", 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0785000000000006e-05 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133673+0000", 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107703 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.565016634000003, 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029548180000000001, 2024-04-26T12:39:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 880 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281595+0000", 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.92e-06 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281608+0000", 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281639+0000", 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0263000000000001e-05 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281654+0000", 2024-04-26T12:39:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5613000000000001e-05 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281790+0000", 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013560300000000001 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282021+0000", 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023109399999999999 2024-04-26T12:39:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282352+0000", 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033127100000000001 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.283508+0000", 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011555820000000001 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284259+0000", 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075111399999999999 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284429+0000", 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017024499999999999 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284547+0000", 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118193 2024-04-26T12:39:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.560640907, 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049047079999999998, 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 882 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285970+0000", 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285981+0000", 2024-04-26T12:39:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0993e-05 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286015+0000", 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3309999999999998e-05 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286034+0000", 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8936e-05 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286154+0000", 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011998900000000001 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286385+0000", 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000231585 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286882+0000", 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000496763 2024-04-26T12:39:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.288886+0000", 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002004207 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290664+0000", 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017773800000000001 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290757+0000", 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3616000000000006e-05 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290873+0000", 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011579899999999999 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.555388561999997, 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030718659999999999, 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 883 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291223+0000", 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2869999999999999e-06 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291234+0000", 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1596999999999999e-05 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291265+0000", 2024-04-26T12:39:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.044e-05 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291283+0000", 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7878999999999999e-05 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291402+0000", 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119406 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291649+0000", 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024725499999999999 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291980+0000", 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033056999999999997 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.293099+0000", 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011188979999999999 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294018+0000", 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091867000000000001 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294175+0000", 2024-04-26T12:39:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015740200000000001 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294292+0000", 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011746199999999999 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.551099170999997, 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032575410000000001, 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 885 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295511+0000", 2024-04-26T12:39:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3060000000000001e-06 2024-04-26T12:39:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295518+0000", 2024-04-26T12:39:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295538+0000", 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9409999999999999e-05 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295549+0000", 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1328999999999999e-05 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295669+0000", 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119616 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295892+0000", 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223799 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.296415+0000", 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052249900000000005 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.297588+0000", 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011734740000000001 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298501+0000", 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091317000000000004 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298652+0000", 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015026199999999999 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298768+0000", 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115779 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.484220716999999, 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030403560000000001, 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 913 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362391+0000", 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362407+0000", 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6066000000000002e-05 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362437+0000", 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9728999999999999e-05 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362452+0000", 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5147000000000001e-05 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362568+0000", 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116172 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362806+0000", 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023781900000000001 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.363150+0000", 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000344144 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.364211+0000", 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010614979999999999 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365228+0000", 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001016669 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365315+0000", 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6496000000000007e-05 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365429+0000", 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114226 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.451493394000003, 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003220929, 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 927 2024-04-26T12:39:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395118+0000", 2024-04-26T12:39:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4099999999999998e-06 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395130+0000", 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1487e-05 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395161+0000", 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1152999999999998e-05 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395181+0000", 2024-04-26T12:39:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0273999999999999e-05 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395306+0000", 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124805 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395534+0000", 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000228085 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.396011+0000", 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000477493 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.397356+0000", 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013446199999999999 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398060+0000", 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070440100000000001 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398223+0000", 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000162855 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398337+0000", 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113346 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.447930051, 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030649560000000002, 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 928 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398682+0000", 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.43e-06 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398693+0000", 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1324e-05 2024-04-26T12:39:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398724+0000", 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0926000000000002e-05 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398742+0000", 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398865+0000", 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123542 2024-04-26T12:39:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399201+0000", 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033574800000000003 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399744+0000", 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054293600000000005 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401070+0000", 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013257360000000001 2024-04-26T12:39:06.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401546+0000", 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047601000000000002 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401633+0000", 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7225999999999995e-05 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401744+0000", 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000111195 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:06.990 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:06.990 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:06.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:06.992 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:06.987+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:07.092 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:07.090+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:07.145 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:07.146 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:07.162 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:07.162 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:07.163 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:07.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:07.163 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:07.163 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:07.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:07.180 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:07.180 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:07.193 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:07.190+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:07.200 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:07.200 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:07.218 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:07.218 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:07.236 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:07.237 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:07.258 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:07.258 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:07.280 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:07.280 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:07.293 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:07.294+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:07.299 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:07.299 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:07.313 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:07.395 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:07.391+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:07.435 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:07.435 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:07.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:07.496 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:07.494+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:07.597 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:07.594+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:07.617 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:07.617 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:07.631 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:07.698 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:07.695+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:07.748 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:07.748 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:39:07.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:07.830 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:07.830+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:07.901 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:07.899+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:07.940 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:07.940 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:07.954 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:08.040 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:08.039+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:08.102 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:08.099+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:08.120 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:08.120 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:08.135 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:08.203 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:08.202+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:08.296 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:08.296 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:08.304 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:08.303+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:08.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:08.405 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:08.402+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:08.478 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:08.479 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:08.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:08.505 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:08.503+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:08.606 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:08.606+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:08.627 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:08.627 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:08.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:08.733 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:08.734+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:08.807 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:08.806+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:08.814 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:08.814 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:08.828 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:08.913 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:08.914+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:08.995 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:08.996 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:09.008 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:09.006+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:09.010 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:09.109 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:09.107+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:09.179 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:09.180 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:09.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:09.210 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:09.207+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:09.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:09.311 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:09.307+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:09.314 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:09.314 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:09.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:09.421 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:09.422+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:09.452 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:09.452 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:09.471 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:09.471 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:09.489 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:09.489 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:09.506 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:09.507 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:09.514 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:39:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 55.070863697, 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.013625513000001, 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:39:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 50.894483239000003, 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:39:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:39:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:39:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.003598478000001, 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:39:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:39:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.985475467999997, 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:39:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:39:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.958380853000001, 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:39:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:39:09.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:09.548 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.939574178000001, 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:09.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:39:09.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.554 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.906070833999998, 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:39:09.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.560 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.876331905999997, 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:39:09.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.566 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.870592144, 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:39:09.572 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:09.510+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:09.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:39:09.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.826559596000003, 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.575 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:09.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:39:09.580 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.824901175000001, 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.581 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.820668738999998, 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:39:09.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:39:09.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:39:09.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.533654132000002, 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:39:09.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.529561913000002, 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.598 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:39:09.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.431121803000003, 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028684980000000001, 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.604 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 796 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081975+0000", 2024-04-26T12:39:09.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081977+0000", 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.081989+0000", 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1663e-05 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082020+0000", 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0746e-05 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082035+0000", 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5647000000000001e-05 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082174+0000", 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013828899999999999 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082387+0000", 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021377500000000001 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.082704+0000", 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000316934 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.083853+0000", 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001148388 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084695+0000", 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084224699999999996 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084779+0000", 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3652999999999993e-05 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.084844+0000", 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4808999999999996e-05 2024-04-26T12:39:09.609 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.427329258999997, 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.610 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:39:09.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:39:09.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:39:09.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.144380894999998, 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.140074923, 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.621 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:39:09.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:39:09.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:39:09.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.074330562999997, 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029228000000000001, 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:09.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438769+0000", 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3499999999999999e-06 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438781+0000", 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2027e-05 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438812+0000", 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1238999999999997e-05 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438830+0000", 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7677e-05 2024-04-26T12:39:09.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438969+0000", 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013923200000000001 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439175+0000", 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020586199999999999 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439538+0000", 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036342699999999999 2024-04-26T12:39:09.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.440591+0000", 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010524390000000001 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441533+0000", 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094222499999999999 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441621+0000", 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8399999999999994e-05 2024-04-26T12:39:09.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441689+0000", 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7922000000000005e-05 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:09.632 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:09.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:09.633 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:09.633 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:09.634 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:09.634 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:09.634 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:09.635 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:09.635 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:09.636 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:09.637 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:09.635+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:09.737 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:09.734+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:09.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:39:09.807 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:09.808 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:09.808 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:09.808 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:09.823 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:09.838 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:09.835+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:09.940 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:09.935+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:09.996 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:09.996 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:09.996 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:10.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:10.041 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:10.039+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:10.138 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:40 5.6 5:66d44ff0:::zonegroup_info.6cf2425f-74db-47a8-896e-35ab7b9def6a:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:39:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 55.635965034000002, 2024-04-26T12:39:10.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031402079999999998, 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:10.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497958+0000", 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.922e-06 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497970+0000", 2024-04-26T12:39:10.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.136e-05 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497995+0000", 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5279999999999999e-05 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498009+0000", 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3872e-05 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498111+0000", 2024-04-26T12:39:10.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101927 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498303+0000", 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019180600000000001 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498553+0000", 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024977300000000001 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.499918+0000", 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001365003 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500885+0000", 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00096762599999999997 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500997+0000", 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111742 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.501097+0000", 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9896999999999996e-05 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.626599599000002, 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047946860000000003, 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.144 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 52 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507325+0000", 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.717e-06 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507336+0000", 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1182999999999999e-05 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507370+0000", 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4230000000000003e-05 2024-04-26T12:39:10.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507388+0000", 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7453e-05 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507508+0000", 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012033599999999999 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507749+0000", 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024146700000000001 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507923+0000", 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017378700000000001 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.508980+0000", 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056707 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.511982+0000", 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030022809999999999 2024-04-26T12:39:10.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512050+0000", 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7457000000000001e-05 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512117+0000", 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7068000000000002e-05 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.516432723999998, 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036369689999999999, 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617492+0000", 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617505+0000", 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.306e-05 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617536+0000", 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1007000000000003e-05 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617553+0000", 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7629999999999999e-05 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617719+0000", 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016533800000000001 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618065+0000", 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034657399999999999 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618778+0000", 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071317099999999997 2024-04-26T12:39:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620613+0000", 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018347260000000001 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620980+0000", 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036717100000000001 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621062+0000", 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1442999999999999e-05 2024-04-26T12:39:10.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621126+0000", 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4085999999999996e-05 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.502789395999997, 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026109499999999999, 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.155 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 281 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631133+0000", 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0559999999999999e-06 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631139+0000", 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1419999999999998e-06 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631154+0000", 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4893e-05 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631161+0000", 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9179999999999997e-06 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631234+0000", 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2976000000000001e-05 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631374+0000", 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140218 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631555+0000", 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018107600000000001 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.632139+0000", 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058337700000000005 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633653+0000", 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001514123 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633695+0000", 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2208e-05 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633743+0000", 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7963000000000001e-05 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.174078012999999, 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035079099999999999, 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959846+0000", 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959860+0000", 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3329999999999999e-05 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959891+0000", 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1576999999999999e-05 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959906+0000", 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4912999999999999e-05 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960018+0000", 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011209600000000001 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960260+0000", 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024201100000000001 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960602+0000", 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034149700000000001 2024-04-26T12:39:10.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.961961+0000", 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013591230000000001 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963193+0000", 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012322399999999999 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963281+0000", 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8306000000000005e-05 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963352+0000", 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0216999999999995e-05 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.133270654999997, 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002916901, 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.166 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000653+0000", 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000665+0000", 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.187e-05 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000696+0000", 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0607e-05 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000712+0000", 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6192999999999999e-05 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000825+0000", 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113213 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001039+0000", 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021364100000000001 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001352+0000", 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000313071 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.002433+0000", 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010811779999999999 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003365+0000", 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093210299999999999 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003449+0000", 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3973000000000004e-05 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003568+0000", 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118542 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.171 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.129492827, 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027713579999999998, 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 762 2024-04-26T12:39:10.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004431+0000", 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.77e-06 2024-04-26T12:39:10.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004441+0000", 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0523000000000001e-05 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004467+0000", 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5522999999999999e-05 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004479+0000", 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2486999999999999e-05 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004586+0000", 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106926 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004721+0000", 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013467199999999999 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:10.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004986+0000", 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026559100000000003 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006110+0000", 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123995 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006998+0000", 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088729 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007083+0000", 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5871999999999994e-05 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007200+0000", 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116709 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.000988012000001, 2024-04-26T12:39:10.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028708179999999998, 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132936+0000", 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132949+0000", 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2533e-05 2024-04-26T12:39:10.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132980+0000", 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1423000000000001e-05 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132995+0000", 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5e-05 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133125+0000", 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012975899999999999 2024-04-26T12:39:10.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133349+0000", 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223842 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133698+0000", 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034930699999999998 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.134765+0000", 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001066808 2024-04-26T12:39:10.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135647+0000", 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088210700000000003 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135735+0000", 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8206000000000002e-05 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135804+0000", 2024-04-26T12:39:10.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9103000000000006e-05 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.997159330999999, 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028524739999999998, 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136764+0000", 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9759999999999998e-06 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136776+0000", 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.133e-05 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136802+0000", 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136822+0000", 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9247000000000001e-05 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136933+0000", 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110946 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137069+0000", 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013615200000000001 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137342+0000", 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027280099999999998 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.138318+0000", 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00097641000000000004 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139458+0000", 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011402669999999999 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139545+0000", 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6948999999999997e-05 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139615+0000", 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9560000000000005e-05 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:10.188 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.946994388999997, 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028263889999999999, 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186930+0000", 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186944+0000", 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4e-05 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186974+0000", 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0332999999999999e-05 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186989+0000", 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4776e-05 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187122+0000", 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013347599999999999 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187343+0000", 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022082499999999999 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187668+0000", 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032438699999999998 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.188757+0000", 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001089565 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189604+0000", 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084688799999999996 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189689+0000", 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5348999999999999e-05 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189754+0000", 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4159999999999996e-05 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.942950670000002, 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031280219999999998, 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.194 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:10.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190973+0000", 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8199999999999999e-06 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190982+0000", 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1530000000000003e-06 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191006+0000", 2024-04-26T12:39:10.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191018+0000", 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191149+0000", 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013097200000000001 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191397+0000", 2024-04-26T12:39:10.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024733099999999999 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191899+0000", 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050217600000000001 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193371+0000", 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014719959999999999 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193942+0000", 2024-04-26T12:39:10.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000571475 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194031+0000", 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8696000000000006e-05 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194099+0000", 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.932491954, 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034761900000000001, 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201432+0000", 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3630000000000001e-06 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201445+0000", 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3016999999999999e-05 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201475+0000", 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9719000000000001e-05 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201490+0000", 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201647+0000", 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156909 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202024+0000", 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037773100000000002 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202591+0000", 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000566992 2024-04-26T12:39:10.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.203991+0000", 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013995290000000001 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204629+0000", 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063768500000000003 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204786+0000", 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015742600000000001 2024-04-26T12:39:10.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204906+0000", 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119869 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.927806050000001, 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034202299999999998, 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.205 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206117+0000", 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.68e-06 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206126+0000", 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5900000000000008e-06 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206151+0000", 2024-04-26T12:39:10.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4939e-05 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206163+0000", 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2597e-05 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206291+0000", 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012768600000000001 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206539+0000", 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000248061 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.207052+0000", 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051334299999999998 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.208330+0000", 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012775060000000001 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209262+0000", 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093203999999999997 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209418+0000", 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015631900000000001 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209536+0000", 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117469 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.210 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.880521301999998, 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027845690000000002, 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.211 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253402+0000", 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1830000000000001e-06 2024-04-26T12:39:10.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253414+0000", 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1223000000000001e-05 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253444+0000", 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0300000000000001e-05 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253459+0000", 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4749999999999999e-05 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253585+0000", 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126379 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253813+0000", 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000227498 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.254131+0000", 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031848800000000002 2024-04-26T12:39:10.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.255218+0000", 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010869180000000001 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256027+0000", 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080942099999999995 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256114+0000", 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6599000000000002e-05 2024-04-26T12:39:10.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256185+0000", 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0809999999999995e-05 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.787461890000003, 2024-04-26T12:39:10.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035106930000000001, 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346462+0000", 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5459999999999998e-06 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346475+0000", 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2764e-05 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346506+0000", 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1266000000000002e-05 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346521+0000", 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4887e-05 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346676+0000", 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015471800000000001 2024-04-26T12:39:10.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347095+0000", 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041862399999999998 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347690+0000", 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059590499999999998 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349002+0000", 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00131185 2024-04-26T12:39:10.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349697+0000", 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069428800000000004 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349855+0000", 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015838899999999999 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349970+0000", 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115456 2024-04-26T12:39:10.221 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.782990517999998, 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003318194, 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.222 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350933+0000", 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350942+0000", 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2429999999999994e-06 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350967+0000", 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4239999999999998e-05 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350981+0000", 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4093e-05 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351122+0000", 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014118299999999999 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351371+0000", 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000249604 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351883+0000", 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051186600000000004 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.353068+0000", 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011850980000000001 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354094+0000", 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010259290000000001 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354181+0000", 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6812999999999997e-05 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354249+0000", 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8162000000000002e-05 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.688014584999998, 2024-04-26T12:39:10.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028482690000000001, 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445910+0000", 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6570000000000001e-06 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445922+0000", 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2806000000000001e-05 2024-04-26T12:39:10.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445955+0000", 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2036999999999998e-05 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445970+0000", 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446092+0000", 2024-04-26T12:39:10.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121523 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446313+0000", 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022160800000000001 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446651+0000", 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000338074 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.447983+0000", 2024-04-26T12:39:10.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013322029999999999 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448614+0000", 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063038899999999997 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448695+0000", 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1348999999999997e-05 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448755+0000", 2024-04-26T12:39:10.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0139999999999997e-05 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.684281892999998, 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003146959, 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 951 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449641+0000", 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3230000000000001e-06 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449648+0000", 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1300000000000003e-06 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449669+0000", 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0809999999999999e-05 2024-04-26T12:39:10.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449680+0000", 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1416999999999999e-05 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449805+0000", 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012442200000000001 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449942+0000", 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013762299999999999 2024-04-26T12:39:10.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.450223+0000", 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028021699999999998 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.451636+0000", 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001413573 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452587+0000", 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000950799 2024-04-26T12:39:10.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452672+0000", 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4735999999999996e-05 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452787+0000", 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011490899999999999 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.673832257000001, 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035247389999999998, 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460092+0000", 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460105+0000", 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3730000000000001e-05 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460135+0000", 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9649e-05 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460154+0000", 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8953e-05 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460270+0000", 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011612600000000001 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460494+0000", 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022413199999999999 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460813+0000", 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031844700000000002 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.462087+0000", 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273927 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463222+0000", 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354080000000001 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463434+0000", 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021214500000000001 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463614+0000", 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017984199999999999 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.669223270000003, 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002995798, 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.244 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:10.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464700+0000", 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.844e-06 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464712+0000", 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1763000000000001e-05 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464738+0000", 2024-04-26T12:39:10.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5829999999999998e-05 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464751+0000", 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3456e-05 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464895+0000", 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143399 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465152+0000", 2024-04-26T12:39:10.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025729799999999999 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465636+0000", 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048426300000000002 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.466751+0000", 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011144550000000001 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467488+0000", 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000737501 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467576+0000", 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8252999999999997e-05 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467694+0000", 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117736 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.249 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.250 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.250 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:10.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:10.252 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:10.247+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:10.352 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:10.351+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:10.386 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:10.386 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:10.386 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:10.386 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:10.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:10.453 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:10.450+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:10.541 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:10.541 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:10.541 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:10.541 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:10.541 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:10.554 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:10.551+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:10.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:10.655 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:10.655+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:10.731 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.213459626000002, 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002983332, 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 56 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515116+0000", 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5550000000000001e-06 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515127+0000", 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0899e-05 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515152+0000", 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.561e-05 2024-04-26T12:39:10.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515165+0000", 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2727e-05 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515291+0000", 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000125628 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515490+0000", 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000199452 2024-04-26T12:39:10.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515690+0000", 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000200189 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517095+0000", 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014043860000000001 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517890+0000", 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079524999999999995 2024-04-26T12:39:10.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518006+0000", 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011569 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518097+0000", 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0946000000000006e-05 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.737 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889461985664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.210343102000003, 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030541930000000002, 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518232+0000", 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7430000000000001e-06 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518239+0000", 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1670000000000002e-06 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518263+0000", 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4786e-05 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518276+0000", 2024-04-26T12:39:10.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2394e-05 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518374+0000", 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8544999999999999e-05 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518533+0000", 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000158763 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518836+0000", 2024-04-26T12:39:10.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030328000000000001 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.520242+0000", 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001405643 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521076+0000", 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083431100000000002 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521187+0000", 2024-04-26T12:39:10.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110714 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521284+0000", 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6847000000000003e-05 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889461986816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.207511793999998, 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003156112, 2024-04-26T12:39:10.743 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 59 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521063+0000", 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9599999999999999e-06 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521074+0000", 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521105+0000", 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1199999999999999e-05 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521125+0000", 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9806999999999999e-05 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521260+0000", 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013498500000000001 2024-04-26T12:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521472+0000", 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021194900000000001 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521908+0000", 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043670900000000002 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523344+0000", 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001435579 2024-04-26T12:39:10.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524086+0000", 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000741805 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524148+0000", 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2408000000000003e-05 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524217+0000", 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9016999999999993e-05 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.224156417000003, 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046495770000000002, 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.749 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504420+0000", 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504437+0000", 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6926e-05 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504481+0000", 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3946999999999998e-05 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504506+0000", 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4986000000000001e-05 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504777+0000", 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027106100000000001 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505020+0000", 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024332499999999999 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505444+0000", 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000423783 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.507435+0000", 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019909950000000002 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508814+0000", 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001378799 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508964+0000", 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014972600000000001 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509066+0000", 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010223200000000001 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.184817889999998, 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003567382, 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.755 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543758+0000", 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.286e-06 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543774+0000", 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.571e-05 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543813+0000", 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9110000000000003e-05 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543831+0000", 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8139999999999999e-05 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543962+0000", 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130832 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544216+0000", 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025436099999999999 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544648+0000", 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043157999999999998 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.546300+0000", 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001651661 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547173+0000", 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087328999999999998 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547258+0000", 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4878999999999998e-05 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547322+0000", 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4533e-05 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.144117737999998, 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035366059999999999, 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.760 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584458+0000", 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999999e-06 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584469+0000", 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.165e-05 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584501+0000", 2024-04-26T12:39:10.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2005999999999998e-05 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584526+0000", 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4683000000000001e-05 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584654+0000", 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012805299999999999 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584869+0000", 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021525400000000001 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.585275+0000", 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00040564399999999998 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.586816+0000", 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015407579999999999 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587844+0000", 2024-04-26T12:39:10.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010284020000000001 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587927+0000", 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3286000000000002e-05 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587992+0000", 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4323000000000001e-05 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.136817991000001, 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029981999999999999, 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591757+0000", 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591769+0000", 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1600000000000001e-05 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591799+0000", 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0543000000000002e-05 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591825+0000", 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5752e-05 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591941+0000", 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116143 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592156+0000", 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021444899999999999 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592548+0000", 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039236700000000002 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594185+0000", 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016373469999999999 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594615+0000", 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042984300000000001 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594692+0000", 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.695e-05 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594753+0000", 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0869000000000003e-05 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 49.129282658999998, 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033442010000000002, 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.771 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:10.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599292+0000", 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9769999999999999e-06 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599303+0000", 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0386e-05 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599334+0000", 2024-04-26T12:39:10.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1087000000000002e-05 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599356+0000", 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2138999999999999e-05 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599475+0000", 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119589 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599696+0000", 2024-04-26T12:39:10.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022040199999999999 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.600100+0000", 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000404044 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.601568+0000", 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001468001 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602489+0000", 2024-04-26T12:39:10.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092147699999999997 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602571+0000", 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1818999999999997e-05 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602634+0000", 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3280000000000004e-05 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.830431664999999, 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034449799999999998, 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898143+0000", 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898153+0000", 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0176999999999999e-05 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898180+0000", 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6781999999999999e-05 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898202+0000", 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1605000000000001e-05 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898329+0000", 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127367 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898546+0000", 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021638199999999999 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898892+0000", 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034662799999999998 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.900063+0000", 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171184 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901429+0000", 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013658990000000001 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901525+0000", 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5433000000000006e-05 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901586+0000", 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1463000000000004e-05 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.783003805, 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030447159999999998, 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 736 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945571+0000", 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945585+0000", 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3766e-05 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945616+0000", 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1254000000000003e-05 2024-04-26T12:39:10.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945632+0000", 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5296000000000001e-05 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945745+0000", 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011295599999999999 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945978+0000", 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023348800000000001 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.946293+0000", 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000314958 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.947440+0000", 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011467440000000001 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948328+0000", 2024-04-26T12:39:10.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088776000000000002 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948494+0000", 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016587899999999999 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948614+0000", 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012025500000000001 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.787 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.779043303000002, 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003238646, 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 738 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949531+0000", 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7069999999999999e-06 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949541+0000", 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949566+0000", 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5533000000000001e-05 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949579+0000", 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.236e-05 2024-04-26T12:39:10.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949722+0000", 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014327200000000001 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949970+0000", 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024837500000000001 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.950482+0000", 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051128299999999996 2024-04-26T12:39:10.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.951825+0000", 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013431630000000001 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952625+0000", 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080046700000000002 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952705+0000", 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9869000000000004e-05 2024-04-26T12:39:10.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952768+0000", 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3057000000000003e-05 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:774 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.697222961000001, 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029121680000000001, 2024-04-26T12:39:10.793 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 774 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031352+0000", 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9700000000000002e-06 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031361+0000", 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.414e-06 2024-04-26T12:39:10.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031387+0000", 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031399+0000", 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2377e-05 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031574+0000", 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017496800000000001 2024-04-26T12:39:10.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031715+0000", 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031989+0000", 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027419800000000002 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.033007+0000", 2024-04-26T12:39:10.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010173319999999999 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034110+0000", 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001102879 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034192+0000", 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2346000000000001e-05 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034262+0000", 2024-04-26T12:39:10.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0185999999999995e-05 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.687605521000002, 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028610879999999999, 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 778 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040970+0000", 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040981+0000", 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1703e-05 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041013+0000", 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1303000000000002e-05 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041030+0000", 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7493e-05 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041206+0000", 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017595499999999999 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041420+0000", 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021373200000000001 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041722+0000", 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030209799999999999 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.042818+0000", 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001095738 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043676+0000", 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085838699999999995 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043762+0000", 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6521999999999996e-05 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043828+0000", 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5957000000000006e-05 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:10.804 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.683621502000001, 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032202580000000001, 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 780 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044954+0000", 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045055+0000", 2024-04-26T12:39:10.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010158900000000001 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045427+0000", 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037136100000000001 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045461+0000", 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4193000000000003e-05 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045615+0000", 2024-04-26T12:39:10.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000153652 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045815+0000", 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020044799999999999 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.046189+0000", 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037399699999999999 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.047313+0000", 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123899 2024-04-26T12:39:10.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048021+0000", 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070842099999999999 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048105+0000", 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3152999999999995e-05 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048172+0000", 2024-04-26T12:39:10.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7012000000000001e-05 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.629385867000003, 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028409210000000002, 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.810 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099190+0000", 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099202+0000", 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2019e-05 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099233+0000", 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1093000000000002e-05 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099247+0000", 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4579999999999999e-05 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099361+0000", 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113723 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099573+0000", 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021191499999999999 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099895+0000", 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032170099999999997 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101037+0000", 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011427270000000001 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101880+0000", 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084234700000000002 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101964+0000", 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3856000000000005e-05 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.102028+0000", 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4220000000000005e-05 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.468697194000001, 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028492639999999998, 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 871 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.816 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259878+0000", 2024-04-26T12:39:10.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0930000000000001e-06 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259888+0000", 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0713999999999999e-05 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259917+0000", 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8276000000000002e-05 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259931+0000", 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4032999999999999e-05 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260072+0000", 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141326 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260299+0000", 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022688799999999999 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260617+0000", 2024-04-26T12:39:10.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031782099999999998 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.261683+0000", 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001065812 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262584+0000", 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00090090600000000004 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262665+0000", 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1578999999999999e-05 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262725+0000", 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9815999999999998e-05 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:10.821 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.405773189999998, 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028604580000000002, 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 897 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:10.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322801+0000", 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.536e-06 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322810+0000", 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3340000000000002e-06 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322835+0000", 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5136000000000001e-05 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322854+0000", 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8853000000000001e-05 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322990+0000", 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000136169 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323117+0000", 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012680600000000001 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323392+0000", 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027538500000000001 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.324484+0000", 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001092462 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325508+0000", 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001023272 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325595+0000", 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6889000000000001e-05 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325660+0000", 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5616000000000003e-05 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.402695170000001, 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003075749, 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325880+0000", 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9259999999999999e-06 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325889+0000", 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8600000000000005e-06 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325918+0000", 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9006999999999999e-05 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325939+0000", 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0863e-05 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326058+0000", 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011906899999999999 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326273+0000", 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000214355 2024-04-26T12:39:10.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326585+0000", 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031177800000000002 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.327864+0000", 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012790430000000001 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328808+0000", 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094398300000000002 2024-04-26T12:39:10.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328893+0000", 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5263e-05 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328953+0000", 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0602e-05 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.832 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.310423389, 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002915997, 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:10.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418151+0000", 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.75e-06 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418161+0000", 2024-04-26T12:39:10.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418187+0000", 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6417000000000001e-05 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418207+0000", 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9902999999999999e-05 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418335+0000", 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127892 2024-04-26T12:39:10.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418570+0000", 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023533500000000001 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418956+0000", 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038606699999999997 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420042+0000", 2024-04-26T12:39:10.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001086175 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420918+0000", 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087580700000000004 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421002+0000", 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4239000000000004e-05 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421065+0000", 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:39:10.837 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.306510899000003, 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028511209999999999, 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:10.838 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 939 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:10.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422063+0000", 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5200000000000001e-06 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422074+0000", 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0407e-05 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422100+0000", 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5848999999999999e-05 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:10.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422119+0000", 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422268+0000", 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148899 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422392+0000", 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012443900000000001 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:10.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422672+0000", 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000279368 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.423773+0000", 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001101582 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424766+0000", 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099285499999999995 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424852+0000", 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5913000000000002e-05 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424913+0000", 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1136000000000006e-05 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:10.843 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:10.845 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:10.846 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:39:10.846 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:10.843+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:10.946 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:10.942+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:10.976 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:10.976 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:10.976 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:10.976 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:10.990 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:11.076 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:11.074+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:11.147 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:11.142+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:11.157 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:11.157 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:11.157 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:11.158 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:11.158 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:11.171 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:11.248 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:11.246+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:11.337 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:11.337 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:11.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:11.337 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:11.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.337 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:39:11.337 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:11.337 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.875528410000001, 2024-04-26T12:39:11.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011918331000000001, 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "reached pg", 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 43 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:11.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457566+0000", 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5530000000000001e-06 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457583+0000", 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7654000000000001e-05 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457626+0000", 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2110000000000002e-05 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457652+0000", 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6789000000000001e-05 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457863+0000", 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000210225 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457885+0000", 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2456999999999999e-05 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469169+0000", 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011284343 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469481+0000", 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031119999999999997 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.808328570999997, 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003553853, 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.342 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 211 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:11.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524766+0000", 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0829999999999997e-06 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524786+0000", 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9494e-05 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524830+0000", 2024-04-26T12:39:11.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4240000000000003e-05 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524856+0000", 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5703000000000001e-05 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525044+0000", 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018797799999999999 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525374+0000", 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033005099999999999 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525827+0000", 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045309000000000001 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.527234+0000", 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014076259999999999 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528147+0000", 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091301299999999995 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528241+0000", 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3466000000000003e-05 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528316+0000", 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.729102718999997, 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003758815, 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.348 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 232 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603990+0000", 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.357e-06 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604002+0000", 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.154e-05 2024-04-26T12:39:11.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604033+0000", 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1136999999999997e-05 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604049+0000", 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5869e-05 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604216+0000", 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167615 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604567+0000", 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035053100000000001 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.605359+0000", 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079155700000000002 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607196+0000", 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018378699999999999 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607588+0000", 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039154700000000001 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607677+0000", 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9319000000000003e-05 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607747+0000", 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9473000000000004e-05 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:243 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.707770383000003, 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032017550000000001, 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.354 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 243 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:11.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625323+0000", 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8399999999999999e-06 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625338+0000", 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4637000000000001e-05 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625375+0000", 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7648999999999998e-05 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625396+0000", 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1047e-05 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625563+0000", 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016640900000000001 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625966+0000", 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040301699999999998 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.626371+0000", 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040509600000000003 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.627764+0000", 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001393266 2024-04-26T12:39:11.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628199+0000", 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043461599999999997 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628404+0000", 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020512899999999999 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628522+0000", 2024-04-26T12:39:11.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011804899999999999 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.702573370000003, 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032314010000000001, 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.360 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 276 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:11.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630519+0000", 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1459999999999999e-06 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630532+0000", 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2604e-05 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630558+0000", 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630576+0000", 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630750+0000", 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173392 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631068+0000", 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031842099999999999 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631575+0000", 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00050638899999999999 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.632975+0000", 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001400486 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633495+0000", 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051948900000000004 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633635+0000", 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000140972 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633749+0000", 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113239 2024-04-26T12:39:11.365 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:295 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.698209057, 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032101120000000002, 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.366 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 295 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634883+0000", 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.204e-06 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634891+0000", 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0830000000000004e-06 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634905+0000", 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.382e-05 2024-04-26T12:39:11.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634926+0000", 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1243e-05 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635316+0000", 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039014699999999998 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635549+0000", 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023250500000000001 2024-04-26T12:39:11.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.636038+0000", 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048965300000000005 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637344+0000", 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001305683 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637862+0000", 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051851600000000001 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637977+0000", 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114926 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638092+0000", 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114332 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:355 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.689348052, 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003073569, 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 355 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643745+0000", 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2859999999999998e-06 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643758+0000", 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2644e-05 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643805+0000", 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7763000000000003e-05 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643825+0000", 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9375999999999999e-05 2024-04-26T12:39:11.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643970+0000", 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014545199999999999 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644263+0000", 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029315800000000001 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:11.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644807+0000", 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054336300000000005 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646108+0000", 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001300896 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646628+0000", 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052052000000000001 2024-04-26T12:39:11.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646730+0000", 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102229 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646816+0000", 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5882000000000002e-05 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:408 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.668199731999998, 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029401380000000001, 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 408 2024-04-26T12:39:11.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664894+0000", 2024-04-26T12:39:11.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664906+0000", 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2323e-05 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664953+0000", 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6594000000000001e-05 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664967+0000", 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4813e-05 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665094+0000", 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012636200000000001 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665327+0000", 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233172 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665786+0000", 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045890599999999997 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667078+0000", 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012926400000000001 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667564+0000", 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048546700000000001 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667708+0000", 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014418800000000001 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667831+0000", 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123013 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.383 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:497 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.607276110000001, 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046691349999999996, 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 497 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725817+0000", 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725830+0000", 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2672e-05 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725862+0000", 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2042000000000003e-05 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725930+0000", 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7731000000000006e-05 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726082+0000", 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152929 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726313+0000", 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023097499999999999 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726729+0000", 2024-04-26T12:39:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041546699999999998 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729760+0000", 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003031083 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730288+0000", 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052804299999999996 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730419+0000", 2024-04-26T12:39:11.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013093499999999999 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730484+0000", 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4772999999999998e-05 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.513477633000001, 2024-04-26T12:39:11.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002976111, 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 633 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819615+0000", 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7269999999999999e-06 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819626+0000", 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:39:11.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819660+0000", 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4079999999999999e-05 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819679+0000", 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9103e-05 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819807+0000", 2024-04-26T12:39:11.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012822899999999999 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820044+0000", 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023652800000000001 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820418+0000", 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037437400000000002 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.821605+0000", 2024-04-26T12:39:11.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011867939999999999 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822310+0000", 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070503099999999995 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822480+0000", 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170089 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822589+0000", 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010892599999999999 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.406866751999999, 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030753500000000001, 2024-04-26T12:39:11.395 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 727 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:11.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926226+0000", 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1129999999999999e-06 2024-04-26T12:39:11.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926237+0000", 2024-04-26T12:39:11.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:39:11.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926265+0000", 2024-04-26T12:39:11.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.864e-05 2024-04-26T12:39:11.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926283+0000", 2024-04-26T12:39:11.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7949999999999999e-05 2024-04-26T12:39:11.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926378+0000", 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5081999999999995e-05 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926590+0000", 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021203500000000001 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:11.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926950+0000", 2024-04-26T12:39:11.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035924399999999999 2024-04-26T12:39:11.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.928069+0000", 2024-04-26T12:39:11.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001119302 2024-04-26T12:39:11.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929136+0000", 2024-04-26T12:39:11.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001066542 2024-04-26T12:39:11.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929227+0000", 2024-04-26T12:39:11.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1142000000000003e-05 2024-04-26T12:39:11.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929299+0000", 2024-04-26T12:39:11.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2620000000000006e-05 2024-04-26T12:39:11.404 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.404 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.404 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.405 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.405 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:11.405 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.219759115999999, 2024-04-26T12:39:11.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029575529999999999, 2024-04-26T12:39:11.405 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.405 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.405 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.406 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.406 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.406 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.406 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 808 2024-04-26T12:39:11.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.407 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:11.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:11.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113334+0000", 2024-04-26T12:39:11.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:11.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113347+0000", 2024-04-26T12:39:11.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.288e-05 2024-04-26T12:39:11.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113378+0000", 2024-04-26T12:39:11.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1056000000000002e-05 2024-04-26T12:39:11.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113394+0000", 2024-04-26T12:39:11.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5616000000000001e-05 2024-04-26T12:39:11.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113541+0000", 2024-04-26T12:39:11.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147412 2024-04-26T12:39:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113767+0000", 2024-04-26T12:39:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225372 2024-04-26T12:39:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:11.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.114085+0000", 2024-04-26T12:39:11.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031803799999999998 2024-04-26T12:39:11.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.115306+0000", 2024-04-26T12:39:11.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012213 2024-04-26T12:39:11.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116132+0000", 2024-04-26T12:39:11.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00082585700000000005 2024-04-26T12:39:11.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116224+0000", 2024-04-26T12:39:11.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2392999999999994e-05 2024-04-26T12:39:11.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116289+0000", 2024-04-26T12:39:11.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4999000000000006e-05 2024-04-26T12:39:11.416 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.416 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.417 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.417 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.418 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:11.418 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.202265435000001, 2024-04-26T12:39:11.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028474419999999999, 2024-04-26T12:39:11.418 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.419 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.419 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.419 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.419 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.419 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.419 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 816 2024-04-26T12:39:11.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.420 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130827+0000", 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7239999999999999e-06 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130836+0000", 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0729999999999994e-06 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130857+0000", 2024-04-26T12:39:11.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1396999999999999e-05 2024-04-26T12:39:11.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130870+0000", 2024-04-26T12:39:11.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2363e-05 2024-04-26T12:39:11.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130982+0000", 2024-04-26T12:39:11.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112509 2024-04-26T12:39:11.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131114+0000", 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131779 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131385+0000", 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027119500000000001 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.132710+0000", 2024-04-26T12:39:11.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013251059999999999 2024-04-26T12:39:11.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133474+0000", 2024-04-26T12:39:11.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00076380800000000004 2024-04-26T12:39:11.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133565+0000", 2024-04-26T12:39:11.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0785000000000006e-05 2024-04-26T12:39:11.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133673+0000", 2024-04-26T12:39:11.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107703 2024-04-26T12:39:11.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.428 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.051498164999998, 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029548180000000001, 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.429 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 880 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281595+0000", 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.92e-06 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281608+0000", 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281639+0000", 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0263000000000001e-05 2024-04-26T12:39:11.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281654+0000", 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5613000000000001e-05 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281790+0000", 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013560300000000001 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282021+0000", 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023109399999999999 2024-04-26T12:39:11.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282352+0000", 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033127100000000001 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.283508+0000", 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011555820000000001 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284259+0000", 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075111399999999999 2024-04-26T12:39:11.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284429+0000", 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017024499999999999 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284547+0000", 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118193 2024-04-26T12:39:11.434 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.047122438000002, 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049047079999999998, 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.435 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 882 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285970+0000", 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285981+0000", 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0993e-05 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286015+0000", 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3309999999999998e-05 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286034+0000", 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8936e-05 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286154+0000", 2024-04-26T12:39:11.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011998900000000001 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286385+0000", 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000231585 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286882+0000", 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000496763 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.288886+0000", 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002004207 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290664+0000", 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017773800000000001 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290757+0000", 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3616000000000006e-05 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290873+0000", 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011579899999999999 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.041870093, 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030718659999999999, 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.441 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 883 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291223+0000", 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2869999999999999e-06 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291234+0000", 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1596999999999999e-05 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291265+0000", 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.044e-05 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291283+0000", 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7878999999999999e-05 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291402+0000", 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119406 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291649+0000", 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024725499999999999 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291980+0000", 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033056999999999997 2024-04-26T12:39:11.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.293099+0000", 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011188979999999999 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294018+0000", 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091867000000000001 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294175+0000", 2024-04-26T12:39:11.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015740200000000001 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294292+0000", 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011746199999999999 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.037580702, 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032575410000000001, 2024-04-26T12:39:11.447 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 885 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295511+0000", 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3060000000000001e-06 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295518+0000", 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295538+0000", 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9409999999999999e-05 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295549+0000", 2024-04-26T12:39:11.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1328999999999999e-05 2024-04-26T12:39:11.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295669+0000", 2024-04-26T12:39:11.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119616 2024-04-26T12:39:11.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295892+0000", 2024-04-26T12:39:11.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223799 2024-04-26T12:39:11.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:11.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.296415+0000", 2024-04-26T12:39:11.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052249900000000005 2024-04-26T12:39:11.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.297588+0000", 2024-04-26T12:39:11.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011734740000000001 2024-04-26T12:39:11.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298501+0000", 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091317000000000004 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298652+0000", 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015026199999999999 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298768+0000", 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115779 2024-04-26T12:39:11.454 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 48.970702248000002, 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030403560000000001, 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.455 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 913 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362391+0000", 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362407+0000", 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6066000000000002e-05 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362437+0000", 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9728999999999999e-05 2024-04-26T12:39:11.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362452+0000", 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5147000000000001e-05 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362568+0000", 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116172 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362806+0000", 2024-04-26T12:39:11.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023781900000000001 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.363150+0000", 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000344144 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.364211+0000", 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010614979999999999 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365228+0000", 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001016669 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365315+0000", 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6496000000000007e-05 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365429+0000", 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114226 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 48.937974924999999, 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003220929, 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.461 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 927 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:11.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395118+0000", 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4099999999999998e-06 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395130+0000", 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1487e-05 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395161+0000", 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1152999999999998e-05 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395181+0000", 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0273999999999999e-05 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395306+0000", 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124805 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395534+0000", 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000228085 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.396011+0000", 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000477493 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.397356+0000", 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013446199999999999 2024-04-26T12:39:11.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398060+0000", 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070440100000000001 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398223+0000", 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000162855 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398337+0000", 2024-04-26T12:39:11.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113346 2024-04-26T12:39:11.467 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.467 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.467 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.467 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:11.467 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:11.468 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 48.934411582000003, 2024-04-26T12:39:11.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030649560000000002, 2024-04-26T12:39:11.468 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:11.468 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:11.468 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 928 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:11.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398682+0000", 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.43e-06 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398693+0000", 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1324e-05 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398724+0000", 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0926000000000002e-05 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398742+0000", 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398865+0000", 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123542 2024-04-26T12:39:11.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399201+0000", 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033574800000000003 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399744+0000", 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054293600000000005 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401070+0000", 2024-04-26T12:39:11.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013257360000000001 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401546+0000", 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047601000000000002 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401633+0000", 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7225999999999995e-05 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401744+0000", 2024-04-26T12:39:11.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000111195 2024-04-26T12:39:11.474 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.474 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.474 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.474 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:11.474 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:11.474 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:11.475 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:11.476 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:11.470+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:11.576 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:11.574+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:11.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:11.642 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:11.642 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:11.642 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:11.642 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:11.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:11.701 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:11.698+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:11.778 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:11.778+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:11.780 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:11.781 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:11.796 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:11.815 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:11.815 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:11.824 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:11.824 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:11.824 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:11.824 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:11.824 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:11.831 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:11.831 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:11.838 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:11.849 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:11.849 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:11.868 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:11.886 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:11.886 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:11.888 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:11.886+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:11.904 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:11.904 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:11.966 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:11.966 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:11.980 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:11.978+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:11.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:12.081 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:12.078+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:12.144 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:12.145 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:12.159 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:12.201 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:12.198+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:12.283 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:12.282+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:12.323 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:12.323 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:12.338 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:12.384 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:12.382+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:12.464 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:12.464 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:12.478 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:12.528 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:12.526+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:12.586 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:12.586+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:12.602 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:12.602 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:12.616 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:12.687 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:12.686+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:12.781 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:12.781 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:12.788 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:12.786+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:12.796 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:12.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:39:12.893 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:12.894+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:12.918 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:12.918 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:12.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:12.989 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:12.990+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:13.068 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:13.068 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:13.081 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:13.122 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:13.122+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:13.192 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:13.190+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:13.240 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:13.254 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:13.297 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:13.298+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:13.368 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:13.368 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:13.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:13.421 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:13.422+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:13.494 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:13.490+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:13.535 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:13.535 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:13.550 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:13.595 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:13.594+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:13.667 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:13.667 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:13.681 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:13.696 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:13.694+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:13.783 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:39:13.797 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:13.798+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:13.848 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:13.848 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:13.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:13.909 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:13.910+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:13.923 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:14.001 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:14.002+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:14.034 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:14.034 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:14.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:14.091 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:14.100 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:14.098+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:14.108 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:14.109 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:14.125 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:14.125 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:14.155 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:14.176 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:14.176 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:14.197 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:14.197 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:14.200 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:14.198+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:14.207 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:14.208 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:14.208 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:14.218 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:14.218 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:14.221 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:14.238 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:14.239 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:14.302 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:14.302+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:14.366 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:14.366 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:14.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:14.366 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:14.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.366 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:40 5.6 5:66d44ff0:::zonegroup_info.6cf2425f-74db-47a8-896e-35ab7b9def6a:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:39:14.366 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:14.366 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 59.867103923000002, 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031402079999999998, 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497958+0000", 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.922e-06 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497970+0000", 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.136e-05 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497995+0000", 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5279999999999999e-05 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498009+0000", 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3872e-05 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498111+0000", 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101927 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498303+0000", 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019180600000000001 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498553+0000", 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024977300000000001 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.499918+0000", 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001365003 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500885+0000", 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00096762599999999997 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500997+0000", 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111742 2024-04-26T12:39:14.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.501097+0000", 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9896999999999996e-05 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 55.857738488000003, 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047946860000000003, 2024-04-26T12:39:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 52 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507325+0000", 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.717e-06 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507336+0000", 2024-04-26T12:39:14.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1182999999999999e-05 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507370+0000", 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4230000000000003e-05 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507388+0000", 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7453e-05 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507508+0000", 2024-04-26T12:39:14.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012033599999999999 2024-04-26T12:39:14.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507749+0000", 2024-04-26T12:39:14.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024146700000000001 2024-04-26T12:39:14.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:14.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507923+0000", 2024-04-26T12:39:14.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017378700000000001 2024-04-26T12:39:14.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.508980+0000", 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056707 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.511982+0000", 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030022809999999999 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512050+0000", 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7457000000000001e-05 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512117+0000", 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7068000000000002e-05 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.747571612999998, 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036369689999999999, 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:39:14.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617492+0000", 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617505+0000", 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.306e-05 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617536+0000", 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1007000000000003e-05 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617553+0000", 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7629999999999999e-05 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617719+0000", 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016533800000000001 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618065+0000", 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034657399999999999 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618778+0000", 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071317099999999997 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620613+0000", 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018347260000000001 2024-04-26T12:39:14.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620980+0000", 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036717100000000001 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621062+0000", 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1442999999999999e-05 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621126+0000", 2024-04-26T12:39:14.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4085999999999996e-05 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.733928284999998, 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026109499999999999, 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 281 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631132+0000", 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631133+0000", 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0559999999999999e-06 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631139+0000", 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1419999999999998e-06 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631154+0000", 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4893e-05 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631161+0000", 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9179999999999997e-06 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631234+0000", 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2976000000000001e-05 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631374+0000", 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140218 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.631555+0000", 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018107600000000001 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.632139+0000", 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00058337700000000005 2024-04-26T12:39:14.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633653+0000", 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001514123 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633695+0000", 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2208e-05 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.633743+0000", 2024-04-26T12:39:14.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7963000000000001e-05 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.405216901999999, 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035079099999999999, 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959846+0000", 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959860+0000", 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3329999999999999e-05 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959891+0000", 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1576999999999999e-05 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959906+0000", 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4912999999999999e-05 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960018+0000", 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011209600000000001 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960260+0000", 2024-04-26T12:39:14.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024201100000000001 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960602+0000", 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034149700000000001 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.961961+0000", 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013591230000000001 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963193+0000", 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012322399999999999 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963281+0000", 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8306000000000005e-05 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963352+0000", 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0216999999999995e-05 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.364409543999997, 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002916901, 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.397 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000653+0000", 2024-04-26T12:39:14.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:39:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000665+0000", 2024-04-26T12:39:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.187e-05 2024-04-26T12:39:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000696+0000", 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0607e-05 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000712+0000", 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6192999999999999e-05 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000825+0000", 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113213 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001039+0000", 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021364100000000001 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001352+0000", 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000313071 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.002433+0000", 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010811779999999999 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003365+0000", 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093210299999999999 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003449+0000", 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3973000000000004e-05 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003568+0000", 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118542 2024-04-26T12:39:14.402 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.360631716, 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027713579999999998, 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 762 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004429+0000", 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004431+0000", 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.77e-06 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004441+0000", 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0523000000000001e-05 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004467+0000", 2024-04-26T12:39:14.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5522999999999999e-05 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004479+0000", 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2486999999999999e-05 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004586+0000", 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106926 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004721+0000", 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013467199999999999 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.004986+0000", 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026559100000000003 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006110+0000", 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123995 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.006998+0000", 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088729 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007083+0000", 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5871999999999994e-05 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.007200+0000", 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116709 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.408 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.232126901000001, 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028708179999999998, 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-04-26T12:39:14.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132936+0000", 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132949+0000", 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2533e-05 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132980+0000", 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1423000000000001e-05 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132995+0000", 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5e-05 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133125+0000", 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012975899999999999 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133349+0000", 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223842 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133698+0000", 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034930699999999998 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.134765+0000", 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001066808 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135647+0000", 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088210700000000003 2024-04-26T12:39:14.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135735+0000", 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8206000000000002e-05 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135804+0000", 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9103000000000006e-05 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.228298219999999, 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028524739999999998, 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.415 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136764+0000", 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9759999999999998e-06 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136776+0000", 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.133e-05 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136802+0000", 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136822+0000", 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9247000000000001e-05 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136933+0000", 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110946 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137069+0000", 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013615200000000001 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137342+0000", 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027280099999999998 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.138318+0000", 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00097641000000000004 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139458+0000", 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011402669999999999 2024-04-26T12:39:14.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139545+0000", 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6948999999999997e-05 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139615+0000", 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9560000000000005e-05 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.178133277999997, 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028263889999999999, 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 841 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186927+0000", 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186930+0000", 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186944+0000", 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4e-05 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186974+0000", 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0332999999999999e-05 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.186989+0000", 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4776e-05 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187122+0000", 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013347599999999999 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187343+0000", 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022082499999999999 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.187668+0000", 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032438699999999998 2024-04-26T12:39:14.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.188757+0000", 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001089565 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189604+0000", 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084688799999999996 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189689+0000", 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5348999999999999e-05 2024-04-26T12:39:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.189754+0000", 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4159999999999996e-05 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.174089559000002, 2024-04-26T12:39:14.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031280219999999998, 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190973+0000", 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8199999999999999e-06 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190982+0000", 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1530000000000003e-06 2024-04-26T12:39:14.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191006+0000", 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191018+0000", 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191149+0000", 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013097200000000001 2024-04-26T12:39:14.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191397+0000", 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024733099999999999 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191899+0000", 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050217600000000001 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193371+0000", 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014719959999999999 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193942+0000", 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000571475 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194031+0000", 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8696000000000006e-05 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194099+0000", 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.163630843, 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034761900000000001, 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.432 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201432+0000", 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3630000000000001e-06 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201445+0000", 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3016999999999999e-05 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201475+0000", 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9719000000000001e-05 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201490+0000", 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201647+0000", 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156909 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202024+0000", 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037773100000000002 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202591+0000", 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000566992 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.203991+0000", 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013995290000000001 2024-04-26T12:39:14.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204629+0000", 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063768500000000003 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204786+0000", 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015742600000000001 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204906+0000", 2024-04-26T12:39:14.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119869 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.158944939000001, 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034202299999999998, 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.438 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-04-26T12:39:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:14.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206117+0000", 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.68e-06 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206126+0000", 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5900000000000008e-06 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206151+0000", 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4939e-05 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206163+0000", 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2597e-05 2024-04-26T12:39:14.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206291+0000", 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012768600000000001 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206539+0000", 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000248061 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:14.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.207052+0000", 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051334299999999998 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.208330+0000", 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012775060000000001 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209262+0000", 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093203999999999997 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209418+0000", 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015631900000000001 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209536+0000", 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117469 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.444 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.111660190999999, 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027845690000000002, 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 868 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253400+0000", 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253402+0000", 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1830000000000001e-06 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253414+0000", 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1223000000000001e-05 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253444+0000", 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0300000000000001e-05 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253459+0000", 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4749999999999999e-05 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253585+0000", 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126379 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.253813+0000", 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000227498 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.254131+0000", 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031848800000000002 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.255218+0000", 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010869180000000001 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256027+0000", 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080942099999999995 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256114+0000", 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6599000000000002e-05 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.256185+0000", 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0809999999999995e-05 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.018600779000003, 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035106930000000001, 2024-04-26T12:39:14.450 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346462+0000", 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5459999999999998e-06 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346475+0000", 2024-04-26T12:39:14.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2764e-05 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346506+0000", 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1266000000000002e-05 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346521+0000", 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4887e-05 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346676+0000", 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015471800000000001 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347095+0000", 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041862399999999998 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347690+0000", 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059590499999999998 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349002+0000", 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00131185 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349697+0000", 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069428800000000004 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349855+0000", 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015838899999999999 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349970+0000", 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115456 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.014129406999999, 2024-04-26T12:39:14.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003318194, 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:14.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350933+0000", 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350942+0000", 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2429999999999994e-06 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350967+0000", 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4239999999999998e-05 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350981+0000", 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4093e-05 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351122+0000", 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014118299999999999 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351371+0000", 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000249604 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351883+0000", 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051186600000000004 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.353068+0000", 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011850980000000001 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354094+0000", 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010259290000000001 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354181+0000", 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6812999999999997e-05 2024-04-26T12:39:14.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354249+0000", 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8162000000000002e-05 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.462 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.919153473999998, 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028482690000000001, 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-04-26T12:39:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:14.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445910+0000", 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6570000000000001e-06 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445922+0000", 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2806000000000001e-05 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445955+0000", 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2036999999999998e-05 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445970+0000", 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446092+0000", 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121523 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446313+0000", 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022160800000000001 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446651+0000", 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000338074 2024-04-26T12:39:14.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.447983+0000", 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013322029999999999 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448614+0000", 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063038899999999997 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448695+0000", 2024-04-26T12:39:14.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1348999999999997e-05 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448755+0000", 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0139999999999997e-05 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.915420781999998, 2024-04-26T12:39:14.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003146959, 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 951 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449641+0000", 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3230000000000001e-06 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449648+0000", 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1300000000000003e-06 2024-04-26T12:39:14.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449669+0000", 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0809999999999999e-05 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449680+0000", 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1416999999999999e-05 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449805+0000", 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012442200000000001 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449942+0000", 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013762299999999999 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.450223+0000", 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028021699999999998 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.451636+0000", 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001413573 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452587+0000", 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000950799 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452672+0000", 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4735999999999996e-05 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452787+0000", 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011490899999999999 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.904971146000001, 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035247389999999998, 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.485 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:39:14.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460092+0000", 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460105+0000", 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3730000000000001e-05 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460135+0000", 2024-04-26T12:39:14.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9649e-05 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460154+0000", 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8953e-05 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460270+0000", 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011612600000000001 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460494+0000", 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022413199999999999 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460813+0000", 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031844700000000002 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.462087+0000", 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273927 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463222+0000", 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354080000000001 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463434+0000", 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021214500000000001 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463614+0000", 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017984199999999999 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.490 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.900362158999997, 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002995798, 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.491 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464700+0000", 2024-04-26T12:39:14.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.844e-06 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464712+0000", 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1763000000000001e-05 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464738+0000", 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5829999999999998e-05 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464751+0000", 2024-04-26T12:39:14.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3456e-05 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464895+0000", 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143399 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465152+0000", 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025729799999999999 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465636+0000", 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048426300000000002 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.466751+0000", 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011144550000000001 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467488+0000", 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000737501 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467576+0000", 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8252999999999997e-05 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467694+0000", 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117736 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:14.496 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:14.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:14.498 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:14.498+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:14.598 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:14.598+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:14.697 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:14.697 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:14.697 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:14.697 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:14.700 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:14.698+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:14.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:14.801 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:14.798+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:14.882 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:14.882 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:14.883 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:14.883 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:14.883 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:14.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:14.902 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:14.898+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:15.003 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:14.998+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:15.026 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:15.026 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:15.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:15.026 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:15.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.026 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:15.026 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:15.026 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.508616328999999, 2024-04-26T12:39:15.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002983332, 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 56 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515116+0000", 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5550000000000001e-06 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515127+0000", 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0899e-05 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515152+0000", 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.561e-05 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515165+0000", 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2727e-05 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515291+0000", 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000125628 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515490+0000", 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000199452 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515690+0000", 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000200189 2024-04-26T12:39:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517095+0000", 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014043860000000001 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517890+0000", 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079524999999999995 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518006+0000", 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011569 2024-04-26T12:39:15.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518097+0000", 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0946000000000006e-05 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889461985664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.505499804999999, 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030541930000000002, 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.032 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518232+0000", 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7430000000000001e-06 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518239+0000", 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1670000000000002e-06 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518263+0000", 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4786e-05 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518276+0000", 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2394e-05 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518374+0000", 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8544999999999999e-05 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518533+0000", 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000158763 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518836+0000", 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030328000000000001 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.520242+0000", 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001405643 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521076+0000", 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083431100000000002 2024-04-26T12:39:15.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521187+0000", 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110714 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521284+0000", 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6847000000000003e-05 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.037 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889461986816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.502668497000002, 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003156112, 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 59 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521063+0000", 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9599999999999999e-06 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521074+0000", 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521105+0000", 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1199999999999999e-05 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521125+0000", 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9806999999999999e-05 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521260+0000", 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013498500000000001 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521472+0000", 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021194900000000001 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521908+0000", 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043670900000000002 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523344+0000", 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001435579 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524086+0000", 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000741805 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524148+0000", 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2408000000000003e-05 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524217+0000", 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9016999999999993e-05 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.51931312, 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046495770000000002, 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.043 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504420+0000", 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504437+0000", 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6926e-05 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504481+0000", 2024-04-26T12:39:15.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3946999999999998e-05 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504506+0000", 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4986000000000001e-05 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504777+0000", 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027106100000000001 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505020+0000", 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024332499999999999 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505444+0000", 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000423783 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.507435+0000", 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019909950000000002 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508814+0000", 2024-04-26T12:39:15.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001378799 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508964+0000", 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014972600000000001 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509066+0000", 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010223200000000001 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.479974593000001, 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003567382, 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543758+0000", 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.286e-06 2024-04-26T12:39:15.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543774+0000", 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.571e-05 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543813+0000", 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9110000000000003e-05 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543831+0000", 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8139999999999999e-05 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543962+0000", 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130832 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544216+0000", 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025436099999999999 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544648+0000", 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043157999999999998 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.546300+0000", 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001651661 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547173+0000", 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087328999999999998 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547258+0000", 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4878999999999998e-05 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547322+0000", 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4533e-05 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.439274441000002, 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035366059999999999, 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.054 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584458+0000", 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999999e-06 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584469+0000", 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.165e-05 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584501+0000", 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2005999999999998e-05 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584526+0000", 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4683000000000001e-05 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584654+0000", 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012805299999999999 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584869+0000", 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021525400000000001 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.585275+0000", 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00040564399999999998 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.586816+0000", 2024-04-26T12:39:15.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015407579999999999 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587844+0000", 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010284020000000001 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587927+0000", 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3286000000000002e-05 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587992+0000", 2024-04-26T12:39:15.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4323000000000001e-05 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.431974693999997, 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029981999999999999, 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591757+0000", 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591769+0000", 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1600000000000001e-05 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591799+0000", 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0543000000000002e-05 2024-04-26T12:39:15.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591825+0000", 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5752e-05 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591941+0000", 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116143 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592156+0000", 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021444899999999999 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592548+0000", 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039236700000000002 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594185+0000", 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016373469999999999 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594615+0000", 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042984300000000001 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594692+0000", 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.695e-05 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594753+0000", 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0869000000000003e-05 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.065 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.424439362000001, 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033442010000000002, 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-04-26T12:39:15.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.067 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:15.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599292+0000", 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9769999999999999e-06 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599303+0000", 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0386e-05 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599334+0000", 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1087000000000002e-05 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599356+0000", 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2138999999999999e-05 2024-04-26T12:39:15.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599475+0000", 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119589 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599696+0000", 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022040199999999999 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:15.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.600100+0000", 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000404044 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.601568+0000", 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001468001 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602489+0000", 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092147699999999997 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602571+0000", 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1818999999999997e-05 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602634+0000", 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3280000000000004e-05 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.125588368000003, 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034449799999999998, 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.073 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898143+0000", 2024-04-26T12:39:15.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898153+0000", 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0176999999999999e-05 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898180+0000", 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6781999999999999e-05 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898202+0000", 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1605000000000001e-05 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898329+0000", 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127367 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898546+0000", 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021638199999999999 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898892+0000", 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034662799999999998 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.900063+0000", 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171184 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901429+0000", 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013658990000000001 2024-04-26T12:39:15.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901525+0000", 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5433000000000006e-05 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901586+0000", 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1463000000000004e-05 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.078160508000003, 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030447159999999998, 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 736 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945571+0000", 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:15.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945585+0000", 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3766e-05 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945616+0000", 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1254000000000003e-05 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945632+0000", 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5296000000000001e-05 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945745+0000", 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011295599999999999 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945978+0000", 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023348800000000001 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.946293+0000", 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000314958 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.947440+0000", 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011467440000000001 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948328+0000", 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088776000000000002 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948494+0000", 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016587899999999999 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948614+0000", 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012025500000000001 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.074200005999998, 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003238646, 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 738 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.085 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949531+0000", 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7069999999999999e-06 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949541+0000", 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949566+0000", 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5533000000000001e-05 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949579+0000", 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.236e-05 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949722+0000", 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014327200000000001 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949970+0000", 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024837500000000001 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:15.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.950482+0000", 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051128299999999996 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.951825+0000", 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013431630000000001 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952625+0000", 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080046700000000002 2024-04-26T12:39:15.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952705+0000", 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9869000000000004e-05 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952768+0000", 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3057000000000003e-05 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.090 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:774 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.992379663999998, 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029121680000000001, 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.091 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 774 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031352+0000", 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9700000000000002e-06 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031361+0000", 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.414e-06 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031387+0000", 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031399+0000", 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2377e-05 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031574+0000", 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017496800000000001 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031715+0000", 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031989+0000", 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027419800000000002 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.033007+0000", 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010173319999999999 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034110+0000", 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001102879 2024-04-26T12:39:15.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034192+0000", 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2346000000000001e-05 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034262+0000", 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0185999999999995e-05 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.096 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.982762223999998, 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028610879999999999, 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 778 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040970+0000", 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:15.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040981+0000", 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1703e-05 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041013+0000", 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1303000000000002e-05 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041030+0000", 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7493e-05 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041206+0000", 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017595499999999999 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041420+0000", 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021373200000000001 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041722+0000", 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030209799999999999 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.042818+0000", 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001095738 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043676+0000", 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085838699999999995 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043762+0000", 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6521999999999996e-05 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043828+0000", 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5957000000000006e-05 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.102 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.978778204999998, 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032202580000000001, 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 780 2024-04-26T12:39:15.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044954+0000", 2024-04-26T12:39:15.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045055+0000", 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010158900000000001 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045427+0000", 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037136100000000001 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045461+0000", 2024-04-26T12:39:15.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4193000000000003e-05 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045615+0000", 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000153652 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045815+0000", 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020044799999999999 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:15.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.046189+0000", 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037399699999999999 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.047313+0000", 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123899 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048021+0000", 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070842099999999999 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048105+0000", 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3152999999999995e-05 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048172+0000", 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7012000000000001e-05 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.108 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.92454257, 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028409210000000002, 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.109 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099190+0000", 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099202+0000", 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2019e-05 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099233+0000", 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1093000000000002e-05 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099247+0000", 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4579999999999999e-05 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099361+0000", 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113723 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099573+0000", 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021191499999999999 2024-04-26T12:39:15.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099895+0000", 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032170099999999997 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101037+0000", 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011427270000000001 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101880+0000", 2024-04-26T12:39:15.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084234700000000002 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101964+0000", 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3856000000000005e-05 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.102028+0000", 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4220000000000005e-05 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.114 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.763853896999997, 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028492639999999998, 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.115 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 871 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259878+0000", 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0930000000000001e-06 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259888+0000", 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0713999999999999e-05 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259917+0000", 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8276000000000002e-05 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259931+0000", 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4032999999999999e-05 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260072+0000", 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141326 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260299+0000", 2024-04-26T12:39:15.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022688799999999999 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260617+0000", 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031782099999999998 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.261683+0000", 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001065812 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262584+0000", 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00090090600000000004 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262665+0000", 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1578999999999999e-05 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262725+0000", 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9815999999999998e-05 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.700929893000001, 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028604580000000002, 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.121 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 897 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322801+0000", 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.536e-06 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322810+0000", 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3340000000000002e-06 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322835+0000", 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5136000000000001e-05 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322854+0000", 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8853000000000001e-05 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322990+0000", 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000136169 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323117+0000", 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012680600000000001 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323392+0000", 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027538500000000001 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.324484+0000", 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001092462 2024-04-26T12:39:15.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325508+0000", 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001023272 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325595+0000", 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6889000000000001e-05 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325660+0000", 2024-04-26T12:39:15.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5616000000000003e-05 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.697851872999998, 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003075749, 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.127 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325880+0000", 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9259999999999999e-06 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325889+0000", 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8600000000000005e-06 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325918+0000", 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9006999999999999e-05 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325939+0000", 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0863e-05 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326058+0000", 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011906899999999999 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326273+0000", 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000214355 2024-04-26T12:39:15.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326585+0000", 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031177800000000002 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.327864+0000", 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012790430000000001 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328808+0000", 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094398300000000002 2024-04-26T12:39:15.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328893+0000", 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5263e-05 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328953+0000", 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0602e-05 2024-04-26T12:39:15.132 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.605580091999997, 2024-04-26T12:39:15.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002915997, 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:15.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418151+0000", 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.75e-06 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418161+0000", 2024-04-26T12:39:15.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418187+0000", 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6417000000000001e-05 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418207+0000", 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9902999999999999e-05 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418335+0000", 2024-04-26T12:39:15.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127892 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418570+0000", 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023533500000000001 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418956+0000", 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038606699999999997 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420042+0000", 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001086175 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420918+0000", 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087580700000000004 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421002+0000", 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4239000000000004e-05 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421065+0000", 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.601667601999999, 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028511209999999999, 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:15.139 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 939 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422063+0000", 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5200000000000001e-06 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422074+0000", 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0407e-05 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422100+0000", 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5848999999999999e-05 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422119+0000", 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422268+0000", 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148899 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422392+0000", 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012443900000000001 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422672+0000", 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000279368 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.423773+0000", 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001101582 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424766+0000", 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099285499999999995 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424852+0000", 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5913000000000002e-05 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424913+0000", 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1136000000000006e-05 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:15.144 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:15.146 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:15.146 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:15.142+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:15.247 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:15.246+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:15.277 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:15.277 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:15.277 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:15.277 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:15.291 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:15.348 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:15.346+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:15.414 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:15.415 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:15.415 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:15.415 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:15.415 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:15.429 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:15.472 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:15.470+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:15.550 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:15.546+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:15.595 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:15.595 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:15.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:15.595 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:15.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.133960412, 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011918331000000001, 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "reached pg", 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 43 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457566+0000", 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5530000000000001e-06 2024-04-26T12:39:15.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457583+0000", 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7654000000000001e-05 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457626+0000", 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2110000000000002e-05 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457652+0000", 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6789000000000001e-05 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457863+0000", 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000210225 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457885+0000", 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2456999999999999e-05 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469169+0000", 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011284343 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469481+0000", 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031119999999999997 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.600 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.066760573000003, 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003553853, 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 211 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:15.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524766+0000", 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0829999999999997e-06 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524786+0000", 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9494e-05 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524830+0000", 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4240000000000003e-05 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524856+0000", 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5703000000000001e-05 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525044+0000", 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018797799999999999 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525374+0000", 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033005099999999999 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525827+0000", 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045309000000000001 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.527234+0000", 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014076259999999999 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528147+0000", 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091301299999999995 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528241+0000", 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3466000000000003e-05 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528316+0000", 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.987534721000003, 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003758815, 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.606 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 232 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603990+0000", 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.357e-06 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604002+0000", 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.154e-05 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604033+0000", 2024-04-26T12:39:15.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1136999999999997e-05 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604049+0000", 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5869e-05 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604216+0000", 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167615 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604567+0000", 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035053100000000001 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.605359+0000", 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079155700000000002 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607196+0000", 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018378699999999999 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607588+0000", 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039154700000000001 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607677+0000", 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9319000000000003e-05 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607747+0000", 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9473000000000004e-05 2024-04-26T12:39:15.611 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:243 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.966202385000003, 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032017550000000001, 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.612 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 243 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625323+0000", 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8399999999999999e-06 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625338+0000", 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4637000000000001e-05 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625375+0000", 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7648999999999998e-05 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625396+0000", 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1047e-05 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625563+0000", 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016640900000000001 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625966+0000", 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040301699999999998 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:15.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.626371+0000", 2024-04-26T12:39:15.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040509600000000003 2024-04-26T12:39:15.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.627764+0000", 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001393266 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628199+0000", 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043461599999999997 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628404+0000", 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020512899999999999 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628522+0000", 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011804899999999999 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.961005372000002, 2024-04-26T12:39:15.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032314010000000001, 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 276 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630519+0000", 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1459999999999999e-06 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630532+0000", 2024-04-26T12:39:15.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2604e-05 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630558+0000", 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630576+0000", 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630750+0000", 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173392 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631068+0000", 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031842099999999999 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631575+0000", 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00050638899999999999 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.632975+0000", 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001400486 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633495+0000", 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051948900000000004 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633635+0000", 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000140972 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633749+0000", 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113239 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:295 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.625 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.956641058999999, 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032101120000000002, 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 295 2024-04-26T12:39:15.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634883+0000", 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.204e-06 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634891+0000", 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0830000000000004e-06 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634905+0000", 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.382e-05 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634926+0000", 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1243e-05 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635316+0000", 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039014699999999998 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635549+0000", 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023250500000000001 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.636038+0000", 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048965300000000005 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637344+0000", 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001305683 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637862+0000", 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051851600000000001 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637977+0000", 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114926 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638092+0000", 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114332 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:355 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.947780053999999, 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003073569, 2024-04-26T12:39:15.632 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 355 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643745+0000", 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2859999999999998e-06 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643758+0000", 2024-04-26T12:39:15.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2644e-05 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643805+0000", 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7763000000000003e-05 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643825+0000", 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9375999999999999e-05 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643970+0000", 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014545199999999999 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644263+0000", 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029315800000000001 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644807+0000", 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054336300000000005 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646108+0000", 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001300896 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646628+0000", 2024-04-26T12:39:15.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052052000000000001 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646730+0000", 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102229 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646816+0000", 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5882000000000002e-05 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.638 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:408 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.926631733999997, 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029401380000000001, 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.639 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 408 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664894+0000", 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664906+0000", 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2323e-05 2024-04-26T12:39:15.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664953+0000", 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6594000000000001e-05 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664967+0000", 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4813e-05 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665094+0000", 2024-04-26T12:39:15.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012636200000000001 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665327+0000", 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233172 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665786+0000", 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045890599999999997 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667078+0000", 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012926400000000001 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667564+0000", 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048546700000000001 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667708+0000", 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014418800000000001 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667831+0000", 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123013 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:497 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.865708112, 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046691349999999996, 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.645 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 497 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725817+0000", 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725830+0000", 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2672e-05 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725862+0000", 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2042000000000003e-05 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725930+0000", 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7731000000000006e-05 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726082+0000", 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152929 2024-04-26T12:39:15.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726313+0000", 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023097499999999999 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726729+0000", 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041546699999999998 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729760+0000", 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003031083 2024-04-26T12:39:15.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730288+0000", 2024-04-26T12:39:15.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052804299999999996 2024-04-26T12:39:15.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730419+0000", 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013093499999999999 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730484+0000", 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4772999999999998e-05 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.651 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.771909635, 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002976111, 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 633 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819615+0000", 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7269999999999999e-06 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819626+0000", 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819660+0000", 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4079999999999999e-05 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819679+0000", 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9103e-05 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819807+0000", 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012822899999999999 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820044+0000", 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023652800000000001 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820418+0000", 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037437400000000002 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.821605+0000", 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011867939999999999 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822310+0000", 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070503099999999995 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822480+0000", 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170089 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822589+0000", 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010892599999999999 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.665298753999998, 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030753500000000001, 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 727 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926226+0000", 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1129999999999999e-06 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926237+0000", 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926265+0000", 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.864e-05 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926283+0000", 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7949999999999999e-05 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926378+0000", 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5081999999999995e-05 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926590+0000", 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021203500000000001 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926950+0000", 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035924399999999999 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.928069+0000", 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001119302 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929136+0000", 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001066542 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929227+0000", 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1142000000000003e-05 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929299+0000", 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2620000000000006e-05 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:15.662 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.478191117999998, 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029575529999999999, 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 808 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113334+0000", 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113347+0000", 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.288e-05 2024-04-26T12:39:15.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113378+0000", 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1056000000000002e-05 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113394+0000", 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5616000000000001e-05 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113541+0000", 2024-04-26T12:39:15.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147412 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113767+0000", 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225372 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.114085+0000", 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031803799999999998 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.115306+0000", 2024-04-26T12:39:15.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012213 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116132+0000", 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00082585700000000005 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116224+0000", 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2392999999999994e-05 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116289+0000", 2024-04-26T12:39:15.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4999000000000006e-05 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.460697437, 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028474419999999999, 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.668 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 816 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130827+0000", 2024-04-26T12:39:15.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7239999999999999e-06 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130836+0000", 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0729999999999994e-06 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130857+0000", 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1396999999999999e-05 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130870+0000", 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2363e-05 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130982+0000", 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112509 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131114+0000", 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131779 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131385+0000", 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027119500000000001 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.132710+0000", 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013251059999999999 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133474+0000", 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00076380800000000004 2024-04-26T12:39:15.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133565+0000", 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0785000000000006e-05 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133673+0000", 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107703 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.309930166999997, 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029548180000000001, 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 880 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.674 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281595+0000", 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.92e-06 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281608+0000", 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281639+0000", 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0263000000000001e-05 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281654+0000", 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5613000000000001e-05 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281790+0000", 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013560300000000001 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282021+0000", 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023109399999999999 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282352+0000", 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033127100000000001 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.283508+0000", 2024-04-26T12:39:15.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011555820000000001 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284259+0000", 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075111399999999999 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284429+0000", 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017024499999999999 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284547+0000", 2024-04-26T12:39:15.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118193 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.305554440000002, 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049047079999999998, 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.679 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 882 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285970+0000", 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285981+0000", 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0993e-05 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286015+0000", 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3309999999999998e-05 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286034+0000", 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8936e-05 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286154+0000", 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011998900000000001 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286385+0000", 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000231585 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286882+0000", 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000496763 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.288886+0000", 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002004207 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290664+0000", 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017773800000000001 2024-04-26T12:39:15.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290757+0000", 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3616000000000006e-05 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290873+0000", 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011579899999999999 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.300302094999999, 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030718659999999999, 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 883 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291223+0000", 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2869999999999999e-06 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291234+0000", 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1596999999999999e-05 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291265+0000", 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.044e-05 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291283+0000", 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7878999999999999e-05 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291402+0000", 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119406 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291649+0000", 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024725499999999999 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291980+0000", 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033056999999999997 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.293099+0000", 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011188979999999999 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294018+0000", 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091867000000000001 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294175+0000", 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015740200000000001 2024-04-26T12:39:15.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294292+0000", 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011746199999999999 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.296012703999999, 2024-04-26T12:39:15.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032575410000000001, 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 885 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295511+0000", 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3060000000000001e-06 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295518+0000", 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295538+0000", 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9409999999999999e-05 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295549+0000", 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1328999999999999e-05 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295669+0000", 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119616 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295892+0000", 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223799 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.296415+0000", 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052249900000000005 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.297588+0000", 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011734740000000001 2024-04-26T12:39:15.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298501+0000", 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091317000000000004 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298652+0000", 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015026199999999999 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298768+0000", 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115779 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.229134250000001, 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030403560000000001, 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.696 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 913 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362391+0000", 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362407+0000", 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6066000000000002e-05 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362437+0000", 2024-04-26T12:39:15.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9728999999999999e-05 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362452+0000", 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5147000000000001e-05 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362568+0000", 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116172 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362806+0000", 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023781900000000001 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.363150+0000", 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000344144 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.364211+0000", 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010614979999999999 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365228+0000", 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001016669 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365315+0000", 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6496000000000007e-05 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365429+0000", 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114226 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.701 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.196406926999998, 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003220929, 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 927 2024-04-26T12:39:15.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395118+0000", 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4099999999999998e-06 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395130+0000", 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1487e-05 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395161+0000", 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1152999999999998e-05 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395181+0000", 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0273999999999999e-05 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395306+0000", 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124805 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395534+0000", 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000228085 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:15.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.396011+0000", 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000477493 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.397356+0000", 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013446199999999999 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398060+0000", 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070440100000000001 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398223+0000", 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000162855 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398337+0000", 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113346 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.707 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.192843584000002, 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030649560000000002, 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 928 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.708 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:15.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398682+0000", 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.43e-06 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398693+0000", 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1324e-05 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398724+0000", 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0926000000000002e-05 2024-04-26T12:39:15.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398742+0000", 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398865+0000", 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123542 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399201+0000", 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033574800000000003 2024-04-26T12:39:15.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399744+0000", 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054293600000000005 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401070+0000", 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013257360000000001 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401546+0000", 2024-04-26T12:39:15.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047601000000000002 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401633+0000", 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7225999999999995e-05 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401744+0000", 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000111195 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.713 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:15.714 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:15.714 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:15.715 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:15.716 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:15.710+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:15.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:39:15.819 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:15.814+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:15.885 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:15.885 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:15.885 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:15.885 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:15.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:15.920 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:15.918+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:16.022 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:16.022+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:16.062 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:16.062 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:16.062 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:16.062 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:16.062 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:16.076 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:16.123 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:16.122+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:16.196 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:16.196 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:16.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:16.196 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:16.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.704009919000001, 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.197 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:39:16.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.687313283999998, 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.203 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:16.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:39:16.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.208 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.683506796000003, 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:39:16.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:39:16.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:39:16.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.695259829999998, 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.213 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:16.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.218 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.633310258000002, 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:16.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:39:16.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:39:16.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.622433282000003, 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.224 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:16.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.611044675999999, 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.231 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:16.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:39:16.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:39:16.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:39:16.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.236 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.517790546000001, 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.515769009000003, 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.242 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.512848423999998, 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:39:16.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.512567996000001, 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.253 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.507842955999998, 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.259 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:39:16.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:39:16.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.264 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.504620906, 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:39:16.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:39:16.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:39:16.268 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.503139046000001, 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:39:16.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.501900415000001, 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.273 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.278 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.498915707999998, 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:39:16.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:39:16.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:39:16.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.496824857, 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.283 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:39:16.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:39:16.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.484657829, 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:39:16.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:39:16.293 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.476061285, 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:16.294 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:39:16.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:39:16.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:16.299 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.463901798000002, 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:16.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:16.303 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:16.304 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:16.305 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:16.305 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:16.302+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:16.405 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:16.406+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:16.479 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:16.480 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:16.480 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:16.480 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:16.482 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:16.482 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:16.494 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:16.501 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:16.501 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:16.506 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:16.506+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:16.520 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:16.520 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:16.538 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:16.538 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:16.556 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:16.573 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:16.574 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:16.594 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:16.594 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:16.607 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:16.602+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:16.613 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:16.613 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:16.620 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:16.620 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:16.627 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:16.733 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:16.730+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:16.796 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:39:16.809 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:16.806+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:16.810 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:16.810 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:16.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:16.911 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:16.910+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:16.985 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:16.985 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:16.999 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:17.045 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:17.042+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:17.113 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:17.110+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:17.124 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:17.124 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:17.139 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:17.234 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:17.230+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:17.310 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:17.310 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:17.315 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:17.314+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:17.324 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:17.416 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:17.414+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:17.451 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:17.451 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:17.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:17.517 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:17.514+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:17.582 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:17.582 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:17.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:17.638 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:17.638+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:17.719 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:17.714+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:17.763 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:17.763 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:17.777 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:17.821 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:17.822+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:17.900 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:17.901 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:17.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:17.921 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:17.918+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:18.022 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:18.022+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:18.087 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:18.087 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:18.100 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:18.123 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:18.118+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:18.224 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:18.222+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:18.254 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:18.254 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:18.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:18.325 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:18.322+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:18.426 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:18.422+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:18.430 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:18.430 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:18.444 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:18.526 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:18.522+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:18.560 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:18.561 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:18.573 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:18.627 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:18.626+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:18.634 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:18.710 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:18.710 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:18.724 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:18.728 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:18.726+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:18.798 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:18.798 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:18.818 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:18.818 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:18.821 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:39:18.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:18.837 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:18.837 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:18.834+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:18.847 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:18.847 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:18.856 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:18.856 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:18.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:18.878 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:18.878 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:18.905 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:18.905 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:18.930 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:18.926+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:18.939 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:18.940 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:18.974 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:18.974 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:18.995 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:18.995 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:18.995 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:18.995 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:18.996 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:19.010 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:19.058 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:19.058+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:19.132 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:19.130+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:19.180 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 60.662383290999998, 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002983332, 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 56 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515116+0000", 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5550000000000001e-06 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515127+0000", 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0899e-05 2024-04-26T12:39:19.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515152+0000", 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.561e-05 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515165+0000", 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2727e-05 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515291+0000", 2024-04-26T12:39:19.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000125628 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515490+0000", 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000199452 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515690+0000", 2024-04-26T12:39:19.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000200189 2024-04-26T12:39:19.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517095+0000", 2024-04-26T12:39:19.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014043860000000001 2024-04-26T12:39:19.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517890+0000", 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079524999999999995 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518006+0000", 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011569 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518097+0000", 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0946000000000006e-05 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889461985664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 60.659266766999998, 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030541930000000002, 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518232+0000", 2024-04-26T12:39:19.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7430000000000001e-06 2024-04-26T12:39:19.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518239+0000", 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1670000000000002e-06 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518263+0000", 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4786e-05 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518276+0000", 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2394e-05 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518374+0000", 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8544999999999999e-05 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518533+0000", 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000158763 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518836+0000", 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030328000000000001 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.520242+0000", 2024-04-26T12:39:19.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001405643 2024-04-26T12:39:19.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521076+0000", 2024-04-26T12:39:19.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083431100000000002 2024-04-26T12:39:19.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521187+0000", 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110714 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521284+0000", 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6847000000000003e-05 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.194 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889461986816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 60.656435459000001, 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003156112, 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 59 2024-04-26T12:39:19.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:19.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521063+0000", 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9599999999999999e-06 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521074+0000", 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:19.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521105+0000", 2024-04-26T12:39:19.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1199999999999999e-05 2024-04-26T12:39:19.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521125+0000", 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9806999999999999e-05 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521260+0000", 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013498500000000001 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521472+0000", 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021194900000000001 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521908+0000", 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043670900000000002 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523344+0000", 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001435579 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524086+0000", 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000741805 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524148+0000", 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2408000000000003e-05 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524217+0000", 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9016999999999993e-05 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.673080081999998, 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046495770000000002, 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.202 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:19.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:19.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504420+0000", 2024-04-26T12:39:19.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:39:19.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504437+0000", 2024-04-26T12:39:19.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6926e-05 2024-04-26T12:39:19.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504481+0000", 2024-04-26T12:39:19.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3946999999999998e-05 2024-04-26T12:39:19.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504506+0000", 2024-04-26T12:39:19.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4986000000000001e-05 2024-04-26T12:39:19.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504777+0000", 2024-04-26T12:39:19.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027106100000000001 2024-04-26T12:39:19.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505020+0000", 2024-04-26T12:39:19.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024332499999999999 2024-04-26T12:39:19.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:19.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505444+0000", 2024-04-26T12:39:19.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000423783 2024-04-26T12:39:19.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.507435+0000", 2024-04-26T12:39:19.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019909950000000002 2024-04-26T12:39:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508814+0000", 2024-04-26T12:39:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001378799 2024-04-26T12:39:19.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508964+0000", 2024-04-26T12:39:19.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014972600000000001 2024-04-26T12:39:19.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509066+0000", 2024-04-26T12:39:19.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010223200000000001 2024-04-26T12:39:19.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.212 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.213 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.213 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:19.213 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.633741555, 2024-04-26T12:39:19.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003567382, 2024-04-26T12:39:19.213 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.213 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:19.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543758+0000", 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.286e-06 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543774+0000", 2024-04-26T12:39:19.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.571e-05 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543813+0000", 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9110000000000003e-05 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543831+0000", 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8139999999999999e-05 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543962+0000", 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130832 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544216+0000", 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025436099999999999 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544648+0000", 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043157999999999998 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.546300+0000", 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001651661 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547173+0000", 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087328999999999998 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547258+0000", 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4878999999999998e-05 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547322+0000", 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4533e-05 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.593041403000001, 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035366059999999999, 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.219 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:19.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584458+0000", 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999999e-06 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584469+0000", 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.165e-05 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584501+0000", 2024-04-26T12:39:19.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2005999999999998e-05 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584526+0000", 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4683000000000001e-05 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584654+0000", 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012805299999999999 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584869+0000", 2024-04-26T12:39:19.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021525400000000001 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.585275+0000", 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00040564399999999998 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.586816+0000", 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015407579999999999 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587844+0000", 2024-04-26T12:39:19.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010284020000000001 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587927+0000", 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3286000000000002e-05 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587992+0000", 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4323000000000001e-05 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.585741656000003, 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029981999999999999, 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591757+0000", 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591769+0000", 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1600000000000001e-05 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591799+0000", 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0543000000000002e-05 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591825+0000", 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5752e-05 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591941+0000", 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116143 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592156+0000", 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021444899999999999 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592548+0000", 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039236700000000002 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594185+0000", 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016373469999999999 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594615+0000", 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042984300000000001 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594692+0000", 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.695e-05 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594753+0000", 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0869000000000003e-05 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.578206324, 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033442010000000002, 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.230 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599292+0000", 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9769999999999999e-06 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599303+0000", 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0386e-05 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599334+0000", 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1087000000000002e-05 2024-04-26T12:39:19.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599356+0000", 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2138999999999999e-05 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599475+0000", 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119589 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599696+0000", 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022040199999999999 2024-04-26T12:39:19.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.600100+0000", 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000404044 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.601568+0000", 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001468001 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602489+0000", 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092147699999999997 2024-04-26T12:39:19.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602571+0000", 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1818999999999997e-05 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602634+0000", 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3280000000000004e-05 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.235 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.279355330000001, 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034449799999999998, 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898143+0000", 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898153+0000", 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0176999999999999e-05 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898180+0000", 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6781999999999999e-05 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898202+0000", 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1605000000000001e-05 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898329+0000", 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127367 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898546+0000", 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021638199999999999 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898892+0000", 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034662799999999998 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.900063+0000", 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171184 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901429+0000", 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013658990000000001 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901525+0000", 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5433000000000006e-05 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901586+0000", 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1463000000000004e-05 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.231927470000002, 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030447159999999998, 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 736 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945571+0000", 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945585+0000", 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3766e-05 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945616+0000", 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1254000000000003e-05 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945632+0000", 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5296000000000001e-05 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945745+0000", 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011295599999999999 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945978+0000", 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023348800000000001 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.946293+0000", 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000314958 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.947440+0000", 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011467440000000001 2024-04-26T12:39:19.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948328+0000", 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088776000000000002 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948494+0000", 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016587899999999999 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948614+0000", 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012025500000000001 2024-04-26T12:39:19.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.227966967999997, 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003238646, 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.247 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 738 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949531+0000", 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7069999999999999e-06 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949541+0000", 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949566+0000", 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5533000000000001e-05 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949579+0000", 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.236e-05 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949722+0000", 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014327200000000001 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949970+0000", 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024837500000000001 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.950482+0000", 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051128299999999996 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.951825+0000", 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013431630000000001 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952625+0000", 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080046700000000002 2024-04-26T12:39:19.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952705+0000", 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9869000000000004e-05 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952768+0000", 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3057000000000003e-05 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.252 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:774 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.146146625999997, 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029121680000000001, 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 774 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:19.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031352+0000", 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9700000000000002e-06 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031361+0000", 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.414e-06 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031387+0000", 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031399+0000", 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2377e-05 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031574+0000", 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017496800000000001 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031715+0000", 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031989+0000", 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027419800000000002 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.033007+0000", 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010173319999999999 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034110+0000", 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001102879 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034192+0000", 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2346000000000001e-05 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034262+0000", 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0185999999999995e-05 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.136529185999997, 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028610879999999999, 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.258 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 778 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040970+0000", 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040981+0000", 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1703e-05 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041013+0000", 2024-04-26T12:39:19.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1303000000000002e-05 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041030+0000", 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7493e-05 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041206+0000", 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017595499999999999 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041420+0000", 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021373200000000001 2024-04-26T12:39:19.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041722+0000", 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030209799999999999 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.042818+0000", 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001095738 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043676+0000", 2024-04-26T12:39:19.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085838699999999995 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043762+0000", 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6521999999999996e-05 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043828+0000", 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5957000000000006e-05 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.132545167000004, 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032202580000000001, 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 780 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044954+0000", 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045055+0000", 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010158900000000001 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045427+0000", 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037136100000000001 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045461+0000", 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4193000000000003e-05 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045615+0000", 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000153652 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045815+0000", 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020044799999999999 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.046189+0000", 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037399699999999999 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.047313+0000", 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123899 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048021+0000", 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070842099999999999 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048105+0000", 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3152999999999995e-05 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048172+0000", 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7012000000000001e-05 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.078309531999999, 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028409210000000002, 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.269 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:19.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099190+0000", 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099202+0000", 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2019e-05 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099233+0000", 2024-04-26T12:39:19.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1093000000000002e-05 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099247+0000", 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4579999999999999e-05 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099361+0000", 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113723 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099573+0000", 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021191499999999999 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099895+0000", 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032170099999999997 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101037+0000", 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011427270000000001 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101880+0000", 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084234700000000002 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101964+0000", 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3856000000000005e-05 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.102028+0000", 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4220000000000005e-05 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.917620859000003, 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028492639999999998, 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 871 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259878+0000", 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0930000000000001e-06 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259888+0000", 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0713999999999999e-05 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259917+0000", 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8276000000000002e-05 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259931+0000", 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4032999999999999e-05 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260072+0000", 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141326 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260299+0000", 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022688799999999999 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260617+0000", 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031782099999999998 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.261683+0000", 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001065812 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262584+0000", 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00090090600000000004 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262665+0000", 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1578999999999999e-05 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262725+0000", 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9815999999999998e-05 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.854696855, 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028604580000000002, 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.280 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 897 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:19.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322801+0000", 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.536e-06 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322810+0000", 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3340000000000002e-06 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322835+0000", 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5136000000000001e-05 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322854+0000", 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8853000000000001e-05 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322990+0000", 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000136169 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323117+0000", 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012680600000000001 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323392+0000", 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027538500000000001 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.324484+0000", 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001092462 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325508+0000", 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001023272 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325595+0000", 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6889000000000001e-05 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325660+0000", 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5616000000000003e-05 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.851618834999996, 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003075749, 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.286 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325880+0000", 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9259999999999999e-06 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325889+0000", 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8600000000000005e-06 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325918+0000", 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9006999999999999e-05 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325939+0000", 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0863e-05 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326058+0000", 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011906899999999999 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326273+0000", 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000214355 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326585+0000", 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031177800000000002 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.327864+0000", 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012790430000000001 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328808+0000", 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094398300000000002 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328893+0000", 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5263e-05 2024-04-26T12:39:19.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328953+0000", 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0602e-05 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.759347054000003, 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002915997, 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.291 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:19.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418151+0000", 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.75e-06 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418161+0000", 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418187+0000", 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6417000000000001e-05 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418207+0000", 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9902999999999999e-05 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418335+0000", 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127892 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418570+0000", 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023533500000000001 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418956+0000", 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038606699999999997 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420042+0000", 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001086175 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420918+0000", 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087580700000000004 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421002+0000", 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4239000000000004e-05 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421065+0000", 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.755434563999998, 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028511209999999999, 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 939 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.297 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422063+0000", 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5200000000000001e-06 2024-04-26T12:39:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422074+0000", 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0407e-05 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422100+0000", 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5848999999999999e-05 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422119+0000", 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:39:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422268+0000", 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148899 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422392+0000", 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012443900000000001 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422672+0000", 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000279368 2024-04-26T12:39:19.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.423773+0000", 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001101582 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424766+0000", 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099285499999999995 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424852+0000", 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5913000000000002e-05 2024-04-26T12:39:19.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424913+0000", 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1136000000000006e-05 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:19.302 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:19.304 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:19.304 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:19.298+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:19.405 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:19.402+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:19.436 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:19.436 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:19.437 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:19.437 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:19.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:19.506 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:19.506+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:19.607 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:19.606+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:19.616 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:19.616 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:19.616 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:19.616 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:19.616 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:19.630 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:19.708 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:19.706+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:19.751 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:19.751 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:19.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:19.751 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:19.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.751 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:39:19.751 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:19.751 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.28993577, 2024-04-26T12:39:19.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011918331000000001, 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "reached pg", 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 43 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457566+0000", 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5530000000000001e-06 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457583+0000", 2024-04-26T12:39:19.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7654000000000001e-05 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457626+0000", 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2110000000000002e-05 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457652+0000", 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6789000000000001e-05 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457863+0000", 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000210225 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457885+0000", 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2456999999999999e-05 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469169+0000", 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011284343 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469481+0000", 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031119999999999997 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.222735931000003, 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003553853, 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.756 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 211 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:19.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524766+0000", 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0829999999999997e-06 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524786+0000", 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9494e-05 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524830+0000", 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4240000000000003e-05 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524856+0000", 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5703000000000001e-05 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525044+0000", 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018797799999999999 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525374+0000", 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033005099999999999 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525827+0000", 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045309000000000001 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.527234+0000", 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014076259999999999 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528147+0000", 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091301299999999995 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528241+0000", 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3466000000000003e-05 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528316+0000", 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.143510079000002, 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003758815, 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 232 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603990+0000", 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.357e-06 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604002+0000", 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.154e-05 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604033+0000", 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1136999999999997e-05 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604049+0000", 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5869e-05 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604216+0000", 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167615 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604567+0000", 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035053100000000001 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.605359+0000", 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079155700000000002 2024-04-26T12:39:19.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607196+0000", 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018378699999999999 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607588+0000", 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039154700000000001 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607677+0000", 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9319000000000003e-05 2024-04-26T12:39:19.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607747+0000", 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9473000000000004e-05 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:243 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.122177743000002, 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032017550000000001, 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.767 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 243 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625323+0000", 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8399999999999999e-06 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625338+0000", 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4637000000000001e-05 2024-04-26T12:39:19.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625375+0000", 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7648999999999998e-05 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625396+0000", 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1047e-05 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625563+0000", 2024-04-26T12:39:19.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016640900000000001 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625966+0000", 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040301699999999998 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.626371+0000", 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040509600000000003 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.627764+0000", 2024-04-26T12:39:19.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001393266 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628199+0000", 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043461599999999997 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628404+0000", 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020512899999999999 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628522+0000", 2024-04-26T12:39:19.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011804899999999999 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.116980730000002, 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032314010000000001, 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.773 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 276 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630519+0000", 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1459999999999999e-06 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630532+0000", 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2604e-05 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630558+0000", 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630576+0000", 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630750+0000", 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173392 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631068+0000", 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031842099999999999 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631575+0000", 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00050638899999999999 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.632975+0000", 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001400486 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633495+0000", 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051948900000000004 2024-04-26T12:39:19.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633635+0000", 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000140972 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633749+0000", 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113239 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:295 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.112616416999998, 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032101120000000002, 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 295 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.779 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634883+0000", 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.204e-06 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634891+0000", 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0830000000000004e-06 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634905+0000", 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.382e-05 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634926+0000", 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1243e-05 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635316+0000", 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039014699999999998 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635549+0000", 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023250500000000001 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.636038+0000", 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048965300000000005 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637344+0000", 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001305683 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637862+0000", 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051851600000000001 2024-04-26T12:39:19.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637977+0000", 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114926 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638092+0000", 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114332 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:355 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.103755411999998, 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003073569, 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 355 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643745+0000", 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2859999999999998e-06 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643758+0000", 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2644e-05 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643805+0000", 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7763000000000003e-05 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643825+0000", 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9375999999999999e-05 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643970+0000", 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014545199999999999 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644263+0000", 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029315800000000001 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644807+0000", 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054336300000000005 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646108+0000", 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001300896 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646628+0000", 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052052000000000001 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646730+0000", 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102229 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646816+0000", 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5882000000000002e-05 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:408 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.082607092000003, 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029401380000000001, 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.790 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 408 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664894+0000", 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664906+0000", 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2323e-05 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664953+0000", 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6594000000000001e-05 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664967+0000", 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4813e-05 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665094+0000", 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012636200000000001 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665327+0000", 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233172 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665786+0000", 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045890599999999997 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667078+0000", 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012926400000000001 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667564+0000", 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048546700000000001 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667708+0000", 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014418800000000001 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667831+0000", 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123013 2024-04-26T12:39:19.795 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:497 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.021683469999999, 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046691349999999996, 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.796 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 497 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725817+0000", 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725830+0000", 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2672e-05 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725862+0000", 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2042000000000003e-05 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725930+0000", 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7731000000000006e-05 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726082+0000", 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152929 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726313+0000", 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023097499999999999 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726729+0000", 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041546699999999998 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729760+0000", 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003031083 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730288+0000", 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052804299999999996 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730419+0000", 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013093499999999999 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730484+0000", 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4772999999999998e-05 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:19.801 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.927884992999999, 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002976111, 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 633 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:19.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819615+0000", 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7269999999999999e-06 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819626+0000", 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819660+0000", 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4079999999999999e-05 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819679+0000", 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9103e-05 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819807+0000", 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012822899999999999 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820044+0000", 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023652800000000001 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820418+0000", 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037437400000000002 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.821605+0000", 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011867939999999999 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822310+0000", 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070503099999999995 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822480+0000", 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170089 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822589+0000", 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010892599999999999 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.821274111999998, 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030753500000000001, 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.807 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 727 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926226+0000", 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1129999999999999e-06 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926237+0000", 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926265+0000", 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.864e-05 2024-04-26T12:39:19.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926283+0000", 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7949999999999999e-05 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926378+0000", 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5081999999999995e-05 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926590+0000", 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021203500000000001 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926950+0000", 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035924399999999999 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.928069+0000", 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001119302 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929136+0000", 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001066542 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929227+0000", 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1142000000000003e-05 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929299+0000", 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2620000000000006e-05 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.634166475999997, 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029575529999999999, 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 808 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113334+0000", 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113347+0000", 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.288e-05 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113378+0000", 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1056000000000002e-05 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113394+0000", 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5616000000000001e-05 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113541+0000", 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147412 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113767+0000", 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225372 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.114085+0000", 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031803799999999998 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.115306+0000", 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012213 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116132+0000", 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00082585700000000005 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116224+0000", 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2392999999999994e-05 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116289+0000", 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4999000000000006e-05 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.818 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.616672794999999, 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028474419999999999, 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 816 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130827+0000", 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7239999999999999e-06 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130836+0000", 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0729999999999994e-06 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130857+0000", 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1396999999999999e-05 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130870+0000", 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2363e-05 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130982+0000", 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112509 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131114+0000", 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131779 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131385+0000", 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027119500000000001 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.132710+0000", 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013251059999999999 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133474+0000", 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00076380800000000004 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133565+0000", 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0785000000000006e-05 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133673+0000", 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107703 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.465905524999997, 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029548180000000001, 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.824 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 880 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281595+0000", 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.92e-06 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281608+0000", 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281639+0000", 2024-04-26T12:39:19.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0263000000000001e-05 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281654+0000", 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5613000000000001e-05 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281790+0000", 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013560300000000001 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282021+0000", 2024-04-26T12:39:19.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023109399999999999 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282352+0000", 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033127100000000001 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.283508+0000", 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011555820000000001 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284259+0000", 2024-04-26T12:39:19.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075111399999999999 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284429+0000", 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017024499999999999 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284547+0000", 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118193 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.829 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.461529798000001, 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049047079999999998, 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 882 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285970+0000", 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:39:19.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285981+0000", 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0993e-05 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286015+0000", 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3309999999999998e-05 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286034+0000", 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8936e-05 2024-04-26T12:39:19.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286154+0000", 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011998900000000001 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286385+0000", 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000231585 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286882+0000", 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000496763 2024-04-26T12:39:19.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.288886+0000", 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002004207 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290664+0000", 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017773800000000001 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290757+0000", 2024-04-26T12:39:19.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3616000000000006e-05 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290873+0000", 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011579899999999999 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.456277452999998, 2024-04-26T12:39:19.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030718659999999999, 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 883 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291223+0000", 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2869999999999999e-06 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291234+0000", 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1596999999999999e-05 2024-04-26T12:39:19.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291265+0000", 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.044e-05 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291283+0000", 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7878999999999999e-05 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291402+0000", 2024-04-26T12:39:19.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119406 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291649+0000", 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024725499999999999 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291980+0000", 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033056999999999997 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.293099+0000", 2024-04-26T12:39:19.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011188979999999999 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294018+0000", 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091867000000000001 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294175+0000", 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015740200000000001 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294292+0000", 2024-04-26T12:39:19.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011746199999999999 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.451988061999998, 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032575410000000001, 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.841 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 885 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295511+0000", 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3060000000000001e-06 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295518+0000", 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295538+0000", 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9409999999999999e-05 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295549+0000", 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1328999999999999e-05 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295669+0000", 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119616 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295892+0000", 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223799 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.296415+0000", 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052249900000000005 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.297588+0000", 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011734740000000001 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298501+0000", 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091317000000000004 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298652+0000", 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015026199999999999 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298768+0000", 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115779 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.846 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.385109608, 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030403560000000001, 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 913 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362391+0000", 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362407+0000", 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6066000000000002e-05 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362437+0000", 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9728999999999999e-05 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362452+0000", 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5147000000000001e-05 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362568+0000", 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116172 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362806+0000", 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023781900000000001 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.363150+0000", 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000344144 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.364211+0000", 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010614979999999999 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365228+0000", 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001016669 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365315+0000", 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6496000000000007e-05 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365429+0000", 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114226 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.352382284999997, 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003220929, 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.852 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 927 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395118+0000", 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4099999999999998e-06 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395130+0000", 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1487e-05 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395161+0000", 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1152999999999998e-05 2024-04-26T12:39:19.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395181+0000", 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0273999999999999e-05 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395306+0000", 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124805 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395534+0000", 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000228085 2024-04-26T12:39:19.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.396011+0000", 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000477493 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.397356+0000", 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013446199999999999 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398060+0000", 2024-04-26T12:39:19.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070440100000000001 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398223+0000", 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000162855 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398337+0000", 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113346 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.857 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 57.348818942000001, 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030649560000000002, 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:19.858 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 928 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:19.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398682+0000", 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.43e-06 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398693+0000", 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1324e-05 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398724+0000", 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0926000000000002e-05 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:19.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398742+0000", 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398865+0000", 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123542 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399201+0000", 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033574800000000003 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399744+0000", 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054293600000000005 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401070+0000", 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013257360000000001 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401546+0000", 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047601000000000002 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401633+0000", 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7225999999999995e-05 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401744+0000", 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000111195 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:19.863 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:19.865 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:39:19.865 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:19.866 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:19.862+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:19.966 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:19.962+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:20.037 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:20.037 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:20.037 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:20.037 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:20.051 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:20.066 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:20.066+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:20.168 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:20.166+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:20.216 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:20.216 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:20.216 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:20.216 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:20.216 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:20.230 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:20.269 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:20.266+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.865497097999999, 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.358 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:39:20.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:39:20.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:39:20.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:39:20.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.364 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.848800463000003, 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.365 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:39:20.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:39:20.370 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.844993975000001, 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.371 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:39:20.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:39:20.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:39:20.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:39:20.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:39:20.375 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.375 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.375 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.856747009000003, 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.376 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.377 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:39:20.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.377 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:20.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.794797437, 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.382 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:39:20.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:39:20.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:20.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.388 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.783920461000001, 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:20.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:39:20.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.772531854999997, 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.394 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:39:20.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:39:20.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:39:20.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.679277724999999, 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.400 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:39:20.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:39:20.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:39:20.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.677256188000001, 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:39:20.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:39:20.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:39:20.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.674335603000003, 2024-04-26T12:39:20.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:39:20.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:39:20.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.674055174999999, 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.417 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:39:20.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:39:20.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:39:20.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.669330135000003, 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:39:20.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:39:20.428 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.666108084999998, 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:20.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.664626224999999, 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:39:20.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:39:20.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:39:20.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.663387594, 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.437 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:39:20.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.442 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.660402887000004, 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:20.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:39:20.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.658312035999998, 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.447 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:39:20.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:39:20.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:39:20.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.646145007999998, 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.637548463999998, 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:39:20.458 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.463 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.625388977, 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:39:20.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:39:20.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:39:20.468 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.468 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.468 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.468 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.468 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.468 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:20.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:20.470 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:20.470+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:20.571 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:20.566+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:20.599 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:20.600 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:20.600 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:20.600 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:20.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:20.671 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:20.670+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:20.772 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:20.766+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:20.778 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:20.778 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:20.778 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:20.778 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:20.778 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:20.792 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:20.880 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:20.878+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:20.962 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:20.962 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.486092214999999, 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:39:20.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.471099983999999, 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.969 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.974 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.446303542000003, 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.975 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:39:20.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:39:20.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:39:20.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:39:20.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.443624743000001, 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:39:20.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:39:20.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:39:20.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:39:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.442152710000002, 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:39:20.986 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:20.990 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.321253816999999, 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.303919063999999, 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:39:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:39:20.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:39:20.998 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.303246786000003, 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:20.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.273985482000001, 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.003 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:39:21.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.007 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.260086559000001, 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:39:21.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:39:21.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.254633974000001, 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:39:21.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:39:21.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.252513557, 2024-04-26T12:39:21.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:39:21.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:39:21.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.250550982999997, 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.250098792000003, 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.025 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:39:21.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:39:21.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.247738869000003, 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.030 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:39:21.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:21.035 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.242040328999998, 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:39:21.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:39:21.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.080876582000002, 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:39:21.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.872128517, 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.046 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.723337602000001, 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:39:21.051 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:21.052 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:39:21.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 58.642044224999999, 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:21.056 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.057 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:39:21.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:21.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:39:21.061 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:39:21.061 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.061 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.061 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.061 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:21.061 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:21.061 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:21.062 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:21.063 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:21.064 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:21.062+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:21.164 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:21.158+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:21.201 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:21.201 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:21.221 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:21.221 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:21.230 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:21.231 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:21.231 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:21.231 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:21.238 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:21.238 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:21.245 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:21.253 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:21.253 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:21.265 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:21.262+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:21.273 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:21.274 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:21.293 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:21.293 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:21.313 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:21.313 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:21.331 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:21.332 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:21.392 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:21.390+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:21.411 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:21.411 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:21.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:21.472 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:21.470+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:21.549 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:21.549 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:21.562 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:21.610 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:21.610+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:21.667 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:21.662+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:21.687 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:21.688 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:21.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:21.768 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:21.766+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:21.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:39:21.869 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:21.866+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:21.877 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:21.877 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:21.893 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:21.985 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:21.986+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:22.064 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:22.064 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:22.071 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:22.070+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:22.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:22.172 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:22.170+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:22.233 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:22.234 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:22.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:22.273 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:22.270+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:22.374 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:22.374+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:22.405 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:22.405 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:22.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:22.509 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:22.510+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:22.576 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:22.574+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:22.627 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:22.627 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:22.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:22.678 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:22.674+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:22.779 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:22.778+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:22.834 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:39:22.851 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:22.851 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:22.871 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:22.879 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:22.874+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:22.980 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:22.978+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:23.068 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:23.068 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:23.082 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:23.078+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:23.085 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:23.183 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:23.182+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:23.205 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:23.205 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:23.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:23.283 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:23.282+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:23.327 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:23.327 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:23.339 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:23.349 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:23.425 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:23.426+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:23.485 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:23.482+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:23.512 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:23.512 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:23.528 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:23.528 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:23.531 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:23.531 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:23.548 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:23.549 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:23.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:23.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:23.579 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:23.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:23.599 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:23.599 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:23.598+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:23.619 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:23.619 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:23.639 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:23.640 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:23.659 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:23.660 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:23.710 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:56 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.193665027999998, 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002983332, 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 56 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515113+0000", 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515116+0000", 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5550000000000001e-06 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515127+0000", 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0899e-05 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515152+0000", 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.561e-05 2024-04-26T12:39:23.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515165+0000", 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2727e-05 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515291+0000", 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000125628 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515490+0000", 2024-04-26T12:39:23.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000199452 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.515690+0000", 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000200189 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517095+0000", 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014043860000000001 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.517890+0000", 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079524999999999995 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518006+0000", 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011569 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518097+0000", 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0946000000000006e-05 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.716 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889461985664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.190548504000006, 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030541930000000002, 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 57 2024-04-26T12:39:23.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518230+0000", 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518232+0000", 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7430000000000001e-06 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518239+0000", 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1670000000000002e-06 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518263+0000", 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4786e-05 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518276+0000", 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2394e-05 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518374+0000", 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8544999999999999e-05 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518533+0000", 2024-04-26T12:39:23.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000158763 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.518836+0000", 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030328000000000001 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.520242+0000", 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001405643 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521076+0000", 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083431100000000002 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521187+0000", 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110714 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521284+0000", 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6847000000000003e-05 2024-04-26T12:39:23.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:59 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889461986816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.187717195999994, 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003156112, 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 59 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521061+0000", 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521063+0000", 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9599999999999999e-06 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521074+0000", 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521105+0000", 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1199999999999999e-05 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521125+0000", 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9806999999999999e-05 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521260+0000", 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013498500000000001 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521472+0000", 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021194900000000001 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521908+0000", 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043670900000000002 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523344+0000", 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001435579 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524086+0000", 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000741805 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524148+0000", 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2408000000000003e-05 2024-04-26T12:39:23.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524217+0000", 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9016999999999993e-05 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 62.204361818999999, 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046495770000000002, 2024-04-26T12:39:23.729 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 207 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:23.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504416+0000", 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504420+0000", 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504437+0000", 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6926e-05 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504481+0000", 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3946999999999998e-05 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504506+0000", 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4986000000000001e-05 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504777+0000", 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027106100000000001 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505020+0000", 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024332499999999999 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.505444+0000", 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000423783 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.507435+0000", 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019909950000000002 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508814+0000", 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001378799 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.508964+0000", 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014972600000000001 2024-04-26T12:39:23.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509066+0000", 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010223200000000001 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 62.165023292000001, 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003567382, 2024-04-26T12:39:23.735 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 216 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543755+0000", 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543758+0000", 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.286e-06 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543774+0000", 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.571e-05 2024-04-26T12:39:23.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543813+0000", 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9110000000000003e-05 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543831+0000", 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8139999999999999e-05 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.543962+0000", 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130832 2024-04-26T12:39:23.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544216+0000", 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025436099999999999 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.544648+0000", 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043157999999999998 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.546300+0000", 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001651661 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547173+0000", 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087328999999999998 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547258+0000", 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4878999999999998e-05 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.547322+0000", 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4533e-05 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 62.124323140000001, 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035366059999999999, 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 227 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584455+0000", 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584458+0000", 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5469999999999999e-06 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584469+0000", 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.165e-05 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584501+0000", 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2005999999999998e-05 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584526+0000", 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4683000000000001e-05 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584654+0000", 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012805299999999999 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.584869+0000", 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021525400000000001 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.585275+0000", 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00040564399999999998 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.586816+0000", 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015407579999999999 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587844+0000", 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010284020000000001 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587927+0000", 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3286000000000002e-05 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.587992+0000", 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4323000000000001e-05 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 62.117023392999997, 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029981999999999999, 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.747 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 229 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591755+0000", 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591757+0000", 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3369999999999998e-06 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591769+0000", 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1600000000000001e-05 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591799+0000", 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0543000000000002e-05 2024-04-26T12:39:23.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591825+0000", 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5752e-05 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.591941+0000", 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116143 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592156+0000", 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021444899999999999 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.592548+0000", 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039236700000000002 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594185+0000", 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016373469999999999 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594615+0000", 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042984300000000001 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594692+0000", 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.695e-05 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.594753+0000", 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0869000000000003e-05 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 62.109488061, 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033442010000000002, 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 231 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599290+0000", 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599292+0000", 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9769999999999999e-06 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599303+0000", 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0386e-05 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599334+0000", 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1087000000000002e-05 2024-04-26T12:39:23.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599356+0000", 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2138999999999999e-05 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599475+0000", 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119589 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599696+0000", 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022040199999999999 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.600100+0000", 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000404044 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.601568+0000", 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001468001 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602489+0000", 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092147699999999997 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602571+0000", 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1818999999999997e-05 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.602634+0000", 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3280000000000004e-05 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.758 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.810637067000002, 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034449799999999998, 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 715 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898141+0000", 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898143+0000", 2024-04-26T12:39:23.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898153+0000", 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0176999999999999e-05 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898180+0000", 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6781999999999999e-05 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898202+0000", 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1605000000000001e-05 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898329+0000", 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127367 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898546+0000", 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021638199999999999 2024-04-26T12:39:23.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.898892+0000", 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034662799999999998 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.900063+0000", 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001171184 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901429+0000", 2024-04-26T12:39:23.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013658990000000001 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901525+0000", 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5433000000000006e-05 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.901586+0000", 2024-04-26T12:39:23.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1463000000000004e-05 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.763209207000003, 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030447159999999998, 2024-04-26T12:39:23.765 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 736 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:23.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945569+0000", 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945571+0000", 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945585+0000", 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3766e-05 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945616+0000", 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1254000000000003e-05 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945632+0000", 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5296000000000001e-05 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945745+0000", 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011295599999999999 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.945978+0000", 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023348800000000001 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.946293+0000", 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000314958 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.947440+0000", 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011467440000000001 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948328+0000", 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088776000000000002 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948494+0000", 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016587899999999999 2024-04-26T12:39:23.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.948614+0000", 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012025500000000001 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.759248704999997, 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003238646, 2024-04-26T12:39:23.771 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 738 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949530+0000", 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949531+0000", 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7069999999999999e-06 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949541+0000", 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:23.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949566+0000", 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5533000000000001e-05 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949579+0000", 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.236e-05 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949722+0000", 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014327200000000001 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.949970+0000", 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024837500000000001 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.950482+0000", 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051128299999999996 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.951825+0000", 2024-04-26T12:39:23.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013431630000000001 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952625+0000", 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080046700000000002 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952705+0000", 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9869000000000004e-05 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.952768+0000", 2024-04-26T12:39:23.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3057000000000003e-05 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:774 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.677428362999997, 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029121680000000001, 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 774 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031350+0000", 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031352+0000", 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9700000000000002e-06 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031361+0000", 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.414e-06 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031387+0000", 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031399+0000", 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2377e-05 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031574+0000", 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017496800000000001 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031715+0000", 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.031989+0000", 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027419800000000002 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.033007+0000", 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010173319999999999 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034110+0000", 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001102879 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034192+0000", 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2346000000000001e-05 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.034262+0000", 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0185999999999995e-05 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.782 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.667810922999998, 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028610879999999999, 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 778 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040967+0000", 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040970+0000", 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.040981+0000", 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1703e-05 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041013+0000", 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1303000000000002e-05 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041030+0000", 2024-04-26T12:39:23.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7493e-05 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041206+0000", 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017595499999999999 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041420+0000", 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021373200000000001 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.041722+0000", 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00030209799999999999 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.042818+0000", 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001095738 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043676+0000", 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085838699999999995 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043762+0000", 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6521999999999996e-05 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.043828+0000", 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5957000000000006e-05 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.788 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.663826903999997, 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032202580000000001, 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 780 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044951+0000", 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.044954+0000", 2024-04-26T12:39:23.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5330000000000001e-06 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045055+0000", 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010158900000000001 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045427+0000", 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037136100000000001 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045461+0000", 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4193000000000003e-05 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045615+0000", 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000153652 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.045815+0000", 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020044799999999999 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.046189+0000", 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037399699999999999 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.047313+0000", 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001123899 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048021+0000", 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070842099999999999 2024-04-26T12:39:23.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048105+0000", 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3152999999999995e-05 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.048172+0000", 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7012000000000001e-05 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.609591268999999, 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028409210000000002, 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 802 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.795 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099187+0000", 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099190+0000", 2024-04-26T12:39:23.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099202+0000", 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2019e-05 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099233+0000", 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1093000000000002e-05 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099247+0000", 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4579999999999999e-05 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099361+0000", 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113723 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099573+0000", 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021191499999999999 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.099895+0000", 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032170099999999997 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101037+0000", 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011427270000000001 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101880+0000", 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084234700000000002 2024-04-26T12:39:23.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.101964+0000", 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3856000000000005e-05 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.102028+0000", 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4220000000000005e-05 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.448902596000003, 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028492639999999998, 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 871 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259876+0000", 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259878+0000", 2024-04-26T12:39:23.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0930000000000001e-06 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259888+0000", 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0713999999999999e-05 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259917+0000", 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8276000000000002e-05 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.259931+0000", 2024-04-26T12:39:23.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4032999999999999e-05 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260072+0000", 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141326 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260299+0000", 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022688799999999999 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:23.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.260617+0000", 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031782099999999998 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.261683+0000", 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001065812 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262584+0000", 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00090090600000000004 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262665+0000", 2024-04-26T12:39:23.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1578999999999999e-05 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.262725+0000", 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9815999999999998e-05 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:23.806 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.385978592000001, 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028604580000000002, 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 897 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322800+0000", 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322801+0000", 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.536e-06 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322810+0000", 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3340000000000002e-06 2024-04-26T12:39:23.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322835+0000", 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5136000000000001e-05 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322854+0000", 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8853000000000001e-05 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.322990+0000", 2024-04-26T12:39:23.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000136169 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323117+0000", 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012680600000000001 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.323392+0000", 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027538500000000001 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.324484+0000", 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001092462 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325508+0000", 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001023272 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325595+0000", 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6889000000000001e-05 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325660+0000", 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5616000000000003e-05 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.382900571999997, 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003075749, 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.812 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 898 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325878+0000", 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325880+0000", 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9259999999999999e-06 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325889+0000", 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8600000000000005e-06 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325918+0000", 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9006999999999999e-05 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.325939+0000", 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0863e-05 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326058+0000", 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011906899999999999 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326273+0000", 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000214355 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.326585+0000", 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031177800000000002 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.327864+0000", 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012790430000000001 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328808+0000", 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094398300000000002 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328893+0000", 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5263e-05 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.328953+0000", 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0602e-05 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.290628791000003, 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002915997, 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 937 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.818 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418149+0000", 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418151+0000", 2024-04-26T12:39:23.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.75e-06 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418161+0000", 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3160000000000003e-06 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418187+0000", 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6417000000000001e-05 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418207+0000", 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9902999999999999e-05 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418335+0000", 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000127892 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418570+0000", 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023533500000000001 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:23.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.418956+0000", 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038606699999999997 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420042+0000", 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001086175 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.420918+0000", 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087580700000000004 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421002+0000", 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4239000000000004e-05 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.421065+0000", 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3095999999999994e-05 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.286716300999998, 2024-04-26T12:39:23.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028511209999999999, 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 939 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422062+0000", 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422063+0000", 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5200000000000001e-06 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422074+0000", 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0407e-05 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422100+0000", 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5848999999999999e-05 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422119+0000", 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422268+0000", 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148899 2024-04-26T12:39:23.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422392+0000", 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012443900000000001 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.422672+0000", 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000279368 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.423773+0000", 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001101582 2024-04-26T12:39:23.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424766+0000", 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099285499999999995 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424852+0000", 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5913000000000002e-05 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.424913+0000", 2024-04-26T12:39:23.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1136000000000006e-05 2024-04-26T12:39:23.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.829 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.829 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:23.829 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:23.829 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:23.829 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:23.710+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:23.830 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:23.832 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:23.826+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:23.932 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:23.930+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:23.962 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:23.962 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:23.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:24.033 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:24.030+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:24.097 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:24.098 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:24.098 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:24.098 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:24.098 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:24.112 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:24.156 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:24.154+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:24.235 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:24.230+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:24.281 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.820458475999999, 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011918331000000001, 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "reached pg", 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.282 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 43 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457566+0000", 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5530000000000001e-06 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457583+0000", 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7654000000000001e-05 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457626+0000", 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2110000000000002e-05 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457652+0000", 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6789000000000001e-05 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457863+0000", 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000210225 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457885+0000", 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2456999999999999e-05 2024-04-26T12:39:24.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469169+0000", 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011284343 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469481+0000", 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031119999999999997 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.753258637000002, 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003553853, 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 211 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524766+0000", 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0829999999999997e-06 2024-04-26T12:39:24.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524786+0000", 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9494e-05 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524830+0000", 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4240000000000003e-05 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524856+0000", 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5703000000000001e-05 2024-04-26T12:39:24.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525044+0000", 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018797799999999999 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525374+0000", 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033005099999999999 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525827+0000", 2024-04-26T12:39:24.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045309000000000001 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.527234+0000", 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014076259999999999 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528147+0000", 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091301299999999995 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528241+0000", 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3466000000000003e-05 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528316+0000", 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.674032785000001, 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003758815, 2024-04-26T12:39:24.292 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 232 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603990+0000", 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.357e-06 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604002+0000", 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.154e-05 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604033+0000", 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1136999999999997e-05 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604049+0000", 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5869e-05 2024-04-26T12:39:24.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604216+0000", 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167615 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604567+0000", 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035053100000000001 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:24.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.605359+0000", 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079155700000000002 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607196+0000", 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018378699999999999 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607588+0000", 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039154700000000001 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607677+0000", 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9319000000000003e-05 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607747+0000", 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9473000000000004e-05 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:243 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.298 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.652700449000001, 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032017550000000001, 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 243 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625323+0000", 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8399999999999999e-06 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625338+0000", 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4637000000000001e-05 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625375+0000", 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7648999999999998e-05 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625396+0000", 2024-04-26T12:39:24.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1047e-05 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625563+0000", 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016640900000000001 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625966+0000", 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040301699999999998 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:24.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.626371+0000", 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040509600000000003 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.627764+0000", 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001393266 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628199+0000", 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043461599999999997 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628404+0000", 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020512899999999999 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628522+0000", 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011804899999999999 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.304 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.647503436000001, 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032314010000000001, 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 276 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630519+0000", 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1459999999999999e-06 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630532+0000", 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2604e-05 2024-04-26T12:39:24.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630558+0000", 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630576+0000", 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630750+0000", 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173392 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631068+0000", 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031842099999999999 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631575+0000", 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00050638899999999999 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.632975+0000", 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001400486 2024-04-26T12:39:24.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633495+0000", 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051948900000000004 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633635+0000", 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000140972 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633749+0000", 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113239 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:295 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.643139122999997, 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032101120000000002, 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.310 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 295 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:24.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634883+0000", 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.204e-06 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634891+0000", 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0830000000000004e-06 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634905+0000", 2024-04-26T12:39:24.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.382e-05 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634926+0000", 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1243e-05 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635316+0000", 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039014699999999998 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635549+0000", 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023250500000000001 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.636038+0000", 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048965300000000005 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637344+0000", 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001305683 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637862+0000", 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051851600000000001 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637977+0000", 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114926 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638092+0000", 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114332 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:355 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.634278117999997, 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003073569, 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 355 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643745+0000", 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2859999999999998e-06 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643758+0000", 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2644e-05 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643805+0000", 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7763000000000003e-05 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643825+0000", 2024-04-26T12:39:24.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9375999999999999e-05 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643970+0000", 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014545199999999999 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644263+0000", 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029315800000000001 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644807+0000", 2024-04-26T12:39:24.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054336300000000005 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646108+0000", 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001300896 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646628+0000", 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052052000000000001 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646730+0000", 2024-04-26T12:39:24.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102229 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646816+0000", 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5882000000000002e-05 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.321 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:408 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.613129798000003, 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029401380000000001, 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 408 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664894+0000", 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664906+0000", 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2323e-05 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664953+0000", 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6594000000000001e-05 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664967+0000", 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4813e-05 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665094+0000", 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012636200000000001 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665327+0000", 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233172 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665786+0000", 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045890599999999997 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667078+0000", 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012926400000000001 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667564+0000", 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048546700000000001 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667708+0000", 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014418800000000001 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667831+0000", 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123013 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:497 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.552206175999999, 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046691349999999996, 2024-04-26T12:39:24.327 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 497 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725817+0000", 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725830+0000", 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2672e-05 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725862+0000", 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2042000000000003e-05 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725930+0000", 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7731000000000006e-05 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726082+0000", 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152929 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726313+0000", 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023097499999999999 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726729+0000", 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041546699999999998 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729760+0000", 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003031083 2024-04-26T12:39:24.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730288+0000", 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052804299999999996 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730419+0000", 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013093499999999999 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730484+0000", 2024-04-26T12:39:24.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4772999999999998e-05 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.458407698999999, 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002976111, 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.333 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 633 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819615+0000", 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7269999999999999e-06 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819626+0000", 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819660+0000", 2024-04-26T12:39:24.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4079999999999999e-05 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819679+0000", 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9103e-05 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819807+0000", 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012822899999999999 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820044+0000", 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023652800000000001 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820418+0000", 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037437400000000002 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.821605+0000", 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011867939999999999 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822310+0000", 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070503099999999995 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822480+0000", 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170089 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822589+0000", 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010892599999999999 2024-04-26T12:39:24.338 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.351796817999997, 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030753500000000001, 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 727 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926226+0000", 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1129999999999999e-06 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926237+0000", 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926265+0000", 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.864e-05 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926283+0000", 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7949999999999999e-05 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926378+0000", 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5081999999999995e-05 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926590+0000", 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021203500000000001 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926950+0000", 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035924399999999999 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.928069+0000", 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001119302 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929136+0000", 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001066542 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929227+0000", 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1142000000000003e-05 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929299+0000", 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2620000000000006e-05 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.164689181999996, 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029575529999999999, 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 808 2024-04-26T12:39:24.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113334+0000", 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113347+0000", 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.288e-05 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113378+0000", 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1056000000000002e-05 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113394+0000", 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5616000000000001e-05 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113541+0000", 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147412 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113767+0000", 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225372 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.114085+0000", 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031803799999999998 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.115306+0000", 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012213 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116132+0000", 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00082585700000000005 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116224+0000", 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2392999999999994e-05 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116289+0000", 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4999000000000006e-05 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.350 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 62.147195500999999, 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028474419999999999, 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 816 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130827+0000", 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7239999999999999e-06 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130836+0000", 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0729999999999994e-06 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130857+0000", 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1396999999999999e-05 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130870+0000", 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2363e-05 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130982+0000", 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112509 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131114+0000", 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131779 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131385+0000", 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027119500000000001 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.132710+0000", 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013251059999999999 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133474+0000", 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00076380800000000004 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133565+0000", 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0785000000000006e-05 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133673+0000", 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107703 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.996428231000003, 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029548180000000001, 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.356 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 880 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:24.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281595+0000", 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.92e-06 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281608+0000", 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281639+0000", 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0263000000000001e-05 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281654+0000", 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5613000000000001e-05 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281790+0000", 2024-04-26T12:39:24.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013560300000000001 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282021+0000", 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023109399999999999 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282352+0000", 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033127100000000001 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.283508+0000", 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011555820000000001 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284259+0000", 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075111399999999999 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284429+0000", 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017024499999999999 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284547+0000", 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118193 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.992052504, 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049047079999999998, 2024-04-26T12:39:24.362 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 882 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:24.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285970+0000", 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:39:24.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285981+0000", 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0993e-05 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286015+0000", 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3309999999999998e-05 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286034+0000", 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8936e-05 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286154+0000", 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011998900000000001 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286385+0000", 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000231585 2024-04-26T12:39:24.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286882+0000", 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000496763 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.288886+0000", 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002004207 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290664+0000", 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017773800000000001 2024-04-26T12:39:24.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290757+0000", 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3616000000000006e-05 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290873+0000", 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011579899999999999 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.368 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.986800158999998, 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030718659999999999, 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 883 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291223+0000", 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2869999999999999e-06 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291234+0000", 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1596999999999999e-05 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291265+0000", 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.044e-05 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291283+0000", 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7878999999999999e-05 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291402+0000", 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119406 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291649+0000", 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024725499999999999 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291980+0000", 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033056999999999997 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.293099+0000", 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011188979999999999 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294018+0000", 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091867000000000001 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294175+0000", 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015740200000000001 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294292+0000", 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011746199999999999 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.982510767999997, 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032575410000000001, 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.374 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 885 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295511+0000", 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3060000000000001e-06 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295518+0000", 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:39:24.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295538+0000", 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9409999999999999e-05 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295549+0000", 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1328999999999999e-05 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295669+0000", 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119616 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295892+0000", 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223799 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.296415+0000", 2024-04-26T12:39:24.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052249900000000005 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.297588+0000", 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011734740000000001 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298501+0000", 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091317000000000004 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298652+0000", 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015026199999999999 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298768+0000", 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115779 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.380 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.915632314, 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030403560000000001, 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 913 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362391+0000", 2024-04-26T12:39:24.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362407+0000", 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6066000000000002e-05 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362437+0000", 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9728999999999999e-05 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362452+0000", 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5147000000000001e-05 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362568+0000", 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116172 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362806+0000", 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023781900000000001 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.363150+0000", 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000344144 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.364211+0000", 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010614979999999999 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365228+0000", 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001016669 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365315+0000", 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6496000000000007e-05 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365429+0000", 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114226 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.386 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.882904990999997, 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003220929, 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 927 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395118+0000", 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4099999999999998e-06 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395130+0000", 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1487e-05 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395161+0000", 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1152999999999998e-05 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395181+0000", 2024-04-26T12:39:24.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0273999999999999e-05 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395306+0000", 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124805 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395534+0000", 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000228085 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.396011+0000", 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000477493 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.397356+0000", 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013446199999999999 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398060+0000", 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070440100000000001 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398223+0000", 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000162855 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398337+0000", 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113346 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 61.879341648, 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030649560000000002, 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 928 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398682+0000", 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.43e-06 2024-04-26T12:39:24.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398693+0000", 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1324e-05 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398724+0000", 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0926000000000002e-05 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398742+0000", 2024-04-26T12:39:24.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398865+0000", 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123542 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399201+0000", 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033574800000000003 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:24.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399744+0000", 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054293600000000005 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401070+0000", 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013257360000000001 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401546+0000", 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047601000000000002 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401633+0000", 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7225999999999995e-05 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401744+0000", 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000111195 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.398 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:24.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:24.400 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:24.398+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:24.501 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:24.498+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:24.575 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:24.576 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:24.576 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:24.576 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:24.590 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:24.632 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:24.630+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:24.702 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:24.702+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:24.758 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:24.758 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:24.758 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:24.758 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:24.758 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:24.772 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:24.804 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:24.802+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:24.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:39:24.894 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:24.894 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:24.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:24.894 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.402006495999998, 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:39:24.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:39:24.901 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.385309860999996, 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.902 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:39:24.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:39:24.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:39:24.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:39:24.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:39:24.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:24.908 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.381503373000001, 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:39:24.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:39:24.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.393256407000003, 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.913 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.331306834999999, 2024-04-26T12:39:24.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:39:24.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:39:24.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:39:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.320429859000001, 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.924 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:39:24.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:39:24.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.309041252999997, 2024-04-26T12:39:24.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:39:24.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.215787122999998, 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.935 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:24.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:39:24.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.213765586000001, 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.941 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:39:24.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:39:24.946 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.210845001000003, 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.947 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.952 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.210564572999999, 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.205839533000002, 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.958 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:24.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.963 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.202617482999997, 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:39:24.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:39:24.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.201135622999999, 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.968 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:39:24.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:39:24.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:39:24.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.199896991999999, 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:39:24.972 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:39:24.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:39:24.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.196912285000003, 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:39:24.978 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:39:24.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.982 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.194821433999998, 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:39:24.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:39:24.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.988 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.182654405999997, 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.174057861999998, 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:24.994 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:24.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:39:24.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:24.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:24.999 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.161898375, 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:25.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:39:25.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.004 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:25.006 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:25.006 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:25.002+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:25.106 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:25.102+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:25.176 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:25.176 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:25.176 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:25.177 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:25.190 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:25.232 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:25.230+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:25.308 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:25.306+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:25.353 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:25.353 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:25.354 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:25.354 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:25.354 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:25.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:25.409 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:25.410+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:25.510 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:25.510+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:25.538 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:25.538 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:25.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:25.538 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.061433549, 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:25.539 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:25.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:25.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:39:25.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:25.546 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.046441318000007, 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:39:25.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:39:25.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.021644875999996, 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.553 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:25.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:25.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:39:25.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.559 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.018966077000002, 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:25.560 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:39:25.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 64.017494044000003, 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:25.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:39:25.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.896595151, 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:25.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:39:25.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.576 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.879260398, 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.577 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:39:25.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.878588120000003, 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:39:25.582 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:25.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:39:25.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:25.587 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.849326816000001, 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:39:25.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:39:25.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.835427893000002, 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:39:25.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:39:25.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.829975308000002, 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.598 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:25.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:39:25.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.603 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.827854891000001, 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:39:25.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:39:25.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:39:25.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.825892316999997, 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.609 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:25.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:39:25.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:39:25.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:25.614 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.825440125999997, 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:39:25.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.823080203000004, 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:39:25.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:39:25.623 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.817381662999999, 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:25.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.628 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.656217916000003, 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:39:25.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:39:25.633 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.447469851000001, 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:39:25.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.298678936000002, 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:39:25.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 63.217385559, 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:39:25.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:25.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:25.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:39:25.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:39:25.648 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.648 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.648 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.648 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:25.648 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:25.648 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:25.650 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:25.650 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:25.646+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:25.683 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:25.750 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:25.750+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:25.820 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:25.820 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:25.820 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:25.820 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:25.832 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:25.833 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:25.834 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:25.836 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:39:25.851 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:25.850+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:25.862 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:25.862 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:25.878 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:25.878 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:25.909 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:25.909 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:25.942 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:25.943 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:25.952 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:25.950+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:25.957 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:25.957 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:25.957 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:25.957 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:25.958 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:25.971 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:25.973 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:25.973 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:26.005 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:26.005 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:26.036 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:26.036 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:26.062 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:26.058+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:26.139 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:26.140 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:26.154 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:26.154 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:26.154+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:26.255 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:26.250+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:26.329 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:26.329 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:26.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:26.356 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:26.354+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:26.451 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:26.452 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:26.457 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:26.454+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:26.466 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:26.558 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:26.554+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:26.627 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:26.628 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:26.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:26.685 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:26.686+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:26.760 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:26.758+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:26.761 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:26.761 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:26.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:26.865 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:26.866+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:26.962 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:26.958+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:26.969 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:26.969 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:26.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:27.077 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:27.078+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:27.164 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:27.162+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:27.183 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:27.183 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:27.201 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:27.295 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:27.294+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:27.353 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:27.353 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:27.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:27.367 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:27.362+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:27.467 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:27.462+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:27.524 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:27.524 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:27.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:27.568 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:27.562+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:27.669 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:27.666+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:27.673 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:27.673 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:27.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:27.770 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:27.770+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:27.820 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:27.820 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:27.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:27.861 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:39:27.871 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:27.866+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:27.972 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:27.970+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:28.014 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:28.014 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:28.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:28.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:28.078 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:28.078+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:28.174 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:28.174+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:28.240 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:28.240 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:28.241 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:28.241 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:28.256 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:28.270 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:28.271 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:28.275 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:28.274+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:28.298 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:28.298 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:28.314 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:28.314 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:28.345 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:28.345 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:28.376 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:28.374+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:28.377 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:28.378 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:28.387 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:28.387 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:28.401 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:28.409 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:28.410 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:28.434 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:28.434 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:28.477 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:28.474+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:28.524 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:28.524 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:28.524 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:28.524 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:28.525 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:28.539 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:28.584 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:28.582+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:28.679 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:28.678+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.248635190000002, 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011918331000000001, 2024-04-26T12:39:28.710 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "reached pg", 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 43 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457566+0000", 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5530000000000001e-06 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457583+0000", 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7654000000000001e-05 2024-04-26T12:39:28.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457626+0000", 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2110000000000002e-05 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457652+0000", 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6789000000000001e-05 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457863+0000", 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000210225 2024-04-26T12:39:28.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457885+0000", 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2456999999999999e-05 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469169+0000", 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011284343 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469481+0000", 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031119999999999997 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.181435351000005, 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003553853, 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.715 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 211 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524766+0000", 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0829999999999997e-06 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524786+0000", 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9494e-05 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524830+0000", 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4240000000000003e-05 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524856+0000", 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5703000000000001e-05 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525044+0000", 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018797799999999999 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525374+0000", 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033005099999999999 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525827+0000", 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045309000000000001 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.527234+0000", 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014076259999999999 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528147+0000", 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091301299999999995 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528241+0000", 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3466000000000003e-05 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528316+0000", 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:39:28.720 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.102209498999997, 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003758815, 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.721 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.722 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 232 2024-04-26T12:39:28.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.722 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:28.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603990+0000", 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.357e-06 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604002+0000", 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.154e-05 2024-04-26T12:39:28.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604033+0000", 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1136999999999997e-05 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604049+0000", 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5869e-05 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604216+0000", 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167615 2024-04-26T12:39:28.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604567+0000", 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035053100000000001 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.605359+0000", 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079155700000000002 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607196+0000", 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018378699999999999 2024-04-26T12:39:28.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607588+0000", 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039154700000000001 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607677+0000", 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9319000000000003e-05 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607747+0000", 2024-04-26T12:39:28.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9473000000000004e-05 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:243 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.080877162999997, 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032017550000000001, 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.727 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 243 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625323+0000", 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8399999999999999e-06 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625338+0000", 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4637000000000001e-05 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625375+0000", 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7648999999999998e-05 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625396+0000", 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1047e-05 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625563+0000", 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016640900000000001 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625966+0000", 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040301699999999998 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.626371+0000", 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040509600000000003 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.627764+0000", 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001393266 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628199+0000", 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043461599999999997 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628404+0000", 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020512899999999999 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628522+0000", 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011804899999999999 2024-04-26T12:39:28.732 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.075680149999997, 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032314010000000001, 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.733 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 276 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630519+0000", 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1459999999999999e-06 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630532+0000", 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2604e-05 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630558+0000", 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630576+0000", 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630750+0000", 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173392 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631068+0000", 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031842099999999999 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631575+0000", 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00050638899999999999 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.632975+0000", 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001400486 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633495+0000", 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051948900000000004 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633635+0000", 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000140972 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633749+0000", 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113239 2024-04-26T12:39:28.738 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.739 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.741 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:295 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.071315837, 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032101120000000002, 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.742 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 295 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634883+0000", 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.204e-06 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634891+0000", 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0830000000000004e-06 2024-04-26T12:39:28.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634905+0000", 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.382e-05 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634926+0000", 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1243e-05 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635316+0000", 2024-04-26T12:39:28.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039014699999999998 2024-04-26T12:39:28.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635549+0000", 2024-04-26T12:39:28.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023250500000000001 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.636038+0000", 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048965300000000005 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637344+0000", 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001305683 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637862+0000", 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051851600000000001 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637977+0000", 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114926 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638092+0000", 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114332 2024-04-26T12:39:28.748 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:355 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.062454832, 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003073569, 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.749 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 355 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643745+0000", 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2859999999999998e-06 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643758+0000", 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2644e-05 2024-04-26T12:39:28.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643805+0000", 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7763000000000003e-05 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643825+0000", 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9375999999999999e-05 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643970+0000", 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014545199999999999 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644263+0000", 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029315800000000001 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644807+0000", 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054336300000000005 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646108+0000", 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001300896 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646628+0000", 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052052000000000001 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646730+0000", 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102229 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646816+0000", 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5882000000000002e-05 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:408 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.755 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.041306512000006, 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029401380000000001, 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 408 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664894+0000", 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664906+0000", 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2323e-05 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664953+0000", 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6594000000000001e-05 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664967+0000", 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4813e-05 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665094+0000", 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012636200000000001 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665327+0000", 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233172 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665786+0000", 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045890599999999997 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667078+0000", 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012926400000000001 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667564+0000", 2024-04-26T12:39:28.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048546700000000001 2024-04-26T12:39:28.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667708+0000", 2024-04-26T12:39:28.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014418800000000001 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667831+0000", 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123013 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:497 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.762 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:28.763 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.980382890000001, 2024-04-26T12:39:28.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046691349999999996, 2024-04-26T12:39:28.763 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.763 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.763 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.763 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.763 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.763 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.763 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 497 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725817+0000", 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725830+0000", 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2672e-05 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725862+0000", 2024-04-26T12:39:28.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2042000000000003e-05 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725930+0000", 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7731000000000006e-05 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726082+0000", 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152929 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726313+0000", 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023097499999999999 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726729+0000", 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041546699999999998 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729760+0000", 2024-04-26T12:39:28.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003031083 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730288+0000", 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052804299999999996 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730419+0000", 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013093499999999999 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730484+0000", 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4772999999999998e-05 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.886584412999994, 2024-04-26T12:39:28.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002976111, 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 633 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819615+0000", 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7269999999999999e-06 2024-04-26T12:39:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819626+0000", 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819660+0000", 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4079999999999999e-05 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819679+0000", 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9103e-05 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819807+0000", 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012822899999999999 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820044+0000", 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023652800000000001 2024-04-26T12:39:28.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820418+0000", 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037437400000000002 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.821605+0000", 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011867939999999999 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822310+0000", 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070503099999999995 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822480+0000", 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170089 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822589+0000", 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010892599999999999 2024-04-26T12:39:28.775 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.779973532, 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030753500000000001, 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.776 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 727 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926226+0000", 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1129999999999999e-06 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926237+0000", 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926265+0000", 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.864e-05 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926283+0000", 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7949999999999999e-05 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926378+0000", 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5081999999999995e-05 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926590+0000", 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021203500000000001 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926950+0000", 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035924399999999999 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.928069+0000", 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001119302 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929136+0000", 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001066542 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929227+0000", 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1142000000000003e-05 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929299+0000", 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2620000000000006e-05 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.782 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.592865896000006, 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029575529999999999, 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 808 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113334+0000", 2024-04-26T12:39:28.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113347+0000", 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.288e-05 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113378+0000", 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1056000000000002e-05 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113394+0000", 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5616000000000001e-05 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113541+0000", 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147412 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113767+0000", 2024-04-26T12:39:28.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225372 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.114085+0000", 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031803799999999998 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.115306+0000", 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012213 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116132+0000", 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00082585700000000005 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116224+0000", 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2392999999999994e-05 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116289+0000", 2024-04-26T12:39:28.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4999000000000006e-05 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.575372215000002, 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028474419999999999, 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.789 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 816 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130827+0000", 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7239999999999999e-06 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130836+0000", 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0729999999999994e-06 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130857+0000", 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1396999999999999e-05 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130870+0000", 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2363e-05 2024-04-26T12:39:28.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130982+0000", 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112509 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131114+0000", 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131779 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:28.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131385+0000", 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027119500000000001 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.132710+0000", 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013251059999999999 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133474+0000", 2024-04-26T12:39:28.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00076380800000000004 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133565+0000", 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0785000000000006e-05 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133673+0000", 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107703 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.795 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.424604944999999, 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029548180000000001, 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.796 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 880 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:28.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281595+0000", 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.92e-06 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281608+0000", 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281639+0000", 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0263000000000001e-05 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281654+0000", 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5613000000000001e-05 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281790+0000", 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013560300000000001 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282021+0000", 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023109399999999999 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282352+0000", 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033127100000000001 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.283508+0000", 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011555820000000001 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284259+0000", 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075111399999999999 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284429+0000", 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017024499999999999 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284547+0000", 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118193 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.802 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.420229218000003, 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049047079999999998, 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 882 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.803 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285970+0000", 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285981+0000", 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0993e-05 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286015+0000", 2024-04-26T12:39:28.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3309999999999998e-05 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286034+0000", 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8936e-05 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286154+0000", 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011998900000000001 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286385+0000", 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000231585 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286882+0000", 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000496763 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.288886+0000", 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002004207 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290664+0000", 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017773800000000001 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290757+0000", 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3616000000000006e-05 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290873+0000", 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011579899999999999 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:28.809 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.414976873000001, 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030718659999999999, 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 883 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.810 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291223+0000", 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2869999999999999e-06 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291234+0000", 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1596999999999999e-05 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291265+0000", 2024-04-26T12:39:28.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.044e-05 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291283+0000", 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7878999999999999e-05 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291402+0000", 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119406 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291649+0000", 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024725499999999999 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291980+0000", 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033056999999999997 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.293099+0000", 2024-04-26T12:39:28.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011188979999999999 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294018+0000", 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091867000000000001 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294175+0000", 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015740200000000001 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294292+0000", 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011746199999999999 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.410687482, 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032575410000000001, 2024-04-26T12:39:28.816 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 885 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:28.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295511+0000", 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3060000000000001e-06 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295518+0000", 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295538+0000", 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9409999999999999e-05 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295549+0000", 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1328999999999999e-05 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295669+0000", 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119616 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295892+0000", 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223799 2024-04-26T12:39:28.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.296415+0000", 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052249900000000005 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.297588+0000", 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011734740000000001 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298501+0000", 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091317000000000004 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298652+0000", 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015026199999999999 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298768+0000", 2024-04-26T12:39:28.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115779 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.343809027999995, 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030403560000000001, 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.823 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 913 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362391+0000", 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362407+0000", 2024-04-26T12:39:28.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6066000000000002e-05 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362437+0000", 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9728999999999999e-05 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362452+0000", 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5147000000000001e-05 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362568+0000", 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116172 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362806+0000", 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023781900000000001 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.363150+0000", 2024-04-26T12:39:28.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000344144 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.364211+0000", 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010614979999999999 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365228+0000", 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001016669 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365315+0000", 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6496000000000007e-05 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365429+0000", 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114226 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.829 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.311081705000007, 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003220929, 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 927 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.830 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395118+0000", 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4099999999999998e-06 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395130+0000", 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1487e-05 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395161+0000", 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1152999999999998e-05 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395181+0000", 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0273999999999999e-05 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395306+0000", 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124805 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395534+0000", 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000228085 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.396011+0000", 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000477493 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.397356+0000", 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013446199999999999 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398060+0000", 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070440100000000001 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398223+0000", 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000162855 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398337+0000", 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113346 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 66.307518361999996, 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030649560000000002, 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:28.836 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 928 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398682+0000", 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.43e-06 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398693+0000", 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1324e-05 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398724+0000", 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0926000000000002e-05 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398742+0000", 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398865+0000", 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123542 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399201+0000", 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033574800000000003 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399744+0000", 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054293600000000005 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401070+0000", 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013257360000000001 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401546+0000", 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047601000000000002 2024-04-26T12:39:28.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401633+0000", 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7225999999999995e-05 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401744+0000", 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000111195 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.842 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.843 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:28.843 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:28.843 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:28.845 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:28.845 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:28.842+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:28.947 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:28.942+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:29.018 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:29.019 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:29.019 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:29.019 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:29.032 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:29.047 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:29.046+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:29.151 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:29.150+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:29.201 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:29.202 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:29.202 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:29.202 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:29.202 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:29.215 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:29.251 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:29.250+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:29.265 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:39:29.340 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:29.340 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:29.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:29.340 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:29.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.340 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:29.340 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 70.847738152000005, 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:29.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.346 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 70.831041517000003, 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.347 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:39:29.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:29.352 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 70.827235028999993, 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:39:29.356 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.838988063000002, 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.357 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:39:29.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:39:29.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:39:29.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.777038490999999, 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:39:29.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:39:29.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.766161514999993, 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:39:29.368 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:39:29.373 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.754772908999996, 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.374 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:39:29.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:39:29.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.379 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.661518779000005, 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.659497242, 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:39:29.385 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.656576657000002, 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.391 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:39:29.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:39:29.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.656296229000006, 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.397 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:39:29.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:39:29.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.651571188999995, 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:39:29.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:29.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.648349139000004, 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.412 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.646867279000006, 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:39:29.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:39:29.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:39:29.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.645628647999999, 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.417 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.422 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.642643941000003, 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.426 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.640553089999997, 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:39:29.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:29.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.628386062000004, 2024-04-26T12:39:29.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:29.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:39:29.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:39:29.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:39:29.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.619789518000005, 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:39:29.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.607630030999999, 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:39:29.447 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.448 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.448 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.448 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.448 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.448 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:29.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:29.450 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:29.450+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:29.550 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:29.550+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:29.575 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:29.576 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:29.576 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:29.576 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:29.590 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:29.651 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:29.650+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:29.706 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:29.707 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:29.707 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:29.707 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:29.707 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:29.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:29.764 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:29.762+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:29.844 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:29.844 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:29.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:29.845 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:29.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.845 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:29.845 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:29.845 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.369389888000001, 2024-04-26T12:39:29.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:39:29.846 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.846 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.846 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.846 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:29.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:29.852 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.354397657000007, 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:29.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.329601214999997, 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:39:29.858 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:39:29.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:39:29.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.326922416000002, 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:29.864 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:29.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.325450383000003, 2024-04-26T12:39:29.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:29.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:39:29.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.20455149, 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:29.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:39:29.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:39:29.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:39:29.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.187216737, 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.186544459000004, 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.882 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:39:29.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:39:29.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.157283155000002, 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:39:29.886 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:29.890 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.143384232000002, 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:39:29.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:39:29.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.894 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.137931647000002, 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:39:29.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:39:29.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.135811230000002, 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:39:29.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.133848655999998, 2024-04-26T12:39:29.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:39:29.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:39:29.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.907 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.133396465000004, 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:39:29.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:39:29.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:39:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.131036542000004, 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 68.125338002000007, 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.916 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:39:29.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:39:29.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:29.920 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.964174255000003, 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:29.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:39:29.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:39:29.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.755426189999994, 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.928 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.606635275000002, 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:39:29.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:39:29.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:39:29.932 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 67.525341897999994, 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:29.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:29.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:29.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:29.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:39:29.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:39:29.937 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.937 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.937 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.937 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:29.937 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:29.937 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:29.939 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:29.939 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:29.934+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:30.039 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:30.038+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:30.107 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:30.108 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:30.108 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:30.108 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:30.122 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:30.168 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:30.166+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:30.241 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:30.238+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:30.242 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:30.242 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:30.242 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:30.242 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:30.242 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:30.256 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:30.342 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:30.342+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:30.426 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.033745549000002, 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.427 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:39:30.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:39:30.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:39:30.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.960289692999993, 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:39:30.435 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:39:30.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:39:30.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.960102927999998, 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.442 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:39:30.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:39:30.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.448 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.960060440999996, 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:30.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:39:30.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.455 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.878274418999993, 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.456 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:30.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:39:30.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.878157000000002, 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.463 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:39:30.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:39:30.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:39:30.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:39:30.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:39:30.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.469 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.730295772999995, 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.470 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:39:30.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:39:30.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:39:30.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.476 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.730099437999996, 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.477 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:30.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:39:30.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:39:30.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:39:30.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:39:30.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.730063830999995, 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.484 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:39:30.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.730026049000003, 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.491 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:39:30.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:39:30.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.729825289999994, 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.498 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:39:30.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:39:30.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.504 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.729718401, 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:39:30.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:39:30.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.729678333999999, 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.512 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:39:30.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:39:30.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.729483115999997, 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:39:30.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:39:30.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:39:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.729446038999995, 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.525 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:39:30.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:39:30.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:39:30.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.277968595000004, 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.532 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:30.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:39:30.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.277823412999993, 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.539 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:30.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:39:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.545 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 84.471828657000003, 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.546 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:30.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:30.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:39:30.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:39:30.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 84.471751054999999, 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:39:30.553 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.554 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.554 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.554 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:39:30.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.554 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:30.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:30.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:39:30.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:39:30.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:39:30.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:39:30.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:39:30.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:39:30.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:39:30.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:30.561 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 84.471460859999993, 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:30.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:30.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:30.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:39:30.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:39:30.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:30.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:39:30.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:39:30.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:30.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:30.568 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:30.569 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:30.569 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:30.570 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:30.570+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:30.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:30.671 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:30.670+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:30.742 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:30.742 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:30.742 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:30.742 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:30.759 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:30.770 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:30.770 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:30.772 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:30.770+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:30.802 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:30.802 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:30.833 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:30.834 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:30.864 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:30.865 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:30.873 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:30.870+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:30.898 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:30.899 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:30.931 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:30.932 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:30.940 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:30.940 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:30.958 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:30.964 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:30.965 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:30.998 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:30.999 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:30.999 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:30.998+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:31.075 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:31.074+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:31.135 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:31.135 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:31.152 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:31.193 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:31.194+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:31.276 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:31.274+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:31.293 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:39:31.349 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T12:39:31.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:39:31.363 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:31.363 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:31.378 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:31.378+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:31.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:31.479 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:31.474+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:31.580 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:31.578+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:31.597 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:31.597 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:31.616 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:31.681 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:31.678+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:31.782 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:31.782+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:31.831 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:31.831 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:31.849 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:31.893 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:31.894+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:31.984 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:31.982+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:32.021 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:32.022 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:32.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:32.085 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:32.082+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:32.186 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:32.186+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:32.250 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:32.250 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:32.268 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:32.276 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:39:32.283 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:39:32.287 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:32.282+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:32.311 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:39:32.387 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:32.382+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:32.460 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:32.461 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:32.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:32.488 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:32.486+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:32.589 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:32.590+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:32.657 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:32.657 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:32.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:32.690 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:32.686+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:32.791 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:32.790+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:32.855 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:32.855 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:32.869 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:32.913 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:32.914+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:32.978 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:32.979 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:32.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:32.994 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:32.990+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:33.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:33.094 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:33.094+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:33.125 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:33.125 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:33.139 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:33.195 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:33.194+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:33.232 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:33.232 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:33.259 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:33.259 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:33.263 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:33.273 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:33.284 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:39:33.296 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:33.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:39:33.320 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:33.318+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:33.328 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:33.358 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:33.358 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:33.391 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:33.397 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:33.394+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:33.402 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:33.402 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:33.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:33.402 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:33.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.403 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-26T12:39:33.403 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:33.403 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 76.940745282999998, 2024-04-26T12:39:33.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011918331000000001, 2024-04-26T12:39:33.403 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.403 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.403 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "reached pg", 2024-04-26T12:39:33.403 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.403 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 43 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457562+0000", 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457566+0000", 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5530000000000001e-06 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457583+0000", 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7654000000000001e-05 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457626+0000", 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2110000000000002e-05 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457652+0000", 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6789000000000001e-05 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457863+0000", 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000210225 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.457885+0000", 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2456999999999999e-05 2024-04-26T12:39:33.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469169+0000", 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011284343 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:16.469481+0000", 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031119999999999997 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.407 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.873545444000001, 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003553853, 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 211 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524762+0000", 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524766+0000", 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0829999999999997e-06 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524786+0000", 2024-04-26T12:39:33.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9494e-05 2024-04-26T12:39:33.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524830+0000", 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4240000000000003e-05 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.524856+0000", 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5703000000000001e-05 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525044+0000", 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018797799999999999 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525374+0000", 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033005099999999999 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.525827+0000", 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045309000000000001 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.527234+0000", 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014076259999999999 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528147+0000", 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091301299999999995 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528241+0000", 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3466000000000003e-05 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.528316+0000", 2024-04-26T12:39:33.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.794319591999994, 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003758815, 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.414 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 232 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603988+0000", 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.603990+0000", 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.357e-06 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604002+0000", 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.154e-05 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604033+0000", 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1136999999999997e-05 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604049+0000", 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5869e-05 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604216+0000", 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167615 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.604567+0000", 2024-04-26T12:39:33.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035053100000000001 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.605359+0000", 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079155700000000002 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607196+0000", 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018378699999999999 2024-04-26T12:39:33.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607588+0000", 2024-04-26T12:39:33.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039154700000000001 2024-04-26T12:39:33.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607677+0000", 2024-04-26T12:39:33.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9319000000000003e-05 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.607747+0000", 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9473000000000004e-05 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:243 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.772987255999993, 2024-04-26T12:39:33.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032017550000000001, 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 243 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625320+0000", 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625323+0000", 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8399999999999999e-06 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625338+0000", 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4637000000000001e-05 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625375+0000", 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7648999999999998e-05 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625396+0000", 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1047e-05 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625563+0000", 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016640900000000001 2024-04-26T12:39:33.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.625966+0000", 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040301699999999998 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.626371+0000", 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040509600000000003 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.627764+0000", 2024-04-26T12:39:33.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001393266 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628199+0000", 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043461599999999997 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628404+0000", 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020512899999999999 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.628522+0000", 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011804899999999999 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:276 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.767790242999993, 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032314010000000001, 2024-04-26T12:39:33.426 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 276 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630517+0000", 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630519+0000", 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1459999999999999e-06 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630532+0000", 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2604e-05 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630558+0000", 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630576+0000", 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.630750+0000", 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173392 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631068+0000", 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031842099999999999 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.631575+0000", 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00050638899999999999 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.632975+0000", 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001400486 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633495+0000", 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051948900000000004 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633635+0000", 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000140972 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.633749+0000", 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113239 2024-04-26T12:39:33.431 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:295 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.763425929999997, 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032101120000000002, 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.432 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 295 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634882+0000", 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634883+0000", 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.204e-06 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634891+0000", 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0830000000000004e-06 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634905+0000", 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.382e-05 2024-04-26T12:39:33.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.634926+0000", 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1243e-05 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635316+0000", 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039014699999999998 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.635549+0000", 2024-04-26T12:39:33.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023250500000000001 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.636038+0000", 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048965300000000005 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637344+0000", 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001305683 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637862+0000", 2024-04-26T12:39:33.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00051851600000000001 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.637977+0000", 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114926 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638092+0000", 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114332 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:355 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.754564924999997, 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003073569, 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 355 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.438 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643743+0000", 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643745+0000", 2024-04-26T12:39:33.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2859999999999998e-06 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643758+0000", 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2644e-05 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643805+0000", 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7763000000000003e-05 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643825+0000", 2024-04-26T12:39:33.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9375999999999999e-05 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.643970+0000", 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014545199999999999 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644263+0000", 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029315800000000001 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:33.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.644807+0000", 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054336300000000005 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646108+0000", 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001300896 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646628+0000", 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052052000000000001 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646730+0000", 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102229 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.646816+0000", 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5882000000000002e-05 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.443 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:408 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.445 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:33.445 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.733416605000002, 2024-04-26T12:39:33.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029401380000000001, 2024-04-26T12:39:33.445 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.445 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.445 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.445 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.445 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 408 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664891+0000", 2024-04-26T12:39:33.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664894+0000", 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664906+0000", 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2323e-05 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664953+0000", 2024-04-26T12:39:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6594000000000001e-05 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.664967+0000", 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4813e-05 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665094+0000", 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012636200000000001 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665327+0000", 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233172 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.665786+0000", 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045890599999999997 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667078+0000", 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012926400000000001 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667564+0000", 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048546700000000001 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667708+0000", 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014418800000000001 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.667831+0000", 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123013 2024-04-26T12:39:33.450 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:497 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.672492982999998, 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046691349999999996, 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.451 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 497 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725815+0000", 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725817+0000", 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725830+0000", 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2672e-05 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725862+0000", 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2042000000000003e-05 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.725930+0000", 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7731000000000006e-05 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726082+0000", 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152929 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726313+0000", 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023097499999999999 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.726729+0000", 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041546699999999998 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729760+0000", 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003031083 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730288+0000", 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052804299999999996 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730419+0000", 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013093499999999999 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.730484+0000", 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4772999999999998e-05 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.456 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.578694506000005, 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002976111, 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 633 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:33.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819613+0000", 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819615+0000", 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7269999999999999e-06 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819626+0000", 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1229999999999999e-05 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819660+0000", 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4079999999999999e-05 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819679+0000", 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9103e-05 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.819807+0000", 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012822899999999999 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820044+0000", 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023652800000000001 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.820418+0000", 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037437400000000002 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.821605+0000", 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011867939999999999 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822310+0000", 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070503099999999995 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822480+0000", 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170089 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.822589+0000", 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010892599999999999 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.462 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.472083624999996, 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030753500000000001, 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 727 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926224+0000", 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926226+0000", 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1129999999999999e-06 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926237+0000", 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0679999999999999e-05 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926265+0000", 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.864e-05 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926283+0000", 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7949999999999999e-05 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926378+0000", 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5081999999999995e-05 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926590+0000", 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021203500000000001 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.926950+0000", 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00035924399999999999 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.928069+0000", 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001119302 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929136+0000", 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001066542 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929227+0000", 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1142000000000003e-05 2024-04-26T12:39:33.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.929299+0000", 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2620000000000006e-05 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.284975989000003, 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029575529999999999, 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.468 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 808 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113332+0000", 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113334+0000", 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113347+0000", 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.288e-05 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113378+0000", 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1056000000000002e-05 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113394+0000", 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5616000000000001e-05 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113541+0000", 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147412 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.113767+0000", 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225372 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.114085+0000", 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031803799999999998 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.115306+0000", 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012213 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116132+0000", 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00082585700000000005 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116224+0000", 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2392999999999994e-05 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.116289+0000", 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4999000000000006e-05 2024-04-26T12:39:33.473 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.267482307999998, 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028474419999999999, 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.474 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 816 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130825+0000", 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130827+0000", 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7239999999999999e-06 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130836+0000", 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0729999999999994e-06 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130857+0000", 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1396999999999999e-05 2024-04-26T12:39:33.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130870+0000", 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2363e-05 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.130982+0000", 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112509 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131114+0000", 2024-04-26T12:39:33.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131779 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.131385+0000", 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027119500000000001 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.132710+0000", 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013251059999999999 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133474+0000", 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00076380800000000004 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133565+0000", 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0785000000000006e-05 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.133673+0000", 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107703 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.116715037999995, 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029548180000000001, 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 880 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.480 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281593+0000", 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281595+0000", 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.92e-06 2024-04-26T12:39:33.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281608+0000", 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281639+0000", 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0263000000000001e-05 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281654+0000", 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5613000000000001e-05 2024-04-26T12:39:33.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.281790+0000", 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013560300000000001 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282021+0000", 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023109399999999999 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.282352+0000", 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033127100000000001 2024-04-26T12:39:33.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.283508+0000", 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011555820000000001 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284259+0000", 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075111399999999999 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284429+0000", 2024-04-26T12:39:33.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017024499999999999 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.284547+0000", 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118193 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.112339310999999, 2024-04-26T12:39:33.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049047079999999998, 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 882 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285968+0000", 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285970+0000", 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1299999999999999e-06 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.285981+0000", 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0993e-05 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286015+0000", 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3309999999999998e-05 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286034+0000", 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8936e-05 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286154+0000", 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011998900000000001 2024-04-26T12:39:33.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286385+0000", 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000231585 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.286882+0000", 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000496763 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.288886+0000", 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002004207 2024-04-26T12:39:33.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290664+0000", 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017773800000000001 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290757+0000", 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3616000000000006e-05 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.290873+0000", 2024-04-26T12:39:33.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011579899999999999 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.107086965999997, 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030718659999999999, 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 883 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291221+0000", 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291223+0000", 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2869999999999999e-06 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291234+0000", 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1596999999999999e-05 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291265+0000", 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.044e-05 2024-04-26T12:39:33.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291283+0000", 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7878999999999999e-05 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291402+0000", 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119406 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291649+0000", 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024725499999999999 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.291980+0000", 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033056999999999997 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.293099+0000", 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011188979999999999 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294018+0000", 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091867000000000001 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294175+0000", 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015740200000000001 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.294292+0000", 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011746199999999999 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.496 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:885 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.102797574999997, 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032575410000000001, 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.497 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 885 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295510+0000", 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295511+0000", 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3060000000000001e-06 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295518+0000", 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8970000000000002e-06 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295538+0000", 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9409999999999999e-05 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295549+0000", 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1328999999999999e-05 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295669+0000", 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119616 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.295892+0000", 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223799 2024-04-26T12:39:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.296415+0000", 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052249900000000005 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.297588+0000", 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011734740000000001 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298501+0000", 2024-04-26T12:39:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091317000000000004 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298652+0000", 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015026199999999999 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.298768+0000", 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115779 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.035919121000006, 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030403560000000001, 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 913 2024-04-26T12:39:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362388+0000", 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362391+0000", 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362407+0000", 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6066000000000002e-05 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362437+0000", 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9728999999999999e-05 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362452+0000", 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5147000000000001e-05 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362568+0000", 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116172 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.362806+0000", 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023781900000000001 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.363150+0000", 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000344144 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.364211+0000", 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010614979999999999 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365228+0000", 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001016669 2024-04-26T12:39:33.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365315+0000", 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6496000000000007e-05 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.365429+0000", 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114226 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.003191798000003, 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003220929, 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 927 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395116+0000", 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395118+0000", 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4099999999999998e-06 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395130+0000", 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1487e-05 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395161+0000", 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1152999999999998e-05 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395181+0000", 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0273999999999999e-05 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395306+0000", 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124805 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.395534+0000", 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000228085 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.396011+0000", 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000477493 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.397356+0000", 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013446199999999999 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398060+0000", 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00070440100000000001 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398223+0000", 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000162855 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398337+0000", 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113346 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 70.999628455000007, 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030649560000000002, 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:33.514 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 928 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398679+0000", 2024-04-26T12:39:33.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398682+0000", 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.43e-06 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398693+0000", 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1324e-05 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398724+0000", 2024-04-26T12:39:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0926000000000002e-05 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398742+0000", 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.398865+0000", 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123542 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399201+0000", 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033574800000000003 2024-04-26T12:39:33.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.399744+0000", 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00054293600000000005 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401070+0000", 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013257360000000001 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401546+0000", 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047601000000000002 2024-04-26T12:39:33.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401633+0000", 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7225999999999995e-05 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.401744+0000", 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000111195 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:33.519 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:33.520 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:33.520 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:33.521 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:33.521 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:33.522 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:33.522 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:33.518+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:33.523 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:33.622 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:33.622+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:33.694 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:33.694 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:33.694 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:33.694 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:33.708 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:33.723 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:33.722+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:33.824 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:33.822+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:33.827 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:33.827 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:33.827 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:33.841 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:33.929 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:33.926+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:34.012 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:34.012 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:34.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:34.012 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:34.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.012 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 75.519966370000006, 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:39:34.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:39:34.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 75.503269735000003, 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.019 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:34.024 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 75.499463246999994, 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.028 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.511216281000003, 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:39:34.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:39:34.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:39:34.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.449266709, 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:39:34.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.438389732999994, 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:39:34.040 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:39:34.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:39:34.045 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.427001126999997, 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.046 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.047 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:34.051 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.333746997000006, 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.052 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:34.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:34.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:39:34.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.057 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.331725460000001, 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.061 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.062 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.328804875000003, 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.063 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.064 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.064 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.064 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.064 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:39:34.064 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.064 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.064 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.066 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:39:34.067 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:39:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:39:34.069 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.070 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.328524447000007, 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.071 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:39:34.072 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:39:34.073 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:39:34.074 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.075 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.323799406999996, 2024-04-26T12:39:34.076 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.077 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:39:34.078 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:39:34.079 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:39:34.080 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:39:34.081 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.320577357000005, 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.082 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.083 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:39:34.084 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:39:34.085 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.319095497000006, 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:39:34.086 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.087 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.088 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.089 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.090 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.317856866, 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.092 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.093 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.094 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.095 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.314872159000004, 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.096 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:39:34.097 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.098 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.099 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:34.100 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.312781307999998, 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.101 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:39:34.102 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:39:34.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:39:34.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:39:34.105 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.300614280000005, 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.106 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.107 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:39:34.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:39:34.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.292017736000005, 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:39:34.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:39:34.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:39:34.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.279858249, 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.117 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.121 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:34.123 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:34.123 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:34.118+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:34.223 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:34.222+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:34.290 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:34.291 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:34.291 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:34.291 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:39:34.307 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:34.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:39:34.319 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-26T12:39:34.356 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:34.354+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:34.425 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:34.422+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:34.428 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:34.428 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:34.428 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:34.428 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:34.429 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:34.443 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:34.526 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:34.526+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:34.614 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:34.614 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 76.138031593999997, 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.615 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:39:34.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:39:34.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:39:34.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:39:34.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 76.123039363000004, 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.621 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:39:34.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:39:34.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 76.098242920999994, 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:39:34.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:39:34.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:39:34.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:39:34.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 76.095564121999999, 2024-04-26T12:39:34.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:34.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:39:34.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:39:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:39:34.639 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 73.094092089, 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.640 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.641 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:34.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:34.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:39:34.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:39:34.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:39:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:39:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:39:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:39:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:39:34.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.973193195999997, 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.955858442999997, 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.650 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:34.654 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.955186165000001, 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:39:34.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.925924860999999, 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:39:34.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:39:34.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.912025937999999, 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:39:34.663 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:39:34.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.667 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.906573352999999, 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:34.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.672 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.904452935999998, 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:39:34.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:39:34.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:39:34.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:39:34.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:39:34.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:39:34.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:39:34.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:39:34.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.679 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.902490361999995, 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.680 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:39:34.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:39:34.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.684 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.902038171000001, 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.899678248000001, 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.689 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:34.693 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.893979708000003, 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:39:34.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:39:34.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.732815961, 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:39:34.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:39:34.702 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.702 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.702 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.702 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.524067896000005, 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:39:34.707 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.375276980999999, 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.712 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 72.293983604000005, 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:34.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:34.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:34.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:39:34.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:39:34.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:34.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:39:34.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:39:34.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:34.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:39:34.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:39:34.718 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.718 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.718 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.718 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:34.718 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:34.718 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:34.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:34.720 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:34.718+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:34.820 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:34.818+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:34.888 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:34.888 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:34.888 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:34.888 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:34.902 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:34.921 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:34.922+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:35.022 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:35.022+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:35.027 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:35.027 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:35.027 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:35.027 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:35.027 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:35.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:35.123 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:35.122+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:35.160 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:35.160 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:35.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:35.160 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:35.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.160 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.160 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:35.160 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.770136660000006, 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:35.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:39:35.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:39:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.164 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.166 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.696680803999996, 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.167 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:39:35.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:39:35.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:35.172 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.696494039000001, 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:35.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.696451551999999, 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.178 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:39:35.183 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.614665529999996, 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.184 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.189 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.190 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.190 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:35.190 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.614548111000005, 2024-04-26T12:39:35.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:39:35.190 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.190 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.190 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:35.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.193 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.466686883999998, 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:39:35.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:39:35.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:39:35.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:39:35.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.466490549, 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:39:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:39:35.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.206 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.466454941999999, 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.207 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:35.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:39:35.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:39:35.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:39:35.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.466417160000006, 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:39:35.212 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:39:35.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:39:35.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:39:35.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.217 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.466216400999997, 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:39:35.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:39:35.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:39:35.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:39:35.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:39:35.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.466109512000003, 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.223 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:39:35.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:39:35.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:39:35.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.228 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.466069445000002, 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:35.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.465874227, 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.234 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.239 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.465837149999999, 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:39:35.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:39:35.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:39:35.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:39:35.244 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.014359705999993, 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.245 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.250 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.014214523999996, 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:35.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:39:35.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:39:35.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 89.208219768000006, 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:39:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:39:35.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:39:35.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 89.208142166000002, 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:39:35.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:39:35.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:39:35.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 89.207851970999997, 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:39:35.267 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:39:35.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:39:35.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:39:35.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:39:35.273 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.273 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.273 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.273 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:35.273 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:35.273 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:35.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:35.275 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:35.274+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:35.304 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.3 to 1 (10000) 2024-04-26T12:39:35.309 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:39:35.335 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-26T12:39:35.375 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:35.370+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:35.452 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:35.452 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:35.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:35.513 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:35.514+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:35.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:35.577 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:35.574+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:35.643 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:35.643 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:35.643 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:35.643 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:35.643 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:35.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:35.678 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:35.674+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:35.744 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:35.744 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:35.775 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:35.775 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:35.778 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:35.778+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:35.806 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:35.828 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:35.828 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:35.836 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:35.837 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:35.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:35.859 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:35.859 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:35.880 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:35.878+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:35.889 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:35.889 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:35.924 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:35.925 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:35.959 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:35.959 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:35.981 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:35.978+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:36.009 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:36.009 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:36.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:36.109 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:36.110+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:36.185 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:36.178+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:36.236 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:36.237 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:36.255 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:36.284 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:36.282+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:36.307 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.4 to 1 (10000) 2024-04-26T12:39:36.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-26T12:39:36.385 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:36.382+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:36.478 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:36.478 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:36.486 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:36.486+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:36.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:36.587 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:36.586+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:36.688 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:36.686+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:36.715 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:36.715 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:36.735 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:36.825 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:36.826+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:36.890 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:36.890+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:36.956 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:36.956 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:36.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:36.991 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:36.986+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:37.092 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:37.090+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:37.186 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:37.193 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:37.190+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:37.203 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:37.294 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:37.290+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:37.313 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.5 to 1 (10000) 2024-04-26T12:39:37.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-26T12:39:37.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:39:37.375 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:37.375 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:37.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:37.396 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:37.394+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:37.496 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:37.494+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:37.597 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:37.598+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:37.620 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:37.620 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:37.638 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:37.698 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:37.694+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:37.799 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:37.798+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:37.854 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:37.854 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:37.872 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:37.913 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:37.914+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:37.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:38.005 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:38.005 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:38.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:38.033 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:38.034+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:38.102 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:38.102+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:38.136 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:38.136 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:38.151 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:38.184 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:38.184 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:38.202 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:38.202+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:38.214 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:38.215 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:38.245 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:38.246 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:38.274 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:38.274 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:38.276 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:38.276 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:38.288 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:38.308 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:38.309 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:38.333 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:38.330+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:38.344 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:39:38.345 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:38.345 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:38.346 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.6 to 1 (10000) 2024-04-26T12:39:38.376 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-26T12:39:38.379 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:38.380 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:38.410 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:38.410 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:38.410 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:38.410 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:38.413 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:38.413 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:38.413 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:38.410+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:38.424 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:38.504 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:38.502+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:38.590 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:38.590 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:38.590 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:38.590 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:38.590 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:38.604 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:38.608 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:38.602+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:38.707 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:38.706+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:38.734 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:38.734 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.241866344000002, 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:39:38.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:39:38.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:39:38.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:39:38.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:38.741 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.225169708999999, 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:38.747 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.221363221000004, 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:39:38.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:39:38.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.752 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:38.752 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:38.752 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.233116254999999, 2024-04-26T12:39:38.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:39:38.752 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.752 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.752 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.752 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.752 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:38.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:39:38.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.171166682999996, 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:39:38.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:39:38.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:39:38.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.764 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.160289707000004, 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.765 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.148901101000007, 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.771 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:39:38.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:39:38.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:39:38.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:39:38.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.055646971000002, 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.777 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:39:38.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:39:38.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.053625433999997, 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.783 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.788 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.050704848999999, 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:38.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:39:38.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:39:38.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:39:38.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:39:38.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:39:38.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:39:38.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.050424421000002, 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:39:38.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.800 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.045699381000006, 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:39:38.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:39:38.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.042477331000001, 2024-04-26T12:39:38.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:39:38.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:39:38.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.040995471000002, 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:39:38.814 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.039756839999995, 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:39:38.820 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.036772132999999, 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:38.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.034681281999994, 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.825 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:38.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:39:38.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:39:38.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:39:38.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.022514254000001, 2024-04-26T12:39:38.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:39:38.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:39:38.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:39:38.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.013917710000001, 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:38.836 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:39:38.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:39:38.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:39:38.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.001758222999996, 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.845 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.846 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:38.846 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:38.846 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:38.847 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:38.848 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:38.842+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:38.948 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:38.946+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:39.016 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:39.016 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:39.030 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:39.076 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:39.074+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:39.150 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:39.150+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:39.153 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:39.153 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:39.153 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:39.153 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:39.153 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:39.167 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:39.250 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:39.250+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.855125896000004, 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.332 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:39:39.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:39:39.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.840133664999996, 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:39.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.815337223, 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.344 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:39:39.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:39:39.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:39:39.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.812658424000006, 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.811186391000007, 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.355 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:39:39.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.690287498000004, 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.359 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:39:39.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.672952745000003, 2024-04-26T12:39:39.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:39:39.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:39:39.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.672280466999993, 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:39:39.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:39:39.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:39:39.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.643019163000005, 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:39.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:39:39.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:39:39.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:39.380 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.629120240000006, 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:39.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:39:39.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.384 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.623667655000006, 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:39:39.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:39.389 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.621547238000005, 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:39.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.619584664000001, 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:39.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:39:39.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.619132472999993, 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.398 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:39.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:39:39.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:39.402 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.616772549999993, 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:39.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.611074009999996, 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:39.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:39:39.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:39:39.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.449910263000007, 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:39:39.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.415 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.241162197999998, 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.419 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.092371283000006, 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 77.011077905999997, 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:39:39.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:39:39.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:39:39.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.428 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:39.430 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.7 to 1 (10000) 2024-04-26T12:39:39.430 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:39.431 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:39.426+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:39.431 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:39:39.431 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:39:39.530 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:39.530+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:39.599 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:39.599 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:39.599 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:39.599 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:39.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:39.662 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:39.658+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:39.732 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:39.732 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:39.733 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:39.733 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:39.733 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:39.733 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:39.730+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:39.746 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:39.833 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:39.834+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.517572322999996, 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.910 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:39:39.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:39:39.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:39:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.916 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.444116467000001, 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.443929702000005, 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:39:39.922 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:39:39.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:39:39.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:39:39.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.443887215000004, 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:39:39.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:39:39.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:39:39.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.362101193000001, 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:39:39.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.361983773999995, 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.940 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:39:39.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:39:39.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.214122547000002, 2024-04-26T12:39:39.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:39:39.946 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.946 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.946 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.946 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.946 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.946 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.946 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:39:39.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.946 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:39.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:39:39.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:39:39.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.213926212000004, 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:39:39.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:39:39.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:39:39.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.213890605000003, 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.958 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.213852822999996, 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:39:39.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.213652064000001, 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:39:39.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:39:39.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.213545174999993, 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.975 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:39.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:39:39.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.213505108000007, 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.981 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:39.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:39:39.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.213309890000005, 2024-04-26T12:39:39.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:39:39.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.213272813000003, 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.993 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:39.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:39.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:39:39.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.998 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 94.761795368999998, 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:39.999 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:39:40.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.004 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 94.761650187000001, 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:40.005 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:39:40.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:40.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:40.010 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 93.955655430999997, 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:39:40.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:39:40.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:39:40.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.016 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 93.955577829000006, 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:40.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:39:40.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:39:40.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:40.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.022 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 93.955287634000001, 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:40.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:40.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:40.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:39:40.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:39:40.028 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.028 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:40.028 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.028 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:40.028 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:40.028 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:40.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:40.035 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:39:40.041 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:39:40.042 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:40.030+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:40.044 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-04-26T12:39:39.355472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":804,"num_read_kb":547,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":527,"ondisk_log_size":527,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243784,"kb_used_data":6800,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730936,"statfs":{"total":773094113280,"available":772844478464,"internally_reserved":0,"allocated":6963200,"data_stored":4184910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.049629"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432011+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:39:37.432011+0000","last_peered":"2024-04-26T12:39:37.432011+0000","last_clean":"2024-04-26T12:39:37.432011+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:39:37.432011+0000","last_undegraded":"2024-04-26T12:39:37.432011+0000","last_fullsized":"2024-04-26T12:39:37.432011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749284+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:39:37.749284+0000","last_peered":"2024-04-26T12:39:37.749284+0000","last_clean":"2024-04-26T12:39:37.749284+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:39:37.749284+0000","last_undegraded":"2024-04-26T12:39:37.749284+0000","last_fullsized":"2024-04-26T12:39:37.749284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758302+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:39:37.758302+0000","last_peered":"2024-04-26T12:39:37.758302+0000","last_clean":"2024-04-26T12:39:37.758302+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:39:37.758302+0000","last_undegraded":"2024-04-26T12:39:37.758302+0000","last_fullsized":"2024-04-26T12:39:37.758302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429878+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:39:37.429878+0000","last_peered":"2024-04-26T12:39:37.429878+0000","last_clean":"2024-04-26T12:39:37.429878+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:39:37.429878+0000","last_undegraded":"2024-04-26T12:39:37.429878+0000","last_fullsized":"2024-04-26T12:39:37.429878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322450+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:39:37.322450+0000","last_peered":"2024-04-26T12:39:37.322450+0000","last_clean":"2024-04-26T12:39:37.322450+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:39:37.322450+0000","last_undegraded":"2024-04-26T12:39:37.322450+0000","last_fullsized":"2024-04-26T12:39:37.322450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321324+0000","last_change":"2024-04-26T12:38:32.099160+0000","last_active":"2024-04-26T12:39:37.321324+0000","last_peered":"2024-04-26T12:39:37.321324+0000","last_clean":"2024-04-26T12:39:37.321324+0000","last_became_active":"2024-04-26T12:38:32.093033+0000","last_became_peered":"2024-04-26T12:38:32.093033+0000","last_unstale":"2024-04-26T12:39:37.321324+0000","last_undegraded":"2024-04-26T12:39:37.321324+0000","last_fullsized":"2024-04-26T12:39:37.321324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:22.221188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750405+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:39:37.750405+0000","last_peered":"2024-04-26T12:39:37.750405+0000","last_clean":"2024-04-26T12:39:37.750405+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:39:37.750405+0000","last_undegraded":"2024-04-26T12:39:37.750405+0000","last_fullsized":"2024-04-26T12:39:37.750405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318755+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:39:37.318755+0000","last_peered":"2024-04-26T12:39:37.318755+0000","last_clean":"2024-04-26T12:39:37.318755+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:39:37.318755+0000","last_undegraded":"2024-04-26T12:39:37.318755+0000","last_fullsized":"2024-04-26T12:39:37.318755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430620+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:39:37.430620+0000","last_peered":"2024-04-26T12:39:37.430620+0000","last_clean":"2024-04-26T12:39:37.430620+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:39:37.430620+0000","last_undegraded":"2024-04-26T12:39:37.430620+0000","last_fullsized":"2024-04-26T12:39:37.430620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517570+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:39:37.517570+0000","last_peered":"2024-04-26T12:39:37.517570+0000","last_clean":"2024-04-26T12:39:37.517570+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:39:37.517570+0000","last_undegraded":"2024-04-26T12:39:37.517570+0000","last_fullsized":"2024-04-26T12:39:37.517570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310695+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:39:37.310695+0000","last_peered":"2024-04-26T12:39:37.310695+0000","last_clean":"2024-04-26T12:39:37.310695+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:39:37.310695+0000","last_undegraded":"2024-04-26T12:39:37.310695+0000","last_fullsized":"2024-04-26T12:39:37.310695+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322332+0000","last_change":"2024-04-26T12:38:32.092960+0000","last_active":"2024-04-26T12:39:37.322332+0000","last_peered":"2024-04-26T12:39:37.322332+0000","last_clean":"2024-04-26T12:39:37.322332+0000","last_became_active":"2024-04-26T12:38:32.092562+0000","last_became_peered":"2024-04-26T12:38:32.092562+0000","last_unstale":"2024-04-26T12:39:37.322332+0000","last_undegraded":"2024-04-26T12:39:37.322332+0000","last_fullsized":"2024-04-26T12:39:37.322332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:43.474569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430367+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:39:37.430367+0000","last_peered":"2024-04-26T12:39:37.430367+0000","last_clean":"2024-04-26T12:39:37.430367+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:39:37.430367+0000","last_undegraded":"2024-04-26T12:39:37.430367+0000","last_fullsized":"2024-04-26T12:39:37.430367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750544+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:39:37.750544+0000","last_peered":"2024-04-26T12:39:37.750544+0000","last_clean":"2024-04-26T12:39:37.750544+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:39:37.750544+0000","last_undegraded":"2024-04-26T12:39:37.750544+0000","last_fullsized":"2024-04-26T12:39:37.750544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697925+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:39:37.697925+0000","last_peered":"2024-04-26T12:39:37.697925+0000","last_clean":"2024-04-26T12:39:37.697925+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:39:37.697925+0000","last_undegraded":"2024-04-26T12:39:37.697925+0000","last_fullsized":"2024-04-26T12:39:37.697925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313584+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:39:37.313584+0000","last_peered":"2024-04-26T12:39:37.313584+0000","last_clean":"2024-04-26T12:39:37.313584+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:39:37.313584+0000","last_undegraded":"2024-04-26T12:39:37.313584+0000","last_fullsized":"2024-04-26T12:39:37.313584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316635+0000","last_change":"2024-04-26T12:38:32.098437+0000","last_active":"2024-04-26T12:39:37.316635+0000","last_peered":"2024-04-26T12:39:37.316635+0000","last_clean":"2024-04-26T12:39:37.316635+0000","last_became_active":"2024-04-26T12:38:32.093038+0000","last_became_peered":"2024-04-26T12:38:32.093038+0000","last_unstale":"2024-04-26T12:39:37.316635+0000","last_undegraded":"2024-04-26T12:39:37.316635+0000","last_fullsized":"2024-04-26T12:39:37.316635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:11.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432318+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:39:37.432318+0000","last_peered":"2024-04-26T12:39:37.432318+0000","last_clean":"2024-04-26T12:39:37.432318+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:39:37.432318+0000","last_undegraded":"2024-04-26T12:39:37.432318+0000","last_fullsized":"2024-04-26T12:39:37.432318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430338+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:39:37.430338+0000","last_peered":"2024-04-26T12:39:37.430338+0000","last_clean":"2024-04-26T12:39:37.430338+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:39:37.430338+0000","last_undegraded":"2024-04-26T12:39:37.430338+0000","last_fullsized":"2024-04-26T12:39:37.430338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518633+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:39:37.518633+0000","last_peered":"2024-04-26T12:39:37.518633+0000","last_clean":"2024-04-26T12:39:37.518633+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:39:37.518633+0000","last_undegraded":"2024-04-26T12:39:37.518633+0000","last_fullsized":"2024-04-26T12:39:37.518633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751435+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:39:37.751435+0000","last_peered":"2024-04-26T12:39:37.751435+0000","last_clean":"2024-04-26T12:39:37.751435+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:39:37.751435+0000","last_undegraded":"2024-04-26T12:39:37.751435+0000","last_fullsized":"2024-04-26T12:39:37.751435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518286+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:39:37.518286+0000","last_peered":"2024-04-26T12:39:37.518286+0000","last_clean":"2024-04-26T12:39:37.518286+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:39:37.518286+0000","last_undegraded":"2024-04-26T12:39:37.518286+0000","last_fullsized":"2024-04-26T12:39:37.518286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311236+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:39:37.311236+0000","last_peered":"2024-04-26T12:39:37.311236+0000","last_clean":"2024-04-26T12:39:37.311236+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:39:37.311236+0000","last_undegraded":"2024-04-26T12:39:37.311236+0000","last_fullsized":"2024-04-26T12:39:37.311236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517843+0000","last_change":"2024-04-26T12:38:32.097333+0000","last_active":"2024-04-26T12:39:37.517843+0000","last_peered":"2024-04-26T12:39:37.517843+0000","last_clean":"2024-04-26T12:39:37.517843+0000","last_became_active":"2024-04-26T12:38:32.097076+0000","last_became_peered":"2024-04-26T12:38:32.097076+0000","last_unstale":"2024-04-26T12:39:37.517843+0000","last_undegraded":"2024-04-26T12:39:37.517843+0000","last_fullsized":"2024-04-26T12:39:37.517843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:52.365241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311893+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:39:37.311893+0000","last_peered":"2024-04-26T12:39:37.311893+0000","last_clean":"2024-04-26T12:39:37.311893+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:39:37.311893+0000","last_undegraded":"2024-04-26T12:39:37.311893+0000","last_fullsized":"2024-04-26T12:39:37.311893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688676+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:39:37.688676+0000","last_peered":"2024-04-26T12:39:37.688676+0000","last_clean":"2024-04-26T12:39:37.688676+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:39:37.688676+0000","last_undegraded":"2024-04-26T12:39:37.688676+0000","last_fullsized":"2024-04-26T12:39:37.688676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757859+0000","last_change":"2024-04-26T12:38:32.098711+0000","last_active":"2024-04-26T12:39:37.757859+0000","last_peered":"2024-04-26T12:39:37.757859+0000","last_clean":"2024-04-26T12:39:37.757859+0000","last_became_active":"2024-04-26T12:38:32.097887+0000","last_became_peered":"2024-04-26T12:38:32.097887+0000","last_unstale":"2024-04-26T12:39:37.757859+0000","last_undegraded":"2024-04-26T12:39:37.757859+0000","last_fullsized":"2024-04-26T12:39:37.757859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:43.980582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321429+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:39:37.321429+0000","last_peered":"2024-04-26T12:39:37.321429+0000","last_clean":"2024-04-26T12:39:37.321429+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:39:37.321429+0000","last_undegraded":"2024-04-26T12:39:37.321429+0000","last_fullsized":"2024-04-26T12:39:37.321429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697170+0000","last_change":"2024-04-26T12:38:32.091108+0000","last_active":"2024-04-26T12:39:37.697170+0000","last_peered":"2024-04-26T12:39:37.697170+0000","last_clean":"2024-04-26T12:39:37.697170+0000","last_became_active":"2024-04-26T12:38:32.090800+0000","last_became_peered":"2024-04-26T12:38:32.090800+0000","last_unstale":"2024-04-26T12:39:37.697170+0000","last_undegraded":"2024-04-26T12:39:37.697170+0000","last_fullsized":"2024-04-26T12:39:37.697170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:54.159328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692377+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:39:37.692377+0000","last_peered":"2024-04-26T12:39:37.692377+0000","last_clean":"2024-04-26T12:39:37.692377+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:39:37.692377+0000","last_undegraded":"2024-04-26T12:39:37.692377+0000","last_fullsized":"2024-04-26T12:39:37.692377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430872+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:39:37.430872+0000","last_peered":"2024-04-26T12:39:37.430872+0000","last_clean":"2024-04-26T12:39:37.430872+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:39:37.430872+0000","last_undegraded":"2024-04-26T12:39:37.430872+0000","last_fullsized":"2024-04-26T12:39:37.430872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750625+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:39:37.750625+0000","last_peered":"2024-04-26T12:39:37.750625+0000","last_clean":"2024-04-26T12:39:37.750625+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:39:37.750625+0000","last_undegraded":"2024-04-26T12:39:37.750625+0000","last_fullsized":"2024-04-26T12:39:37.750625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"29'9","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322577+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:39:37.322577+0000","last_peered":"2024-04-26T12:39:37.322577+0000","last_clean":"2024-04-26T12:39:37.322577+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:39:37.322577+0000","last_undegraded":"2024-04-26T12:39:37.322577+0000","last_fullsized":"2024-04-26T12:39:37.322577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431678+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:39:37.431678+0000","last_peered":"2024-04-26T12:39:37.431678+0000","last_clean":"2024-04-26T12:39:37.431678+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:39:37.431678+0000","last_undegraded":"2024-04-26T12:39:37.431678+0000","last_fullsized":"2024-04-26T12:39:37.431678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749180+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:39:37.749180+0000","last_peered":"2024-04-26T12:39:37.749180+0000","last_clean":"2024-04-26T12:39:37.749180+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:39:37.749180+0000","last_undegraded":"2024-04-26T12:39:37.749180+0000","last_fullsized":"2024-04-26T12:39:37.749180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751585+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:39:37.751585+0000","last_peered":"2024-04-26T12:39:37.751585+0000","last_clean":"2024-04-26T12:39:37.751585+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:39:37.751585+0000","last_undegraded":"2024-04-26T12:39:37.751585+0000","last_fullsized":"2024-04-26T12:39:37.751585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321591+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:39:37.321591+0000","last_peered":"2024-04-26T12:39:37.321591+0000","last_clean":"2024-04-26T12:39:37.321591+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:39:37.321591+0000","last_undegraded":"2024-04-26T12:39:37.321591+0000","last_fullsized":"2024-04-26T12:39:37.321591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692217+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:39:37.692217+0000","last_peered":"2024-04-26T12:39:37.692217+0000","last_clean":"2024-04-26T12:39:37.692217+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:39:37.692217+0000","last_undegraded":"2024-04-26T12:39:37.692217+0000","last_fullsized":"2024-04-26T12:39:37.692217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313360+0000","last_change":"2024-04-26T12:38:32.099862+0000","last_active":"2024-04-26T12:39:37.313360+0000","last_peered":"2024-04-26T12:39:37.313360+0000","last_clean":"2024-04-26T12:39:37.313360+0000","last_became_active":"2024-04-26T12:38:32.098951+0000","last_became_peered":"2024-04-26T12:38:32.098951+0000","last_unstale":"2024-04-26T12:39:37.313360+0000","last_undegraded":"2024-04-26T12:39:37.313360+0000","last_fullsized":"2024-04-26T12:39:37.313360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:37.401523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322451+0000","last_change":"2024-04-26T12:38:32.100120+0000","last_active":"2024-04-26T12:39:37.322451+0000","last_peered":"2024-04-26T12:39:37.322451+0000","last_clean":"2024-04-26T12:39:37.322451+0000","last_became_active":"2024-04-26T12:38:32.099583+0000","last_became_peered":"2024-04-26T12:38:32.099583+0000","last_unstale":"2024-04-26T12:39:37.322451+0000","last_undegraded":"2024-04-26T12:39:37.322451+0000","last_fullsized":"2024-04-26T12:39:37.322451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:16.598403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321034+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:39:37.321034+0000","last_peered":"2024-04-26T12:39:37.321034+0000","last_clean":"2024-04-26T12:39:37.321034+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:39:37.321034+0000","last_undegraded":"2024-04-26T12:39:37.321034+0000","last_fullsized":"2024-04-26T12:39:37.321034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325232+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:39:37.325232+0000","last_peered":"2024-04-26T12:39:37.325232+0000","last_clean":"2024-04-26T12:39:37.325232+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:39:37.325232+0000","last_undegraded":"2024-04-26T12:39:37.325232+0000","last_fullsized":"2024-04-26T12:39:37.325232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430606+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:39:37.430606+0000","last_peered":"2024-04-26T12:39:37.430606+0000","last_clean":"2024-04-26T12:39:37.430606+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:39:37.430606+0000","last_undegraded":"2024-04-26T12:39:37.430606+0000","last_fullsized":"2024-04-26T12:39:37.430606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.691183+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:39:37.691183+0000","last_peered":"2024-04-26T12:39:37.691183+0000","last_clean":"2024-04-26T12:39:37.691183+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:39:37.691183+0000","last_undegraded":"2024-04-26T12:39:37.691183+0000","last_fullsized":"2024-04-26T12:39:37.691183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311721+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:39:37.311721+0000","last_peered":"2024-04-26T12:39:37.311721+0000","last_clean":"2024-04-26T12:39:37.311721+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:39:37.311721+0000","last_undegraded":"2024-04-26T12:39:37.311721+0000","last_fullsized":"2024-04-26T12:39:37.311721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431059+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:39:37.431059+0000","last_peered":"2024-04-26T12:39:37.431059+0000","last_clean":"2024-04-26T12:39:37.431059+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:39:37.431059+0000","last_undegraded":"2024-04-26T12:39:37.431059+0000","last_fullsized":"2024-04-26T12:39:37.431059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311104+0000","last_change":"2024-04-26T12:38:32.097189+0000","last_active":"2024-04-26T12:39:37.311104+0000","last_peered":"2024-04-26T12:39:37.311104+0000","last_clean":"2024-04-26T12:39:37.311104+0000","last_became_active":"2024-04-26T12:38:32.096313+0000","last_became_peered":"2024-04-26T12:38:32.096313+0000","last_unstale":"2024-04-26T12:39:37.311104+0000","last_undegraded":"2024-04-26T12:39:37.311104+0000","last_fullsized":"2024-04-26T12:39:37.311104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:26.879794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.690711+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:39:37.690711+0000","last_peered":"2024-04-26T12:39:37.690711+0000","last_clean":"2024-04-26T12:39:37.690711+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:39:37.690711+0000","last_undegraded":"2024-04-26T12:39:37.690711+0000","last_fullsized":"2024-04-26T12:39:37.690711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516676+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:39:37.516676+0000","last_peered":"2024-04-26T12:39:37.516676+0000","last_clean":"2024-04-26T12:39:37.516676+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:39:37.516676+0000","last_undegraded":"2024-04-26T12:39:37.516676+0000","last_fullsized":"2024-04-26T12:39:37.516676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750421+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:39:37.750421+0000","last_peered":"2024-04-26T12:39:37.750421+0000","last_clean":"2024-04-26T12:39:37.750421+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:39:37.750421+0000","last_undegraded":"2024-04-26T12:39:37.750421+0000","last_fullsized":"2024-04-26T12:39:37.750421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"29'9","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431357+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:39:37.431357+0000","last_peered":"2024-04-26T12:39:37.431357+0000","last_clean":"2024-04-26T12:39:37.431357+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:39:37.431357+0000","last_undegraded":"2024-04-26T12:39:37.431357+0000","last_fullsized":"2024-04-26T12:39:37.431357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.691510+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:39:37.691510+0000","last_peered":"2024-04-26T12:39:37.691510+0000","last_clean":"2024-04-26T12:39:37.691510+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:39:37.691510+0000","last_undegraded":"2024-04-26T12:39:37.691510+0000","last_fullsized":"2024-04-26T12:39:37.691510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750813+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:39:37.750813+0000","last_peered":"2024-04-26T12:39:37.750813+0000","last_clean":"2024-04-26T12:39:37.750813+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:39:37.750813+0000","last_undegraded":"2024-04-26T12:39:37.750813+0000","last_fullsized":"2024-04-26T12:39:37.750813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313275+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:39:37.313275+0000","last_peered":"2024-04-26T12:39:37.313275+0000","last_clean":"2024-04-26T12:39:37.313275+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:39:37.313275+0000","last_undegraded":"2024-04-26T12:39:37.313275+0000","last_fullsized":"2024-04-26T12:39:37.313275+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429556+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:39:37.429556+0000","last_peered":"2024-04-26T12:39:37.429556+0000","last_clean":"2024-04-26T12:39:37.429556+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:39:37.429556+0000","last_undegraded":"2024-04-26T12:39:37.429556+0000","last_fullsized":"2024-04-26T12:39:37.429556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"29'19","reported_seq":111,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749207+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:39:37.749207+0000","last_peered":"2024-04-26T12:39:37.749207+0000","last_clean":"2024-04-26T12:39:37.749207+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:39:37.749207+0000","last_undegraded":"2024-04-26T12:39:37.749207+0000","last_fullsized":"2024-04-26T12:39:37.749207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754219+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:39:37.754219+0000","last_peered":"2024-04-26T12:39:37.754219+0000","last_clean":"2024-04-26T12:39:37.754219+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:39:37.754219+0000","last_undegraded":"2024-04-26T12:39:37.754219+0000","last_fullsized":"2024-04-26T12:39:37.754219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749901+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:39:37.749901+0000","last_peered":"2024-04-26T12:39:37.749901+0000","last_clean":"2024-04-26T12:39:37.749901+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:39:37.749901+0000","last_undegraded":"2024-04-26T12:39:37.749901+0000","last_fullsized":"2024-04-26T12:39:37.749901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.753166+0000","last_change":"2024-04-26T12:38:32.097378+0000","last_active":"2024-04-26T12:39:37.753166+0000","last_peered":"2024-04-26T12:39:37.753166+0000","last_clean":"2024-04-26T12:39:37.753166+0000","last_became_active":"2024-04-26T12:38:32.096994+0000","last_became_peered":"2024-04-26T12:38:32.096994+0000","last_unstale":"2024-04-26T12:39:37.753166+0000","last_undegraded":"2024-04-26T12:39:37.753166+0000","last_fullsized":"2024-04-26T12:39:37.753166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:26.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432200+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:39:37.432200+0000","last_peered":"2024-04-26T12:39:37.432200+0000","last_clean":"2024-04-26T12:39:37.432200+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:39:37.432200+0000","last_undegraded":"2024-04-26T12:39:37.432200+0000","last_fullsized":"2024-04-26T12:39:37.432200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310068+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:39:37.310068+0000","last_peered":"2024-04-26T12:39:37.310068+0000","last_clean":"2024-04-26T12:39:37.310068+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:39:37.310068+0000","last_undegraded":"2024-04-26T12:39:37.310068+0000","last_fullsized":"2024-04-26T12:39:37.310068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"29'9","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699097+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:39:37.699097+0000","last_peered":"2024-04-26T12:39:37.699097+0000","last_clean":"2024-04-26T12:39:37.699097+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:39:37.699097+0000","last_undegraded":"2024-04-26T12:39:37.699097+0000","last_fullsized":"2024-04-26T12:39:37.699097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693658+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:39:37.693658+0000","last_peered":"2024-04-26T12:39:37.693658+0000","last_clean":"2024-04-26T12:39:37.693658+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:39:37.693658+0000","last_undegraded":"2024-04-26T12:39:37.693658+0000","last_fullsized":"2024-04-26T12:39:37.693658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517288+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:39:37.517288+0000","last_peered":"2024-04-26T12:39:37.517288+0000","last_clean":"2024-04-26T12:39:37.517288+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:39:37.517288+0000","last_undegraded":"2024-04-26T12:39:37.517288+0000","last_fullsized":"2024-04-26T12:39:37.517288+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516966+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:39:37.516966+0000","last_peered":"2024-04-26T12:39:37.516966+0000","last_clean":"2024-04-26T12:39:37.516966+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:39:37.516966+0000","last_undegraded":"2024-04-26T12:39:37.516966+0000","last_fullsized":"2024-04-26T12:39:37.516966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432002+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:39:37.432002+0000","last_peered":"2024-04-26T12:39:37.432002+0000","last_clean":"2024-04-26T12:39:37.432002+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:39:37.432002+0000","last_undegraded":"2024-04-26T12:39:37.432002+0000","last_fullsized":"2024-04-26T12:39:37.432002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311519+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:39:37.311519+0000","last_peered":"2024-04-26T12:39:37.311519+0000","last_clean":"2024-04-26T12:39:37.311519+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:39:37.311519+0000","last_undegraded":"2024-04-26T12:39:37.311519+0000","last_fullsized":"2024-04-26T12:39:37.311519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'15","reported_seq":105,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429866+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:39:37.429866+0000","last_peered":"2024-04-26T12:39:37.429866+0000","last_clean":"2024-04-26T12:39:37.429866+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:39:37.429866+0000","last_undegraded":"2024-04-26T12:39:37.429866+0000","last_fullsized":"2024-04-26T12:39:37.429866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"26'2","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.317658+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:39:37.317658+0000","last_peered":"2024-04-26T12:39:37.317658+0000","last_clean":"2024-04-26T12:39:37.317658+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:39:37.317658+0000","last_undegraded":"2024-04-26T12:39:37.317658+0000","last_fullsized":"2024-04-26T12:39:37.317658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322702+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:39:37.322702+0000","last_peered":"2024-04-26T12:39:37.322702+0000","last_clean":"2024-04-26T12:39:37.322702+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:39:37.322702+0000","last_undegraded":"2024-04-26T12:39:37.322702+0000","last_fullsized":"2024-04-26T12:39:37.322702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.326297+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:39:37.326297+0000","last_peered":"2024-04-26T12:39:37.326297+0000","last_clean":"2024-04-26T12:39:37.326297+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:39:37.326297+0000","last_undegraded":"2024-04-26T12:39:37.326297+0000","last_fullsized":"2024-04-26T12:39:37.326297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750899+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:39:37.750899+0000","last_peered":"2024-04-26T12:39:37.750899+0000","last_clean":"2024-04-26T12:39:37.750899+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:39:37.750899+0000","last_undegraded":"2024-04-26T12:39:37.750899+0000","last_fullsized":"2024-04-26T12:39:37.750899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310919+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:39:37.310919+0000","last_peered":"2024-04-26T12:39:37.310919+0000","last_clean":"2024-04-26T12:39:37.310919+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:39:37.310919+0000","last_undegraded":"2024-04-26T12:39:37.310919+0000","last_fullsized":"2024-04-26T12:39:37.310919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"29'12","reported_seq":102,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.317974+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:39:37.317974+0000","last_peered":"2024-04-26T12:39:37.317974+0000","last_clean":"2024-04-26T12:39:37.317974+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:39:37.317974+0000","last_undegraded":"2024-04-26T12:39:37.317974+0000","last_fullsized":"2024-04-26T12:39:37.317974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.309905+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:39:37.309905+0000","last_peered":"2024-04-26T12:39:37.309905+0000","last_clean":"2024-04-26T12:39:37.309905+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:39:37.309905+0000","last_undegraded":"2024-04-26T12:39:37.309905+0000","last_fullsized":"2024-04-26T12:39:37.309905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758460+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:39:37.758460+0000","last_peered":"2024-04-26T12:39:37.758460+0000","last_clean":"2024-04-26T12:39:37.758460+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:39:37.758460+0000","last_undegraded":"2024-04-26T12:39:37.758460+0000","last_fullsized":"2024-04-26T12:39:37.758460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692300+0000","last_change":"2024-04-26T12:38:32.098058+0000","last_active":"2024-04-26T12:39:37.692300+0000","last_peered":"2024-04-26T12:39:37.692300+0000","last_clean":"2024-04-26T12:39:37.692300+0000","last_became_active":"2024-04-26T12:38:32.095643+0000","last_became_peered":"2024-04-26T12:38:32.095643+0000","last_unstale":"2024-04-26T12:39:37.692300+0000","last_undegraded":"2024-04-26T12:39:37.692300+0000","last_fullsized":"2024-04-26T12:39:37.692300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:56.628368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688538+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:39:37.688538+0000","last_peered":"2024-04-26T12:39:37.688538+0000","last_clean":"2024-04-26T12:39:37.688538+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:39:37.688538+0000","last_undegraded":"2024-04-26T12:39:37.688538+0000","last_fullsized":"2024-04-26T12:39:37.688538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312227+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:39:37.312227+0000","last_peered":"2024-04-26T12:39:37.312227+0000","last_clean":"2024-04-26T12:39:37.312227+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:39:37.312227+0000","last_undegraded":"2024-04-26T12:39:37.312227+0000","last_fullsized":"2024-04-26T12:39:37.312227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'11","reported_seq":102,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758178+0000","last_change":"2024-04-26T12:38:32.096426+0000","last_active":"2024-04-26T12:39:37.758178+0000","last_peered":"2024-04-26T12:39:37.758178+0000","last_clean":"2024-04-26T12:39:37.758178+0000","last_became_active":"2024-04-26T12:38:32.095992+0000","last_became_peered":"2024-04-26T12:38:32.095992+0000","last_unstale":"2024-04-26T12:39:37.758178+0000","last_undegraded":"2024-04-26T12:39:37.758178+0000","last_fullsized":"2024-04-26T12:39:37.758178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:27.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322917+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:39:37.322917+0000","last_peered":"2024-04-26T12:39:37.322917+0000","last_clean":"2024-04-26T12:39:37.322917+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:39:37.322917+0000","last_undegraded":"2024-04-26T12:39:37.322917+0000","last_fullsized":"2024-04-26T12:39:37.322917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697269+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:39:37.697269+0000","last_peered":"2024-04-26T12:39:37.697269+0000","last_clean":"2024-04-26T12:39:37.697269+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:39:37.697269+0000","last_undegraded":"2024-04-26T12:39:37.697269+0000","last_fullsized":"2024-04-26T12:39:37.697269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312309+0000","last_change":"2024-04-26T12:38:32.097968+0000","last_active":"2024-04-26T12:39:37.312309+0000","last_peered":"2024-04-26T12:39:37.312309+0000","last_clean":"2024-04-26T12:39:37.312309+0000","last_became_active":"2024-04-26T12:38:32.095619+0000","last_became_peered":"2024-04-26T12:38:32.095619+0000","last_unstale":"2024-04-26T12:39:37.312309+0000","last_undegraded":"2024-04-26T12:39:37.312309+0000","last_fullsized":"2024-04-26T12:39:37.312309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517237+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:39:37.517237+0000","last_peered":"2024-04-26T12:39:37.517237+0000","last_clean":"2024-04-26T12:39:37.517237+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:39:37.517237+0000","last_undegraded":"2024-04-26T12:39:37.517237+0000","last_fullsized":"2024-04-26T12:39:37.517237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754777+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:39:37.754777+0000","last_peered":"2024-04-26T12:39:37.754777+0000","last_clean":"2024-04-26T12:39:37.754777+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:39:37.754777+0000","last_undegraded":"2024-04-26T12:39:37.754777+0000","last_fullsized":"2024-04-26T12:39:37.754777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"29'15","reported_seq":105,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313449+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:39:37.313449+0000","last_peered":"2024-04-26T12:39:37.313449+0000","last_clean":"2024-04-26T12:39:37.313449+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:39:37.313449+0000","last_undegraded":"2024-04-26T12:39:37.313449+0000","last_fullsized":"2024-04-26T12:39:37.313449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312776+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:39:37.312776+0000","last_peered":"2024-04-26T12:39:37.312776+0000","last_clean":"2024-04-26T12:39:37.312776+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:39:37.312776+0000","last_undegraded":"2024-04-26T12:39:37.312776+0000","last_fullsized":"2024-04-26T12:39:37.312776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752886+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:39:37.752886+0000","last_peered":"2024-04-26T12:39:37.752886+0000","last_clean":"2024-04-26T12:39:37.752886+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:39:37.752886+0000","last_undegraded":"2024-04-26T12:39:37.752886+0000","last_fullsized":"2024-04-26T12:39:37.752886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517911+0000","last_change":"2024-04-26T12:38:32.098436+0000","last_active":"2024-04-26T12:39:37.517911+0000","last_peered":"2024-04-26T12:39:37.517911+0000","last_clean":"2024-04-26T12:39:37.517911+0000","last_became_active":"2024-04-26T12:38:32.097675+0000","last_became_peered":"2024-04-26T12:38:32.097675+0000","last_unstale":"2024-04-26T12:39:37.517911+0000","last_undegraded":"2024-04-26T12:39:37.517911+0000","last_fullsized":"2024-04-26T12:39:37.517911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:10.967994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310397+0000","last_change":"2024-04-26T12:38:32.091912+0000","last_active":"2024-04-26T12:39:37.310397+0000","last_peered":"2024-04-26T12:39:37.310397+0000","last_clean":"2024-04-26T12:39:37.310397+0000","last_became_active":"2024-04-26T12:38:32.091595+0000","last_became_peered":"2024-04-26T12:38:32.091595+0000","last_unstale":"2024-04-26T12:39:37.310397+0000","last_undegraded":"2024-04-26T12:39:37.310397+0000","last_fullsized":"2024-04-26T12:39:37.310397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:30.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751924+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:39:37.751924+0000","last_peered":"2024-04-26T12:39:37.751924+0000","last_clean":"2024-04-26T12:39:37.751924+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:39:37.751924+0000","last_undegraded":"2024-04-26T12:39:37.751924+0000","last_fullsized":"2024-04-26T12:39:37.751924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.691599+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:39:37.691599+0000","last_peered":"2024-04-26T12:39:37.691599+0000","last_clean":"2024-04-26T12:39:37.691599+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:39:37.691599+0000","last_undegraded":"2024-04-26T12:39:37.691599+0000","last_fullsized":"2024-04-26T12:39:37.691599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517795+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:39:37.517795+0000","last_peered":"2024-04-26T12:39:37.517795+0000","last_clean":"2024-04-26T12:39:37.517795+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:39:37.517795+0000","last_undegraded":"2024-04-26T12:39:37.517795+0000","last_fullsized":"2024-04-26T12:39:37.517795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321211+0000","last_change":"2024-04-26T12:38:32.092303+0000","last_active":"2024-04-26T12:39:37.321211+0000","last_peered":"2024-04-26T12:39:37.321211+0000","last_clean":"2024-04-26T12:39:37.321211+0000","last_became_active":"2024-04-26T12:38:32.091872+0000","last_became_peered":"2024-04-26T12:38:32.091872+0000","last_unstale":"2024-04-26T12:39:37.321211+0000","last_undegraded":"2024-04-26T12:39:37.321211+0000","last_fullsized":"2024-04-26T12:39:37.321211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758731+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:39:37.758731+0000","last_peered":"2024-04-26T12:39:37.758731+0000","last_clean":"2024-04-26T12:39:37.758731+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:39:37.758731+0000","last_undegraded":"2024-04-26T12:39:37.758731+0000","last_fullsized":"2024-04-26T12:39:37.758731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699739+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:39:37.699739+0000","last_peered":"2024-04-26T12:39:37.699739+0000","last_clean":"2024-04-26T12:39:37.699739+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:39:37.699739+0000","last_undegraded":"2024-04-26T12:39:37.699739+0000","last_fullsized":"2024-04-26T12:39:37.699739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750824+0000","last_change":"2024-04-26T12:38:32.094763+0000","last_active":"2024-04-26T12:39:37.750824+0000","last_peered":"2024-04-26T12:39:37.750824+0000","last_clean":"2024-04-26T12:39:37.750824+0000","last_became_active":"2024-04-26T12:38:32.094384+0000","last_became_peered":"2024-04-26T12:38:32.094384+0000","last_unstale":"2024-04-26T12:39:37.750824+0000","last_undegraded":"2024-04-26T12:39:37.750824+0000","last_fullsized":"2024-04-26T12:39:37.750824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"29'17","reported_seq":108,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750165+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:39:37.750165+0000","last_peered":"2024-04-26T12:39:37.750165+0000","last_clean":"2024-04-26T12:39:37.750165+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:39:37.750165+0000","last_undegraded":"2024-04-26T12:39:37.750165+0000","last_fullsized":"2024-04-26T12:39:37.750165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517308+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:39:37.517308+0000","last_peered":"2024-04-26T12:39:37.517308+0000","last_clean":"2024-04-26T12:39:37.517308+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:39:37.517308+0000","last_undegraded":"2024-04-26T12:39:37.517308+0000","last_fullsized":"2024-04-26T12:39:37.517308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754118+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:39:37.754118+0000","last_peered":"2024-04-26T12:39:37.754118+0000","last_clean":"2024-04-26T12:39:37.754118+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:39:37.754118+0000","last_undegraded":"2024-04-26T12:39:37.754118+0000","last_fullsized":"2024-04-26T12:39:37.754118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518066+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:39:37.518066+0000","last_peered":"2024-04-26T12:39:37.518066+0000","last_clean":"2024-04-26T12:39:37.518066+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:39:37.518066+0000","last_undegraded":"2024-04-26T12:39:37.518066+0000","last_fullsized":"2024-04-26T12:39:37.518066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":248,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430053+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:39:37.430053+0000","last_peered":"2024-04-26T12:39:37.430053+0000","last_clean":"2024-04-26T12:39:37.430053+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:39:37.430053+0000","last_undegraded":"2024-04-26T12:39:37.430053+0000","last_fullsized":"2024-04-26T12:39:37.430053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750816+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:39:37.750816+0000","last_peered":"2024-04-26T12:39:37.750816+0000","last_clean":"2024-04-26T12:39:37.750816+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:39:37.750816+0000","last_undegraded":"2024-04-26T12:39:37.750816+0000","last_fullsized":"2024-04-26T12:39:37.750816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.694078+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:39:37.694078+0000","last_peered":"2024-04-26T12:39:37.694078+0000","last_clean":"2024-04-26T12:39:37.694078+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:39:37.694078+0000","last_undegraded":"2024-04-26T12:39:37.694078+0000","last_fullsized":"2024-04-26T12:39:37.694078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430923+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:39:37.430923+0000","last_peered":"2024-04-26T12:39:37.430923+0000","last_clean":"2024-04-26T12:39:37.430923+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:39:37.430923+0000","last_undegraded":"2024-04-26T12:39:37.430923+0000","last_fullsized":"2024-04-26T12:39:37.430923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"29'13","reported_seq":107,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750726+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:39:37.750726+0000","last_peered":"2024-04-26T12:39:37.750726+0000","last_clean":"2024-04-26T12:39:37.750726+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:39:37.750726+0000","last_undegraded":"2024-04-26T12:39:37.750726+0000","last_fullsized":"2024-04-26T12:39:37.750726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322816+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:39:37.322816+0000","last_peered":"2024-04-26T12:39:37.322816+0000","last_clean":"2024-04-26T12:39:37.322816+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:39:37.322816+0000","last_undegraded":"2024-04-26T12:39:37.322816+0000","last_fullsized":"2024-04-26T12:39:37.322816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.515963+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:39:37.515963+0000","last_peered":"2024-04-26T12:39:37.515963+0000","last_clean":"2024-04-26T12:39:37.515963+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:39:37.515963+0000","last_undegraded":"2024-04-26T12:39:37.515963+0000","last_fullsized":"2024-04-26T12:39:37.515963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325011+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:39:37.325011+0000","last_peered":"2024-04-26T12:39:37.325011+0000","last_clean":"2024-04-26T12:39:37.325011+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:39:37.325011+0000","last_undegraded":"2024-04-26T12:39:37.325011+0000","last_fullsized":"2024-04-26T12:39:37.325011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429762+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:39:37.429762+0000","last_peered":"2024-04-26T12:39:37.429762+0000","last_clean":"2024-04-26T12:39:37.429762+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:39:37.429762+0000","last_undegraded":"2024-04-26T12:39:37.429762+0000","last_fullsized":"2024-04-26T12:39:37.429762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318090+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:39:37.318090+0000","last_peered":"2024-04-26T12:39:37.318090+0000","last_clean":"2024-04-26T12:39:37.318090+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:39:37.318090+0000","last_undegraded":"2024-04-26T12:39:37.318090+0000","last_fullsized":"2024-04-26T12:39:37.318090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751502+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:39:37.751502+0000","last_peered":"2024-04-26T12:39:37.751502+0000","last_clean":"2024-04-26T12:39:37.751502+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:39:37.751502+0000","last_undegraded":"2024-04-26T12:39:37.751502+0000","last_fullsized":"2024-04-26T12:39:37.751502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"29'23","reported_seq":137,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754680+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:39:37.754680+0000","last_peered":"2024-04-26T12:39:37.754680+0000","last_clean":"2024-04-26T12:39:37.754680+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:39:37.754680+0000","last_undegraded":"2024-04-26T12:39:37.754680+0000","last_fullsized":"2024-04-26T12:39:37.754680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431118+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:39:37.431118+0000","last_peered":"2024-04-26T12:39:37.431118+0000","last_clean":"2024-04-26T12:39:37.431118+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:39:37.431118+0000","last_undegraded":"2024-04-26T12:39:37.431118+0000","last_fullsized":"2024-04-26T12:39:37.431118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752499+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:39:37.752499+0000","last_peered":"2024-04-26T12:39:37.752499+0000","last_clean":"2024-04-26T12:39:37.752499+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:39:37.752499+0000","last_undegraded":"2024-04-26T12:39:37.752499+0000","last_fullsized":"2024-04-26T12:39:37.752499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758808+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:39:37.758808+0000","last_peered":"2024-04-26T12:39:37.758808+0000","last_clean":"2024-04-26T12:39:37.758808+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:39:37.758808+0000","last_undegraded":"2024-04-26T12:39:37.758808+0000","last_fullsized":"2024-04-26T12:39:37.758808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310597+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:39:37.310597+0000","last_peered":"2024-04-26T12:39:37.310597+0000","last_clean":"2024-04-26T12:39:37.310597+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:39:37.310597+0000","last_undegraded":"2024-04-26T12:39:37.310597+0000","last_fullsized":"2024-04-26T12:39:37.310597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.753566+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:39:37.753566+0000","last_peered":"2024-04-26T12:39:37.753566+0000","last_clean":"2024-04-26T12:39:37.753566+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:39:37.753566+0000","last_undegraded":"2024-04-26T12:39:37.753566+0000","last_fullsized":"2024-04-26T12:39:37.753566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312914+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:39:37.312914+0000","last_peered":"2024-04-26T12:39:37.312914+0000","last_clean":"2024-04-26T12:39:37.312914+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:39:37.312914+0000","last_undegraded":"2024-04-26T12:39:37.312914+0000","last_fullsized":"2024-04-26T12:39:37.312914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'15","reported_seq":117,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431640+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:39:37.431640+0000","last_peered":"2024-04-26T12:39:37.431640+0000","last_clean":"2024-04-26T12:39:37.431640+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:39:37.431640+0000","last_undegraded":"2024-04-26T12:39:37.431640+0000","last_fullsized":"2024-04-26T12:39:37.431640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321938+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:39:37.321938+0000","last_peered":"2024-04-26T12:39:37.321938+0000","last_clean":"2024-04-26T12:39:37.321938+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:39:37.321938+0000","last_undegraded":"2024-04-26T12:39:37.321938+0000","last_fullsized":"2024-04-26T12:39:37.321938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688874+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:39:37.688874+0000","last_peered":"2024-04-26T12:39:37.688874+0000","last_clean":"2024-04-26T12:39:37.688874+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:39:37.688874+0000","last_undegraded":"2024-04-26T12:39:37.688874+0000","last_fullsized":"2024-04-26T12:39:37.688874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.755069+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:39:37.755069+0000","last_peered":"2024-04-26T12:39:37.755069+0000","last_clean":"2024-04-26T12:39:37.755069+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:39:37.755069+0000","last_undegraded":"2024-04-26T12:39:37.755069+0000","last_fullsized":"2024-04-26T12:39:37.755069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752305+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:39:37.752305+0000","last_peered":"2024-04-26T12:39:37.752305+0000","last_clean":"2024-04-26T12:39:37.752305+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:39:37.752305+0000","last_undegraded":"2024-04-26T12:39:37.752305+0000","last_fullsized":"2024-04-26T12:39:37.752305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.326086+0000","last_change":"2024-04-26T12:38:32.099375+0000","last_active":"2024-04-26T12:39:37.326086+0000","last_peered":"2024-04-26T12:39:37.326086+0000","last_clean":"2024-04-26T12:39:37.326086+0000","last_became_active":"2024-04-26T12:38:32.098983+0000","last_became_peered":"2024-04-26T12:38:32.098983+0000","last_unstale":"2024-04-26T12:39:37.326086+0000","last_undegraded":"2024-04-26T12:39:37.326086+0000","last_fullsized":"2024-04-26T12:39:37.326086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.281648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322217+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:39:37.322217+0000","last_peered":"2024-04-26T12:39:37.322217+0000","last_clean":"2024-04-26T12:39:37.322217+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:39:37.322217+0000","last_undegraded":"2024-04-26T12:39:37.322217+0000","last_fullsized":"2024-04-26T12:39:37.322217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693054+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:39:37.693054+0000","last_peered":"2024-04-26T12:39:37.693054+0000","last_clean":"2024-04-26T12:39:37.693054+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:39:37.693054+0000","last_undegraded":"2024-04-26T12:39:37.693054+0000","last_fullsized":"2024-04-26T12:39:37.693054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518635+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:39:37.518635+0000","last_peered":"2024-04-26T12:39:37.518635+0000","last_clean":"2024-04-26T12:39:37.518635+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:39:37.518635+0000","last_undegraded":"2024-04-26T12:39:37.518635+0000","last_fullsized":"2024-04-26T12:39:37.518635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.748879+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:39:37.748879+0000","last_peered":"2024-04-26T12:39:37.748879+0000","last_clean":"2024-04-26T12:39:37.748879+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:39:37.748879+0000","last_undegraded":"2024-04-26T12:39:37.748879+0000","last_fullsized":"2024-04-26T12:39:37.748879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754195+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:39:37.754195+0000","last_peered":"2024-04-26T12:39:37.754195+0000","last_clean":"2024-04-26T12:39:37.754195+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:39:37.754195+0000","last_undegraded":"2024-04-26T12:39:37.754195+0000","last_fullsized":"2024-04-26T12:39:37.754195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751756+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:39:37.751756+0000","last_peered":"2024-04-26T12:39:37.751756+0000","last_clean":"2024-04-26T12:39:37.751756+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:39:37.751756+0000","last_undegraded":"2024-04-26T12:39:37.751756+0000","last_fullsized":"2024-04-26T12:39:37.751756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.755356+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:39:37.755356+0000","last_peered":"2024-04-26T12:39:37.755356+0000","last_clean":"2024-04-26T12:39:37.755356+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:39:37.755356+0000","last_undegraded":"2024-04-26T12:39:37.755356+0000","last_fullsized":"2024-04-26T12:39:37.755356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325652+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:39:37.325652+0000","last_peered":"2024-04-26T12:39:37.325652+0000","last_clean":"2024-04-26T12:39:37.325652+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:39:37.325652+0000","last_undegraded":"2024-04-26T12:39:37.325652+0000","last_fullsized":"2024-04-26T12:39:37.325652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'18","reported_seq":111,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316194+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:39:37.316194+0000","last_peered":"2024-04-26T12:39:37.316194+0000","last_clean":"2024-04-26T12:39:37.316194+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:39:37.316194+0000","last_undegraded":"2024-04-26T12:39:37.316194+0000","last_fullsized":"2024-04-26T12:39:37.316194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687667+0000","last_change":"2024-04-26T12:38:32.094008+0000","last_active":"2024-04-26T12:39:37.687667+0000","last_peered":"2024-04-26T12:39:37.687667+0000","last_clean":"2024-04-26T12:39:37.687667+0000","last_became_active":"2024-04-26T12:38:32.092362+0000","last_became_peered":"2024-04-26T12:38:32.092362+0000","last_unstale":"2024-04-26T12:39:37.687667+0000","last_undegraded":"2024-04-26T12:39:37.687667+0000","last_fullsized":"2024-04-26T12:39:37.687667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.395782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322334+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:39:37.322334+0000","last_peered":"2024-04-26T12:39:37.322334+0000","last_clean":"2024-04-26T12:39:37.322334+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:39:37.322334+0000","last_undegraded":"2024-04-26T12:39:37.322334+0000","last_fullsized":"2024-04-26T12:39:37.322334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.326193+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:39:37.326193+0000","last_peered":"2024-04-26T12:39:37.326193+0000","last_clean":"2024-04-26T12:39:37.326193+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:39:37.326193+0000","last_undegraded":"2024-04-26T12:39:37.326193+0000","last_fullsized":"2024-04-26T12:39:37.326193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.755147+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:39:37.755147+0000","last_peered":"2024-04-26T12:39:37.755147+0000","last_clean":"2024-04-26T12:39:37.755147+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:39:37.755147+0000","last_undegraded":"2024-04-26T12:39:37.755147+0000","last_fullsized":"2024-04-26T12:39:37.755147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432627+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:39:37.432627+0000","last_peered":"2024-04-26T12:39:37.432627+0000","last_clean":"2024-04-26T12:39:37.432627+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:39:37.432627+0000","last_undegraded":"2024-04-26T12:39:37.432627+0000","last_fullsized":"2024-04-26T12:39:37.432627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516585+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:39:37.516585+0000","last_peered":"2024-04-26T12:39:37.516585+0000","last_clean":"2024-04-26T12:39:37.516585+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:39:37.516585+0000","last_undegraded":"2024-04-26T12:39:37.516585+0000","last_fullsized":"2024-04-26T12:39:37.516585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":101,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752607+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:39:37.752607+0000","last_peered":"2024-04-26T12:39:37.752607+0000","last_clean":"2024-04-26T12:39:37.752607+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:39:37.752607+0000","last_undegraded":"2024-04-26T12:39:37.752607+0000","last_fullsized":"2024-04-26T12:39:37.752607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749410+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:39:37.749410+0000","last_peered":"2024-04-26T12:39:37.749410+0000","last_clean":"2024-04-26T12:39:37.749410+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:39:37.749410+0000","last_undegraded":"2024-04-26T12:39:37.749410+0000","last_fullsized":"2024-04-26T12:39:37.749410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.690917+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:39:37.690917+0000","last_peered":"2024-04-26T12:39:37.690917+0000","last_clean":"2024-04-26T12:39:37.690917+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:39:37.690917+0000","last_undegraded":"2024-04-26T12:39:37.690917+0000","last_fullsized":"2024-04-26T12:39:37.690917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697608+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:39:37.697608+0000","last_peered":"2024-04-26T12:39:37.697608+0000","last_clean":"2024-04-26T12:39:37.697608+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:39:37.697608+0000","last_undegraded":"2024-04-26T12:39:37.697608+0000","last_fullsized":"2024-04-26T12:39:37.697608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.690532+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:39:37.690532+0000","last_peered":"2024-04-26T12:39:37.690532+0000","last_clean":"2024-04-26T12:39:37.690532+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:39:37.690532+0000","last_undegraded":"2024-04-26T12:39:37.690532+0000","last_fullsized":"2024-04-26T12:39:37.690532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758445+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:39:37.758445+0000","last_peered":"2024-04-26T12:39:37.758445+0000","last_clean":"2024-04-26T12:39:37.758445+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:39:37.758445+0000","last_undegraded":"2024-04-26T12:39:37.758445+0000","last_fullsized":"2024-04-26T12:39:37.758445+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687586+0000","last_change":"2024-04-26T12:38:32.094625+0000","last_active":"2024-04-26T12:39:37.687586+0000","last_peered":"2024-04-26T12:39:37.687586+0000","last_clean":"2024-04-26T12:39:37.687586+0000","last_became_active":"2024-04-26T12:38:32.093266+0000","last_became_peered":"2024-04-26T12:38:32.093266+0000","last_unstale":"2024-04-26T12:39:37.687586+0000","last_undegraded":"2024-04-26T12:39:37.687586+0000","last_fullsized":"2024-04-26T12:39:37.687586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:18:18.695479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693817+0000","last_change":"2024-04-26T12:38:32.097625+0000","last_active":"2024-04-26T12:39:37.693817+0000","last_peered":"2024-04-26T12:39:37.693817+0000","last_clean":"2024-04-26T12:39:37.693817+0000","last_became_active":"2024-04-26T12:38:32.097186+0000","last_became_peered":"2024-04-26T12:38:32.097186+0000","last_unstale":"2024-04-26T12:39:37.693817+0000","last_undegraded":"2024-04-26T12:39:37.693817+0000","last_fullsized":"2024-04-26T12:39:37.693817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:09.866995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699444+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:39:37.699444+0000","last_peered":"2024-04-26T12:39:37.699444+0000","last_clean":"2024-04-26T12:39:37.699444+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:39:37.699444+0000","last_undegraded":"2024-04-26T12:39:37.699444+0000","last_fullsized":"2024-04-26T12:39:37.699444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322061+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:39:37.322061+0000","last_peered":"2024-04-26T12:39:37.322061+0000","last_clean":"2024-04-26T12:39:37.322061+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:39:37.322061+0000","last_undegraded":"2024-04-26T12:39:37.322061+0000","last_fullsized":"2024-04-26T12:39:37.322061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749826+0000","last_change":"2024-04-26T12:38:32.089371+0000","last_active":"2024-04-26T12:39:37.749826+0000","last_peered":"2024-04-26T12:39:37.749826+0000","last_clean":"2024-04-26T12:39:37.749826+0000","last_became_active":"2024-04-26T12:38:32.088665+0000","last_became_peered":"2024-04-26T12:38:32.088665+0000","last_unstale":"2024-04-26T12:39:37.749826+0000","last_undegraded":"2024-04-26T12:39:37.749826+0000","last_fullsized":"2024-04-26T12:39:37.749826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:48.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325338+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:39:37.325338+0000","last_peered":"2024-04-26T12:39:37.325338+0000","last_clean":"2024-04-26T12:39:37.325338+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:39:37.325338+0000","last_undegraded":"2024-04-26T12:39:37.325338+0000","last_fullsized":"2024-04-26T12:39:37.325338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.519104+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:39:37.519104+0000","last_peered":"2024-04-26T12:39:37.519104+0000","last_clean":"2024-04-26T12:39:37.519104+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:39:37.519104+0000","last_undegraded":"2024-04-26T12:39:37.519104+0000","last_fullsized":"2024-04-26T12:39:37.519104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697485+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:39:37.697485+0000","last_peered":"2024-04-26T12:39:37.697485+0000","last_clean":"2024-04-26T12:39:37.697485+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:39:37.697485+0000","last_undegraded":"2024-04-26T12:39:37.697485+0000","last_fullsized":"2024-04-26T12:39:37.697485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'19","reported_seq":116,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429765+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:39:37.429765+0000","last_peered":"2024-04-26T12:39:37.429765+0000","last_clean":"2024-04-26T12:39:37.429765+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:39:37.429765+0000","last_undegraded":"2024-04-26T12:39:37.429765+0000","last_fullsized":"2024-04-26T12:39:37.429765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693738+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:39:37.693738+0000","last_peered":"2024-04-26T12:39:37.693738+0000","last_clean":"2024-04-26T12:39:37.693738+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:39:37.693738+0000","last_undegraded":"2024-04-26T12:39:37.693738+0000","last_fullsized":"2024-04-26T12:39:37.693738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750339+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:39:37.750339+0000","last_peered":"2024-04-26T12:39:37.750339+0000","last_clean":"2024-04-26T12:39:37.750339+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:39:37.750339+0000","last_undegraded":"2024-04-26T12:39:37.750339+0000","last_fullsized":"2024-04-26T12:39:37.750339+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322711+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:39:37.322711+0000","last_peered":"2024-04-26T12:39:37.322711+0000","last_clean":"2024-04-26T12:39:37.322711+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:39:37.322711+0000","last_undegraded":"2024-04-26T12:39:37.322711+0000","last_fullsized":"2024-04-26T12:39:37.322711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517030+0000","last_change":"2024-04-26T12:38:32.098082+0000","last_active":"2024-04-26T12:39:37.517030+0000","last_peered":"2024-04-26T12:39:37.517030+0000","last_clean":"2024-04-26T12:39:37.517030+0000","last_became_active":"2024-04-26T12:38:32.097658+0000","last_became_peered":"2024-04-26T12:38:32.097658+0000","last_unstale":"2024-04-26T12:39:37.517030+0000","last_undegraded":"2024-04-26T12:39:37.517030+0000","last_fullsized":"2024-04-26T12:39:37.517030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:15.092930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431183+0000","last_change":"2024-04-26T12:38:32.090992+0000","last_active":"2024-04-26T12:39:37.431183+0000","last_peered":"2024-04-26T12:39:37.431183+0000","last_clean":"2024-04-26T12:39:37.431183+0000","last_became_active":"2024-04-26T12:38:32.090197+0000","last_became_peered":"2024-04-26T12:38:32.090197+0000","last_unstale":"2024-04-26T12:39:37.431183+0000","last_undegraded":"2024-04-26T12:39:37.431183+0000","last_fullsized":"2024-04-26T12:39:37.431183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:51.388263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754280+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:39:37.754280+0000","last_peered":"2024-04-26T12:39:37.754280+0000","last_clean":"2024-04-26T12:39:37.754280+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:39:37.754280+0000","last_undegraded":"2024-04-26T12:39:37.754280+0000","last_fullsized":"2024-04-26T12:39:37.754280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'11","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687451+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:39:37.687451+0000","last_peered":"2024-04-26T12:39:37.687451+0000","last_clean":"2024-04-26T12:39:37.687451+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:39:37.687451+0000","last_undegraded":"2024-04-26T12:39:37.687451+0000","last_fullsized":"2024-04-26T12:39:37.687451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697351+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:39:37.697351+0000","last_peered":"2024-04-26T12:39:37.697351+0000","last_clean":"2024-04-26T12:39:37.697351+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:39:37.697351+0000","last_undegraded":"2024-04-26T12:39:37.697351+0000","last_fullsized":"2024-04-26T12:39:37.697351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692830+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:39:37.692830+0000","last_peered":"2024-04-26T12:39:37.692830+0000","last_clean":"2024-04-26T12:39:37.692830+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:39:37.692830+0000","last_undegraded":"2024-04-26T12:39:37.692830+0000","last_fullsized":"2024-04-26T12:39:37.692830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754162+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:39:37.754162+0000","last_peered":"2024-04-26T12:39:37.754162+0000","last_clean":"2024-04-26T12:39:37.754162+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:39:37.754162+0000","last_undegraded":"2024-04-26T12:39:37.754162+0000","last_fullsized":"2024-04-26T12:39:37.754162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431991+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:39:37.431991+0000","last_peered":"2024-04-26T12:39:37.431991+0000","last_clean":"2024-04-26T12:39:37.431991+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:39:37.431991+0000","last_undegraded":"2024-04-26T12:39:37.431991+0000","last_fullsized":"2024-04-26T12:39:37.431991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688795+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:39:37.688795+0000","last_peered":"2024-04-26T12:39:37.688795+0000","last_clean":"2024-04-26T12:39:37.688795+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:39:37.688795+0000","last_undegraded":"2024-04-26T12:39:37.688795+0000","last_fullsized":"2024-04-26T12:39:37.688795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'5","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316748+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:39:37.316748+0000","last_peered":"2024-04-26T12:39:37.316748+0000","last_clean":"2024-04-26T12:39:37.316748+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:39:37.316748+0000","last_undegraded":"2024-04-26T12:39:37.316748+0000","last_fullsized":"2024-04-26T12:39:37.316748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430005+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:39:37.430005+0000","last_peered":"2024-04-26T12:39:37.430005+0000","last_clean":"2024-04-26T12:39:37.430005+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:39:37.430005+0000","last_undegraded":"2024-04-26T12:39:37.430005+0000","last_fullsized":"2024-04-26T12:39:37.430005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322088+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:39:37.322088+0000","last_peered":"2024-04-26T12:39:37.322088+0000","last_clean":"2024-04-26T12:39:37.322088+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:39:37.322088+0000","last_undegraded":"2024-04-26T12:39:37.322088+0000","last_fullsized":"2024-04-26T12:39:37.322088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687895+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:39:37.687895+0000","last_peered":"2024-04-26T12:39:37.687895+0000","last_clean":"2024-04-26T12:39:37.687895+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:39:37.687895+0000","last_undegraded":"2024-04-26T12:39:37.687895+0000","last_fullsized":"2024-04-26T12:39:37.687895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751754+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:39:37.751754+0000","last_peered":"2024-04-26T12:39:37.751754+0000","last_clean":"2024-04-26T12:39:37.751754+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:39:37.751754+0000","last_undegraded":"2024-04-26T12:39:37.751754+0000","last_fullsized":"2024-04-26T12:39:37.751754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429174+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:39:37.429174+0000","last_peered":"2024-04-26T12:39:37.429174+0000","last_clean":"2024-04-26T12:39:37.429174+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:39:37.429174+0000","last_undegraded":"2024-04-26T12:39:37.429174+0000","last_fullsized":"2024-04-26T12:39:37.429174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"29'11","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688352+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:39:37.688352+0000","last_peered":"2024-04-26T12:39:37.688352+0000","last_clean":"2024-04-26T12:39:37.688352+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:39:37.688352+0000","last_undegraded":"2024-04-26T12:39:37.688352+0000","last_fullsized":"2024-04-26T12:39:37.688352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516476+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:39:37.516476+0000","last_peered":"2024-04-26T12:39:37.516476+0000","last_clean":"2024-04-26T12:39:37.516476+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:39:37.516476+0000","last_undegraded":"2024-04-26T12:39:37.516476+0000","last_fullsized":"2024-04-26T12:39:37.516476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749569+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:39:37.749569+0000","last_peered":"2024-04-26T12:39:37.749569+0000","last_clean":"2024-04-26T12:39:37.749569+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:39:37.749569+0000","last_undegraded":"2024-04-26T12:39:37.749569+0000","last_fullsized":"2024-04-26T12:39:37.749569+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697843+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:39:37.697843+0000","last_peered":"2024-04-26T12:39:37.697843+0000","last_clean":"2024-04-26T12:39:37.697843+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:39:37.697843+0000","last_undegraded":"2024-04-26T12:39:37.697843+0000","last_fullsized":"2024-04-26T12:39:37.697843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.323488+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:39:37.323488+0000","last_peered":"2024-04-26T12:39:37.323488+0000","last_clean":"2024-04-26T12:39:37.323488+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:39:37.323488+0000","last_undegraded":"2024-04-26T12:39:37.323488+0000","last_fullsized":"2024-04-26T12:39:37.323488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516556+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:39:37.516556+0000","last_peered":"2024-04-26T12:39:37.516556+0000","last_clean":"2024-04-26T12:39:37.516556+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:39:37.516556+0000","last_undegraded":"2024-04-26T12:39:37.516556+0000","last_fullsized":"2024-04-26T12:39:37.516556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"29'9","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429642+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:39:37.429642+0000","last_peered":"2024-04-26T12:39:37.429642+0000","last_clean":"2024-04-26T12:39:37.429642+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:39:37.429642+0000","last_undegraded":"2024-04-26T12:39:37.429642+0000","last_fullsized":"2024-04-26T12:39:37.429642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318488+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:39:37.318488+0000","last_peered":"2024-04-26T12:39:37.318488+0000","last_clean":"2024-04-26T12:39:37.318488+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:39:37.318488+0000","last_undegraded":"2024-04-26T12:39:37.318488+0000","last_fullsized":"2024-04-26T12:39:37.318488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518948+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:39:37.518948+0000","last_peered":"2024-04-26T12:39:37.518948+0000","last_clean":"2024-04-26T12:39:37.518948+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:39:37.518948+0000","last_undegraded":"2024-04-26T12:39:37.518948+0000","last_fullsized":"2024-04-26T12:39:37.518948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699613+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:39:37.699613+0000","last_peered":"2024-04-26T12:39:37.699613+0000","last_clean":"2024-04-26T12:39:37.699613+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:39:37.699613+0000","last_undegraded":"2024-04-26T12:39:37.699613+0000","last_fullsized":"2024-04-26T12:39:37.699613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322944+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:39:37.322944+0000","last_peered":"2024-04-26T12:39:37.322944+0000","last_clean":"2024-04-26T12:39:37.322944+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:39:37.322944+0000","last_undegraded":"2024-04-26T12:39:37.322944+0000","last_fullsized":"2024-04-26T12:39:37.322944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'12","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757355+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:39:37.757355+0000","last_peered":"2024-04-26T12:39:37.757355+0000","last_clean":"2024-04-26T12:39:37.757355+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:39:37.757355+0000","last_undegraded":"2024-04-26T12:39:37.757355+0000","last_fullsized":"2024-04-26T12:39:37.757355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750150+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:39:37.750150+0000","last_peered":"2024-04-26T12:39:37.750150+0000","last_clean":"2024-04-26T12:39:37.750150+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:39:37.750150+0000","last_undegraded":"2024-04-26T12:39:37.750150+0000","last_fullsized":"2024-04-26T12:39:37.750150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688450+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:39:37.688450+0000","last_peered":"2024-04-26T12:39:37.688450+0000","last_clean":"2024-04-26T12:39:37.688450+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:39:37.688450+0000","last_undegraded":"2024-04-26T12:39:37.688450+0000","last_fullsized":"2024-04-26T12:39:37.688450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.324901+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:39:37.324901+0000","last_peered":"2024-04-26T12:39:37.324901+0000","last_clean":"2024-04-26T12:39:37.324901+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:39:37.324901+0000","last_undegraded":"2024-04-26T12:39:37.324901+0000","last_fullsized":"2024-04-26T12:39:37.324901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.753245+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:39:37.753245+0000","last_peered":"2024-04-26T12:39:37.753245+0000","last_clean":"2024-04-26T12:39:37.753245+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:39:37.753245+0000","last_undegraded":"2024-04-26T12:39:37.753245+0000","last_fullsized":"2024-04-26T12:39:37.753245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518687+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:39:37.518687+0000","last_peered":"2024-04-26T12:39:37.518687+0000","last_clean":"2024-04-26T12:39:37.518687+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:39:37.518687+0000","last_undegraded":"2024-04-26T12:39:37.518687+0000","last_fullsized":"2024-04-26T12:39:37.518687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"29'15","reported_seq":105,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430701+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:39:37.430701+0000","last_peered":"2024-04-26T12:39:37.430701+0000","last_clean":"2024-04-26T12:39:37.430701+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:39:37.430701+0000","last_undegraded":"2024-04-26T12:39:37.430701+0000","last_fullsized":"2024-04-26T12:39:37.430701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757455+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:39:37.757455+0000","last_peered":"2024-04-26T12:39:37.757455+0000","last_clean":"2024-04-26T12:39:37.757455+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:39:37.757455+0000","last_undegraded":"2024-04-26T12:39:37.757455+0000","last_fullsized":"2024-04-26T12:39:37.757455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516131+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:39:37.516131+0000","last_peered":"2024-04-26T12:39:37.516131+0000","last_clean":"2024-04-26T12:39:37.516131+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:39:37.516131+0000","last_undegraded":"2024-04-26T12:39:37.516131+0000","last_fullsized":"2024-04-26T12:39:37.516131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693473+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:39:37.693473+0000","last_peered":"2024-04-26T12:39:37.693473+0000","last_clean":"2024-04-26T12:39:37.693473+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:39:37.693473+0000","last_undegraded":"2024-04-26T12:39:37.693473+0000","last_fullsized":"2024-04-26T12:39:37.693473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754453+0000","last_change":"2024-04-26T12:38:32.097004+0000","last_active":"2024-04-26T12:39:37.754453+0000","last_peered":"2024-04-26T12:39:37.754453+0000","last_clean":"2024-04-26T12:39:37.754453+0000","last_became_active":"2024-04-26T12:38:32.096196+0000","last_became_peered":"2024-04-26T12:38:32.096196+0000","last_unstale":"2024-04-26T12:39:37.754453+0000","last_undegraded":"2024-04-26T12:39:37.754453+0000","last_fullsized":"2024-04-26T12:39:37.754453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:00.173484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.698039+0000","last_change":"2024-04-26T12:38:32.100356+0000","last_active":"2024-04-26T12:39:37.698039+0000","last_peered":"2024-04-26T12:39:37.698039+0000","last_clean":"2024-04-26T12:39:37.698039+0000","last_became_active":"2024-04-26T12:38:32.099529+0000","last_became_peered":"2024-04-26T12:38:32.099529+0000","last_unstale":"2024-04-26T12:39:37.698039+0000","last_undegraded":"2024-04-26T12:39:37.698039+0000","last_fullsized":"2024-04-26T12:39:37.698039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:32.397561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"29'11","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.691052+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:39:37.691052+0000","last_peered":"2024-04-26T12:39:37.691052+0000","last_clean":"2024-04-26T12:39:37.691052+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:39:37.691052+0000","last_undegraded":"2024-04-26T12:39:37.691052+0000","last_fullsized":"2024-04-26T12:39:37.691052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757350+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:39:37.757350+0000","last_peered":"2024-04-26T12:39:37.757350+0000","last_clean":"2024-04-26T12:39:37.757350+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:39:37.757350+0000","last_undegraded":"2024-04-26T12:39:37.757350+0000","last_fullsized":"2024-04-26T12:39:37.757350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749242+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:39:37.749242+0000","last_peered":"2024-04-26T12:39:37.749242+0000","last_clean":"2024-04-26T12:39:37.749242+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:39:37.749242+0000","last_undegraded":"2024-04-26T12:39:37.749242+0000","last_fullsized":"2024-04-26T12:39:37.749242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311968+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:39:37.311968+0000","last_peered":"2024-04-26T12:39:37.311968+0000","last_clean":"2024-04-26T12:39:37.311968+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:39:37.311968+0000","last_undegraded":"2024-04-26T12:39:37.311968+0000","last_fullsized":"2024-04-26T12:39:37.311968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318595+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:39:37.318595+0000","last_peered":"2024-04-26T12:39:37.318595+0000","last_clean":"2024-04-26T12:39:37.318595+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:39:37.318595+0000","last_undegraded":"2024-04-26T12:39:37.318595+0000","last_fullsized":"2024-04-26T12:39:37.318595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757728+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:39:37.757728+0000","last_peered":"2024-04-26T12:39:37.757728+0000","last_clean":"2024-04-26T12:39:37.757728+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:39:37.757728+0000","last_undegraded":"2024-04-26T12:39:37.757728+0000","last_fullsized":"2024-04-26T12:39:37.757728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518653+0000","last_change":"2024-04-26T12:38:32.098589+0000","last_active":"2024-04-26T12:39:37.518653+0000","last_peered":"2024-04-26T12:39:37.518653+0000","last_clean":"2024-04-26T12:39:37.518653+0000","last_became_active":"2024-04-26T12:38:32.097940+0000","last_became_peered":"2024-04-26T12:38:32.097940+0000","last_unstale":"2024-04-26T12:39:37.518653+0000","last_undegraded":"2024-04-26T12:39:37.518653+0000","last_fullsized":"2024-04-26T12:39:37.518653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518438+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:39:37.518438+0000","last_peered":"2024-04-26T12:39:37.518438+0000","last_clean":"2024-04-26T12:39:37.518438+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:39:37.518438+0000","last_undegraded":"2024-04-26T12:39:37.518438+0000","last_fullsized":"2024-04-26T12:39:37.518438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429114+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:39:37.429114+0000","last_peered":"2024-04-26T12:39:37.429114+0000","last_clean":"2024-04-26T12:39:37.429114+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:39:37.429114+0000","last_undegraded":"2024-04-26T12:39:37.429114+0000","last_fullsized":"2024-04-26T12:39:37.429114+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699187+0000","last_change":"2024-04-26T12:38:32.097299+0000","last_active":"2024-04-26T12:39:37.699187+0000","last_peered":"2024-04-26T12:39:37.699187+0000","last_clean":"2024-04-26T12:39:37.699187+0000","last_became_active":"2024-04-26T12:38:32.096485+0000","last_became_peered":"2024-04-26T12:38:32.096485+0000","last_unstale":"2024-04-26T12:39:37.699187+0000","last_undegraded":"2024-04-26T12:39:37.699187+0000","last_fullsized":"2024-04-26T12:39:37.699187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:18.433433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750532+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:39:37.750532+0000","last_peered":"2024-04-26T12:39:37.750532+0000","last_clean":"2024-04-26T12:39:37.750532+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:39:37.750532+0000","last_undegraded":"2024-04-26T12:39:37.750532+0000","last_fullsized":"2024-04-26T12:39:37.750532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429730+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:39:37.429730+0000","last_peered":"2024-04-26T12:39:37.429730+0000","last_clean":"2024-04-26T12:39:37.429730+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:39:37.429730+0000","last_undegraded":"2024-04-26T12:39:37.429730+0000","last_fullsized":"2024-04-26T12:39:37.429730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"29'15","reported_seq":105,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749582+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:39:37.749582+0000","last_peered":"2024-04-26T12:39:37.749582+0000","last_clean":"2024-04-26T12:39:37.749582+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:39:37.749582+0000","last_undegraded":"2024-04-26T12:39:37.749582+0000","last_fullsized":"2024-04-26T12:39:37.749582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316339+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:39:37.316339+0000","last_peered":"2024-04-26T12:39:37.316339+0000","last_clean":"2024-04-26T12:39:37.316339+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:39:37.316339+0000","last_undegraded":"2024-04-26T12:39:37.316339+0000","last_fullsized":"2024-04-26T12:39:37.316339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432444+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:39:37.432444+0000","last_peered":"2024-04-26T12:39:37.432444+0000","last_clean":"2024-04-26T12:39:37.432444+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:39:37.432444+0000","last_undegraded":"2024-04-26T12:39:37.432444+0000","last_fullsized":"2024-04-26T12:39:37.432444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693904+0000","last_change":"2024-04-26T12:38:32.097693+0000","last_active":"2024-04-26T12:39:37.693904+0000","last_peered":"2024-04-26T12:39:37.693904+0000","last_clean":"2024-04-26T12:39:37.693904+0000","last_became_active":"2024-04-26T12:38:32.096141+0000","last_became_peered":"2024-04-26T12:38:32.096141+0000","last_unstale":"2024-04-26T12:39:37.693904+0000","last_undegraded":"2024-04-26T12:39:37.693904+0000","last_fullsized":"2024-04-26T12:39:37.693904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.450059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751714+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:39:37.751714+0000","last_peered":"2024-04-26T12:39:37.751714+0000","last_clean":"2024-04-26T12:39:37.751714+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:39:37.751714+0000","last_undegraded":"2024-04-26T12:39:37.751714+0000","last_fullsized":"2024-04-26T12:39:37.751714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750256+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:39:37.750256+0000","last_peered":"2024-04-26T12:39:37.750256+0000","last_clean":"2024-04-26T12:39:37.750256+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:39:37.750256+0000","last_undegraded":"2024-04-26T12:39:37.750256+0000","last_fullsized":"2024-04-26T12:39:37.750256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"29'9","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316452+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:39:37.316452+0000","last_peered":"2024-04-26T12:39:37.316452+0000","last_clean":"2024-04-26T12:39:37.316452+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:39:37.316452+0000","last_undegraded":"2024-04-26T12:39:37.316452+0000","last_fullsized":"2024-04-26T12:39:37.316452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516170+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:39:37.516170+0000","last_peered":"2024-04-26T12:39:37.516170+0000","last_clean":"2024-04-26T12:39:37.516170+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:39:37.516170+0000","last_undegraded":"2024-04-26T12:39:37.516170+0000","last_fullsized":"2024-04-26T12:39:37.516170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692918+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:39:37.692918+0000","last_peered":"2024-04-26T12:39:37.692918+0000","last_clean":"2024-04-26T12:39:37.692918+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:39:37.692918+0000","last_undegraded":"2024-04-26T12:39:37.692918+0000","last_fullsized":"2024-04-26T12:39:37.692918+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688078+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:39:37.688078+0000","last_peered":"2024-04-26T12:39:37.688078+0000","last_clean":"2024-04-26T12:39:37.688078+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:39:37.688078+0000","last_undegraded":"2024-04-26T12:39:37.688078+0000","last_fullsized":"2024-04-26T12:39:37.688078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693230+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:39:37.693230+0000","last_peered":"2024-04-26T12:39:37.693230+0000","last_clean":"2024-04-26T12:39:37.693230+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:39:37.693230+0000","last_undegraded":"2024-04-26T12:39:37.693230+0000","last_fullsized":"2024-04-26T12:39:37.693230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516005+0000","last_change":"2024-04-26T12:38:32.098077+0000","last_active":"2024-04-26T12:39:37.516005+0000","last_peered":"2024-04-26T12:39:37.516005+0000","last_clean":"2024-04-26T12:39:37.516005+0000","last_became_active":"2024-04-26T12:38:32.097608+0000","last_became_peered":"2024-04-26T12:38:32.097608+0000","last_unstale":"2024-04-26T12:39:37.516005+0000","last_undegraded":"2024-04-26T12:39:37.516005+0000","last_fullsized":"2024-04-26T12:39:37.516005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:52.163433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"29'5","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699311+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:39:37.699311+0000","last_peered":"2024-04-26T12:39:37.699311+0000","last_clean":"2024-04-26T12:39:37.699311+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:39:37.699311+0000","last_undegraded":"2024-04-26T12:39:37.699311+0000","last_fullsized":"2024-04-26T12:39:37.699311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516306+0000","last_change":"2024-04-26T12:38:32.097869+0000","last_active":"2024-04-26T12:39:37.516306+0000","last_peered":"2024-04-26T12:39:37.516306+0000","last_clean":"2024-04-26T12:39:37.516306+0000","last_became_active":"2024-04-26T12:38:32.097545+0000","last_became_peered":"2024-04-26T12:38:32.097545+0000","last_unstale":"2024-04-26T12:39:37.516306+0000","last_undegraded":"2024-04-26T12:39:37.516306+0000","last_fullsized":"2024-04-26T12:39:37.516306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:00.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431452+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:39:37.431452+0000","last_peered":"2024-04-26T12:39:37.431452+0000","last_clean":"2024-04-26T12:39:37.431452+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:39:37.431452+0000","last_undegraded":"2024-04-26T12:39:37.431452+0000","last_fullsized":"2024-04-26T12:39:37.431452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516125+0000","last_change":"2024-04-26T12:38:32.098742+0000","last_active":"2024-04-26T12:39:37.516125+0000","last_peered":"2024-04-26T12:39:37.516125+0000","last_clean":"2024-04-26T12:39:37.516125+0000","last_became_active":"2024-04-26T12:38:32.098197+0000","last_became_peered":"2024-04-26T12:38:32.098197+0000","last_unstale":"2024-04-26T12:39:37.516125+0000","last_undegraded":"2024-04-26T12:39:37.516125+0000","last_fullsized":"2024-04-26T12:39:37.516125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.480181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.323326+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:39:37.323326+0000","last_peered":"2024-04-26T12:39:37.323326+0000","last_clean":"2024-04-26T12:39:37.323326+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:39:37.323326+0000","last_undegraded":"2024-04-26T12:39:37.323326+0000","last_fullsized":"2024-04-26T12:39:37.323326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752701+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:39:37.752701+0000","last_peered":"2024-04-26T12:39:37.752701+0000","last_clean":"2024-04-26T12:39:37.752701+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:39:37.752701+0000","last_undegraded":"2024-04-26T12:39:37.752701+0000","last_fullsized":"2024-04-26T12:39:37.752701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'9","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751090+0000","last_change":"2024-04-26T12:38:32.089759+0000","last_active":"2024-04-26T12:39:37.751090+0000","last_peered":"2024-04-26T12:39:37.751090+0000","last_clean":"2024-04-26T12:39:37.751090+0000","last_became_active":"2024-04-26T12:38:32.088214+0000","last_became_peered":"2024-04-26T12:38:32.088214+0000","last_unstale":"2024-04-26T12:39:37.751090+0000","last_undegraded":"2024-04-26T12:39:37.751090+0000","last_fullsized":"2024-04-26T12:39:37.751090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:38.656355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318380+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:39:37.318380+0000","last_peered":"2024-04-26T12:39:37.318380+0000","last_clean":"2024-04-26T12:39:37.318380+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:39:37.318380+0000","last_undegraded":"2024-04-26T12:39:37.318380+0000","last_fullsized":"2024-04-26T12:39:37.318380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321765+0000","last_change":"2024-04-26T12:38:32.098228+0000","last_active":"2024-04-26T12:39:37.321765+0000","last_peered":"2024-04-26T12:39:37.321765+0000","last_clean":"2024-04-26T12:39:37.321765+0000","last_became_active":"2024-04-26T12:38:32.092404+0000","last_became_peered":"2024-04-26T12:38:32.092404+0000","last_unstale":"2024-04-26T12:39:37.321765+0000","last_undegraded":"2024-04-26T12:39:37.321765+0000","last_fullsized":"2024-04-26T12:39:37.321765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758647+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:39:37.758647+0000","last_peered":"2024-04-26T12:39:37.758647+0000","last_clean":"2024-04-26T12:39:37.758647+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:39:37.758647+0000","last_undegraded":"2024-04-26T12:39:37.758647+0000","last_fullsized":"2024-04-26T12:39:37.758647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516472+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:39:37.516472+0000","last_peered":"2024-04-26T12:39:37.516472+0000","last_clean":"2024-04-26T12:39:37.516472+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:39:37.516472+0000","last_undegraded":"2024-04-26T12:39:37.516472+0000","last_fullsized":"2024-04-26T12:39:37.516472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758220+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:39:37.758220+0000","last_peered":"2024-04-26T12:39:37.758220+0000","last_clean":"2024-04-26T12:39:37.758220+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:39:37.758220+0000","last_undegraded":"2024-04-26T12:39:37.758220+0000","last_fullsized":"2024-04-26T12:39:37.758220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":97,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310478+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:39:37.310478+0000","last_peered":"2024-04-26T12:39:37.310478+0000","last_clean":"2024-04-26T12:39:37.310478+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:39:37.310478+0000","last_undegraded":"2024-04-26T12:39:37.310478+0000","last_fullsized":"2024-04-26T12:39:37.310478+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750893+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:39:37.750893+0000","last_peered":"2024-04-26T12:39:37.750893+0000","last_clean":"2024-04-26T12:39:37.750893+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:39:37.750893+0000","last_undegraded":"2024-04-26T12:39:37.750893+0000","last_fullsized":"2024-04-26T12:39:37.750893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752116+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:39:37.752116+0000","last_peered":"2024-04-26T12:39:37.752116+0000","last_clean":"2024-04-26T12:39:37.752116+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:39:37.752116+0000","last_undegraded":"2024-04-26T12:39:37.752116+0000","last_fullsized":"2024-04-26T12:39:37.752116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.755275+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:39:37.755275+0000","last_peered":"2024-04-26T12:39:37.755275+0000","last_clean":"2024-04-26T12:39:37.755275+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:39:37.755275+0000","last_undegraded":"2024-04-26T12:39:37.755275+0000","last_fullsized":"2024-04-26T12:39:37.755275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318864+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:39:37.318864+0000","last_peered":"2024-04-26T12:39:37.318864+0000","last_clean":"2024-04-26T12:39:37.318864+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:39:37.318864+0000","last_undegraded":"2024-04-26T12:39:37.318864+0000","last_fullsized":"2024-04-26T12:39:37.318864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699011+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:39:37.699011+0000","last_peered":"2024-04-26T12:39:37.699011+0000","last_clean":"2024-04-26T12:39:37.699011+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:39:37.699011+0000","last_undegraded":"2024-04-26T12:39:37.699011+0000","last_fullsized":"2024-04-26T12:39:37.699011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692698+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:39:37.692698+0000","last_peered":"2024-04-26T12:39:37.692698+0000","last_clean":"2024-04-26T12:39:37.692698+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:39:37.692698+0000","last_undegraded":"2024-04-26T12:39:37.692698+0000","last_fullsized":"2024-04-26T12:39:37.692698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516954+0000","last_change":"2024-04-26T12:38:32.099762+0000","last_active":"2024-04-26T12:39:37.516954+0000","last_peered":"2024-04-26T12:39:37.516954+0000","last_clean":"2024-04-26T12:39:37.516954+0000","last_became_active":"2024-04-26T12:38:32.099061+0000","last_became_peered":"2024-04-26T12:38:32.099061+0000","last_unstale":"2024-04-26T12:39:37.516954+0000","last_undegraded":"2024-04-26T12:39:37.516954+0000","last_fullsized":"2024-04-26T12:39:37.516954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:17.530530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":97,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757984+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:39:37.757984+0000","last_peered":"2024-04-26T12:39:37.757984+0000","last_clean":"2024-04-26T12:39:37.757984+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:39:37.757984+0000","last_undegraded":"2024-04-26T12:39:37.757984+0000","last_fullsized":"2024-04-26T12:39:37.757984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687822+0000","last_change":"2024-04-26T12:38:58.795730+0000","last_active":"2024-04-26T12:39:37.687822+0000","last_peered":"2024-04-26T12:39:37.687822+0000","last_clean":"2024-04-26T12:39:37.687822+0000","last_became_active":"2024-04-26T12:38:58.795097+0000","last_became_peered":"2024-04-26T12:38:58.795097+0000","last_unstale":"2024-04-26T12:39:37.687822+0000","last_undegraded":"2024-04-26T12:39:37.687822+0000","last_fullsized":"2024-04-26T12:39:37.687822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.166788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518975+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:39:37.518975+0000","last_peered":"2024-04-26T12:39:37.518975+0000","last_clean":"2024-04-26T12:39:37.518975+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:39:37.518975+0000","last_undegraded":"2024-04-26T12:39:37.518975+0000","last_fullsized":"2024-04-26T12:39:37.518975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516288+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:39:37.516288+0000","last_peered":"2024-04-26T12:39:37.516288+0000","last_clean":"2024-04-26T12:39:37.516288+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:39:37.516288+0000","last_undegraded":"2024-04-26T12:39:37.516288+0000","last_fullsized":"2024-04-26T12:39:37.516288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.690791+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:39:37.690791+0000","last_peered":"2024-04-26T12:39:37.690791+0000","last_clean":"2024-04-26T12:39:37.690791+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:39:37.690791+0000","last_undegraded":"2024-04-26T12:39:37.690791+0000","last_fullsized":"2024-04-26T12:39:37.690791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.323221+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:39:37.323221+0000","last_peered":"2024-04-26T12:39:37.323221+0000","last_clean":"2024-04-26T12:39:37.323221+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:39:37.323221+0000","last_undegraded":"2024-04-26T12:39:37.323221+0000","last_fullsized":"2024-04-26T12:39:37.323221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750635+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:39:37.750635+0000","last_peered":"2024-04-26T12:39:37.750635+0000","last_clean":"2024-04-26T12:39:37.750635+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:39:37.750635+0000","last_undegraded":"2024-04-26T12:39:37.750635+0000","last_fullsized":"2024-04-26T12:39:37.750635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313000+0000","last_change":"2024-04-26T12:38:32.101184+0000","last_active":"2024-04-26T12:39:37.313000+0000","last_peered":"2024-04-26T12:39:37.313000+0000","last_clean":"2024-04-26T12:39:37.313000+0000","last_became_active":"2024-04-26T12:38:32.100885+0000","last_became_peered":"2024-04-26T12:38:32.100885+0000","last_unstale":"2024-04-26T12:39:37.313000+0000","last_undegraded":"2024-04-26T12:39:37.313000+0000","last_fullsized":"2024-04-26T12:39:37.313000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:14.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688158+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:39:37.688158+0000","last_peered":"2024-04-26T12:39:37.688158+0000","last_clean":"2024-04-26T12:39:37.688158+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:39:37.688158+0000","last_undegraded":"2024-04-26T12:39:37.688158+0000","last_fullsized":"2024-04-26T12:39:37.688158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312430+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:39:37.312430+0000","last_peered":"2024-04-26T12:39:37.312430+0000","last_clean":"2024-04-26T12:39:37.312430+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:39:37.312430+0000","last_undegraded":"2024-04-26T12:39:37.312430+0000","last_fullsized":"2024-04-26T12:39:37.312430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751713+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:39:37.751713+0000","last_peered":"2024-04-26T12:39:37.751713+0000","last_clean":"2024-04-26T12:39:37.751713+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:39:37.751713+0000","last_undegraded":"2024-04-26T12:39:37.751713+0000","last_fullsized":"2024-04-26T12:39:37.751713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517549+0000","last_change":"2024-04-26T12:38:32.097249+0000","last_active":"2024-04-26T12:39:37.517549+0000","last_peered":"2024-04-26T12:39:37.517549+0000","last_clean":"2024-04-26T12:39:37.517549+0000","last_became_active":"2024-04-26T12:38:32.096972+0000","last_became_peered":"2024-04-26T12:38:32.096972+0000","last_unstale":"2024-04-26T12:39:37.517549+0000","last_undegraded":"2024-04-26T12:39:37.517549+0000","last_fullsized":"2024-04-26T12:39:37.517549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:06.018406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325761+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:39:37.325761+0000","last_peered":"2024-04-26T12:39:37.325761+0000","last_clean":"2024-04-26T12:39:37.325761+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:39:37.325761+0000","last_undegraded":"2024-04-26T12:39:37.325761+0000","last_fullsized":"2024-04-26T12:39:37.325761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430349+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:39:37.430349+0000","last_peered":"2024-04-26T12:39:37.430349+0000","last_clean":"2024-04-26T12:39:37.430349+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:39:37.430349+0000","last_undegraded":"2024-04-26T12:39:37.430349+0000","last_fullsized":"2024-04-26T12:39:37.430349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517849+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:39:37.517849+0000","last_peered":"2024-04-26T12:39:37.517849+0000","last_clean":"2024-04-26T12:39:37.517849+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:39:37.517849+0000","last_undegraded":"2024-04-26T12:39:37.517849+0000","last_fullsized":"2024-04-26T12:39:37.517849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.320917+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:39:37.320917+0000","last_peered":"2024-04-26T12:39:37.320917+0000","last_clean":"2024-04-26T12:39:37.320917+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:39:37.320917+0000","last_undegraded":"2024-04-26T12:39:37.320917+0000","last_fullsized":"2024-04-26T12:39:37.320917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432450+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:39:37.432450+0000","last_peered":"2024-04-26T12:39:37.432450+0000","last_clean":"2024-04-26T12:39:37.432450+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:39:37.432450+0000","last_undegraded":"2024-04-26T12:39:37.432450+0000","last_fullsized":"2024-04-26T12:39:37.432450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687744+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:39:37.687744+0000","last_peered":"2024-04-26T12:39:37.687744+0000","last_clean":"2024-04-26T12:39:37.687744+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:39:37.687744+0000","last_undegraded":"2024-04-26T12:39:37.687744+0000","last_fullsized":"2024-04-26T12:39:37.687744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313129+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:39:37.313129+0000","last_peered":"2024-04-26T12:39:37.313129+0000","last_clean":"2024-04-26T12:39:37.313129+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:39:37.313129+0000","last_undegraded":"2024-04-26T12:39:37.313129+0000","last_fullsized":"2024-04-26T12:39:37.313129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429606+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:39:37.429606+0000","last_peered":"2024-04-26T12:39:37.429606+0000","last_clean":"2024-04-26T12:39:37.429606+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:39:37.429606+0000","last_undegraded":"2024-04-26T12:39:37.429606+0000","last_fullsized":"2024-04-26T12:39:37.429606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752241+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:39:37.752241+0000","last_peered":"2024-04-26T12:39:37.752241+0000","last_clean":"2024-04-26T12:39:37.752241+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:39:37.752241+0000","last_undegraded":"2024-04-26T12:39:37.752241+0000","last_fullsized":"2024-04-26T12:39:37.752241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750165+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:39:37.750165+0000","last_peered":"2024-04-26T12:39:37.750165+0000","last_clean":"2024-04-26T12:39:37.750165+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:39:37.750165+0000","last_undegraded":"2024-04-26T12:39:37.750165+0000","last_fullsized":"2024-04-26T12:39:37.750165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.323032+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:39:37.323032+0000","last_peered":"2024-04-26T12:39:37.323032+0000","last_clean":"2024-04-26T12:39:37.323032+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:39:37.323032+0000","last_undegraded":"2024-04-26T12:39:37.323032+0000","last_fullsized":"2024-04-26T12:39:37.323032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.753015+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:39:37.753015+0000","last_peered":"2024-04-26T12:39:37.753015+0000","last_clean":"2024-04-26T12:39:37.753015+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:39:37.753015+0000","last_undegraded":"2024-04-26T12:39:37.753015+0000","last_fullsized":"2024-04-26T12:39:37.753015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751157+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:39:37.751157+0000","last_peered":"2024-04-26T12:39:37.751157+0000","last_clean":"2024-04-26T12:39:37.751157+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:39:37.751157+0000","last_undegraded":"2024-04-26T12:39:37.751157+0000","last_fullsized":"2024-04-26T12:39:37.751157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":684,"num_read_kb":443,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1331200,"data_stored":967997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":712704,"data_stored":376969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":765952,"data_stored":379226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":376467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":716800,"data_stored":369517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":692224,"data_stored":369119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":378212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1310720,"data_stored":967403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:39:40.056 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:39:40.130 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:40.130+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:40.232 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:40.230+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:40.256 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:40.256 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:40.256 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:40.256 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:40.275 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:40.334 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:40.330+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:40.375 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:39:40.434 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:40.434+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:40.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:40.492 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:40.492 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:40.492 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:40.492 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:40.492 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:40.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:40.534 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:40.530+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:40.619 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:39:40.625 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:39:40.635 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:40.630+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:40.646 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-04-26T12:39:39.355472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":804,"num_read_kb":547,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":527,"ondisk_log_size":527,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243784,"kb_used_data":6800,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730936,"statfs":{"total":773094113280,"available":772844478464,"internally_reserved":0,"allocated":6963200,"data_stored":4184910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.049629"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432011+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:39:37.432011+0000","last_peered":"2024-04-26T12:39:37.432011+0000","last_clean":"2024-04-26T12:39:37.432011+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:39:37.432011+0000","last_undegraded":"2024-04-26T12:39:37.432011+0000","last_fullsized":"2024-04-26T12:39:37.432011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749284+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:39:37.749284+0000","last_peered":"2024-04-26T12:39:37.749284+0000","last_clean":"2024-04-26T12:39:37.749284+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:39:37.749284+0000","last_undegraded":"2024-04-26T12:39:37.749284+0000","last_fullsized":"2024-04-26T12:39:37.749284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758302+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:39:37.758302+0000","last_peered":"2024-04-26T12:39:37.758302+0000","last_clean":"2024-04-26T12:39:37.758302+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:39:37.758302+0000","last_undegraded":"2024-04-26T12:39:37.758302+0000","last_fullsized":"2024-04-26T12:39:37.758302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429878+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:39:37.429878+0000","last_peered":"2024-04-26T12:39:37.429878+0000","last_clean":"2024-04-26T12:39:37.429878+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:39:37.429878+0000","last_undegraded":"2024-04-26T12:39:37.429878+0000","last_fullsized":"2024-04-26T12:39:37.429878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322450+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:39:37.322450+0000","last_peered":"2024-04-26T12:39:37.322450+0000","last_clean":"2024-04-26T12:39:37.322450+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:39:37.322450+0000","last_undegraded":"2024-04-26T12:39:37.322450+0000","last_fullsized":"2024-04-26T12:39:37.322450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321324+0000","last_change":"2024-04-26T12:38:32.099160+0000","last_active":"2024-04-26T12:39:37.321324+0000","last_peered":"2024-04-26T12:39:37.321324+0000","last_clean":"2024-04-26T12:39:37.321324+0000","last_became_active":"2024-04-26T12:38:32.093033+0000","last_became_peered":"2024-04-26T12:38:32.093033+0000","last_unstale":"2024-04-26T12:39:37.321324+0000","last_undegraded":"2024-04-26T12:39:37.321324+0000","last_fullsized":"2024-04-26T12:39:37.321324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:22.221188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750405+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:39:37.750405+0000","last_peered":"2024-04-26T12:39:37.750405+0000","last_clean":"2024-04-26T12:39:37.750405+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:39:37.750405+0000","last_undegraded":"2024-04-26T12:39:37.750405+0000","last_fullsized":"2024-04-26T12:39:37.750405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318755+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:39:37.318755+0000","last_peered":"2024-04-26T12:39:37.318755+0000","last_clean":"2024-04-26T12:39:37.318755+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:39:37.318755+0000","last_undegraded":"2024-04-26T12:39:37.318755+0000","last_fullsized":"2024-04-26T12:39:37.318755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430620+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:39:37.430620+0000","last_peered":"2024-04-26T12:39:37.430620+0000","last_clean":"2024-04-26T12:39:37.430620+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:39:37.430620+0000","last_undegraded":"2024-04-26T12:39:37.430620+0000","last_fullsized":"2024-04-26T12:39:37.430620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517570+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:39:37.517570+0000","last_peered":"2024-04-26T12:39:37.517570+0000","last_clean":"2024-04-26T12:39:37.517570+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:39:37.517570+0000","last_undegraded":"2024-04-26T12:39:37.517570+0000","last_fullsized":"2024-04-26T12:39:37.517570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310695+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:39:37.310695+0000","last_peered":"2024-04-26T12:39:37.310695+0000","last_clean":"2024-04-26T12:39:37.310695+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:39:37.310695+0000","last_undegraded":"2024-04-26T12:39:37.310695+0000","last_fullsized":"2024-04-26T12:39:37.310695+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322332+0000","last_change":"2024-04-26T12:38:32.092960+0000","last_active":"2024-04-26T12:39:37.322332+0000","last_peered":"2024-04-26T12:39:37.322332+0000","last_clean":"2024-04-26T12:39:37.322332+0000","last_became_active":"2024-04-26T12:38:32.092562+0000","last_became_peered":"2024-04-26T12:38:32.092562+0000","last_unstale":"2024-04-26T12:39:37.322332+0000","last_undegraded":"2024-04-26T12:39:37.322332+0000","last_fullsized":"2024-04-26T12:39:37.322332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:43.474569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430367+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:39:37.430367+0000","last_peered":"2024-04-26T12:39:37.430367+0000","last_clean":"2024-04-26T12:39:37.430367+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:39:37.430367+0000","last_undegraded":"2024-04-26T12:39:37.430367+0000","last_fullsized":"2024-04-26T12:39:37.430367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750544+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:39:37.750544+0000","last_peered":"2024-04-26T12:39:37.750544+0000","last_clean":"2024-04-26T12:39:37.750544+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:39:37.750544+0000","last_undegraded":"2024-04-26T12:39:37.750544+0000","last_fullsized":"2024-04-26T12:39:37.750544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697925+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:39:37.697925+0000","last_peered":"2024-04-26T12:39:37.697925+0000","last_clean":"2024-04-26T12:39:37.697925+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:39:37.697925+0000","last_undegraded":"2024-04-26T12:39:37.697925+0000","last_fullsized":"2024-04-26T12:39:37.697925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313584+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:39:37.313584+0000","last_peered":"2024-04-26T12:39:37.313584+0000","last_clean":"2024-04-26T12:39:37.313584+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:39:37.313584+0000","last_undegraded":"2024-04-26T12:39:37.313584+0000","last_fullsized":"2024-04-26T12:39:37.313584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316635+0000","last_change":"2024-04-26T12:38:32.098437+0000","last_active":"2024-04-26T12:39:37.316635+0000","last_peered":"2024-04-26T12:39:37.316635+0000","last_clean":"2024-04-26T12:39:37.316635+0000","last_became_active":"2024-04-26T12:38:32.093038+0000","last_became_peered":"2024-04-26T12:38:32.093038+0000","last_unstale":"2024-04-26T12:39:37.316635+0000","last_undegraded":"2024-04-26T12:39:37.316635+0000","last_fullsized":"2024-04-26T12:39:37.316635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:11.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432318+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:39:37.432318+0000","last_peered":"2024-04-26T12:39:37.432318+0000","last_clean":"2024-04-26T12:39:37.432318+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:39:37.432318+0000","last_undegraded":"2024-04-26T12:39:37.432318+0000","last_fullsized":"2024-04-26T12:39:37.432318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430338+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:39:37.430338+0000","last_peered":"2024-04-26T12:39:37.430338+0000","last_clean":"2024-04-26T12:39:37.430338+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:39:37.430338+0000","last_undegraded":"2024-04-26T12:39:37.430338+0000","last_fullsized":"2024-04-26T12:39:37.430338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518633+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:39:37.518633+0000","last_peered":"2024-04-26T12:39:37.518633+0000","last_clean":"2024-04-26T12:39:37.518633+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:39:37.518633+0000","last_undegraded":"2024-04-26T12:39:37.518633+0000","last_fullsized":"2024-04-26T12:39:37.518633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751435+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:39:37.751435+0000","last_peered":"2024-04-26T12:39:37.751435+0000","last_clean":"2024-04-26T12:39:37.751435+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:39:37.751435+0000","last_undegraded":"2024-04-26T12:39:37.751435+0000","last_fullsized":"2024-04-26T12:39:37.751435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518286+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:39:37.518286+0000","last_peered":"2024-04-26T12:39:37.518286+0000","last_clean":"2024-04-26T12:39:37.518286+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:39:37.518286+0000","last_undegraded":"2024-04-26T12:39:37.518286+0000","last_fullsized":"2024-04-26T12:39:37.518286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311236+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:39:37.311236+0000","last_peered":"2024-04-26T12:39:37.311236+0000","last_clean":"2024-04-26T12:39:37.311236+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:39:37.311236+0000","last_undegraded":"2024-04-26T12:39:37.311236+0000","last_fullsized":"2024-04-26T12:39:37.311236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517843+0000","last_change":"2024-04-26T12:38:32.097333+0000","last_active":"2024-04-26T12:39:37.517843+0000","last_peered":"2024-04-26T12:39:37.517843+0000","last_clean":"2024-04-26T12:39:37.517843+0000","last_became_active":"2024-04-26T12:38:32.097076+0000","last_became_peered":"2024-04-26T12:38:32.097076+0000","last_unstale":"2024-04-26T12:39:37.517843+0000","last_undegraded":"2024-04-26T12:39:37.517843+0000","last_fullsized":"2024-04-26T12:39:37.517843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:52.365241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311893+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:39:37.311893+0000","last_peered":"2024-04-26T12:39:37.311893+0000","last_clean":"2024-04-26T12:39:37.311893+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:39:37.311893+0000","last_undegraded":"2024-04-26T12:39:37.311893+0000","last_fullsized":"2024-04-26T12:39:37.311893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688676+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:39:37.688676+0000","last_peered":"2024-04-26T12:39:37.688676+0000","last_clean":"2024-04-26T12:39:37.688676+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:39:37.688676+0000","last_undegraded":"2024-04-26T12:39:37.688676+0000","last_fullsized":"2024-04-26T12:39:37.688676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757859+0000","last_change":"2024-04-26T12:38:32.098711+0000","last_active":"2024-04-26T12:39:37.757859+0000","last_peered":"2024-04-26T12:39:37.757859+0000","last_clean":"2024-04-26T12:39:37.757859+0000","last_became_active":"2024-04-26T12:38:32.097887+0000","last_became_peered":"2024-04-26T12:38:32.097887+0000","last_unstale":"2024-04-26T12:39:37.757859+0000","last_undegraded":"2024-04-26T12:39:37.757859+0000","last_fullsized":"2024-04-26T12:39:37.757859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:43.980582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321429+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:39:37.321429+0000","last_peered":"2024-04-26T12:39:37.321429+0000","last_clean":"2024-04-26T12:39:37.321429+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:39:37.321429+0000","last_undegraded":"2024-04-26T12:39:37.321429+0000","last_fullsized":"2024-04-26T12:39:37.321429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697170+0000","last_change":"2024-04-26T12:38:32.091108+0000","last_active":"2024-04-26T12:39:37.697170+0000","last_peered":"2024-04-26T12:39:37.697170+0000","last_clean":"2024-04-26T12:39:37.697170+0000","last_became_active":"2024-04-26T12:38:32.090800+0000","last_became_peered":"2024-04-26T12:38:32.090800+0000","last_unstale":"2024-04-26T12:39:37.697170+0000","last_undegraded":"2024-04-26T12:39:37.697170+0000","last_fullsized":"2024-04-26T12:39:37.697170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:54.159328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692377+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:39:37.692377+0000","last_peered":"2024-04-26T12:39:37.692377+0000","last_clean":"2024-04-26T12:39:37.692377+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:39:37.692377+0000","last_undegraded":"2024-04-26T12:39:37.692377+0000","last_fullsized":"2024-04-26T12:39:37.692377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430872+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:39:37.430872+0000","last_peered":"2024-04-26T12:39:37.430872+0000","last_clean":"2024-04-26T12:39:37.430872+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:39:37.430872+0000","last_undegraded":"2024-04-26T12:39:37.430872+0000","last_fullsized":"2024-04-26T12:39:37.430872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750625+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:39:37.750625+0000","last_peered":"2024-04-26T12:39:37.750625+0000","last_clean":"2024-04-26T12:39:37.750625+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:39:37.750625+0000","last_undegraded":"2024-04-26T12:39:37.750625+0000","last_fullsized":"2024-04-26T12:39:37.750625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"29'9","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322577+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:39:37.322577+0000","last_peered":"2024-04-26T12:39:37.322577+0000","last_clean":"2024-04-26T12:39:37.322577+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:39:37.322577+0000","last_undegraded":"2024-04-26T12:39:37.322577+0000","last_fullsized":"2024-04-26T12:39:37.322577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431678+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:39:37.431678+0000","last_peered":"2024-04-26T12:39:37.431678+0000","last_clean":"2024-04-26T12:39:37.431678+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:39:37.431678+0000","last_undegraded":"2024-04-26T12:39:37.431678+0000","last_fullsized":"2024-04-26T12:39:37.431678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749180+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:39:37.749180+0000","last_peered":"2024-04-26T12:39:37.749180+0000","last_clean":"2024-04-26T12:39:37.749180+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:39:37.749180+0000","last_undegraded":"2024-04-26T12:39:37.749180+0000","last_fullsized":"2024-04-26T12:39:37.749180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751585+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:39:37.751585+0000","last_peered":"2024-04-26T12:39:37.751585+0000","last_clean":"2024-04-26T12:39:37.751585+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:39:37.751585+0000","last_undegraded":"2024-04-26T12:39:37.751585+0000","last_fullsized":"2024-04-26T12:39:37.751585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321591+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:39:37.321591+0000","last_peered":"2024-04-26T12:39:37.321591+0000","last_clean":"2024-04-26T12:39:37.321591+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:39:37.321591+0000","last_undegraded":"2024-04-26T12:39:37.321591+0000","last_fullsized":"2024-04-26T12:39:37.321591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692217+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:39:37.692217+0000","last_peered":"2024-04-26T12:39:37.692217+0000","last_clean":"2024-04-26T12:39:37.692217+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:39:37.692217+0000","last_undegraded":"2024-04-26T12:39:37.692217+0000","last_fullsized":"2024-04-26T12:39:37.692217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313360+0000","last_change":"2024-04-26T12:38:32.099862+0000","last_active":"2024-04-26T12:39:37.313360+0000","last_peered":"2024-04-26T12:39:37.313360+0000","last_clean":"2024-04-26T12:39:37.313360+0000","last_became_active":"2024-04-26T12:38:32.098951+0000","last_became_peered":"2024-04-26T12:38:32.098951+0000","last_unstale":"2024-04-26T12:39:37.313360+0000","last_undegraded":"2024-04-26T12:39:37.313360+0000","last_fullsized":"2024-04-26T12:39:37.313360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:37.401523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322451+0000","last_change":"2024-04-26T12:38:32.100120+0000","last_active":"2024-04-26T12:39:37.322451+0000","last_peered":"2024-04-26T12:39:37.322451+0000","last_clean":"2024-04-26T12:39:37.322451+0000","last_became_active":"2024-04-26T12:38:32.099583+0000","last_became_peered":"2024-04-26T12:38:32.099583+0000","last_unstale":"2024-04-26T12:39:37.322451+0000","last_undegraded":"2024-04-26T12:39:37.322451+0000","last_fullsized":"2024-04-26T12:39:37.322451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:16.598403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321034+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:39:37.321034+0000","last_peered":"2024-04-26T12:39:37.321034+0000","last_clean":"2024-04-26T12:39:37.321034+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:39:37.321034+0000","last_undegraded":"2024-04-26T12:39:37.321034+0000","last_fullsized":"2024-04-26T12:39:37.321034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325232+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:39:37.325232+0000","last_peered":"2024-04-26T12:39:37.325232+0000","last_clean":"2024-04-26T12:39:37.325232+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:39:37.325232+0000","last_undegraded":"2024-04-26T12:39:37.325232+0000","last_fullsized":"2024-04-26T12:39:37.325232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430606+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:39:37.430606+0000","last_peered":"2024-04-26T12:39:37.430606+0000","last_clean":"2024-04-26T12:39:37.430606+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:39:37.430606+0000","last_undegraded":"2024-04-26T12:39:37.430606+0000","last_fullsized":"2024-04-26T12:39:37.430606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.691183+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:39:37.691183+0000","last_peered":"2024-04-26T12:39:37.691183+0000","last_clean":"2024-04-26T12:39:37.691183+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:39:37.691183+0000","last_undegraded":"2024-04-26T12:39:37.691183+0000","last_fullsized":"2024-04-26T12:39:37.691183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311721+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:39:37.311721+0000","last_peered":"2024-04-26T12:39:37.311721+0000","last_clean":"2024-04-26T12:39:37.311721+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:39:37.311721+0000","last_undegraded":"2024-04-26T12:39:37.311721+0000","last_fullsized":"2024-04-26T12:39:37.311721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431059+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:39:37.431059+0000","last_peered":"2024-04-26T12:39:37.431059+0000","last_clean":"2024-04-26T12:39:37.431059+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:39:37.431059+0000","last_undegraded":"2024-04-26T12:39:37.431059+0000","last_fullsized":"2024-04-26T12:39:37.431059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311104+0000","last_change":"2024-04-26T12:38:32.097189+0000","last_active":"2024-04-26T12:39:37.311104+0000","last_peered":"2024-04-26T12:39:37.311104+0000","last_clean":"2024-04-26T12:39:37.311104+0000","last_became_active":"2024-04-26T12:38:32.096313+0000","last_became_peered":"2024-04-26T12:38:32.096313+0000","last_unstale":"2024-04-26T12:39:37.311104+0000","last_undegraded":"2024-04-26T12:39:37.311104+0000","last_fullsized":"2024-04-26T12:39:37.311104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:26.879794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.690711+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:39:37.690711+0000","last_peered":"2024-04-26T12:39:37.690711+0000","last_clean":"2024-04-26T12:39:37.690711+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:39:37.690711+0000","last_undegraded":"2024-04-26T12:39:37.690711+0000","last_fullsized":"2024-04-26T12:39:37.690711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516676+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:39:37.516676+0000","last_peered":"2024-04-26T12:39:37.516676+0000","last_clean":"2024-04-26T12:39:37.516676+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:39:37.516676+0000","last_undegraded":"2024-04-26T12:39:37.516676+0000","last_fullsized":"2024-04-26T12:39:37.516676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750421+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:39:37.750421+0000","last_peered":"2024-04-26T12:39:37.750421+0000","last_clean":"2024-04-26T12:39:37.750421+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:39:37.750421+0000","last_undegraded":"2024-04-26T12:39:37.750421+0000","last_fullsized":"2024-04-26T12:39:37.750421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"29'9","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431357+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:39:37.431357+0000","last_peered":"2024-04-26T12:39:37.431357+0000","last_clean":"2024-04-26T12:39:37.431357+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:39:37.431357+0000","last_undegraded":"2024-04-26T12:39:37.431357+0000","last_fullsized":"2024-04-26T12:39:37.431357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.691510+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:39:37.691510+0000","last_peered":"2024-04-26T12:39:37.691510+0000","last_clean":"2024-04-26T12:39:37.691510+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:39:37.691510+0000","last_undegraded":"2024-04-26T12:39:37.691510+0000","last_fullsized":"2024-04-26T12:39:37.691510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750813+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:39:37.750813+0000","last_peered":"2024-04-26T12:39:37.750813+0000","last_clean":"2024-04-26T12:39:37.750813+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:39:37.750813+0000","last_undegraded":"2024-04-26T12:39:37.750813+0000","last_fullsized":"2024-04-26T12:39:37.750813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313275+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:39:37.313275+0000","last_peered":"2024-04-26T12:39:37.313275+0000","last_clean":"2024-04-26T12:39:37.313275+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:39:37.313275+0000","last_undegraded":"2024-04-26T12:39:37.313275+0000","last_fullsized":"2024-04-26T12:39:37.313275+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429556+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:39:37.429556+0000","last_peered":"2024-04-26T12:39:37.429556+0000","last_clean":"2024-04-26T12:39:37.429556+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:39:37.429556+0000","last_undegraded":"2024-04-26T12:39:37.429556+0000","last_fullsized":"2024-04-26T12:39:37.429556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"29'19","reported_seq":111,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749207+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:39:37.749207+0000","last_peered":"2024-04-26T12:39:37.749207+0000","last_clean":"2024-04-26T12:39:37.749207+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:39:37.749207+0000","last_undegraded":"2024-04-26T12:39:37.749207+0000","last_fullsized":"2024-04-26T12:39:37.749207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754219+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:39:37.754219+0000","last_peered":"2024-04-26T12:39:37.754219+0000","last_clean":"2024-04-26T12:39:37.754219+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:39:37.754219+0000","last_undegraded":"2024-04-26T12:39:37.754219+0000","last_fullsized":"2024-04-26T12:39:37.754219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749901+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:39:37.749901+0000","last_peered":"2024-04-26T12:39:37.749901+0000","last_clean":"2024-04-26T12:39:37.749901+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:39:37.749901+0000","last_undegraded":"2024-04-26T12:39:37.749901+0000","last_fullsized":"2024-04-26T12:39:37.749901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.753166+0000","last_change":"2024-04-26T12:38:32.097378+0000","last_active":"2024-04-26T12:39:37.753166+0000","last_peered":"2024-04-26T12:39:37.753166+0000","last_clean":"2024-04-26T12:39:37.753166+0000","last_became_active":"2024-04-26T12:38:32.096994+0000","last_became_peered":"2024-04-26T12:38:32.096994+0000","last_unstale":"2024-04-26T12:39:37.753166+0000","last_undegraded":"2024-04-26T12:39:37.753166+0000","last_fullsized":"2024-04-26T12:39:37.753166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:26.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432200+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:39:37.432200+0000","last_peered":"2024-04-26T12:39:37.432200+0000","last_clean":"2024-04-26T12:39:37.432200+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:39:37.432200+0000","last_undegraded":"2024-04-26T12:39:37.432200+0000","last_fullsized":"2024-04-26T12:39:37.432200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310068+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:39:37.310068+0000","last_peered":"2024-04-26T12:39:37.310068+0000","last_clean":"2024-04-26T12:39:37.310068+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:39:37.310068+0000","last_undegraded":"2024-04-26T12:39:37.310068+0000","last_fullsized":"2024-04-26T12:39:37.310068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"29'9","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699097+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:39:37.699097+0000","last_peered":"2024-04-26T12:39:37.699097+0000","last_clean":"2024-04-26T12:39:37.699097+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:39:37.699097+0000","last_undegraded":"2024-04-26T12:39:37.699097+0000","last_fullsized":"2024-04-26T12:39:37.699097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693658+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:39:37.693658+0000","last_peered":"2024-04-26T12:39:37.693658+0000","last_clean":"2024-04-26T12:39:37.693658+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:39:37.693658+0000","last_undegraded":"2024-04-26T12:39:37.693658+0000","last_fullsized":"2024-04-26T12:39:37.693658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517288+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:39:37.517288+0000","last_peered":"2024-04-26T12:39:37.517288+0000","last_clean":"2024-04-26T12:39:37.517288+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:39:37.517288+0000","last_undegraded":"2024-04-26T12:39:37.517288+0000","last_fullsized":"2024-04-26T12:39:37.517288+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516966+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:39:37.516966+0000","last_peered":"2024-04-26T12:39:37.516966+0000","last_clean":"2024-04-26T12:39:37.516966+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:39:37.516966+0000","last_undegraded":"2024-04-26T12:39:37.516966+0000","last_fullsized":"2024-04-26T12:39:37.516966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432002+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:39:37.432002+0000","last_peered":"2024-04-26T12:39:37.432002+0000","last_clean":"2024-04-26T12:39:37.432002+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:39:37.432002+0000","last_undegraded":"2024-04-26T12:39:37.432002+0000","last_fullsized":"2024-04-26T12:39:37.432002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311519+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:39:37.311519+0000","last_peered":"2024-04-26T12:39:37.311519+0000","last_clean":"2024-04-26T12:39:37.311519+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:39:37.311519+0000","last_undegraded":"2024-04-26T12:39:37.311519+0000","last_fullsized":"2024-04-26T12:39:37.311519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"29'15","reported_seq":105,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429866+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:39:37.429866+0000","last_peered":"2024-04-26T12:39:37.429866+0000","last_clean":"2024-04-26T12:39:37.429866+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:39:37.429866+0000","last_undegraded":"2024-04-26T12:39:37.429866+0000","last_fullsized":"2024-04-26T12:39:37.429866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"26'2","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.317658+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:39:37.317658+0000","last_peered":"2024-04-26T12:39:37.317658+0000","last_clean":"2024-04-26T12:39:37.317658+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:39:37.317658+0000","last_undegraded":"2024-04-26T12:39:37.317658+0000","last_fullsized":"2024-04-26T12:39:37.317658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322702+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:39:37.322702+0000","last_peered":"2024-04-26T12:39:37.322702+0000","last_clean":"2024-04-26T12:39:37.322702+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:39:37.322702+0000","last_undegraded":"2024-04-26T12:39:37.322702+0000","last_fullsized":"2024-04-26T12:39:37.322702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.326297+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:39:37.326297+0000","last_peered":"2024-04-26T12:39:37.326297+0000","last_clean":"2024-04-26T12:39:37.326297+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:39:37.326297+0000","last_undegraded":"2024-04-26T12:39:37.326297+0000","last_fullsized":"2024-04-26T12:39:37.326297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750899+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:39:37.750899+0000","last_peered":"2024-04-26T12:39:37.750899+0000","last_clean":"2024-04-26T12:39:37.750899+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:39:37.750899+0000","last_undegraded":"2024-04-26T12:39:37.750899+0000","last_fullsized":"2024-04-26T12:39:37.750899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310919+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:39:37.310919+0000","last_peered":"2024-04-26T12:39:37.310919+0000","last_clean":"2024-04-26T12:39:37.310919+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:39:37.310919+0000","last_undegraded":"2024-04-26T12:39:37.310919+0000","last_fullsized":"2024-04-26T12:39:37.310919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"29'12","reported_seq":102,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.317974+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:39:37.317974+0000","last_peered":"2024-04-26T12:39:37.317974+0000","last_clean":"2024-04-26T12:39:37.317974+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:39:37.317974+0000","last_undegraded":"2024-04-26T12:39:37.317974+0000","last_fullsized":"2024-04-26T12:39:37.317974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.309905+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:39:37.309905+0000","last_peered":"2024-04-26T12:39:37.309905+0000","last_clean":"2024-04-26T12:39:37.309905+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:39:37.309905+0000","last_undegraded":"2024-04-26T12:39:37.309905+0000","last_fullsized":"2024-04-26T12:39:37.309905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758460+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:39:37.758460+0000","last_peered":"2024-04-26T12:39:37.758460+0000","last_clean":"2024-04-26T12:39:37.758460+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:39:37.758460+0000","last_undegraded":"2024-04-26T12:39:37.758460+0000","last_fullsized":"2024-04-26T12:39:37.758460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692300+0000","last_change":"2024-04-26T12:38:32.098058+0000","last_active":"2024-04-26T12:39:37.692300+0000","last_peered":"2024-04-26T12:39:37.692300+0000","last_clean":"2024-04-26T12:39:37.692300+0000","last_became_active":"2024-04-26T12:38:32.095643+0000","last_became_peered":"2024-04-26T12:38:32.095643+0000","last_unstale":"2024-04-26T12:39:37.692300+0000","last_undegraded":"2024-04-26T12:39:37.692300+0000","last_fullsized":"2024-04-26T12:39:37.692300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:56.628368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688538+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:39:37.688538+0000","last_peered":"2024-04-26T12:39:37.688538+0000","last_clean":"2024-04-26T12:39:37.688538+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:39:37.688538+0000","last_undegraded":"2024-04-26T12:39:37.688538+0000","last_fullsized":"2024-04-26T12:39:37.688538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312227+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:39:37.312227+0000","last_peered":"2024-04-26T12:39:37.312227+0000","last_clean":"2024-04-26T12:39:37.312227+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:39:37.312227+0000","last_undegraded":"2024-04-26T12:39:37.312227+0000","last_fullsized":"2024-04-26T12:39:37.312227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'11","reported_seq":102,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758178+0000","last_change":"2024-04-26T12:38:32.096426+0000","last_active":"2024-04-26T12:39:37.758178+0000","last_peered":"2024-04-26T12:39:37.758178+0000","last_clean":"2024-04-26T12:39:37.758178+0000","last_became_active":"2024-04-26T12:38:32.095992+0000","last_became_peered":"2024-04-26T12:38:32.095992+0000","last_unstale":"2024-04-26T12:39:37.758178+0000","last_undegraded":"2024-04-26T12:39:37.758178+0000","last_fullsized":"2024-04-26T12:39:37.758178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:27.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322917+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:39:37.322917+0000","last_peered":"2024-04-26T12:39:37.322917+0000","last_clean":"2024-04-26T12:39:37.322917+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:39:37.322917+0000","last_undegraded":"2024-04-26T12:39:37.322917+0000","last_fullsized":"2024-04-26T12:39:37.322917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697269+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:39:37.697269+0000","last_peered":"2024-04-26T12:39:37.697269+0000","last_clean":"2024-04-26T12:39:37.697269+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:39:37.697269+0000","last_undegraded":"2024-04-26T12:39:37.697269+0000","last_fullsized":"2024-04-26T12:39:37.697269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312309+0000","last_change":"2024-04-26T12:38:32.097968+0000","last_active":"2024-04-26T12:39:37.312309+0000","last_peered":"2024-04-26T12:39:37.312309+0000","last_clean":"2024-04-26T12:39:37.312309+0000","last_became_active":"2024-04-26T12:38:32.095619+0000","last_became_peered":"2024-04-26T12:38:32.095619+0000","last_unstale":"2024-04-26T12:39:37.312309+0000","last_undegraded":"2024-04-26T12:39:37.312309+0000","last_fullsized":"2024-04-26T12:39:37.312309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517237+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:39:37.517237+0000","last_peered":"2024-04-26T12:39:37.517237+0000","last_clean":"2024-04-26T12:39:37.517237+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:39:37.517237+0000","last_undegraded":"2024-04-26T12:39:37.517237+0000","last_fullsized":"2024-04-26T12:39:37.517237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754777+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:39:37.754777+0000","last_peered":"2024-04-26T12:39:37.754777+0000","last_clean":"2024-04-26T12:39:37.754777+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:39:37.754777+0000","last_undegraded":"2024-04-26T12:39:37.754777+0000","last_fullsized":"2024-04-26T12:39:37.754777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"29'15","reported_seq":105,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313449+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:39:37.313449+0000","last_peered":"2024-04-26T12:39:37.313449+0000","last_clean":"2024-04-26T12:39:37.313449+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:39:37.313449+0000","last_undegraded":"2024-04-26T12:39:37.313449+0000","last_fullsized":"2024-04-26T12:39:37.313449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312776+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:39:37.312776+0000","last_peered":"2024-04-26T12:39:37.312776+0000","last_clean":"2024-04-26T12:39:37.312776+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:39:37.312776+0000","last_undegraded":"2024-04-26T12:39:37.312776+0000","last_fullsized":"2024-04-26T12:39:37.312776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752886+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:39:37.752886+0000","last_peered":"2024-04-26T12:39:37.752886+0000","last_clean":"2024-04-26T12:39:37.752886+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:39:37.752886+0000","last_undegraded":"2024-04-26T12:39:37.752886+0000","last_fullsized":"2024-04-26T12:39:37.752886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517911+0000","last_change":"2024-04-26T12:38:32.098436+0000","last_active":"2024-04-26T12:39:37.517911+0000","last_peered":"2024-04-26T12:39:37.517911+0000","last_clean":"2024-04-26T12:39:37.517911+0000","last_became_active":"2024-04-26T12:38:32.097675+0000","last_became_peered":"2024-04-26T12:38:32.097675+0000","last_unstale":"2024-04-26T12:39:37.517911+0000","last_undegraded":"2024-04-26T12:39:37.517911+0000","last_fullsized":"2024-04-26T12:39:37.517911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:10.967994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310397+0000","last_change":"2024-04-26T12:38:32.091912+0000","last_active":"2024-04-26T12:39:37.310397+0000","last_peered":"2024-04-26T12:39:37.310397+0000","last_clean":"2024-04-26T12:39:37.310397+0000","last_became_active":"2024-04-26T12:38:32.091595+0000","last_became_peered":"2024-04-26T12:38:32.091595+0000","last_unstale":"2024-04-26T12:39:37.310397+0000","last_undegraded":"2024-04-26T12:39:37.310397+0000","last_fullsized":"2024-04-26T12:39:37.310397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:30.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751924+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:39:37.751924+0000","last_peered":"2024-04-26T12:39:37.751924+0000","last_clean":"2024-04-26T12:39:37.751924+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:39:37.751924+0000","last_undegraded":"2024-04-26T12:39:37.751924+0000","last_fullsized":"2024-04-26T12:39:37.751924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.691599+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:39:37.691599+0000","last_peered":"2024-04-26T12:39:37.691599+0000","last_clean":"2024-04-26T12:39:37.691599+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:39:37.691599+0000","last_undegraded":"2024-04-26T12:39:37.691599+0000","last_fullsized":"2024-04-26T12:39:37.691599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517795+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:39:37.517795+0000","last_peered":"2024-04-26T12:39:37.517795+0000","last_clean":"2024-04-26T12:39:37.517795+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:39:37.517795+0000","last_undegraded":"2024-04-26T12:39:37.517795+0000","last_fullsized":"2024-04-26T12:39:37.517795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321211+0000","last_change":"2024-04-26T12:38:32.092303+0000","last_active":"2024-04-26T12:39:37.321211+0000","last_peered":"2024-04-26T12:39:37.321211+0000","last_clean":"2024-04-26T12:39:37.321211+0000","last_became_active":"2024-04-26T12:38:32.091872+0000","last_became_peered":"2024-04-26T12:38:32.091872+0000","last_unstale":"2024-04-26T12:39:37.321211+0000","last_undegraded":"2024-04-26T12:39:37.321211+0000","last_fullsized":"2024-04-26T12:39:37.321211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758731+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:39:37.758731+0000","last_peered":"2024-04-26T12:39:37.758731+0000","last_clean":"2024-04-26T12:39:37.758731+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:39:37.758731+0000","last_undegraded":"2024-04-26T12:39:37.758731+0000","last_fullsized":"2024-04-26T12:39:37.758731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699739+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:39:37.699739+0000","last_peered":"2024-04-26T12:39:37.699739+0000","last_clean":"2024-04-26T12:39:37.699739+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:39:37.699739+0000","last_undegraded":"2024-04-26T12:39:37.699739+0000","last_fullsized":"2024-04-26T12:39:37.699739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750824+0000","last_change":"2024-04-26T12:38:32.094763+0000","last_active":"2024-04-26T12:39:37.750824+0000","last_peered":"2024-04-26T12:39:37.750824+0000","last_clean":"2024-04-26T12:39:37.750824+0000","last_became_active":"2024-04-26T12:38:32.094384+0000","last_became_peered":"2024-04-26T12:38:32.094384+0000","last_unstale":"2024-04-26T12:39:37.750824+0000","last_undegraded":"2024-04-26T12:39:37.750824+0000","last_fullsized":"2024-04-26T12:39:37.750824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"29'17","reported_seq":108,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750165+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:39:37.750165+0000","last_peered":"2024-04-26T12:39:37.750165+0000","last_clean":"2024-04-26T12:39:37.750165+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:39:37.750165+0000","last_undegraded":"2024-04-26T12:39:37.750165+0000","last_fullsized":"2024-04-26T12:39:37.750165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517308+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:39:37.517308+0000","last_peered":"2024-04-26T12:39:37.517308+0000","last_clean":"2024-04-26T12:39:37.517308+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:39:37.517308+0000","last_undegraded":"2024-04-26T12:39:37.517308+0000","last_fullsized":"2024-04-26T12:39:37.517308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754118+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:39:37.754118+0000","last_peered":"2024-04-26T12:39:37.754118+0000","last_clean":"2024-04-26T12:39:37.754118+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:39:37.754118+0000","last_undegraded":"2024-04-26T12:39:37.754118+0000","last_fullsized":"2024-04-26T12:39:37.754118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518066+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:39:37.518066+0000","last_peered":"2024-04-26T12:39:37.518066+0000","last_clean":"2024-04-26T12:39:37.518066+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:39:37.518066+0000","last_undegraded":"2024-04-26T12:39:37.518066+0000","last_fullsized":"2024-04-26T12:39:37.518066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":248,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430053+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:39:37.430053+0000","last_peered":"2024-04-26T12:39:37.430053+0000","last_clean":"2024-04-26T12:39:37.430053+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:39:37.430053+0000","last_undegraded":"2024-04-26T12:39:37.430053+0000","last_fullsized":"2024-04-26T12:39:37.430053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750816+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:39:37.750816+0000","last_peered":"2024-04-26T12:39:37.750816+0000","last_clean":"2024-04-26T12:39:37.750816+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:39:37.750816+0000","last_undegraded":"2024-04-26T12:39:37.750816+0000","last_fullsized":"2024-04-26T12:39:37.750816+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.694078+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:39:37.694078+0000","last_peered":"2024-04-26T12:39:37.694078+0000","last_clean":"2024-04-26T12:39:37.694078+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:39:37.694078+0000","last_undegraded":"2024-04-26T12:39:37.694078+0000","last_fullsized":"2024-04-26T12:39:37.694078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430923+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:39:37.430923+0000","last_peered":"2024-04-26T12:39:37.430923+0000","last_clean":"2024-04-26T12:39:37.430923+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:39:37.430923+0000","last_undegraded":"2024-04-26T12:39:37.430923+0000","last_fullsized":"2024-04-26T12:39:37.430923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"29'13","reported_seq":107,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750726+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:39:37.750726+0000","last_peered":"2024-04-26T12:39:37.750726+0000","last_clean":"2024-04-26T12:39:37.750726+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:39:37.750726+0000","last_undegraded":"2024-04-26T12:39:37.750726+0000","last_fullsized":"2024-04-26T12:39:37.750726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322816+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:39:37.322816+0000","last_peered":"2024-04-26T12:39:37.322816+0000","last_clean":"2024-04-26T12:39:37.322816+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:39:37.322816+0000","last_undegraded":"2024-04-26T12:39:37.322816+0000","last_fullsized":"2024-04-26T12:39:37.322816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.515963+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:39:37.515963+0000","last_peered":"2024-04-26T12:39:37.515963+0000","last_clean":"2024-04-26T12:39:37.515963+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:39:37.515963+0000","last_undegraded":"2024-04-26T12:39:37.515963+0000","last_fullsized":"2024-04-26T12:39:37.515963+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325011+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:39:37.325011+0000","last_peered":"2024-04-26T12:39:37.325011+0000","last_clean":"2024-04-26T12:39:37.325011+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:39:37.325011+0000","last_undegraded":"2024-04-26T12:39:37.325011+0000","last_fullsized":"2024-04-26T12:39:37.325011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429762+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:39:37.429762+0000","last_peered":"2024-04-26T12:39:37.429762+0000","last_clean":"2024-04-26T12:39:37.429762+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:39:37.429762+0000","last_undegraded":"2024-04-26T12:39:37.429762+0000","last_fullsized":"2024-04-26T12:39:37.429762+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318090+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:39:37.318090+0000","last_peered":"2024-04-26T12:39:37.318090+0000","last_clean":"2024-04-26T12:39:37.318090+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:39:37.318090+0000","last_undegraded":"2024-04-26T12:39:37.318090+0000","last_fullsized":"2024-04-26T12:39:37.318090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751502+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:39:37.751502+0000","last_peered":"2024-04-26T12:39:37.751502+0000","last_clean":"2024-04-26T12:39:37.751502+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:39:37.751502+0000","last_undegraded":"2024-04-26T12:39:37.751502+0000","last_fullsized":"2024-04-26T12:39:37.751502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"29'23","reported_seq":137,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754680+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:39:37.754680+0000","last_peered":"2024-04-26T12:39:37.754680+0000","last_clean":"2024-04-26T12:39:37.754680+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:39:37.754680+0000","last_undegraded":"2024-04-26T12:39:37.754680+0000","last_fullsized":"2024-04-26T12:39:37.754680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431118+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:39:37.431118+0000","last_peered":"2024-04-26T12:39:37.431118+0000","last_clean":"2024-04-26T12:39:37.431118+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:39:37.431118+0000","last_undegraded":"2024-04-26T12:39:37.431118+0000","last_fullsized":"2024-04-26T12:39:37.431118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752499+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:39:37.752499+0000","last_peered":"2024-04-26T12:39:37.752499+0000","last_clean":"2024-04-26T12:39:37.752499+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:39:37.752499+0000","last_undegraded":"2024-04-26T12:39:37.752499+0000","last_fullsized":"2024-04-26T12:39:37.752499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758808+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:39:37.758808+0000","last_peered":"2024-04-26T12:39:37.758808+0000","last_clean":"2024-04-26T12:39:37.758808+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:39:37.758808+0000","last_undegraded":"2024-04-26T12:39:37.758808+0000","last_fullsized":"2024-04-26T12:39:37.758808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310597+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:39:37.310597+0000","last_peered":"2024-04-26T12:39:37.310597+0000","last_clean":"2024-04-26T12:39:37.310597+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:39:37.310597+0000","last_undegraded":"2024-04-26T12:39:37.310597+0000","last_fullsized":"2024-04-26T12:39:37.310597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.753566+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:39:37.753566+0000","last_peered":"2024-04-26T12:39:37.753566+0000","last_clean":"2024-04-26T12:39:37.753566+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:39:37.753566+0000","last_undegraded":"2024-04-26T12:39:37.753566+0000","last_fullsized":"2024-04-26T12:39:37.753566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312914+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:39:37.312914+0000","last_peered":"2024-04-26T12:39:37.312914+0000","last_clean":"2024-04-26T12:39:37.312914+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:39:37.312914+0000","last_undegraded":"2024-04-26T12:39:37.312914+0000","last_fullsized":"2024-04-26T12:39:37.312914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'15","reported_seq":117,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431640+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:39:37.431640+0000","last_peered":"2024-04-26T12:39:37.431640+0000","last_clean":"2024-04-26T12:39:37.431640+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:39:37.431640+0000","last_undegraded":"2024-04-26T12:39:37.431640+0000","last_fullsized":"2024-04-26T12:39:37.431640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321938+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:39:37.321938+0000","last_peered":"2024-04-26T12:39:37.321938+0000","last_clean":"2024-04-26T12:39:37.321938+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:39:37.321938+0000","last_undegraded":"2024-04-26T12:39:37.321938+0000","last_fullsized":"2024-04-26T12:39:37.321938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688874+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:39:37.688874+0000","last_peered":"2024-04-26T12:39:37.688874+0000","last_clean":"2024-04-26T12:39:37.688874+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:39:37.688874+0000","last_undegraded":"2024-04-26T12:39:37.688874+0000","last_fullsized":"2024-04-26T12:39:37.688874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.755069+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:39:37.755069+0000","last_peered":"2024-04-26T12:39:37.755069+0000","last_clean":"2024-04-26T12:39:37.755069+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:39:37.755069+0000","last_undegraded":"2024-04-26T12:39:37.755069+0000","last_fullsized":"2024-04-26T12:39:37.755069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752305+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:39:37.752305+0000","last_peered":"2024-04-26T12:39:37.752305+0000","last_clean":"2024-04-26T12:39:37.752305+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:39:37.752305+0000","last_undegraded":"2024-04-26T12:39:37.752305+0000","last_fullsized":"2024-04-26T12:39:37.752305+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.326086+0000","last_change":"2024-04-26T12:38:32.099375+0000","last_active":"2024-04-26T12:39:37.326086+0000","last_peered":"2024-04-26T12:39:37.326086+0000","last_clean":"2024-04-26T12:39:37.326086+0000","last_became_active":"2024-04-26T12:38:32.098983+0000","last_became_peered":"2024-04-26T12:38:32.098983+0000","last_unstale":"2024-04-26T12:39:37.326086+0000","last_undegraded":"2024-04-26T12:39:37.326086+0000","last_fullsized":"2024-04-26T12:39:37.326086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.281648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322217+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:39:37.322217+0000","last_peered":"2024-04-26T12:39:37.322217+0000","last_clean":"2024-04-26T12:39:37.322217+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:39:37.322217+0000","last_undegraded":"2024-04-26T12:39:37.322217+0000","last_fullsized":"2024-04-26T12:39:37.322217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'12","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693054+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:39:37.693054+0000","last_peered":"2024-04-26T12:39:37.693054+0000","last_clean":"2024-04-26T12:39:37.693054+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:39:37.693054+0000","last_undegraded":"2024-04-26T12:39:37.693054+0000","last_fullsized":"2024-04-26T12:39:37.693054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518635+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:39:37.518635+0000","last_peered":"2024-04-26T12:39:37.518635+0000","last_clean":"2024-04-26T12:39:37.518635+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:39:37.518635+0000","last_undegraded":"2024-04-26T12:39:37.518635+0000","last_fullsized":"2024-04-26T12:39:37.518635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.748879+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:39:37.748879+0000","last_peered":"2024-04-26T12:39:37.748879+0000","last_clean":"2024-04-26T12:39:37.748879+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:39:37.748879+0000","last_undegraded":"2024-04-26T12:39:37.748879+0000","last_fullsized":"2024-04-26T12:39:37.748879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754195+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:39:37.754195+0000","last_peered":"2024-04-26T12:39:37.754195+0000","last_clean":"2024-04-26T12:39:37.754195+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:39:37.754195+0000","last_undegraded":"2024-04-26T12:39:37.754195+0000","last_fullsized":"2024-04-26T12:39:37.754195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751756+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:39:37.751756+0000","last_peered":"2024-04-26T12:39:37.751756+0000","last_clean":"2024-04-26T12:39:37.751756+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:39:37.751756+0000","last_undegraded":"2024-04-26T12:39:37.751756+0000","last_fullsized":"2024-04-26T12:39:37.751756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.755356+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:39:37.755356+0000","last_peered":"2024-04-26T12:39:37.755356+0000","last_clean":"2024-04-26T12:39:37.755356+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:39:37.755356+0000","last_undegraded":"2024-04-26T12:39:37.755356+0000","last_fullsized":"2024-04-26T12:39:37.755356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325652+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:39:37.325652+0000","last_peered":"2024-04-26T12:39:37.325652+0000","last_clean":"2024-04-26T12:39:37.325652+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:39:37.325652+0000","last_undegraded":"2024-04-26T12:39:37.325652+0000","last_fullsized":"2024-04-26T12:39:37.325652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'18","reported_seq":111,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316194+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:39:37.316194+0000","last_peered":"2024-04-26T12:39:37.316194+0000","last_clean":"2024-04-26T12:39:37.316194+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:39:37.316194+0000","last_undegraded":"2024-04-26T12:39:37.316194+0000","last_fullsized":"2024-04-26T12:39:37.316194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687667+0000","last_change":"2024-04-26T12:38:32.094008+0000","last_active":"2024-04-26T12:39:37.687667+0000","last_peered":"2024-04-26T12:39:37.687667+0000","last_clean":"2024-04-26T12:39:37.687667+0000","last_became_active":"2024-04-26T12:38:32.092362+0000","last_became_peered":"2024-04-26T12:38:32.092362+0000","last_unstale":"2024-04-26T12:39:37.687667+0000","last_undegraded":"2024-04-26T12:39:37.687667+0000","last_fullsized":"2024-04-26T12:39:37.687667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.395782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322334+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:39:37.322334+0000","last_peered":"2024-04-26T12:39:37.322334+0000","last_clean":"2024-04-26T12:39:37.322334+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:39:37.322334+0000","last_undegraded":"2024-04-26T12:39:37.322334+0000","last_fullsized":"2024-04-26T12:39:37.322334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.326193+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:39:37.326193+0000","last_peered":"2024-04-26T12:39:37.326193+0000","last_clean":"2024-04-26T12:39:37.326193+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:39:37.326193+0000","last_undegraded":"2024-04-26T12:39:37.326193+0000","last_fullsized":"2024-04-26T12:39:37.326193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.755147+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:39:37.755147+0000","last_peered":"2024-04-26T12:39:37.755147+0000","last_clean":"2024-04-26T12:39:37.755147+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:39:37.755147+0000","last_undegraded":"2024-04-26T12:39:37.755147+0000","last_fullsized":"2024-04-26T12:39:37.755147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432627+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:39:37.432627+0000","last_peered":"2024-04-26T12:39:37.432627+0000","last_clean":"2024-04-26T12:39:37.432627+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:39:37.432627+0000","last_undegraded":"2024-04-26T12:39:37.432627+0000","last_fullsized":"2024-04-26T12:39:37.432627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516585+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:39:37.516585+0000","last_peered":"2024-04-26T12:39:37.516585+0000","last_clean":"2024-04-26T12:39:37.516585+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:39:37.516585+0000","last_undegraded":"2024-04-26T12:39:37.516585+0000","last_fullsized":"2024-04-26T12:39:37.516585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":101,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752607+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:39:37.752607+0000","last_peered":"2024-04-26T12:39:37.752607+0000","last_clean":"2024-04-26T12:39:37.752607+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:39:37.752607+0000","last_undegraded":"2024-04-26T12:39:37.752607+0000","last_fullsized":"2024-04-26T12:39:37.752607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749410+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:39:37.749410+0000","last_peered":"2024-04-26T12:39:37.749410+0000","last_clean":"2024-04-26T12:39:37.749410+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:39:37.749410+0000","last_undegraded":"2024-04-26T12:39:37.749410+0000","last_fullsized":"2024-04-26T12:39:37.749410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.690917+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:39:37.690917+0000","last_peered":"2024-04-26T12:39:37.690917+0000","last_clean":"2024-04-26T12:39:37.690917+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:39:37.690917+0000","last_undegraded":"2024-04-26T12:39:37.690917+0000","last_fullsized":"2024-04-26T12:39:37.690917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697608+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:39:37.697608+0000","last_peered":"2024-04-26T12:39:37.697608+0000","last_clean":"2024-04-26T12:39:37.697608+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:39:37.697608+0000","last_undegraded":"2024-04-26T12:39:37.697608+0000","last_fullsized":"2024-04-26T12:39:37.697608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.690532+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:39:37.690532+0000","last_peered":"2024-04-26T12:39:37.690532+0000","last_clean":"2024-04-26T12:39:37.690532+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:39:37.690532+0000","last_undegraded":"2024-04-26T12:39:37.690532+0000","last_fullsized":"2024-04-26T12:39:37.690532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758445+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:39:37.758445+0000","last_peered":"2024-04-26T12:39:37.758445+0000","last_clean":"2024-04-26T12:39:37.758445+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:39:37.758445+0000","last_undegraded":"2024-04-26T12:39:37.758445+0000","last_fullsized":"2024-04-26T12:39:37.758445+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687586+0000","last_change":"2024-04-26T12:38:32.094625+0000","last_active":"2024-04-26T12:39:37.687586+0000","last_peered":"2024-04-26T12:39:37.687586+0000","last_clean":"2024-04-26T12:39:37.687586+0000","last_became_active":"2024-04-26T12:38:32.093266+0000","last_became_peered":"2024-04-26T12:38:32.093266+0000","last_unstale":"2024-04-26T12:39:37.687586+0000","last_undegraded":"2024-04-26T12:39:37.687586+0000","last_fullsized":"2024-04-26T12:39:37.687586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:18:18.695479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693817+0000","last_change":"2024-04-26T12:38:32.097625+0000","last_active":"2024-04-26T12:39:37.693817+0000","last_peered":"2024-04-26T12:39:37.693817+0000","last_clean":"2024-04-26T12:39:37.693817+0000","last_became_active":"2024-04-26T12:38:32.097186+0000","last_became_peered":"2024-04-26T12:38:32.097186+0000","last_unstale":"2024-04-26T12:39:37.693817+0000","last_undegraded":"2024-04-26T12:39:37.693817+0000","last_fullsized":"2024-04-26T12:39:37.693817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:09.866995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699444+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:39:37.699444+0000","last_peered":"2024-04-26T12:39:37.699444+0000","last_clean":"2024-04-26T12:39:37.699444+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:39:37.699444+0000","last_undegraded":"2024-04-26T12:39:37.699444+0000","last_fullsized":"2024-04-26T12:39:37.699444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322061+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:39:37.322061+0000","last_peered":"2024-04-26T12:39:37.322061+0000","last_clean":"2024-04-26T12:39:37.322061+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:39:37.322061+0000","last_undegraded":"2024-04-26T12:39:37.322061+0000","last_fullsized":"2024-04-26T12:39:37.322061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749826+0000","last_change":"2024-04-26T12:38:32.089371+0000","last_active":"2024-04-26T12:39:37.749826+0000","last_peered":"2024-04-26T12:39:37.749826+0000","last_clean":"2024-04-26T12:39:37.749826+0000","last_became_active":"2024-04-26T12:38:32.088665+0000","last_became_peered":"2024-04-26T12:38:32.088665+0000","last_unstale":"2024-04-26T12:39:37.749826+0000","last_undegraded":"2024-04-26T12:39:37.749826+0000","last_fullsized":"2024-04-26T12:39:37.749826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:48.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325338+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:39:37.325338+0000","last_peered":"2024-04-26T12:39:37.325338+0000","last_clean":"2024-04-26T12:39:37.325338+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:39:37.325338+0000","last_undegraded":"2024-04-26T12:39:37.325338+0000","last_fullsized":"2024-04-26T12:39:37.325338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.519104+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:39:37.519104+0000","last_peered":"2024-04-26T12:39:37.519104+0000","last_clean":"2024-04-26T12:39:37.519104+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:39:37.519104+0000","last_undegraded":"2024-04-26T12:39:37.519104+0000","last_fullsized":"2024-04-26T12:39:37.519104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697485+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:39:37.697485+0000","last_peered":"2024-04-26T12:39:37.697485+0000","last_clean":"2024-04-26T12:39:37.697485+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:39:37.697485+0000","last_undegraded":"2024-04-26T12:39:37.697485+0000","last_fullsized":"2024-04-26T12:39:37.697485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'19","reported_seq":116,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429765+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:39:37.429765+0000","last_peered":"2024-04-26T12:39:37.429765+0000","last_clean":"2024-04-26T12:39:37.429765+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:39:37.429765+0000","last_undegraded":"2024-04-26T12:39:37.429765+0000","last_fullsized":"2024-04-26T12:39:37.429765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693738+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:39:37.693738+0000","last_peered":"2024-04-26T12:39:37.693738+0000","last_clean":"2024-04-26T12:39:37.693738+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:39:37.693738+0000","last_undegraded":"2024-04-26T12:39:37.693738+0000","last_fullsized":"2024-04-26T12:39:37.693738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750339+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:39:37.750339+0000","last_peered":"2024-04-26T12:39:37.750339+0000","last_clean":"2024-04-26T12:39:37.750339+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:39:37.750339+0000","last_undegraded":"2024-04-26T12:39:37.750339+0000","last_fullsized":"2024-04-26T12:39:37.750339+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322711+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:39:37.322711+0000","last_peered":"2024-04-26T12:39:37.322711+0000","last_clean":"2024-04-26T12:39:37.322711+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:39:37.322711+0000","last_undegraded":"2024-04-26T12:39:37.322711+0000","last_fullsized":"2024-04-26T12:39:37.322711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517030+0000","last_change":"2024-04-26T12:38:32.098082+0000","last_active":"2024-04-26T12:39:37.517030+0000","last_peered":"2024-04-26T12:39:37.517030+0000","last_clean":"2024-04-26T12:39:37.517030+0000","last_became_active":"2024-04-26T12:38:32.097658+0000","last_became_peered":"2024-04-26T12:38:32.097658+0000","last_unstale":"2024-04-26T12:39:37.517030+0000","last_undegraded":"2024-04-26T12:39:37.517030+0000","last_fullsized":"2024-04-26T12:39:37.517030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:15.092930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431183+0000","last_change":"2024-04-26T12:38:32.090992+0000","last_active":"2024-04-26T12:39:37.431183+0000","last_peered":"2024-04-26T12:39:37.431183+0000","last_clean":"2024-04-26T12:39:37.431183+0000","last_became_active":"2024-04-26T12:38:32.090197+0000","last_became_peered":"2024-04-26T12:38:32.090197+0000","last_unstale":"2024-04-26T12:39:37.431183+0000","last_undegraded":"2024-04-26T12:39:37.431183+0000","last_fullsized":"2024-04-26T12:39:37.431183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:51.388263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754280+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:39:37.754280+0000","last_peered":"2024-04-26T12:39:37.754280+0000","last_clean":"2024-04-26T12:39:37.754280+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:39:37.754280+0000","last_undegraded":"2024-04-26T12:39:37.754280+0000","last_fullsized":"2024-04-26T12:39:37.754280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'11","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687451+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:39:37.687451+0000","last_peered":"2024-04-26T12:39:37.687451+0000","last_clean":"2024-04-26T12:39:37.687451+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:39:37.687451+0000","last_undegraded":"2024-04-26T12:39:37.687451+0000","last_fullsized":"2024-04-26T12:39:37.687451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697351+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:39:37.697351+0000","last_peered":"2024-04-26T12:39:37.697351+0000","last_clean":"2024-04-26T12:39:37.697351+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:39:37.697351+0000","last_undegraded":"2024-04-26T12:39:37.697351+0000","last_fullsized":"2024-04-26T12:39:37.697351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692830+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:39:37.692830+0000","last_peered":"2024-04-26T12:39:37.692830+0000","last_clean":"2024-04-26T12:39:37.692830+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:39:37.692830+0000","last_undegraded":"2024-04-26T12:39:37.692830+0000","last_fullsized":"2024-04-26T12:39:37.692830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754162+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:39:37.754162+0000","last_peered":"2024-04-26T12:39:37.754162+0000","last_clean":"2024-04-26T12:39:37.754162+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:39:37.754162+0000","last_undegraded":"2024-04-26T12:39:37.754162+0000","last_fullsized":"2024-04-26T12:39:37.754162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431991+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:39:37.431991+0000","last_peered":"2024-04-26T12:39:37.431991+0000","last_clean":"2024-04-26T12:39:37.431991+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:39:37.431991+0000","last_undegraded":"2024-04-26T12:39:37.431991+0000","last_fullsized":"2024-04-26T12:39:37.431991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688795+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:39:37.688795+0000","last_peered":"2024-04-26T12:39:37.688795+0000","last_clean":"2024-04-26T12:39:37.688795+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:39:37.688795+0000","last_undegraded":"2024-04-26T12:39:37.688795+0000","last_fullsized":"2024-04-26T12:39:37.688795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'5","reported_seq":86,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316748+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:39:37.316748+0000","last_peered":"2024-04-26T12:39:37.316748+0000","last_clean":"2024-04-26T12:39:37.316748+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:39:37.316748+0000","last_undegraded":"2024-04-26T12:39:37.316748+0000","last_fullsized":"2024-04-26T12:39:37.316748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430005+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:39:37.430005+0000","last_peered":"2024-04-26T12:39:37.430005+0000","last_clean":"2024-04-26T12:39:37.430005+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:39:37.430005+0000","last_undegraded":"2024-04-26T12:39:37.430005+0000","last_fullsized":"2024-04-26T12:39:37.430005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":71,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322088+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:39:37.322088+0000","last_peered":"2024-04-26T12:39:37.322088+0000","last_clean":"2024-04-26T12:39:37.322088+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:39:37.322088+0000","last_undegraded":"2024-04-26T12:39:37.322088+0000","last_fullsized":"2024-04-26T12:39:37.322088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687895+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:39:37.687895+0000","last_peered":"2024-04-26T12:39:37.687895+0000","last_clean":"2024-04-26T12:39:37.687895+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:39:37.687895+0000","last_undegraded":"2024-04-26T12:39:37.687895+0000","last_fullsized":"2024-04-26T12:39:37.687895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751754+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:39:37.751754+0000","last_peered":"2024-04-26T12:39:37.751754+0000","last_clean":"2024-04-26T12:39:37.751754+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:39:37.751754+0000","last_undegraded":"2024-04-26T12:39:37.751754+0000","last_fullsized":"2024-04-26T12:39:37.751754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429174+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:39:37.429174+0000","last_peered":"2024-04-26T12:39:37.429174+0000","last_clean":"2024-04-26T12:39:37.429174+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:39:37.429174+0000","last_undegraded":"2024-04-26T12:39:37.429174+0000","last_fullsized":"2024-04-26T12:39:37.429174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"29'11","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688352+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:39:37.688352+0000","last_peered":"2024-04-26T12:39:37.688352+0000","last_clean":"2024-04-26T12:39:37.688352+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:39:37.688352+0000","last_undegraded":"2024-04-26T12:39:37.688352+0000","last_fullsized":"2024-04-26T12:39:37.688352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516476+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:39:37.516476+0000","last_peered":"2024-04-26T12:39:37.516476+0000","last_clean":"2024-04-26T12:39:37.516476+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:39:37.516476+0000","last_undegraded":"2024-04-26T12:39:37.516476+0000","last_fullsized":"2024-04-26T12:39:37.516476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749569+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:39:37.749569+0000","last_peered":"2024-04-26T12:39:37.749569+0000","last_clean":"2024-04-26T12:39:37.749569+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:39:37.749569+0000","last_undegraded":"2024-04-26T12:39:37.749569+0000","last_fullsized":"2024-04-26T12:39:37.749569+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.697843+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:39:37.697843+0000","last_peered":"2024-04-26T12:39:37.697843+0000","last_clean":"2024-04-26T12:39:37.697843+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:39:37.697843+0000","last_undegraded":"2024-04-26T12:39:37.697843+0000","last_fullsized":"2024-04-26T12:39:37.697843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.323488+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:39:37.323488+0000","last_peered":"2024-04-26T12:39:37.323488+0000","last_clean":"2024-04-26T12:39:37.323488+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:39:37.323488+0000","last_undegraded":"2024-04-26T12:39:37.323488+0000","last_fullsized":"2024-04-26T12:39:37.323488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516556+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:39:37.516556+0000","last_peered":"2024-04-26T12:39:37.516556+0000","last_clean":"2024-04-26T12:39:37.516556+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:39:37.516556+0000","last_undegraded":"2024-04-26T12:39:37.516556+0000","last_fullsized":"2024-04-26T12:39:37.516556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"29'9","reported_seq":96,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429642+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:39:37.429642+0000","last_peered":"2024-04-26T12:39:37.429642+0000","last_clean":"2024-04-26T12:39:37.429642+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:39:37.429642+0000","last_undegraded":"2024-04-26T12:39:37.429642+0000","last_fullsized":"2024-04-26T12:39:37.429642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318488+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:39:37.318488+0000","last_peered":"2024-04-26T12:39:37.318488+0000","last_clean":"2024-04-26T12:39:37.318488+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:39:37.318488+0000","last_undegraded":"2024-04-26T12:39:37.318488+0000","last_fullsized":"2024-04-26T12:39:37.318488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518948+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:39:37.518948+0000","last_peered":"2024-04-26T12:39:37.518948+0000","last_clean":"2024-04-26T12:39:37.518948+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:39:37.518948+0000","last_undegraded":"2024-04-26T12:39:37.518948+0000","last_fullsized":"2024-04-26T12:39:37.518948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699613+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:39:37.699613+0000","last_peered":"2024-04-26T12:39:37.699613+0000","last_clean":"2024-04-26T12:39:37.699613+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:39:37.699613+0000","last_undegraded":"2024-04-26T12:39:37.699613+0000","last_fullsized":"2024-04-26T12:39:37.699613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.322944+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:39:37.322944+0000","last_peered":"2024-04-26T12:39:37.322944+0000","last_clean":"2024-04-26T12:39:37.322944+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:39:37.322944+0000","last_undegraded":"2024-04-26T12:39:37.322944+0000","last_fullsized":"2024-04-26T12:39:37.322944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'12","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757355+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:39:37.757355+0000","last_peered":"2024-04-26T12:39:37.757355+0000","last_clean":"2024-04-26T12:39:37.757355+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:39:37.757355+0000","last_undegraded":"2024-04-26T12:39:37.757355+0000","last_fullsized":"2024-04-26T12:39:37.757355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750150+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:39:37.750150+0000","last_peered":"2024-04-26T12:39:37.750150+0000","last_clean":"2024-04-26T12:39:37.750150+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:39:37.750150+0000","last_undegraded":"2024-04-26T12:39:37.750150+0000","last_fullsized":"2024-04-26T12:39:37.750150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688450+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:39:37.688450+0000","last_peered":"2024-04-26T12:39:37.688450+0000","last_clean":"2024-04-26T12:39:37.688450+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:39:37.688450+0000","last_undegraded":"2024-04-26T12:39:37.688450+0000","last_fullsized":"2024-04-26T12:39:37.688450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.324901+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:39:37.324901+0000","last_peered":"2024-04-26T12:39:37.324901+0000","last_clean":"2024-04-26T12:39:37.324901+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:39:37.324901+0000","last_undegraded":"2024-04-26T12:39:37.324901+0000","last_fullsized":"2024-04-26T12:39:37.324901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.753245+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:39:37.753245+0000","last_peered":"2024-04-26T12:39:37.753245+0000","last_clean":"2024-04-26T12:39:37.753245+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:39:37.753245+0000","last_undegraded":"2024-04-26T12:39:37.753245+0000","last_fullsized":"2024-04-26T12:39:37.753245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518687+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:39:37.518687+0000","last_peered":"2024-04-26T12:39:37.518687+0000","last_clean":"2024-04-26T12:39:37.518687+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:39:37.518687+0000","last_undegraded":"2024-04-26T12:39:37.518687+0000","last_fullsized":"2024-04-26T12:39:37.518687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"29'15","reported_seq":105,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430701+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:39:37.430701+0000","last_peered":"2024-04-26T12:39:37.430701+0000","last_clean":"2024-04-26T12:39:37.430701+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:39:37.430701+0000","last_undegraded":"2024-04-26T12:39:37.430701+0000","last_fullsized":"2024-04-26T12:39:37.430701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757455+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:39:37.757455+0000","last_peered":"2024-04-26T12:39:37.757455+0000","last_clean":"2024-04-26T12:39:37.757455+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:39:37.757455+0000","last_undegraded":"2024-04-26T12:39:37.757455+0000","last_fullsized":"2024-04-26T12:39:37.757455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516131+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:39:37.516131+0000","last_peered":"2024-04-26T12:39:37.516131+0000","last_clean":"2024-04-26T12:39:37.516131+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:39:37.516131+0000","last_undegraded":"2024-04-26T12:39:37.516131+0000","last_fullsized":"2024-04-26T12:39:37.516131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693473+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:39:37.693473+0000","last_peered":"2024-04-26T12:39:37.693473+0000","last_clean":"2024-04-26T12:39:37.693473+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:39:37.693473+0000","last_undegraded":"2024-04-26T12:39:37.693473+0000","last_fullsized":"2024-04-26T12:39:37.693473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.754453+0000","last_change":"2024-04-26T12:38:32.097004+0000","last_active":"2024-04-26T12:39:37.754453+0000","last_peered":"2024-04-26T12:39:37.754453+0000","last_clean":"2024-04-26T12:39:37.754453+0000","last_became_active":"2024-04-26T12:38:32.096196+0000","last_became_peered":"2024-04-26T12:38:32.096196+0000","last_unstale":"2024-04-26T12:39:37.754453+0000","last_undegraded":"2024-04-26T12:39:37.754453+0000","last_fullsized":"2024-04-26T12:39:37.754453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:00.173484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.698039+0000","last_change":"2024-04-26T12:38:32.100356+0000","last_active":"2024-04-26T12:39:37.698039+0000","last_peered":"2024-04-26T12:39:37.698039+0000","last_clean":"2024-04-26T12:39:37.698039+0000","last_became_active":"2024-04-26T12:38:32.099529+0000","last_became_peered":"2024-04-26T12:38:32.099529+0000","last_unstale":"2024-04-26T12:39:37.698039+0000","last_undegraded":"2024-04-26T12:39:37.698039+0000","last_fullsized":"2024-04-26T12:39:37.698039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:32.397561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"29'11","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.691052+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:39:37.691052+0000","last_peered":"2024-04-26T12:39:37.691052+0000","last_clean":"2024-04-26T12:39:37.691052+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:39:37.691052+0000","last_undegraded":"2024-04-26T12:39:37.691052+0000","last_fullsized":"2024-04-26T12:39:37.691052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757350+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:39:37.757350+0000","last_peered":"2024-04-26T12:39:37.757350+0000","last_clean":"2024-04-26T12:39:37.757350+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:39:37.757350+0000","last_undegraded":"2024-04-26T12:39:37.757350+0000","last_fullsized":"2024-04-26T12:39:37.757350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749242+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:39:37.749242+0000","last_peered":"2024-04-26T12:39:37.749242+0000","last_clean":"2024-04-26T12:39:37.749242+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:39:37.749242+0000","last_undegraded":"2024-04-26T12:39:37.749242+0000","last_fullsized":"2024-04-26T12:39:37.749242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.311968+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:39:37.311968+0000","last_peered":"2024-04-26T12:39:37.311968+0000","last_clean":"2024-04-26T12:39:37.311968+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:39:37.311968+0000","last_undegraded":"2024-04-26T12:39:37.311968+0000","last_fullsized":"2024-04-26T12:39:37.311968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318595+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:39:37.318595+0000","last_peered":"2024-04-26T12:39:37.318595+0000","last_clean":"2024-04-26T12:39:37.318595+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:39:37.318595+0000","last_undegraded":"2024-04-26T12:39:37.318595+0000","last_fullsized":"2024-04-26T12:39:37.318595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757728+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:39:37.757728+0000","last_peered":"2024-04-26T12:39:37.757728+0000","last_clean":"2024-04-26T12:39:37.757728+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:39:37.757728+0000","last_undegraded":"2024-04-26T12:39:37.757728+0000","last_fullsized":"2024-04-26T12:39:37.757728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'10","reported_seq":98,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518653+0000","last_change":"2024-04-26T12:38:32.098589+0000","last_active":"2024-04-26T12:39:37.518653+0000","last_peered":"2024-04-26T12:39:37.518653+0000","last_clean":"2024-04-26T12:39:37.518653+0000","last_became_active":"2024-04-26T12:38:32.097940+0000","last_became_peered":"2024-04-26T12:38:32.097940+0000","last_unstale":"2024-04-26T12:39:37.518653+0000","last_undegraded":"2024-04-26T12:39:37.518653+0000","last_fullsized":"2024-04-26T12:39:37.518653+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"26'2","reported_seq":94,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518438+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:39:37.518438+0000","last_peered":"2024-04-26T12:39:37.518438+0000","last_clean":"2024-04-26T12:39:37.518438+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:39:37.518438+0000","last_undegraded":"2024-04-26T12:39:37.518438+0000","last_fullsized":"2024-04-26T12:39:37.518438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429114+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:39:37.429114+0000","last_peered":"2024-04-26T12:39:37.429114+0000","last_clean":"2024-04-26T12:39:37.429114+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:39:37.429114+0000","last_undegraded":"2024-04-26T12:39:37.429114+0000","last_fullsized":"2024-04-26T12:39:37.429114+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699187+0000","last_change":"2024-04-26T12:38:32.097299+0000","last_active":"2024-04-26T12:39:37.699187+0000","last_peered":"2024-04-26T12:39:37.699187+0000","last_clean":"2024-04-26T12:39:37.699187+0000","last_became_active":"2024-04-26T12:38:32.096485+0000","last_became_peered":"2024-04-26T12:38:32.096485+0000","last_unstale":"2024-04-26T12:39:37.699187+0000","last_undegraded":"2024-04-26T12:39:37.699187+0000","last_fullsized":"2024-04-26T12:39:37.699187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:18.433433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750532+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:39:37.750532+0000","last_peered":"2024-04-26T12:39:37.750532+0000","last_clean":"2024-04-26T12:39:37.750532+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:39:37.750532+0000","last_undegraded":"2024-04-26T12:39:37.750532+0000","last_fullsized":"2024-04-26T12:39:37.750532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429730+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:39:37.429730+0000","last_peered":"2024-04-26T12:39:37.429730+0000","last_clean":"2024-04-26T12:39:37.429730+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:39:37.429730+0000","last_undegraded":"2024-04-26T12:39:37.429730+0000","last_fullsized":"2024-04-26T12:39:37.429730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"29'15","reported_seq":105,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.749582+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:39:37.749582+0000","last_peered":"2024-04-26T12:39:37.749582+0000","last_clean":"2024-04-26T12:39:37.749582+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:39:37.749582+0000","last_undegraded":"2024-04-26T12:39:37.749582+0000","last_fullsized":"2024-04-26T12:39:37.749582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316339+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:39:37.316339+0000","last_peered":"2024-04-26T12:39:37.316339+0000","last_clean":"2024-04-26T12:39:37.316339+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:39:37.316339+0000","last_undegraded":"2024-04-26T12:39:37.316339+0000","last_fullsized":"2024-04-26T12:39:37.316339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432444+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:39:37.432444+0000","last_peered":"2024-04-26T12:39:37.432444+0000","last_clean":"2024-04-26T12:39:37.432444+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:39:37.432444+0000","last_undegraded":"2024-04-26T12:39:37.432444+0000","last_fullsized":"2024-04-26T12:39:37.432444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693904+0000","last_change":"2024-04-26T12:38:32.097693+0000","last_active":"2024-04-26T12:39:37.693904+0000","last_peered":"2024-04-26T12:39:37.693904+0000","last_clean":"2024-04-26T12:39:37.693904+0000","last_became_active":"2024-04-26T12:38:32.096141+0000","last_became_peered":"2024-04-26T12:38:32.096141+0000","last_unstale":"2024-04-26T12:39:37.693904+0000","last_undegraded":"2024-04-26T12:39:37.693904+0000","last_fullsized":"2024-04-26T12:39:37.693904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.450059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751714+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:39:37.751714+0000","last_peered":"2024-04-26T12:39:37.751714+0000","last_clean":"2024-04-26T12:39:37.751714+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:39:37.751714+0000","last_undegraded":"2024-04-26T12:39:37.751714+0000","last_fullsized":"2024-04-26T12:39:37.751714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":84,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750256+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:39:37.750256+0000","last_peered":"2024-04-26T12:39:37.750256+0000","last_clean":"2024-04-26T12:39:37.750256+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:39:37.750256+0000","last_undegraded":"2024-04-26T12:39:37.750256+0000","last_fullsized":"2024-04-26T12:39:37.750256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"29'9","reported_seq":95,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.316452+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:39:37.316452+0000","last_peered":"2024-04-26T12:39:37.316452+0000","last_clean":"2024-04-26T12:39:37.316452+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:39:37.316452+0000","last_undegraded":"2024-04-26T12:39:37.316452+0000","last_fullsized":"2024-04-26T12:39:37.316452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516170+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:39:37.516170+0000","last_peered":"2024-04-26T12:39:37.516170+0000","last_clean":"2024-04-26T12:39:37.516170+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:39:37.516170+0000","last_undegraded":"2024-04-26T12:39:37.516170+0000","last_fullsized":"2024-04-26T12:39:37.516170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692918+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:39:37.692918+0000","last_peered":"2024-04-26T12:39:37.692918+0000","last_clean":"2024-04-26T12:39:37.692918+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:39:37.692918+0000","last_undegraded":"2024-04-26T12:39:37.692918+0000","last_fullsized":"2024-04-26T12:39:37.692918+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688078+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:39:37.688078+0000","last_peered":"2024-04-26T12:39:37.688078+0000","last_clean":"2024-04-26T12:39:37.688078+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:39:37.688078+0000","last_undegraded":"2024-04-26T12:39:37.688078+0000","last_fullsized":"2024-04-26T12:39:37.688078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.693230+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:39:37.693230+0000","last_peered":"2024-04-26T12:39:37.693230+0000","last_clean":"2024-04-26T12:39:37.693230+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:39:37.693230+0000","last_undegraded":"2024-04-26T12:39:37.693230+0000","last_fullsized":"2024-04-26T12:39:37.693230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516005+0000","last_change":"2024-04-26T12:38:32.098077+0000","last_active":"2024-04-26T12:39:37.516005+0000","last_peered":"2024-04-26T12:39:37.516005+0000","last_clean":"2024-04-26T12:39:37.516005+0000","last_became_active":"2024-04-26T12:38:32.097608+0000","last_became_peered":"2024-04-26T12:38:32.097608+0000","last_unstale":"2024-04-26T12:39:37.516005+0000","last_undegraded":"2024-04-26T12:39:37.516005+0000","last_fullsized":"2024-04-26T12:39:37.516005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:52.163433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"29'5","reported_seq":90,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699311+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:39:37.699311+0000","last_peered":"2024-04-26T12:39:37.699311+0000","last_clean":"2024-04-26T12:39:37.699311+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:39:37.699311+0000","last_undegraded":"2024-04-26T12:39:37.699311+0000","last_fullsized":"2024-04-26T12:39:37.699311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":66,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516306+0000","last_change":"2024-04-26T12:38:32.097869+0000","last_active":"2024-04-26T12:39:37.516306+0000","last_peered":"2024-04-26T12:39:37.516306+0000","last_clean":"2024-04-26T12:39:37.516306+0000","last_became_active":"2024-04-26T12:38:32.097545+0000","last_became_peered":"2024-04-26T12:38:32.097545+0000","last_unstale":"2024-04-26T12:39:37.516306+0000","last_undegraded":"2024-04-26T12:39:37.516306+0000","last_fullsized":"2024-04-26T12:39:37.516306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:00.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":72,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.431452+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:39:37.431452+0000","last_peered":"2024-04-26T12:39:37.431452+0000","last_clean":"2024-04-26T12:39:37.431452+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:39:37.431452+0000","last_undegraded":"2024-04-26T12:39:37.431452+0000","last_fullsized":"2024-04-26T12:39:37.431452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516125+0000","last_change":"2024-04-26T12:38:32.098742+0000","last_active":"2024-04-26T12:39:37.516125+0000","last_peered":"2024-04-26T12:39:37.516125+0000","last_clean":"2024-04-26T12:39:37.516125+0000","last_became_active":"2024-04-26T12:38:32.098197+0000","last_became_peered":"2024-04-26T12:38:32.098197+0000","last_unstale":"2024-04-26T12:39:37.516125+0000","last_undegraded":"2024-04-26T12:39:37.516125+0000","last_fullsized":"2024-04-26T12:39:37.516125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.480181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.323326+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:39:37.323326+0000","last_peered":"2024-04-26T12:39:37.323326+0000","last_clean":"2024-04-26T12:39:37.323326+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:39:37.323326+0000","last_undegraded":"2024-04-26T12:39:37.323326+0000","last_fullsized":"2024-04-26T12:39:37.323326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752701+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:39:37.752701+0000","last_peered":"2024-04-26T12:39:37.752701+0000","last_clean":"2024-04-26T12:39:37.752701+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:39:37.752701+0000","last_undegraded":"2024-04-26T12:39:37.752701+0000","last_fullsized":"2024-04-26T12:39:37.752701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'9","reported_seq":99,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751090+0000","last_change":"2024-04-26T12:38:32.089759+0000","last_active":"2024-04-26T12:39:37.751090+0000","last_peered":"2024-04-26T12:39:37.751090+0000","last_clean":"2024-04-26T12:39:37.751090+0000","last_became_active":"2024-04-26T12:38:32.088214+0000","last_became_peered":"2024-04-26T12:38:32.088214+0000","last_unstale":"2024-04-26T12:39:37.751090+0000","last_undegraded":"2024-04-26T12:39:37.751090+0000","last_fullsized":"2024-04-26T12:39:37.751090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:38.656355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":75,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318380+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:39:37.318380+0000","last_peered":"2024-04-26T12:39:37.318380+0000","last_clean":"2024-04-26T12:39:37.318380+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:39:37.318380+0000","last_undegraded":"2024-04-26T12:39:37.318380+0000","last_fullsized":"2024-04-26T12:39:37.318380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":64,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.321765+0000","last_change":"2024-04-26T12:38:32.098228+0000","last_active":"2024-04-26T12:39:37.321765+0000","last_peered":"2024-04-26T12:39:37.321765+0000","last_clean":"2024-04-26T12:39:37.321765+0000","last_became_active":"2024-04-26T12:38:32.092404+0000","last_became_peered":"2024-04-26T12:38:32.092404+0000","last_unstale":"2024-04-26T12:39:37.321765+0000","last_undegraded":"2024-04-26T12:39:37.321765+0000","last_fullsized":"2024-04-26T12:39:37.321765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758647+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:39:37.758647+0000","last_peered":"2024-04-26T12:39:37.758647+0000","last_clean":"2024-04-26T12:39:37.758647+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:39:37.758647+0000","last_undegraded":"2024-04-26T12:39:37.758647+0000","last_fullsized":"2024-04-26T12:39:37.758647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516472+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:39:37.516472+0000","last_peered":"2024-04-26T12:39:37.516472+0000","last_clean":"2024-04-26T12:39:37.516472+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:39:37.516472+0000","last_undegraded":"2024-04-26T12:39:37.516472+0000","last_fullsized":"2024-04-26T12:39:37.516472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.758220+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:39:37.758220+0000","last_peered":"2024-04-26T12:39:37.758220+0000","last_clean":"2024-04-26T12:39:37.758220+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:39:37.758220+0000","last_undegraded":"2024-04-26T12:39:37.758220+0000","last_fullsized":"2024-04-26T12:39:37.758220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":97,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.310478+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:39:37.310478+0000","last_peered":"2024-04-26T12:39:37.310478+0000","last_clean":"2024-04-26T12:39:37.310478+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:39:37.310478+0000","last_undegraded":"2024-04-26T12:39:37.310478+0000","last_fullsized":"2024-04-26T12:39:37.310478+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750893+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:39:37.750893+0000","last_peered":"2024-04-26T12:39:37.750893+0000","last_clean":"2024-04-26T12:39:37.750893+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:39:37.750893+0000","last_undegraded":"2024-04-26T12:39:37.750893+0000","last_fullsized":"2024-04-26T12:39:37.750893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752116+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:39:37.752116+0000","last_peered":"2024-04-26T12:39:37.752116+0000","last_clean":"2024-04-26T12:39:37.752116+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:39:37.752116+0000","last_undegraded":"2024-04-26T12:39:37.752116+0000","last_fullsized":"2024-04-26T12:39:37.752116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.755275+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:39:37.755275+0000","last_peered":"2024-04-26T12:39:37.755275+0000","last_clean":"2024-04-26T12:39:37.755275+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:39:37.755275+0000","last_undegraded":"2024-04-26T12:39:37.755275+0000","last_fullsized":"2024-04-26T12:39:37.755275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.318864+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:39:37.318864+0000","last_peered":"2024-04-26T12:39:37.318864+0000","last_clean":"2024-04-26T12:39:37.318864+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:39:37.318864+0000","last_undegraded":"2024-04-26T12:39:37.318864+0000","last_fullsized":"2024-04-26T12:39:37.318864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.699011+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:39:37.699011+0000","last_peered":"2024-04-26T12:39:37.699011+0000","last_clean":"2024-04-26T12:39:37.699011+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:39:37.699011+0000","last_undegraded":"2024-04-26T12:39:37.699011+0000","last_fullsized":"2024-04-26T12:39:37.699011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.692698+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:39:37.692698+0000","last_peered":"2024-04-26T12:39:37.692698+0000","last_clean":"2024-04-26T12:39:37.692698+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:39:37.692698+0000","last_undegraded":"2024-04-26T12:39:37.692698+0000","last_fullsized":"2024-04-26T12:39:37.692698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516954+0000","last_change":"2024-04-26T12:38:32.099762+0000","last_active":"2024-04-26T12:39:37.516954+0000","last_peered":"2024-04-26T12:39:37.516954+0000","last_clean":"2024-04-26T12:39:37.516954+0000","last_became_active":"2024-04-26T12:38:32.099061+0000","last_became_peered":"2024-04-26T12:38:32.099061+0000","last_unstale":"2024-04-26T12:39:37.516954+0000","last_undegraded":"2024-04-26T12:39:37.516954+0000","last_fullsized":"2024-04-26T12:39:37.516954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:17.530530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":97,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.757984+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:39:37.757984+0000","last_peered":"2024-04-26T12:39:37.757984+0000","last_clean":"2024-04-26T12:39:37.757984+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:39:37.757984+0000","last_undegraded":"2024-04-26T12:39:37.757984+0000","last_fullsized":"2024-04-26T12:39:37.757984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687822+0000","last_change":"2024-04-26T12:38:58.795730+0000","last_active":"2024-04-26T12:39:37.687822+0000","last_peered":"2024-04-26T12:39:37.687822+0000","last_clean":"2024-04-26T12:39:37.687822+0000","last_became_active":"2024-04-26T12:38:58.795097+0000","last_became_peered":"2024-04-26T12:38:58.795097+0000","last_unstale":"2024-04-26T12:39:37.687822+0000","last_undegraded":"2024-04-26T12:39:37.687822+0000","last_fullsized":"2024-04-26T12:39:37.687822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.166788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.518975+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:39:37.518975+0000","last_peered":"2024-04-26T12:39:37.518975+0000","last_clean":"2024-04-26T12:39:37.518975+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:39:37.518975+0000","last_undegraded":"2024-04-26T12:39:37.518975+0000","last_fullsized":"2024-04-26T12:39:37.518975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.516288+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:39:37.516288+0000","last_peered":"2024-04-26T12:39:37.516288+0000","last_clean":"2024-04-26T12:39:37.516288+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:39:37.516288+0000","last_undegraded":"2024-04-26T12:39:37.516288+0000","last_fullsized":"2024-04-26T12:39:37.516288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.690791+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:39:37.690791+0000","last_peered":"2024-04-26T12:39:37.690791+0000","last_clean":"2024-04-26T12:39:37.690791+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:39:37.690791+0000","last_undegraded":"2024-04-26T12:39:37.690791+0000","last_fullsized":"2024-04-26T12:39:37.690791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.323221+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:39:37.323221+0000","last_peered":"2024-04-26T12:39:37.323221+0000","last_clean":"2024-04-26T12:39:37.323221+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:39:37.323221+0000","last_undegraded":"2024-04-26T12:39:37.323221+0000","last_fullsized":"2024-04-26T12:39:37.323221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750635+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:39:37.750635+0000","last_peered":"2024-04-26T12:39:37.750635+0000","last_clean":"2024-04-26T12:39:37.750635+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:39:37.750635+0000","last_undegraded":"2024-04-26T12:39:37.750635+0000","last_fullsized":"2024-04-26T12:39:37.750635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313000+0000","last_change":"2024-04-26T12:38:32.101184+0000","last_active":"2024-04-26T12:39:37.313000+0000","last_peered":"2024-04-26T12:39:37.313000+0000","last_clean":"2024-04-26T12:39:37.313000+0000","last_became_active":"2024-04-26T12:38:32.100885+0000","last_became_peered":"2024-04-26T12:38:32.100885+0000","last_unstale":"2024-04-26T12:39:37.313000+0000","last_undegraded":"2024-04-26T12:39:37.313000+0000","last_fullsized":"2024-04-26T12:39:37.313000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:14.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.688158+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:39:37.688158+0000","last_peered":"2024-04-26T12:39:37.688158+0000","last_clean":"2024-04-26T12:39:37.688158+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:39:37.688158+0000","last_undegraded":"2024-04-26T12:39:37.688158+0000","last_fullsized":"2024-04-26T12:39:37.688158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.312430+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:39:37.312430+0000","last_peered":"2024-04-26T12:39:37.312430+0000","last_clean":"2024-04-26T12:39:37.312430+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:39:37.312430+0000","last_undegraded":"2024-04-26T12:39:37.312430+0000","last_fullsized":"2024-04-26T12:39:37.312430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751713+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:39:37.751713+0000","last_peered":"2024-04-26T12:39:37.751713+0000","last_clean":"2024-04-26T12:39:37.751713+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:39:37.751713+0000","last_undegraded":"2024-04-26T12:39:37.751713+0000","last_fullsized":"2024-04-26T12:39:37.751713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":65,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517549+0000","last_change":"2024-04-26T12:38:32.097249+0000","last_active":"2024-04-26T12:39:37.517549+0000","last_peered":"2024-04-26T12:39:37.517549+0000","last_clean":"2024-04-26T12:39:37.517549+0000","last_became_active":"2024-04-26T12:38:32.096972+0000","last_became_peered":"2024-04-26T12:38:32.096972+0000","last_unstale":"2024-04-26T12:39:37.517549+0000","last_undegraded":"2024-04-26T12:39:37.517549+0000","last_fullsized":"2024-04-26T12:39:37.517549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:06.018406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.325761+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:39:37.325761+0000","last_peered":"2024-04-26T12:39:37.325761+0000","last_clean":"2024-04-26T12:39:37.325761+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:39:37.325761+0000","last_undegraded":"2024-04-26T12:39:37.325761+0000","last_fullsized":"2024-04-26T12:39:37.325761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.430349+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:39:37.430349+0000","last_peered":"2024-04-26T12:39:37.430349+0000","last_clean":"2024-04-26T12:39:37.430349+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:39:37.430349+0000","last_undegraded":"2024-04-26T12:39:37.430349+0000","last_fullsized":"2024-04-26T12:39:37.430349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.517849+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:39:37.517849+0000","last_peered":"2024-04-26T12:39:37.517849+0000","last_clean":"2024-04-26T12:39:37.517849+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:39:37.517849+0000","last_undegraded":"2024-04-26T12:39:37.517849+0000","last_fullsized":"2024-04-26T12:39:37.517849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.320917+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:39:37.320917+0000","last_peered":"2024-04-26T12:39:37.320917+0000","last_clean":"2024-04-26T12:39:37.320917+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:39:37.320917+0000","last_undegraded":"2024-04-26T12:39:37.320917+0000","last_fullsized":"2024-04-26T12:39:37.320917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.432450+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:39:37.432450+0000","last_peered":"2024-04-26T12:39:37.432450+0000","last_clean":"2024-04-26T12:39:37.432450+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:39:37.432450+0000","last_undegraded":"2024-04-26T12:39:37.432450+0000","last_fullsized":"2024-04-26T12:39:37.432450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.687744+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:39:37.687744+0000","last_peered":"2024-04-26T12:39:37.687744+0000","last_clean":"2024-04-26T12:39:37.687744+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:39:37.687744+0000","last_undegraded":"2024-04-26T12:39:37.687744+0000","last_fullsized":"2024-04-26T12:39:37.687744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.313129+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:39:37.313129+0000","last_peered":"2024-04-26T12:39:37.313129+0000","last_clean":"2024-04-26T12:39:37.313129+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:39:37.313129+0000","last_undegraded":"2024-04-26T12:39:37.313129+0000","last_fullsized":"2024-04-26T12:39:37.313129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.429606+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:39:37.429606+0000","last_peered":"2024-04-26T12:39:37.429606+0000","last_clean":"2024-04-26T12:39:37.429606+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:39:37.429606+0000","last_undegraded":"2024-04-26T12:39:37.429606+0000","last_fullsized":"2024-04-26T12:39:37.429606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.752241+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:39:37.752241+0000","last_peered":"2024-04-26T12:39:37.752241+0000","last_clean":"2024-04-26T12:39:37.752241+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:39:37.752241+0000","last_undegraded":"2024-04-26T12:39:37.752241+0000","last_fullsized":"2024-04-26T12:39:37.752241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.750165+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:39:37.750165+0000","last_peered":"2024-04-26T12:39:37.750165+0000","last_clean":"2024-04-26T12:39:37.750165+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:39:37.750165+0000","last_undegraded":"2024-04-26T12:39:37.750165+0000","last_fullsized":"2024-04-26T12:39:37.750165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":87,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.323032+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:39:37.323032+0000","last_peered":"2024-04-26T12:39:37.323032+0000","last_clean":"2024-04-26T12:39:37.323032+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:39:37.323032+0000","last_undegraded":"2024-04-26T12:39:37.323032+0000","last_fullsized":"2024-04-26T12:39:37.323032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":92,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.753015+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:39:37.753015+0000","last_peered":"2024-04-26T12:39:37.753015+0000","last_clean":"2024-04-26T12:39:37.753015+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:39:37.753015+0000","last_undegraded":"2024-04-26T12:39:37.753015+0000","last_fullsized":"2024-04-26T12:39:37.753015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":88,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-26T12:39:37.751157+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:39:37.751157+0000","last_peered":"2024-04-26T12:39:37.751157+0000","last_clean":"2024-04-26T12:39:37.751157+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:39:37.751157+0000","last_undegraded":"2024-04-26T12:39:37.751157+0000","last_fullsized":"2024-04-26T12:39:37.751157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":684,"num_read_kb":443,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1331200,"data_stored":967997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":712704,"data_stored":376969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":765952,"data_stored":379226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":376467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":716800,"data_stored":369517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":692224,"data_stored":369119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":733184,"data_stored":378212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1310720,"data_stored":967403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:39:40.656 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:39:40.656 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T12:39:40.657 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:40.657 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:40.684 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:40.685 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:40.701 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:40.701 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:40.716 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:40.716 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:40.721 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:40.747 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:40.747 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:40.748 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:40.746+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:40.782 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:40.783 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:40.816 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:40.837 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:40.834+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:40.850 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:40.850 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:40.883 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:40.884 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:40.915 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:40.915 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:40.929 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:40.937 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:40.934+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:41.038 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:41.038+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:41.139 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:41.134+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:41.145 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:41.145 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:41.162 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:41.240 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:41.238+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:41.341 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:41.342+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:41.349 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:41.373 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:39:41.442 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:41.442+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:41.543 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:41.543 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:41.544 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:41.542+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:41.562 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:41.653 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:41.654+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:41.745 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:41.742+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:41.778 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:41.778 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:41.796 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:41.885 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:41.886+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:41.947 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:41.942+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:42.007 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:42.008 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:42.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:42.065 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:42.066+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:42.149 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:42.150+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:42.236 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:42.237 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:42.250 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:42.246+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:42.255 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:42.351 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:42.350+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:42.451 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:42.450+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:42.466 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:42.467 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:42.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:42.553 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:42.550+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:42.654 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:42.654+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:42.698 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:42.699 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:42.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:42.757 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:42.758+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:42.848 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:42.849 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:42.856 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:42.854+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:42.863 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:42.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:42.957 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:42.958+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:43.026 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:43.027 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:43.040 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:43.084 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:43.082+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:43.106 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:43.107 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:43.137 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:43.137 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:43.158 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:43.158+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:43.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:43.160 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:43.168 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:43.168 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:43.175 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:43.198 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:43.199 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:43.231 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:43.231 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:43.264 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:43.264 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:43.264 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:43.262+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:43.295 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:43.296 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:43.328 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:43.328 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:43.341 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:43.341 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:43.341 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:43.341 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:43.355 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:43.393 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:43.394+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:43.400 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:39:43.463 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:43.458+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:43.522 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:43.522 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:43.522 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:43.522 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:43.522 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:43.536 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:43.564 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:43.562+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:43.665 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:43.666+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:43.709 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:43.709 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:43.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:43.709 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:43.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.709 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:43.709 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.216822729, 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:39:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:39:43.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:39:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:39:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:39:43.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:43.716 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.200126093999998, 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.719 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.196319606000003, 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.722 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:39:43.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:39:43.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.208072639999997, 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.727 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:39:43.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:39:43.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:39:43.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.732 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.146123067999994, 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:39:43.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:39:43.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:39:43.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.135246092000003, 2024-04-26T12:39:43.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:39:43.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.123857486000006, 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.744 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:39:43.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:39:43.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:39:43.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.030603356, 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.750 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:43.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:39:43.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:39:43.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.028581818999996, 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.756 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:39:43.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:39:43.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:39:43.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.025661233999998, 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.762 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:39:43.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:39:43.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.767 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.025380806000001, 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:39:43.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:39:43.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.020655766000004, 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.774 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:39:43.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:39:43.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:39:43.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.017433715999999, 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:39:43.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:39:43.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:39:43.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.015951856000001, 2024-04-26T12:39:43.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:39:43.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:39:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.014713224999994, 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.789 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.794 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.011728517999998, 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:39:43.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:39:43.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.009637667000007, 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:43.804 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 81.997470638999999, 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:43.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:39:43.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 81.988874095, 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:39:43.810 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:39:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 81.976714607999995, 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:43.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:43.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:43.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:43.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:39:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:39:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:43.820 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:43.820 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:43.821 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:43.822 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:43.822+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:43.923 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:43.922+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:43.949 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:43.949 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:43.949 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:43.950 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:43.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:44.024 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:44.021+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:44.085 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:44.085 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:44.086 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:44.086 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:44.086 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:44.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:44.125 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:44.122+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:44.226 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:44.221+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:44.269 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:44.269 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.794671786999999, 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.270 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:44.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:44.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:39:44.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:39:44.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:39:44.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:39:44.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:39:44.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:39:44.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.779679556000005, 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:39:44.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:39:44.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:39:44.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.754883113999995, 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.289 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.290 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.290 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.290 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:44.290 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:44.290 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:39:44.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:39:44.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.752204315, 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:39:44.296 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:39:44.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.750732282000001, 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.302 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.306 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.629833388999998, 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:44.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:39:44.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.612498635999998, 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.311 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:39:44.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:39:44.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:39:44.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.611826358000002, 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.315 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:44.319 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.582565054, 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:39:44.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:39:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.568666131000001, 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:44.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:39:44.328 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.563213546, 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:44.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.561093129, 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:39:44.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:39:44.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.559130554999996, 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.337 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.558678364000002, 2024-04-26T12:39:44.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:44.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:39:44.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.556318441000002, 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.550619901000005, 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:39:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:39:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:39:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.389456154000001, 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:39:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:39:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:39:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.180708089000007, 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:39:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 82.031917174, 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:39:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 81.950623797000006, 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:39:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.371 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:44.373 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:44.373 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:44.370+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:44.380 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:39:44.473 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:44.474+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:44.543 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:44.543 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:44.543 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:44.543 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:44.557 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:44.574 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:44.574+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:44.675 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:44.674+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:44.676 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:44.676 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:44.676 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:44.676 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:44.676 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:44.692 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:44.776 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:44.774+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:44.817 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:44.817 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.424867726, 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.818 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:39:44.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.35141187000001, 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.824 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:44.829 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.351225105, 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:44.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.351182618, 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.835 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:39:44.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:39:44.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:39:44.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:39:44.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.26939659600001, 2024-04-26T12:39:44.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:39:44.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.269279177, 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:39:44.847 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:39:44.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.12141794999999, 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.853 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:39:44.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:39:44.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.858 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.121221615, 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.859 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:44.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:39:44.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:39:44.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:39:44.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.121186008, 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.864 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:39:44.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:39:44.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.121148226, 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.870 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:44.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.875 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.12094746699999, 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:39:44.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.881 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.120840578, 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:39:44.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:39:44.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:39:44.887 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.120800511, 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.890 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:44.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:39:44.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:39:44.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.895 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.120605293, 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.896 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:39:44.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:39:44.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.120568216, 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:39:44.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:39:44.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:39:44.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 99.669090772000004, 2024-04-26T12:39:44.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 99.668945590000007, 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.913 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:39:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 98.862950834000003, 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:39:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 98.862873231999998, 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:39:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 98.862583036999993, 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:39:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:39:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:44.936 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:44.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:44.938 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:44.938+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:45.039 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:45.033+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:45.109 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:45.109 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:45.109 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:45.109 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:45.126 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:45.169 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:45.170+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:45.240 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:45.237+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:45.295 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:45.295 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:45.295 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:45.295 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:45.295 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:45.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:45.341 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:45.337+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:45.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:45.442 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:45.442+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:45.527 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.004866530000001, 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.528 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:39:45.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:39:45.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:45.533 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.001474995999999, 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:39:45.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:39:45.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 84.025657940000002, 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:39:45.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:39:45.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:39:45.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:45.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:39:45.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:39:45.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 84.006648634000001, 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.546 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:39:45.551 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.974726937, 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:39:45.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.960628894999999, 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:39:45.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:39:45.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:45.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:45.563 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.930904771000002, 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.911969834000004, 2024-04-26T12:39:45.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:39:45.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.861059736000001, 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:39:45.575 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:39:45.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:39:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.860648863999998, 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.581 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:45.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:39:45.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:39:45.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:421 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.586 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.85547622, 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025968440000000001, 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 421 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670483+0000", 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4109999999999999e-06 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670491+0000", 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670507+0000", 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6030000000000001e-05 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670518+0000", 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0631e-05 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670575+0000", 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7518000000000001e-05 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670674+0000", 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8998000000000003e-05 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670858+0000", 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018376199999999999 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.671491+0000", 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063290099999999995 2024-04-26T12:39:45.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.672995+0000", 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015041329999999999 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673031+0000", 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5790000000000001e-05 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673078+0000", 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7681e-05 2024-04-26T12:39:45.591 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.785065076999999, 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.592 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:39:45.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.597 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.778239740999993, 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026409879999999999, 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 527 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747719+0000", 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.282e-06 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747727+0000", 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747745+0000", 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7847999999999999e-05 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747754+0000", 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747815+0000", 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1057999999999997e-05 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747915+0000", 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748134+0000", 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021918799999999999 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748691+0000", 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000557414 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750284+0000", 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015928889999999999 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750317+0000", 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2447000000000003e-05 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750359+0000", 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2256000000000003e-05 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.666293358000004, 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.603 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.464075198000003, 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:39:45.608 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:39:45.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:39:45.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.613 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.406780768999994, 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:45.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:39:45.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.618 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.402948715999997, 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026710560000000002, 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.619 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123011+0000", 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.643e-06 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123023+0000", 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1824000000000001e-05 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123048+0000", 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5392999999999999e-05 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123067+0000", 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9236e-05 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123185+0000", 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011799299999999999 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123336+0000", 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150698 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123600+0000", 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026369799999999998 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.124967+0000", 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013678399999999999 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125536+0000", 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056819499999999996 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125621+0000", 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5320000000000003e-05 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125680+0000", 2024-04-26T12:39:45.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9215999999999997e-05 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.221384411000003, 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.624 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:39:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:39:45.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:39:45.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 83.217621824000005, 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:39:45.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:39:45.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:39:45.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.866760915, 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002673173, 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:45.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659200+0000", 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7580000000000001e-06 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659212+0000", 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2096000000000001e-05 2024-04-26T12:39:45.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659235+0000", 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3626999999999999e-05 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659246+0000", 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0943e-05 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659381+0000", 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013473900000000001 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659544+0000", 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016267500000000001 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659716+0000", 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258700000000001 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.660569+0000", 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085223700000000005 2024-04-26T12:39:45.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661768+0000", 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011995770000000001 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661810+0000", 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1866999999999997e-05 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661870+0000", 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0066999999999999e-05 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.639 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.640 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:45.640 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:45.640 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:45.640 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:45.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:45.642 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:45.642 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:45.643 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:45.643 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:45.643 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:45.643 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:45.644 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:45.644 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:45.644 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:45.642+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:45.648 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:45.648 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:45.681 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:45.682 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:45.715 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:45.716 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:45.760 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:45.761 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:45.758+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:45.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:45.861 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:45.862+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:45.927 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:45.927 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:45.941 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:45.985 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:45.986+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:46.045 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:46.041+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:46.093 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:46.094 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:46.107 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:46.153 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:46.154+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:46.216 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:46.216 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:46.229 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:46.273 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:46.274+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:46.347 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:46.346+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:46.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:39:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:46.442 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:46.448 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:46.441+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:46.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:46.549 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:46.550+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:46.650 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:46.649+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:46.677 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:46.677 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:46.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:46.785 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:46.786+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:46.852 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:46.850+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:46.908 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:46.909 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:46.926 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:46.969 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:46.970+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:47.053 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:47.049+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:47.137 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:47.137 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:47.153 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:47.154 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:47.154+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:47.255 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:47.249+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:47.356 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:47.353+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:47.365 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:47.365 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:47.383 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:47.400 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:39:47.465 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:47.466+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:47.512 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:47.512 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:47.526 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:47.572 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:47.569+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:47.648 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:47.648 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:47.660 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:47.653+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:47.664 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:47.740 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:47.789 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:47.790+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:47.832 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:47.832 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:47.846 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:47.892 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:47.889+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:47.937 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:47.937 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:47.960 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:47.958+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:47.964 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:47.964 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:47.968 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:47.968 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:47.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:47.999 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:47.999 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:48.029 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:48.030 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:48.061 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:48.061 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:48.064 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:48.061+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:48.091 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:48.091 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:48.123 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:48.123 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:48.149 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:48.149 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:48.149 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:48.149 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:48.149 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:48.156 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:48.156 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:48.166 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:48.162+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:48.167 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:48.263 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:48.257+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 89.845575053000005, 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.338 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:39:48.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.344 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:48.345 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:48.345 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 89.828878418000002, 2024-04-26T12:39:48.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:39:48.345 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.345 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.345 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.345 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.346 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.346 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:39:48.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.346 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:39:48.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:39:48.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:39:48.350 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 89.825071930000007, 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.355 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.836824964000002, 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:48.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:39:48.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:39:48.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.774875391999998, 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.361 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:39:48.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:39:48.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.763998416000007, 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:39:48.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:39:48.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:39:48.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.372 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.752609809999996, 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:48.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:48.378 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.659355680000004, 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:39:48.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:39:48.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.657334143, 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:39:48.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:48.389 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.654413558000002, 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:39:48.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:39:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:39:48.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.654133130000005, 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.395 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:48.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:39:48.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.400 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.649408089999994, 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:48.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:39:48.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:39:48.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.405 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.646186040000003, 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:39:48.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.644704180000005, 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.410 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.643465548999998, 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.414 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:39:48.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:39:48.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.640480842000002, 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.420 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:39:48.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.424 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.638389990999997, 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:48.430 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.626222963000004, 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:39:48.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:39:48.435 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.617626419000004, 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:39:48.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:39:48.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:48.441 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.605466931999999, 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.445 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:48.447 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:48.447 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:48.441+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:48.548 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:48.546+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:48.620 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:48.620 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:48.620 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:48.621 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:48.634 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:48.648 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:48.646+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:48.749 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:48.745+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:48.756 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:48.756 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:48.756 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:48.756 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:48.757 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:48.770 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:48.850 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:48.850+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.461892902000002, 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.939 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:39:48.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:39:48.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.446900670999995, 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:39:48.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:39:48.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:48.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:48.951 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.422104228999999, 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:48.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 90.419425430000004, 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.957 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:39:48.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:39:48.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.417953397000005, 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:39:48.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:39:48.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.297054504000002, 2024-04-26T12:39:48.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.971 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.279719751000002, 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:48.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.279047473000006, 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.976 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:39:48.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:39:48.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:48.980 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.249786169000004, 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:39:48.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.235887246000004, 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:39:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:39:48.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:39:48.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.230434661000004, 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:39:48.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:39:48.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:39:48.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:48.993 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.228314244000003, 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:48.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:48.997 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.22635167, 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:48.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:48.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.225899479000006, 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.002 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:39:49.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:49.006 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.223539556000006, 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:39:49.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:39:49.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.217841015999994, 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:49.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:39:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:39:49.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.056677269000005, 2024-04-26T12:39:49.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:39:49.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.847929203999996, 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:39:49.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:39:49.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.699138289000004, 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:39:49.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:39:49.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:39:49.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.617844911999995, 2024-04-26T12:39:49.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:39:49.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:39:49.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.032 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.033 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:49.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:49.035 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:49.034+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:49.135 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:49.129+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:49.160 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:49.160 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:49.176 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:49.236 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:49.234+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:49.337 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:49.338+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:49.340 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:49.340 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:49.341 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:49.341 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:49.341 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:49.354 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:49.424 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:39:49.438 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:49.433+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 105.083395638, 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.476 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:39:49.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.482 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.483 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.483 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.483 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:49.483 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 105.009939782, 2024-04-26T12:39:49.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:39:49.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:49.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:39:49.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:39:49.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:39:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:39:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:39:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:39:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:39:49.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:39:49.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.490 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:39:49.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:39:49.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:39:49.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:39:49.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.491 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:39:49.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:39:49.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:39:49.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:39:49.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:39:49.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:39:49.493 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.494 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.494 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.494 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.495 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:49.495 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 105.00975301699999, 2024-04-26T12:39:49.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:39:49.495 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.495 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.496 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.496 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.496 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.496 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.496 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:39:49.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.497 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:49.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:49.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:39:49.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:39:49.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:39:49.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:39:49.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:39:49.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:39:49.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:39:49.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:39:49.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:39:49.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:39:49.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:39:49.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:39:49.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:39:49.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:39:49.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:39:49.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:39:49.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:39:49.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:39:49.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:39:49.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:39:49.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:39:49.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:39:49.508 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.508 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.508 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.509 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.509 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:49.509 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 105.00971053000001, 2024-04-26T12:39:49.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:39:49.510 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.510 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.510 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.510 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.510 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.510 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.511 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:39:49.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.511 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:49.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:49.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:39:49.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:49.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:39:49.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:39:49.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:39:49.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:39:49.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:39:49.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:39:49.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:39:49.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:39:49.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:39:49.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:39:49.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:39:49.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:39:49.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:39:49.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:39:49.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:39:49.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:39:49.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:39:49.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:39:49.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:39:49.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:39:49.522 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.522 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.522 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.522 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.523 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:49.523 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.927924508, 2024-04-26T12:39:49.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:39:49.523 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.523 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.523 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.523 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.524 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.524 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.524 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:39:49.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.524 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:49.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.525 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:49.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:39:49.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:39:49.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:39:49.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:39:49.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:39:49.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:39:49.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:39:49.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:39:49.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:39:49.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:39:49.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:39:49.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:39:49.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:39:49.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:39:49.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:39:49.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.927807089, 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.533 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:39:49.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:39:49.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.77994586200001, 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.539 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:39:49.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:39:49.544 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.77974952700001, 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.545 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:39:49.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.550 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.77971392000001, 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.551 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:49.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.779676138, 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.557 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.562 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.779475379, 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.77936849, 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.568 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:39:49.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:39:49.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:39:49.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.779328423, 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.574 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:39:49.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:39:49.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:39:49.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:39:49.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.77913320499999, 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.579 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.77909612800001, 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.585 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:39:49.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:39:49.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:39:49.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:39:49.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.327618684, 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:39:49.590 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:39:49.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.597 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 104.327473502, 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.598 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:39:49.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:39:49.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 103.521478746, 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:39:49.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:39:49.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:39:49.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 103.521401144, 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:39:49.609 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:49.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 103.521110949, 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:49.615 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:49.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:49.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.620 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:49.621 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:49.621 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:49.622 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:49.623 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:49.622+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:49.723 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:49.717+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:49.795 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:49.795 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:49.796 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:49.796 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:49.813 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:49.861 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:49.862+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:49.925 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:49.921+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:49.983 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:49.983 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:49.983 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:49.983 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:49.983 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:50.001 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:50.026 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:50.021+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:50.127 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:50.121+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:50.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.698082643000006, 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.221 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:39:50.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:39:50.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 91.694691109000004, 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.227 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:39:50.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:39:50.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.718874052999993, 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.233 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:39:50.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.699864747000007, 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:39:50.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:39:50.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:39:50.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:39:50.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.667943050000005, 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:39:50.244 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:39:50.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:39:50.249 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.653845008000005, 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.250 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:39:50.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:39:50.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.624120884000007, 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:39:50.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:39:50.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:39:50.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:39:50.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.605185946999995, 2024-04-26T12:39:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:39:50.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:39:50.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:39:50.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.554275849000007, 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:39:50.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:39:50.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.272 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.553864977000003, 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:39:50.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:39:50.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:39:50.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:421 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.548692333000005, 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025968440000000001, 2024-04-26T12:39:50.278 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 421 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670483+0000", 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4109999999999999e-06 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670491+0000", 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670507+0000", 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6030000000000001e-05 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670518+0000", 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0631e-05 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670575+0000", 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7518000000000001e-05 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670674+0000", 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8998000000000003e-05 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670858+0000", 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018376199999999999 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.671491+0000", 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063290099999999995 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.672995+0000", 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015041329999999999 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673031+0000", 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5790000000000001e-05 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673078+0000", 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7681e-05 2024-04-26T12:39:50.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.478281190000004, 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:39:50.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:39:50.289 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.471455853999998, 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026409879999999999, 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 527 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:39:50.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747719+0000", 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.282e-06 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747727+0000", 2024-04-26T12:39:50.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747745+0000", 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7847999999999999e-05 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747754+0000", 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747815+0000", 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1057999999999997e-05 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747915+0000", 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748134+0000", 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021918799999999999 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748691+0000", 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000557414 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750284+0000", 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015928889999999999 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750317+0000", 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2447000000000003e-05 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750359+0000", 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2256000000000003e-05 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.359509470999996, 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.295 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:39:50.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.157291310999994, 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:39:50.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:39:50.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:50.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:50.306 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.099996881999999, 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:39:50.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:39:50.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:39:50.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:39:50.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 88.096164829000003, 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026710560000000002, 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.312 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123011+0000", 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.643e-06 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123023+0000", 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1824000000000001e-05 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123048+0000", 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5392999999999999e-05 2024-04-26T12:39:50.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123067+0000", 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9236e-05 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123185+0000", 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011799299999999999 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123336+0000", 2024-04-26T12:39:50.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150698 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123600+0000", 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026369799999999998 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.124967+0000", 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013678399999999999 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125536+0000", 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056819499999999996 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125621+0000", 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5320000000000003e-05 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125680+0000", 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9215999999999997e-05 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.914600523999994, 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:39:50.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 87.910837936999997, 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:39:50.323 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:39:50.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:39:50.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:39:50.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 58.559977027999999, 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002673173, 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:50.329 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659200+0000", 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7580000000000001e-06 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659212+0000", 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2096000000000001e-05 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659235+0000", 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3626999999999999e-05 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659246+0000", 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0943e-05 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659381+0000", 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013473900000000001 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659544+0000", 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016267500000000001 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659716+0000", 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258700000000001 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.660569+0000", 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085223700000000005 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661768+0000", 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011995770000000001 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661810+0000", 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1866999999999997e-05 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661870+0000", 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0066999999999999e-05 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:50.334 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:50.336 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:50.336 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:50.334+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:50.377 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:50.378 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:50.408 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:39:50.423 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:50.423 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:50.437 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:50.434+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:50.459 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:50.494 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:50.494 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:50.514 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:50.515 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:50.529 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:50.530 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:50.531 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:50.568 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:50.568 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:50.568 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:50.566+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:50.602 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:50.602 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:50.638 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:50.638 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:50.639 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:50.638+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:50.684 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:50.684 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:50.697 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:50.745 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:50.746+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:50.841 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:50.837+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:50.914 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:50.914 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:50.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:50.981 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:50.982+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:51.042 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:51.037+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:51.103 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:51.103 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:51.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:51.143 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:51.141+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:51.243 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:51.242+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:51.330 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:51.330 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:51.345 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:51.342+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:51.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:51.446 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:51.446+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:51.547 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:51.546+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:51.558 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:51.559 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:51.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:51.648 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:51.641+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:51.749 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:51.745+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:51.788 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:51.789 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:51.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:51.853 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:51.854+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:51.950 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:51.951 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:51.951 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:51.945+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:51.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:52.051 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:52.045+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:52.144 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:52.144 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:52.153 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:52.154+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:52.159 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:52.254 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:52.249+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:52.290 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:52.291 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:52.304 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:52.393 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:52.389+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:52.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:39:52.472 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:52.472 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:52.487 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:52.493 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:52.494+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:52.556 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:52.554+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:52.655 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:52.655 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:52.657 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:52.658+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:52.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:52.669 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:52.758 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:52.758+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:52.791 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:52.791 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:52.805 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:52.808 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:52.808 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:52.825 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:52.826 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:52.842 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:52.842 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:52.858 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:52.859 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:52.859 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:52.853+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:52.877 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:52.877 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:52.894 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:52.895 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:52.915 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:52.915 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:52.923 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:52.923 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:52.923 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:52.923 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:52.923 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:52.936 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:52.936 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:52.937 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:52.981 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:52.977+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:53.061 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:53.062+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 94.614324839000005, 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016374961, 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.107 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 48 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488735+0000", 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488738+0000", 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4429999999999999e-06 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488751+0000", 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2197e-05 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488782+0000", 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1893000000000001e-05 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488806+0000", 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3373000000000001e-05 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488943+0000", 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013749500000000001 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488963+0000", 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.001e-05 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497300+0000", 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083369759999999994 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497597+0000", 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029644799999999999 2024-04-26T12:39:53.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.497877+0000", 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027991099999999998 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.502798+0000", 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049215719999999999 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.504984+0000", 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021857460000000001 2024-04-26T12:39:53.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505059+0000", 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4723999999999998e-05 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505110+0000", 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1172999999999999e-05 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889461983360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 94.597628204000003, 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003408126, 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 49 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505432+0000", 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505434+0000", 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3929999999999998e-06 2024-04-26T12:39:53.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505443+0000", 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7630000000000006e-06 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505467+0000", 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4136999999999999e-05 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505480+0000", 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3063e-05 2024-04-26T12:39:53.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505576+0000", 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5895000000000003e-05 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505665+0000", 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9650999999999999e-05 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.505827+0000", 2024-04-26T12:39:53.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016125100000000001 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.507362+0000", 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015357599999999999 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508488+0000", 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001125256 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508633+0000", 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014574299999999999 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.508840+0000", 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000206214 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:52 7.e e26/25 7:7759931f:::notify.3:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 94.593821715999994, 2024-04-26T12:39:53.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034888580000000001, 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509238+0000", 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509239+0000", 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.257e-06 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509249+0000", 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4769999999999992e-06 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509274+0000", 2024-04-26T12:39:53.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5154e-05 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509295+0000", 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0843e-05 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509421+0000", 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012648999999999999 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.509470+0000", 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8665999999999998e-05 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512659+0000", 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003189412 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.512727+0000", 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7558999999999995e-05 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.605574750000002, 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035697929999999999, 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 205 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.124 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497485+0000", 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497489+0000", 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5439999999999999e-06 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497504+0000", 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5815999999999999e-05 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497540+0000", 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5410000000000001e-05 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497566+0000", 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6253000000000001e-05 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.126 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497721+0000", 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015508899999999999 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.497964+0000", 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000242468 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.498351+0000", 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038773300000000002 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500007+0000", 2024-04-26T12:39:53.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016560279999999999 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500838+0000", 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083073000000000001 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.500919+0000", 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0717000000000007e-05 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.501055+0000", 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000136005 2024-04-26T12:39:53.128 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.543625177999999, 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034292070000000001, 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 220 2024-04-26T12:39:53.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559435+0000", 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559437+0000", 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6740000000000001e-06 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559446+0000", 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.02e-06 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559471+0000", 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4326000000000001e-05 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559484+0000", 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2927e-05 2024-04-26T12:39:53.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559587+0000", 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103076 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.559793+0000", 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020630799999999999 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.560181+0000", 2024-04-26T12:39:53.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038807700000000002 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.561939+0000", 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017581459999999999 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562694+0000", 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075483500000000003 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562786+0000", 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2361999999999994e-05 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.562864+0000", 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7455999999999998e-05 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.134 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.532748201999993, 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003930177, 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 223 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570312+0000", 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570314+0000", 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570325+0000", 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0519999999999999e-05 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570356+0000", 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1195999999999997e-05 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570371+0000", 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5244e-05 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570520+0000", 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014876200000000001 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.570853+0000", 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033351000000000002 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.571537+0000", 2024-04-26T12:39:53.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00068366499999999997 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573082+0000", 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001544945 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.573967+0000", 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000884756 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574127+0000", 2024-04-26T12:39:53.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160202 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.574242+0000", 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114833 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.521359595999996, 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034203670000000001, 2024-04-26T12:39:53.140 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 226 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581700+0000", 2024-04-26T12:39:53.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581702+0000", 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.334e-06 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581714+0000", 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1306e-05 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581745+0000", 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1386000000000001e-05 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581764+0000", 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8423999999999998e-05 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.581911+0000", 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014729899999999999 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.143 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582239+0000", 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032819700000000002 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.582970+0000", 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073066500000000003 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584634+0000", 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001663957 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.584971+0000", 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033742000000000001 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585052+0000", 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0935999999999999e-05 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.585121+0000", 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8442999999999995e-05 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.145 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.146 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:426 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.146 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:53.146 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.428105466000005, 2024-04-26T12:39:53.146 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042463539999999999, 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 426 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674954+0000", 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674957+0000", 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6429999999999999e-06 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674970+0000", 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.327e-05 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.674998+0000", 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7433e-05 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675017+0000", 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426999999999999e-05 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675164+0000", 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000146539 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.149 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675411+0000", 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024742399999999999 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.675933+0000", 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052234600000000003 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677203+0000", 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001269514 2024-04-26T12:39:53.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679002+0000", 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001798867 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679108+0000", 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010630500000000001 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679201+0000", 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2585999999999998e-05 2024-04-26T12:39:53.151 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:429 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.426083929000001, 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050356050000000003, 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 429 2024-04-26T12:39:53.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676976+0000", 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676977+0000", 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.124e-06 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.676984+0000", 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1400000000000002e-06 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677036+0000", 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1858999999999999e-05 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.154 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677051+0000", 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4944e-05 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677143+0000", 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2300999999999996e-05 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677302+0000", 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015858300000000001 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:53.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.677677+0000", 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000375633 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679558+0000", 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001881024 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681775+0000", 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022164559999999999 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681892+0000", 2024-04-26T12:39:53.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116779 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682011+0000", 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119762 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:434 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.423163344000002, 2024-04-26T12:39:53.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048248529999999996, 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 434 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.158 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679896+0000", 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679898+0000", 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.406e-06 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679907+0000", 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4339999999999998e-06 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679923+0000", 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6155999999999999e-05 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.679935+0000", 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1187e-05 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680016+0000", 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1644000000000006e-05 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680132+0000", 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000116039 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680379+0000", 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024708400000000001 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.681689+0000", 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001309616 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684450+0000", 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027609420000000002 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684583+0000", 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013282600000000001 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684721+0000", 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:53.162 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:435 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.422882916000006, 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045055370000000004, 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.163 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 435 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680177+0000", 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680178+0000", 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.203e-06 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680184+0000", 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.477e-06 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680215+0000", 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0389999999999999e-05 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680227+0000", 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1950000000000001e-05 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680316+0000", 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9167999999999997e-05 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680470+0000", 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000153802 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.680860+0000", 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038994099999999999 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.682190+0000", 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013300040000000001 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684492+0000", 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023017929999999999 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684592+0000", 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001009 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684682+0000", 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9908999999999996e-05 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:438 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:53.168 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.418157875999995, 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051469970000000004, 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 438 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:53.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684902+0000", 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684904+0000", 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.857e-06 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684914+0000", 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.065e-05 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684961+0000", 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6962000000000002e-05 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.684980+0000", 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8176999999999999e-05 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685077+0000", 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7768000000000003e-05 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685268+0000", 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019071 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685581+0000", 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031343799999999998 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689848+0000", 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042669159999999999 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689882+0000", 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3439999999999998e-05 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689978+0000", 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6389000000000002e-05 2024-04-26T12:39:53.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690049+0000", 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0690000000000003e-05 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:442 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'11, mlcod=29'9)", 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.414935826000004, 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044978869999999999, 2024-04-26T12:39:53.174 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688124+0000", 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688125+0000", 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1680000000000001e-06 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688134+0000", 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0469999999999999e-06 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688153+0000", 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8754999999999999e-05 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688165+0000", 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.185e-05 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688243+0000", 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8370999999999999e-05 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.688277+0000", 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4149000000000001e-05 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692484+0000", 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042068419999999997 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.692622+0000", 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013770500000000001 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.178 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:446 6.4 e29/23 6:24c8e1ae:gc::gc.19:head v 29'12, mlcod=29'9)", 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.413453966000006, 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059407119999999999, 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689606+0000", 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689608+0000", 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.793e-06 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689618+0000", 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.084e-05 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689646+0000", 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7404000000000001e-05 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689659+0000", 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3433e-05 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689805+0000", 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014546599999999999 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689856+0000", 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0932e-05 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695433+0000", 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055771340000000001 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695546+0000", 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011370999999999999 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.182 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:448 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.412215334999999, 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048358089999999999, 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 448 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.183 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690844+0000", 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690846+0000", 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.42e-06 2024-04-26T12:39:53.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690853+0000", 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5530000000000004e-06 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690874+0000", 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0377000000000002e-05 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690885+0000", 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0899e-05 2024-04-26T12:39:53.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.690993+0000", 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010865 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691119+0000", 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012539199999999999 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:53.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.691395+0000", 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027619100000000001 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693106+0000", 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017108169999999999 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695486+0000", 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023798080000000002 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695567+0000", 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1780000000000006e-05 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695680+0000", 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112922 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:450 6.4 e29/23 6:264a8785:::obj_delete_at_hint.0000000011:head v 29'13, mlcod=29'10)", 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.409230628000003, 2024-04-26T12:39:53.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044467250000000003, 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693829+0000", 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693831+0000", 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.68e-06 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693841+0000", 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0587e-05 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693861+0000", 2024-04-26T12:39:53.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9145999999999999e-05 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693873+0000", 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.292e-05 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.693972+0000", 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8832999999999994e-05 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.694009+0000", 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7082999999999997e-05 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698174+0000", 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004164994 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.698276+0000", 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101482 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.192 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:452 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.407139776999998, 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005312308, 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 452 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.193 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695920+0000", 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695922+0000", 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695931+0000", 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1859999999999998e-06 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695954+0000", 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2745999999999999e-05 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.695968+0000", 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3684e-05 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696074+0000", 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106699 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696216+0000", 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000141469 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.696513+0000", 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029679400000000002 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.697634+0000", 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011214280000000001 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701099+0000", 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034651769999999998 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701169+0000", 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9428e-05 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701232+0000", 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3666999999999999e-05 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:469 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.198 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.394972749000004, 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052183159999999998, 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 469 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:53.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708087+0000", 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708089+0000", 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0169999999999999e-06 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708099+0000", 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8199999999999992e-06 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708128+0000", 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9657000000000001e-05 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708145+0000", 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6393e-05 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708309+0000", 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016384900000000001 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708561+0000", 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025249799999999998 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.708966+0000", 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040445999999999999 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710226+0000", 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012601170000000001 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713049+0000", 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028229959999999999 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713197+0000", 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147844 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.713305+0000", 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108665 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.386376205000005, 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039273789999999999, 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.204 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 478 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716684+0000", 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716685+0000", 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-06 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716693+0000", 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9659999999999996e-06 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716718+0000", 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4777e-05 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716738+0000", 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0060000000000001e-05 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.716853+0000", 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011456899999999999 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717092+0000", 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023960100000000001 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717532+0000", 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043965399999999999 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.718951+0000", 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014184759999999999 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720482+0000", 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015314 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720546+0000", 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4388999999999996e-05 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720611+0000", 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4599999999999998e-05 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.209 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:499 6.1c e29/23 6:3b93e7b4:::obj_delete_at_hint.0000000016:head v 29'2, mlcod=0'0)", 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.374216718, 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003829327, 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728843+0000", 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728845+0000", 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.142e-06 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728859+0000", 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3937000000000001e-05 2024-04-26T12:39:53.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728893+0000", 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3634999999999999e-05 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.728914+0000", 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1438999999999999e-05 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729052+0000", 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138128 2024-04-26T12:39:53.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.729097+0000", 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4280000000000003e-05 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732594+0000", 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003497113 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.732672+0000", 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8652999999999994e-05 2024-04-26T12:39:53.213 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.214 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.214 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.214 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.214 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.214 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:53.215 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:53.216 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:53.213+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:53.317 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:53.314+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:53.382 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:53.383 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:53.383 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:53.383 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:53.396 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:53.417 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:53.418+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:53.514 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:53.514 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:53.514 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:53.514 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:53.514 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:53.518 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:53.518+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:53.528 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:53.619 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:53.618+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.171142970000005, 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:39:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.156150738999997, 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:39:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.131354297000001, 2024-04-26T12:39:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:39:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.128675498000007, 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:209 6.3 e29/23 6:c60da066:gc::gc.4:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 92.127203464999994, 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001909478, 2024-04-26T12:39:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517591+0000", 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517592+0000", 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9999999999999997e-07 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517601+0000", 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9060000000000008e-06 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517632+0000", 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1223999999999998e-05 2024-04-26T12:39:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517648+0000", 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6186000000000001e-05 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517782+0000", 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013425199999999999 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.517814+0000", 2024-04-26T12:39:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1542999999999999e-05 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519427+0000", 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016129709999999999 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.519501+0000", 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3795999999999996e-05 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 92.006304572000005, 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:39:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.988969819000005, 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:39:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:39:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.988297540999994, 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:39:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.959036237000007, 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:39:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:455 6.5 e29/23 6:a4a56432:::obj_delete_at_hint.0000000012:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.945137313999993, 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018299989999999999, 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699657+0000", 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699659+0000", 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.367e-06 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699670+0000", 2024-04-26T12:39:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1133e-05 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699686+0000", 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5766000000000001e-05 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699696+0000", 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0030000000000001e-05 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699829+0000", 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133039 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.699866+0000", 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7647000000000001e-05 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701405+0000", 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015382010000000001 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.701487+0000", 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2816000000000001e-05 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.939684729000007, 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:39:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.937564312000006, 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:39:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.935601738000003, 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:39:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.935149546999995, 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:39:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:39:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.932789623999994, 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:39:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.927091083999997, 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.765927336999994, 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.557179271999999, 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:39:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:39:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.408388357000007, 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:39:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:39:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:894 6.a e29/23 6:575f3851:::obj_delete_at_hint.0000000105:head v 29'15, mlcod=29'13)", 2024-04-26T12:39:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 91.327094979999998, 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001833105, 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317700+0000", 2024-04-26T12:39:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317702+0000", 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.756e-06 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317712+0000", 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0910000000000001e-05 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317743+0000", 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.027e-05 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317761+0000", 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8165999999999999e-05 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317933+0000", 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017198199999999999 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.317968+0000", 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5599999999999998e-05 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319448+0000", 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001479558 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.319533+0000", 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4863000000000004e-05 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:53.743 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:53.744 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:53.745 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:53.742+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:53.768 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:39:53.845 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:53.846+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:53.873 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:53.873 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:53.873 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:53.874 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:53.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:53.946 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:53.946+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:54.008 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:54.009 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:54.024 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:54.047 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:54.046+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:54.149 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:54.146+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:54.149 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.758323706, 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:39:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:39:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:39:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:39:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.68486785, 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.68468108499999, 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:39:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:39:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.68463859800001, 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:39:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:39:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:39:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.602852576, 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:39:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.602735157, 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:39:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.45487393000001, 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:39:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.45467759500001, 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:39:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:39:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:39:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.45464198800001, 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:39:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.454604206, 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:39:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.454403447, 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:39:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.454296558, 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:39:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:39:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.454256491, 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:39:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:39:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.45406127299999, 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:39:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:39:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:39:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.45402419600001, 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:39:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.002546752, 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:39:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:39:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 109.00240157, 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:39:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 108.196406814, 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:39:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 108.19632921199999, 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:39:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:39:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:39:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:39:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 108.196039017, 2024-04-26T12:39:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:39:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:39:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:39:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:54.271 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:54.273 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:54.269+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:54.273 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:54.374 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:54.374+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:54.397 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:54.397 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:54.398 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:54.398 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:54.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:54.441 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 96% (11890/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T12:39:54.474 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:54.474+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:54.538 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:54.538 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:54.538 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:54.538 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:54.538 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:54.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:54.576 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:54.573+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:54.676 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:54.669+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.190128739000002, 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.714 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:39:54.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.186737205, 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:39:54.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:39:54.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:39:54.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.210920149000003, 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:39:54.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:39:54.734 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.191910843000002, 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.735 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:39:54.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.740 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.159989146000001, 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:39:54.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.145891104, 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:39:54.746 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:39:54.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.116166980000003, 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:39:54.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.757 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.097232043000005, 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:39:54.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.046321945000003, 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.763 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:39:54.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:39:54.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.045911072999999, 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:39:54.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:39:54.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.774 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:421 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 93.040738429000001, 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025968440000000001, 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 421 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670482+0000", 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670483+0000", 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4109999999999999e-06 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670491+0000", 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9889999999999992e-06 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670507+0000", 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6030000000000001e-05 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670518+0000", 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0631e-05 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670575+0000", 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7518000000000001e-05 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670674+0000", 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8998000000000003e-05 2024-04-26T12:39:54.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.670858+0000", 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018376199999999999 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.671491+0000", 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063290099999999995 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.672995+0000", 2024-04-26T12:39:54.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015041329999999999 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673031+0000", 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5790000000000001e-05 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.673078+0000", 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7681e-05 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.970327286, 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:39:54.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:39:54.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:39:54.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:39:54.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:527 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:39:54.786 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.963501949999994, 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026409879999999999, 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 527 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747718+0000", 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747719+0000", 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.282e-06 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747727+0000", 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6140000000000003e-06 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747745+0000", 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7847999999999999e-05 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747754+0000", 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6590000000000002e-06 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747815+0000", 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1057999999999997e-05 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.747915+0000", 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9333000000000006e-05 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748134+0000", 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021918799999999999 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.748691+0000", 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000557414 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750284+0000", 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015928889999999999 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750317+0000", 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2447000000000003e-05 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.750359+0000", 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2256000000000003e-05 2024-04-26T12:39:54.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.851555567000005, 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.792 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.797 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.649337407000004, 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:39:54.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.592042977999995, 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.803 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:39:54.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:39:54.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:813 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.588210924999998, 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026710560000000002, 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.809 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 813 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123009+0000", 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123011+0000", 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.643e-06 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123023+0000", 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1824000000000001e-05 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123048+0000", 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5392999999999999e-05 2024-04-26T12:39:54.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123067+0000", 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9236e-05 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123185+0000", 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011799299999999999 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123336+0000", 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150698 2024-04-26T12:39:54.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.123600+0000", 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026369799999999998 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.124967+0000", 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013678399999999999 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125536+0000", 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00056819499999999996 2024-04-26T12:39:54.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125621+0000", 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5320000000000003e-05 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.125680+0000", 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9215999999999997e-05 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.406646620000004, 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:39:54.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 92.402884033000007, 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:39:54.820 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:39:54.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:39:54.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 63.052023124000002, 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002673173, 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:54.826 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659200+0000", 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7580000000000001e-06 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659212+0000", 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2096000000000001e-05 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659235+0000", 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3626999999999999e-05 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659246+0000", 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0943e-05 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659381+0000", 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013473900000000001 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659544+0000", 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016267500000000001 2024-04-26T12:39:54.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659716+0000", 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258700000000001 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.660569+0000", 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085223700000000005 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661768+0000", 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011995770000000001 2024-04-26T12:39:54.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661810+0000", 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1866999999999997e-05 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661870+0000", 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0066999999999999e-05 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:54.831 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:54.833 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:54.833 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:54.830+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:54.934 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:54.933+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:54.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:55.003 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:55.003 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:55.003 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:55.003 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:55.018 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:55.068 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to '7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0'. 2024-04-26T12:39:55.068 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T12:39:55.068 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-26T12:39:55.069 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at 7fad7ff2775 Merge branches 'pr-57058' and 'pr-57095' into wip-cbodley2-testing 2024-04-26T12:39:55.070 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:55.066+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:55.077 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T12:39:55.091 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:55.092 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:55.095 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T12:39:55.097 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T12:39:55.097 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T12:39:55.108 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:55.109 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:55.126 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:55.127 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:55.135 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:55.135 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:55.136 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:55.129+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:55.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:55.142 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:55.148 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:55.162 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:55.163 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:55.183 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:55.183 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:55.204 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:55.204 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:55.224 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:55.224 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:55.237 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:55.234+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:55.278 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:55.278 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:55.292 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:55.338 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:55.337+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:55.439 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:55.438+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:55.442 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:55.442 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:55.456 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:55.541 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:55.542+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:55.610 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:55.610 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:55.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:39:55.640 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:55.637+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:55.741 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:55.737+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:55.790 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:55.790 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:55.793 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:39:55.805 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:39:55.849 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:55.850+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:55.872 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T12:39:55.943 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:55.942+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:55.950 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T12:39:55.965 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:55.966 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:55.979 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:39:55.998 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T12:39:56.000 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T12:39:56.000 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T12:39:56.037 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T12:39:56.040 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-26T12:39:56.040 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T12:39:56.085 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:56.086+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:56.094 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-04-26T12:39:56.096 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-04-26T12:39:56.096 DEBUG:teuthology.orchestra.run.smithi016:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7fad7ff2775e902b06a4e6221e7ff1dd56a7bde0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-04-26T12:39:56.108 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:56.109 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:56.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:39:56.169 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:56.170+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:56.250 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:56.250+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:56.282 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:56.282 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:56.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:39:56.350 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:56.345+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:56.408 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-04-26T12:39:56.408 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-04-26T12:39:56.408 INFO:tasks.workunit.client.0.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00892999 s, 1.2 GB/s 2024-04-26T12:39:56.428 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:56.428 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:56.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:39:56.485 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:56.481+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:56.552 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:56.550+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:56.601 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_39_56 2024-04-26T12:39:56.616 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:56.617 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:56.631 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:39:56.677 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:56.673+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:56.734 INFO:tasks.workunit.client.0.smithi016.stdout:quota set for the bucket: buck_2024_03_26_12_39_56 2024-04-26T12:39:56.754 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:56.754+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:56.758 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:56.758 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:56.772 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:39:56.779 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:39:56.861 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:56.857+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:56.947 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:56.947 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:56.955 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:56.949+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:56.963 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:39:56.981 INFO:tasks.workunit.client.0.smithi016.stdout:quota enabled for the bucket: buck_2024_03_26_12_39_56 2024-04-26T12:39:56.982 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 10Mb. 2024-04-26T12:39:56.982 INFO:tasks.workunit.client.0.smithi016.stdout:upload file successful 2024-04-26T12:39:56.982 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:39:56.982 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - Test max objects passed 2024-04-26T12:39:56.982 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:39:57.056 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:57.053+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:57.137 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:57.137 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:57.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:39:57.197 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:57.193+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:57.226 INFO:tasks.workunit.client.0.smithi016.stdout:user qa_user deleted 2024-04-26T12:39:57.226 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:39:57.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:39:57.256 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-04-26T12:39:57.256 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-04-26T12:39:57.256 INFO:tasks.workunit.client.0.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0254825 s, 411 MB/s 2024-04-26T12:39:57.258 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:57.253+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:57.318 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:57.318 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:57.333 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:39:57.358 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:57.358+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:57.396 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:57.397 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:57.406 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_39_57 2024-04-26T12:39:57.414 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:57.414 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:57.430 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:57.447 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:57.447 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:57.459 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:57.453+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:57.471 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:57.471 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:57.491 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:57.491 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:57.514 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:57.515 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:57.526 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:39:57.537 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:57.537 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:57.597 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:57.598+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:57.661 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:57.662+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:57.665 INFO:tasks.workunit.client.0.smithi016.stdout:bucket quota max_objs set for the given user: buck_2024_03_26_12_39_57 2024-04-26T12:39:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:57.703 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:39:57.762 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:57.757+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 99.356930298999998, 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:39:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:39:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:39:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 99.341938068000005, 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:39:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:39:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 99.317141625999994, 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002416812, 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 54 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513440+0000", 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513443+0000", 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5600000000000001e-06 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513454+0000", 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0693000000000001e-05 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513486+0000", 2024-04-26T12:39:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2413000000000003e-05 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513508+0000", 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513622+0000", 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011383900000000001 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513781+0000", 2024-04-26T12:39:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015913599999999999 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.513949+0000", 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016813900000000001 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.514833+0000", 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00088407500000000001 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515740+0000", 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00090660000000000003 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515805+0000", 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5722000000000005e-05 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.515857+0000", 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1888000000000002e-05 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889461977600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 99.314462827, 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002562777, 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 55 2024-04-26T12:39:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516119+0000", 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516121+0000", 2024-04-26T12:39:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8169999999999999e-06 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516130+0000", 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0329999999999997e-06 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516157+0000", 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7138999999999999e-05 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516179+0000", 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1690000000000001e-05 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516285+0000", 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106229 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516438+0000", 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015281600000000001 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.516668+0000", 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230101 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.517686+0000", 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010178380000000001 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518541+0000", 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00085524400000000001 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518607+0000", 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5438999999999995e-05 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.518682+0000", 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5431000000000003e-05 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:319 6.1 e29/23 6:856b9b26:reshard::reshard.0000000002:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.192091900999998, 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020103849999999999, 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638490+0000", 2024-04-26T12:39:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638491+0000", 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638509+0000", 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8236999999999998e-05 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638558+0000", 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638577+0000", 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8972999999999999e-05 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638710+0000", 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013323600000000001 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.638758+0000", 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7366e-05 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640383+0000", 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016250240000000001 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.640501+0000", 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011803600000000001 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:389 6.3 e29/23 6:c3a682d4:reshard::reshard.0000000004:head v 29'5, mlcod=29'3)", 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.174757147999998, 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019830249999999998, 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655825+0000", 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655827+0000", 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8330000000000001e-06 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655840+0000", 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.349e-05 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655868+0000", 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7824e-05 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.655888+0000", 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0366000000000001e-05 2024-04-26T12:39:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656023+0000", 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013482899999999999 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656064+0000", 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0395999999999997e-05 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657696+0000", 2024-04-26T12:39:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001631831 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.657808+0000", 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112456 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:391 6.c e29/23 6:3677c228:::obj_delete_at_hint.0000000006:head v 29'1, mlcod=0'0)", 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.174084870000002, 2024-04-26T12:39:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019377890000000001, 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656497+0000", 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656498+0000", 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2240000000000001e-06 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656512+0000", 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4005999999999999e-05 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656539+0000", 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6293000000000001e-05 2024-04-26T12:39:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656557+0000", 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8493000000000001e-05 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656695+0000", 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138102 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.656725+0000", 2024-04-26T12:39:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0134e-05 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658354+0000", 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0016284839999999999 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.658435+0000", 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1052999999999998e-05 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.144823565999999, 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:39:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:464 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'6, mlcod=29'3)", 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.125472058, 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00213503, 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705110+0000", 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705113+0000", 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5069999999999999e-06 2024-04-26T12:39:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705127+0000", 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-05 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705157+0000", 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705174+0000", 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6713000000000001e-05 2024-04-26T12:39:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705394+0000", 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000219605 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.705458+0000", 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3975999999999999e-05 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707162+0000", 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001704356 2024-04-26T12:39:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707245+0000", 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2999999999999998e-05 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:467 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.123351640999999, 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0027751640000000001, 2024-04-26T12:39:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707230+0000", 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707232+0000", 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.823e-06 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707247+0000", 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5197e-05 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707278+0000", 2024-04-26T12:39:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0892999999999997e-05 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707297+0000", 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8640000000000001e-05 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707427+0000", 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012953800000000001 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.707469+0000", 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2505e-05 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709909+0000", 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024394999999999998 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.710006+0000", 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7068e-05 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.121389066999996, 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:39:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.120936876000002, 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:39:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.118576953000002, 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:39:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:39:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:478 6.a e29/23 6:5127e642:gc::gc.21:head v 29'7, mlcod=29'5)", 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 96.112878413000004, 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025095870000000002, 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717704+0000", 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717706+0000", 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0600000000000002e-06 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717717+0000", 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1022999999999999e-05 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717738+0000", 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1444999999999999e-05 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717749+0000", 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1088e-05 2024-04-26T12:39:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717850+0000", 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100393 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717885+0000", 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720135+0000", 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022490549999999998 2024-04-26T12:39:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.720213+0000", 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8759999999999998e-05 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.951714666000001, 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:39:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:39:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:39:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.742966601000006, 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:39:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 95.594175686, 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:39:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:39:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4853.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93932591217328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.516830+0000", 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.31375228100000002, 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022173689999999999, 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4853", 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/1452224660", 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 67 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.516830+0000", 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.516830+0000", 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.516833+0000", 2024-04-26T12:39:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1690000000000001e-06 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.516850+0000", 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7050000000000001e-05 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.516889+0000", 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9409000000000002e-05 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.516912+0000", 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2935e-05 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.517044+0000", 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013143200000000001 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.517171+0000", 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012695600000000001 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.517366+0000", 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019495600000000001 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.518364+0000", 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00099796699999999999 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.518838+0000", 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047397500000000001 2024-04-26T12:39:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.518931+0000", 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3523999999999994e-05 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.519047+0000", 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011599600000000001 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.5157.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94906308706368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.625275+0000", 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.20530720599999999, 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002458965, 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.5157", 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/3120368105", 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 45 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.625275+0000", 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.625275+0000", 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.625276+0000", 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.017e-06 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.625280+0000", 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.34e-06 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.625293+0000", 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2497000000000001e-05 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.625303+0000", 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9860000000000006e-06 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.625363+0000", 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0770999999999998e-05 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.625434+0000", 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0269000000000001e-05 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.625572+0000", 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013848300000000001 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.627405+0000", 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018332139999999999 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.627587+0000", 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018190900000000001 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.627657+0000", 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9368000000000004e-05 2024-04-26T12:39:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.627734+0000", 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7111000000000001e-05 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.5157.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94906308724544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:39:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.630650+0000", 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.19993158799999999, 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021034550000000002, 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.5157", 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/3120368105", 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 53 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.630650+0000", 2024-04-26T12:39:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.630650+0000", 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.630652+0000", 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0079999999999999e-06 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.630656+0000", 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6489999999999999e-06 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.630669+0000", 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2658e-05 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.630679+0000", 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0020999999999999e-05 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.630726+0000", 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6999999999999997e-05 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.630783+0000", 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7127999999999999e-05 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.630885+0000", 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102167 2024-04-26T12:39:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.631622+0000", 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00073691399999999997 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.632639+0000", 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010172709999999999 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.632694+0000", 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.4323000000000001e-05 2024-04-26T12:39:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.632754+0000", 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0316000000000003e-05 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:57.933 INFO:tasks.workunit.client.0.smithi016.stdout:quota enabled for the bucket: buck_2024_03_26_12_39_57 2024-04-26T12:39:57.933 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 10Mb. 2024-04-26T12:39:57.933 INFO:tasks.workunit.client.0.smithi016.stdout:upload file successful 2024-04-26T12:39:57.933 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:39:57.933 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - Test max objects for the given user passed 2024-04-26T12:39:57.933 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:39:57.934 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:39:57.935 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:57.929+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:58.035 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:58.034+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:58.113 INFO:tasks.workunit.client.0.smithi016.stdout:user qa_user deleted 2024-04-26T12:39:58.113 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:39:58.117 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:39:58.118 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:58.132 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:39:58.135 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:58.134+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:58.147 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-04-26T12:39:58.147 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-04-26T12:39:58.147 INFO:tasks.workunit.client.0.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0314339 s, 334 MB/s 2024-04-26T12:39:58.236 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:58.229+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:58.256 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:39:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:39:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:39:58.257 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:58.272 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:39:58.296 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_39_58 2024-04-26T12:39:58.336 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:58.334+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:58.421 INFO:tasks.workunit.client.0.smithi016.stdout:quota set for the bucket: buck_2024_03_26_12_39_58 2024-04-26T12:39:58.437 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:58.438+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:58.447 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:39:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:39:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:39:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 114.05485898400001, 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:39:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:39:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.981403128, 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:39:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.981216363, 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:39:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:39:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.981173876, 2024-04-26T12:39:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:39:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:39:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.899387854, 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:39:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:39:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.89927043500001, 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:39:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:39:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.751409208, 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:39:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:39:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:39:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.751212873, 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:39:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:39:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:39:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.751177266, 2024-04-26T12:39:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:39:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:39:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.75113948400001, 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:39:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.750938725, 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:39:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.750831836, 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:39:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:39:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:39:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.750791769, 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:39:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:39:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:39:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.750596551, 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:39:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.750559474, 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:39:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:39:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.29908202999999, 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:39:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:39:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:39:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 113.298936848, 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:39:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 112.49294209200001, 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:39:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:39:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 112.49286449, 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:39:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:39:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:39:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 112.492574295, 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:39:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:39:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:39:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:39:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:39:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:39:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:39:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:39:58.567 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:58.561+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:58.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:39:58.651 INFO:tasks.workunit.client.0.smithi016.stdout:quota enabled for the bucket: buck_2024_03_26_12_39_58 2024-04-26T12:39:58.651 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 10Mb. 2024-04-26T12:39:58.651 INFO:tasks.workunit.client.0.smithi016.stdout:upload file successful 2024-04-26T12:39:58.664 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-04-26T12:39:58.664 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-04-26T12:39:58.664 INFO:tasks.workunit.client.0.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108356 s, 968 MB/s 2024-04-26T12:39:58.668 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:58.661+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:58.683 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:58.684 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:58.684 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:58.697 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:39:58.720 INFO:tasks.workunit.client.0.smithi016.stdout:readding file to bucket: 10MBfile1 2024-04-26T12:39:58.720 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:39:58.720 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - set max objects and test beyond max objects passed 2024-04-26T12:39:58.720 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:39:58.769 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:58.765+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:58.802 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:39:58.825 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:58.825 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:58.825 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:58.843 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:39:58.869 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:58.865+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:39:58.970 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:39:58.965+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:39:59.002 INFO:tasks.workunit.client.0.smithi016.stdout:user qa_user deleted 2024-04-26T12:39:59.002 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:39:59.007 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:59.007 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.48508013199999, 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:39:59.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:39:59.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889461987968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 100.48168859800001, 2024-04-26T12:39:59.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028001290000000002, 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 61 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524483+0000", 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524485+0000", 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524496+0000", 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0890000000000001e-05 2024-04-26T12:39:59.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524525+0000", 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9047000000000002e-05 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524544+0000", 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.931e-05 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524671+0000", 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012717199999999999 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524894+0000", 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022221299999999999 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.525279+0000", 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038582200000000002 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.526265+0000", 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00098602600000000009 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527073+0000", 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00080779300000000001 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527175+0000", 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010189299999999999 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.527283+0000", 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107793 2024-04-26T12:39:59.018 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.505871541999994, 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.019 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:39:59.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.024 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.486862235999993, 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.025 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:39:59.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:39:59.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.454940539000006, 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:39:59.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.440842497000006, 2024-04-26T12:39:59.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:39:59.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:39:59.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:39:59.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.411118372999994, 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.042 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:39:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:39:59.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.392183435999996, 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:39:59.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:39:59.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:39:59.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.053 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.341273337999993, 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:412 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.340862466000004, 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026892359999999998, 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 412 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665309+0000", 2024-04-26T12:39:59.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665310+0000", 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2309999999999999e-06 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665317+0000", 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.737e-06 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665331+0000", 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4106e-05 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665340+0000", 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6950000000000006e-06 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665437+0000", 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7131000000000002e-05 2024-04-26T12:39:59.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665512+0000", 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5018999999999994e-05 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665675+0000", 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016289399999999999 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.666095+0000", 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042070600000000002 2024-04-26T12:39:59.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667894+0000", 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001798507 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667954+0000", 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0257999999999998e-05 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667998+0000", 2024-04-26T12:39:59.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3952000000000002e-05 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.265278679000005, 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.065 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.146506959999996, 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027547579999999999, 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 686 2024-04-26T12:39:59.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859664+0000", 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859666+0000", 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859676+0000", 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4630000000000007e-06 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859704+0000", 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7983e-05 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859719+0000", 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.859841+0000", 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122043 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860110+0000", 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026891099999999999 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.860523+0000", 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041309799999999998 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.861341+0000", 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081765400000000002 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862357+0000", 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010161530000000001 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862392+0000", 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5024999999999998e-05 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.862419+0000", 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7084999999999999e-05 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:59.076 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.944288799999995, 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:39:59.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:39:59.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:39:59.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:39:59.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.886994371, 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.083 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:39:59.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.701598012999995, 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027606319999999998, 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 889 2024-04-26T12:39:59.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304573+0000", 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304576+0000", 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3999999999999999e-06 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304588+0000", 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442999999999999e-05 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304618+0000", 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9560000000000002e-05 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304632+0000", 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3953e-05 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304743+0000", 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111739 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.304964+0000", 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022031199999999999 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.305316+0000", 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035184799999999998 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.306462+0000", 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011468839999999999 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307178+0000", 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071515700000000001 2024-04-26T12:39:59.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307265+0000", 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7410000000000005e-05 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.307334+0000", 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8925999999999997e-05 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 96.697835425999997, 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:39:59.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T12:39:59.100 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.346974517000007, 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002673173, 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1020 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:59.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659197+0000", 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659200+0000", 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7580000000000001e-06 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659212+0000", 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2096000000000001e-05 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659235+0000", 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3626999999999999e-05 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659246+0000", 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0943e-05 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659381+0000", 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013473900000000001 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659544+0000", 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016267500000000001 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.659716+0000", 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258700000000001 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.660569+0000", 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00085223700000000005 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661768+0000", 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011995770000000001 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661810+0000", 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1866999999999997e-05 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:51.661870+0000", 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0066999999999999e-05 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.1445449679999999, 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.106 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:39:59.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.111 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1332 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.075448+0000", 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.93072309600000003, 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031926900000000002, 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1332 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075448+0000", 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075448+0000", 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075449+0000", 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1200000000000001e-07 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075457+0000", 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7219999999999999e-06 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075470+0000", 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2761e-05 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075483+0000", 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3035e-05 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075534+0000", 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1112999999999997e-05 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075592+0000", 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8329999999999999e-05 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075729+0000", 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013689799999999999 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.077033+0000", 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001303834 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.078585+0000", 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001552108 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.078618+0000", 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2876000000000002e-05 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.078641+0000", 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3101000000000001e-05 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1435 4.1e 4:781f43ba:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.288391+0000", 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.717780117, 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027907079999999998, 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.117 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1435 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.288391+0000", 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.288391+0000", 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.288392+0000", 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8599999999999999e-07 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.288394+0000", 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7089999999999998e-06 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.288400+0000", 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5790000000000003e-06 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.288406+0000", 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0530000000000003e-06 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.289283+0000", 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00087689099999999998 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.289412+0000", 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012879300000000001 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.289530+0000", 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011803699999999999 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.290128+0000", 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059788099999999998 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.291133+0000", 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001005904 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.291161+0000", 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7844e-05 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.291182+0000", 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0630999999999999e-05 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.122 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.123 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.123 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:59.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:39:59.125 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-04-26T12:39:59.125 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-04-26T12:39:59.125 INFO:tasks.workunit.client.0.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0722931 s, 145 MB/s 2024-04-26T12:39:59.125 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:59.122+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:59.225 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:39:59.222+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:39:59.239 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_39_59 2024-04-26T12:39:59.284 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:59.284 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:39:59.284 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:59.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:39:59.345 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:39:59.346+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:39:59.427 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:59.426+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:59.462 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:59.462 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:39:59.462 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:39:59.462 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:39:59.463 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:59.476 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:39:59.522 INFO:tasks.workunit.client.0.smithi016.stdout:bucket quota max_objs set for the given user: buck_2024_03_26_12_39_59 2024-04-26T12:39:59.528 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:39:59.521+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:39:59.556 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:39:59.628 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:39:59.626+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.200397899, 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:39:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:39:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:39:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:39:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.143159715, 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.024017441, 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:39:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 98.133132680000003, 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:39:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:39:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:39:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 98.115009670000006, 2024-04-26T12:39:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:39:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 98.087915054999996, 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:39:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:39:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:39:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:39:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:39:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 98.069108380000003, 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:39:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:39:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:39:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 98.035605036000007, 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:39:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:39:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:39:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 98.005866108000006, 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:39:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 98.000126346000002, 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.956093797999998, 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:39:59.699 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:39:59.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:39:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:39:59.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.704 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.954435376999996, 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.705 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:39:59.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:39:59.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:39:59.709 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.950202941000001, 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.710 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:39:59.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:39:59.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.715 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.663188333999997, 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.716 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:39:59.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:39:59.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:39:59.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:39:59.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.659096114999997, 2024-04-26T12:39:59.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:39:59.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:39:59.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.556863461000006, 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:39:59.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.273915097, 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.733 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:39:59.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.269609125000002, 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.739 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:39:59.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:39:59.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:39:59.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:39:59.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 97.203864765000006, 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029228000000000001, 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.744 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 946 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438766+0000", 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438769+0000", 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3499999999999999e-06 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438781+0000", 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2027e-05 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438812+0000", 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1238999999999997e-05 2024-04-26T12:39:59.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438830+0000", 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7677e-05 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.438969+0000", 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013923200000000001 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439175+0000", 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020586199999999999 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.439538+0000", 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036342699999999999 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.440591+0000", 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010524390000000001 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441533+0000", 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094222499999999999 2024-04-26T12:39:59.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441621+0000", 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8399999999999994e-05 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.441689+0000", 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7922000000000005e-05 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.749 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1566 4.24 4:255757bc:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.4.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:59.222826+0000", 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.41980521399999998, 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0061755179999999996, 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1566 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:39:59.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222826+0000", 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222826+0000", 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222828+0000", 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7710000000000001e-06 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:39:59.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222837+0000", 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2110000000000004e-06 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222858+0000", 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1030999999999999e-05 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222868+0000", 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0181e-05 2024-04-26T12:39:59.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222948+0000", 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0365999999999996e-05 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223070+0000", 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012178100000000001 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:39:59.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223222+0000", 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015142199999999999 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.224032+0000", 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081078300000000003 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.228912+0000", 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048800340000000001 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.228955+0000", 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2826e-05 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.229001+0000", 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6112000000000002e-05 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:39:59.755 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:39:59.756 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:39:59.757 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:39:59.758 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:39:59.758 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:39:59.758 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:39:59.759 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:39:59.759 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:39:59.759 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:39:59.759 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:39:59.760 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:39:59.760 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:39:59.753+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:39:59.764 INFO:tasks.workunit.client.0.smithi016.stdout:quota enabled for the bucket: buck_2024_03_26_12_39_59 2024-04-26T12:39:59.764 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 10Mb. 2024-04-26T12:39:59.764 INFO:tasks.workunit.client.0.smithi016.stdout:upload file successful 2024-04-26T12:39:59.779 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:39:59.779 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:39:59.782 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:39:59.786 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records in 2024-04-26T12:39:59.786 INFO:tasks.workunit.client.0.smithi016.stderr:1+0 records out 2024-04-26T12:39:59.786 INFO:tasks.workunit.client.0.smithi016.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0196937 s, 532 MB/s 2024-04-26T12:39:59.804 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:39:59.804 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:39:59.817 INFO:tasks.workunit.client.0.smithi016.stdout:readding file to bucket: 10MBfile1 2024-04-26T12:39:59.817 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:39:59.818 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - set max objects for a given user and test beyond max objects passed 2024-04-26T12:39:59.818 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:39:59.826 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:39:59.826 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:39:59.846 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:39:59.847 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:39:59.858 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:39:59.858+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:39:59.879 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:39:59.879 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:39:59.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:39:59.959 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:39:59.953+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:00.052 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:00.053 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:00.059 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:00.058+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:00.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:00.111 INFO:tasks.workunit.client.0.smithi016.stdout:user qa_user deleted 2024-04-26T12:40:00.112 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:40:00.160 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:00.158+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:00.226 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:00.226 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:00.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:00.261 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:00.257+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:00.269 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_40_00 2024-04-26T12:40:00.362 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:00.362+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:00.384 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:00.384 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:00.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:00.451 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:00.452 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_26_12_40_00 with max size as zero 2024-04-26T12:40:00.452 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:00.452 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:40:00.463 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:00.457+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:00.564 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:00.557+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:00.564 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:00.565 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:00.580 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:00.601 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_40_00 2024-04-26T12:40:00.665 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:00.666+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:00.716 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:00.717 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:00.733 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:00.774 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:00.774 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_26_12_40_00 with max objects as zero 2024-04-26T12:40:00.774 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:00.774 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:40:00.774 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:00.774+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:00.867 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:00.861+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:00.870 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:00.870 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:00.886 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:00.912 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_40_00 2024-04-26T12:40:00.977 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:00.973+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:01.066 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:01.067 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_26_12_40_00 max objects -1 2024-04-26T12:40:01.067 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:01.067 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:40:01.067 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:01.067 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:01.068 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:01.061+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:01.081 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:01.168 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:01.166+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:01.209 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_40_01 2024-04-26T12:40:01.253 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:01.253 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:01.268 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:01.269 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:01.270+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:01.368 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:01.369 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_26_12_40_01 with max size -1 2024-04-26T12:40:01.369 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:01.369 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:40:01.370 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:01.370+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:01.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:01.471 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:01.465+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:01.547 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:01.589 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:01.585+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:01.674 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:01.669+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:01.712 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:01.712 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:01.726 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:01.775 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:01.774+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:01.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:40:01.865 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:01.875 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:01.869+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:01.893 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:01.893 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:01.907 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:01.997 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:01.993+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:02.009 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:02.009 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:02.027 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:02.027 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:02.043 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:02.044 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:02.062 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:02.062 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:02.072 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:02.072 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:02.077 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:02.073+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:02.082 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:02.083 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:02.086 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:02.103 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:02.103 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:02.124 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:02.124 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:02.143 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:02.144 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:02.177 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:02.178+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:02.251 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 103.774091633, 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014486720999999999, 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.252 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 46 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473652+0000", 2024-04-26T12:40:02.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473655+0000", 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7259999999999998e-06 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473676+0000", 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1747e-05 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473711+0000", 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4382999999999999e-05 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473735+0000", 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4187000000000001e-05 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473918+0000", 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018364799999999999 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:40:02.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.473948+0000", 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9383e-05 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482208+0000", 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0082599700000000002 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482497+0000", 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028868399999999999 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.482835+0000", 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033844799999999998 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487114+0000", 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042791829999999998 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.487905+0000", 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079123099999999999 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488025+0000", 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120052 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488139+0000", 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011307900000000001 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889461982208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:40:02.258 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 103.759099402, 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081940539999999992, 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 47 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488644+0000", 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488647+0000", 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488660+0000", 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3295999999999999e-05 2024-04-26T12:40:02.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488691+0000", 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.057e-05 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488709+0000", 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8706e-05 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.488866+0000", 2024-04-26T12:40:02.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156813 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489087+0000", 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000220258 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.489456+0000", 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036973399999999998 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.493779+0000", 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043225939999999999 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496464+0000", 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026851290000000001 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496627+0000", 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016324199999999999 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:18.496838+0000", 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021085200000000001 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:438 6.a e29/23 6:55b0279d:reshard::reshard.0000000009:head v 29'4, mlcod=29'2)", 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.5619849, 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0037877840000000002, 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.264 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685759+0000", 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685760+0000", 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.513e-06 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685772+0000", 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2235000000000001e-05 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685802+0000", 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9345000000000001e-05 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685817+0000", 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5021999999999999e-05 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.685963+0000", 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014611 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.686028+0000", 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5502999999999999e-05 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689468+0000", 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034397009999999999 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.689546+0000", 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8355000000000005e-05 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.268 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:469 6.a e29/23 6:5127e642:gc::gc.21:head v 29'6, mlcod=29'4)", 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.53855040099999, 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003419212, 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709193+0000", 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709195+0000", 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.72e-06 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709209+0000", 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3818000000000001e-05 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709237+0000", 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8418000000000001e-05 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709253+0000", 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6042e-05 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709396+0000", 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014334100000000001 2024-04-26T12:40:02.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709457+0000", 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0652999999999997e-05 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712539+0000", 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030817959999999999 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712612+0000", 2024-04-26T12:40:02.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3423999999999994e-05 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:470 6.5 e29/23 6:a7f90313:reshard::reshard.0000000012:head v 29'7, mlcod=29'5)", 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.53809821, 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052857390000000002, 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709645+0000", 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709647+0000", 2024-04-26T12:40:02.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.03e-06 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709664+0000", 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6273000000000002e-05 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709695+0000", 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1192999999999998e-05 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709716+0000", 2024-04-26T12:40:02.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1203e-05 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709868+0000", 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000152452 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.709921+0000", 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2819999999999999e-05 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714816+0000", 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048950449999999998 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.714931+0000", 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011472300000000001 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:472 6.3 e29/23 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 29'9, mlcod=29'7)", 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.535738287, 2024-04-26T12:40:02.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056444909999999997, 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712005+0000", 2024-04-26T12:40:02.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712007+0000", 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.395e-06 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712016+0000", 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0899999999999994e-06 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712037+0000", 2024-04-26T12:40:02.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1789000000000001e-05 2024-04-26T12:40:02.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712048+0000", 2024-04-26T12:40:02.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0645999999999999e-05 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712176+0000", 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012788 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.712232+0000", 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6347000000000001e-05 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717535+0000", 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053028550000000004 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.717650+0000", 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011448899999999999 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:706 6.5 e29/23 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 29'8, mlcod=29'6)", 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:40:02.283 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.368876, 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034258100000000001, 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878867+0000", 2024-04-26T12:40:02.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878869+0000", 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.403e-06 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878880+0000", 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.136e-05 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878904+0000", 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3703e-05 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.878917+0000", 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2733e-05 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879061+0000", 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144246 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.879118+0000", 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7073000000000001e-05 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882179+0000", 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030607059999999998 2024-04-26T12:40:02.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:21.882293+0000", 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114586 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:798 6.1 e29/23 6:8411e274:::obj_delete_at_hint.0000000073:head v 29'10, mlcod=29'8)", 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.16012793500001, 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003688242, 2024-04-26T12:40:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087615+0000", 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087617+0000", 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.277e-06 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087625+0000", 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3629999999999994e-06 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087646+0000", 2024-04-26T12:40:02.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0550000000000001e-05 2024-04-26T12:40:02.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087662+0000", 2024-04-26T12:40:02.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6552999999999999e-05 2024-04-26T12:40:02.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087801+0000", 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013851900000000001 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.087836+0000", 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5516999999999999e-05 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091234+0000", 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033975339999999998 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.091304+0000", 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9929000000000001e-05 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:861 6.3 e29/23 6:c0550c60:::obj_delete_at_hint.0000000094:head v 29'17, mlcod=29'15)", 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 100.01133702, 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038566070000000002, 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236406+0000", 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236408+0000", 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.074e-06 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236424+0000", 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5290000000000001e-05 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236460+0000", 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6029999999999999e-05 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236483+0000", 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2708999999999999e-05 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236602+0000", 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000119573 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.236663+0000", 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1118999999999995e-05 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240190+0000", 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035269960000000001 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:22.240263+0000", 2024-04-26T12:40:02.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2816000000000002e-05 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1325 3.34 3:2cf99e10:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 4.4106875160000003, 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020543797999999999, 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.298 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1325 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837059+0000", 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2140000000000001e-06 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843506+0000", 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064467209999999999 2024-04-26T12:40:02.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843561+0000", 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.5291999999999998e-05 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843589+0000", 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8354999999999999e-05 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843720+0000", 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013083999999999999 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843945+0000", 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000224782 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.844155+0000", 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000209743 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857491+0000", 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013336249 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857520+0000", 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8941e-05 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857557+0000", 2024-04-26T12:40:02.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7115e-05 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857600+0000", 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2546000000000002e-05 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1326 3.33 e67/17 3:cd5db5f2:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_2:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:02.304 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.842751+0000", 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 4.4049927870000003, 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014005857, 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.842751+0000", 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.842751+0000", 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.842753+0000", 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6070000000000002e-06 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.847225+0000", 2024-04-26T12:40:02.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004471905 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.847271+0000", 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6050999999999997e-05 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.847290+0000", 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9126e-05 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.847373+0000", 2024-04-26T12:40:02.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3154999999999999e-05 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.847390+0000", 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6439999999999998e-05 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.856710+0000", 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0093197569999999997 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.856756+0000", 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6816e-05 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1412 4.18 4:1a9f2fd3:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.2.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.105116+0000", 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 4.1426275329999998, 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032461619999999999, 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.309 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1412 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.105116+0000", 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.105116+0000", 2024-04-26T12:40:02.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.105117+0000", 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3399999999999999e-07 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.105119+0000", 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.105136+0000", 2024-04-26T12:40:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6271000000000001e-05 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.105144+0000", 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4579999999999993e-06 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.105903+0000", 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000758875 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.106016+0000", 2024-04-26T12:40:02.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011337599999999999 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.106160+0000", 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014363700000000001 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.107121+0000", 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096121900000000003 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.108268+0000", 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011470880000000001 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.108321+0000", 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2624999999999998e-05 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.108362+0000", 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1091999999999999e-05 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.314 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1460 3.36 3:6e35934d:::d749f084-3851-4e95-9492-490675b43f90.4382.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 3.622371717, 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025121213, 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.315 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1460 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625375+0000", 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631320+0000", 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059444809999999997 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631360+0000", 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0398999999999997e-05 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631378+0000", 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8050000000000002e-05 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631551+0000", 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017255800000000001 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631822+0000", 2024-04-26T12:40:02.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027131799999999999 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.632685+0000", 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00086248900000000003 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.649790+0000", 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017105170999999999 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650179+0000", 2024-04-26T12:40:02.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000389284 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650359+0000", 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180061 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650493+0000", 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133876 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.320 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1465 3.36 3:6e35934d:::d749f084-3851-4e95-9492-490675b43f90.4382.3_10Mb.:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.941728+0000", 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 3.306015038, 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005527461, 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1465 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.941728+0000", 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.941728+0000", 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.941731+0000", 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3530000000000002e-06 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.941743+0000", 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1816e-05 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.941774+0000", 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0985999999999998e-05 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.941789+0000", 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5085999999999999e-05 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.941943+0000", 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015440500000000001 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.942197+0000", 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025362200000000001 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.942790+0000", 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00059328799999999998 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.946794+0000", 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040042100000000002 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.947113+0000", 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000318979 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.947189+0000", 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5678000000000003e-05 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.947256+0000", 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7038000000000004e-05 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1546 4.18 4:1bacdae8:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.988271+0000", 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 3.259472712, 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051972320000000004, 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.326 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1546 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988271+0000", 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988271+0000", 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988273+0000", 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7099999999999999e-06 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988284+0000", 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1036000000000001e-05 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988320+0000", 2024-04-26T12:40:02.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5182000000000003e-05 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988340+0000", 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0237e-05 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988496+0000", 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000155711 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988725+0000", 2024-04-26T12:40:02.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022955600000000001 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.989091+0000", 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00036574200000000001 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.991053+0000", 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001961628 2024-04-26T12:40:02.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.993247+0000", 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021943710000000001 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.993363+0000", 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011634 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.993468+0000", 2024-04-26T12:40:02.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000104719 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1547 4.5 4:a19a5d8f:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.988381+0000", 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 3.2593619990000002, 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081283559999999998, 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.332 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1547 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988381+0000", 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988381+0000", 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988383+0000", 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6470000000000001e-06 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988391+0000", 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0560000000000005e-06 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988423+0000", 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1538999999999997e-05 2024-04-26T12:40:02.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988444+0000", 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1036e-05 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988551+0000", 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107774 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988703+0000", 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015103800000000001 2024-04-26T12:40:02.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.988982+0000", 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000279358 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.991001+0000", 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002019323 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.996231+0000", 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052293779999999998 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.996391+0000", 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000160404 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.996510+0000", 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011880299999999999 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1562 4.20 4:0441276f:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.4.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.221475+0000", 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 3.0262682349999999, 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056174670000000001, 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1562 2024-04-26T12:40:02.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221475+0000", 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221475+0000", 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221477+0000", 2024-04-26T12:40:02.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2199999999999999e-06 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221488+0000", 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1090000000000001e-05 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221519+0000", 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0749e-05 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221534+0000", 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4486e-05 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221732+0000", 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019865 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221979+0000", 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024620600000000001 2024-04-26T12:40:02.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.222450+0000", 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047156900000000002 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.225140+0000", 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026900069999999999 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.226852+0000", 2024-04-26T12:40:02.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001711995 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.226985+0000", 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013269599999999999 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.227093+0000", 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107799 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1564 4.e 4:70918bc0:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.4.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.221573+0000", 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 3.0261706209999999, 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0068737449999999997, 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1564 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221573+0000", 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221573+0000", 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221574+0000", 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.17e-06 2024-04-26T12:40:02.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221580+0000", 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9660000000000001e-06 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221607+0000", 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6565999999999999e-05 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221656+0000", 2024-04-26T12:40:02.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9555000000000002e-05 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221834+0000", 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017835099999999999 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.222168+0000", 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033395700000000001 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:02.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.222558+0000", 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038980500000000001 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.227844+0000", 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052854699999999996 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.228176+0000", 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000332827 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.228328+0000", 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015193800000000001 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.228447+0000", 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011814 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1568 4.a 4:5082a5a0:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.4.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.221687+0000", 2024-04-26T12:40:02.349 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 3.0260565150000001, 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054322870000000001, 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1568 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221687+0000", 2024-04-26T12:40:02.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221687+0000", 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221688+0000", 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.35e-06 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221701+0000", 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.307e-05 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221720+0000", 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8749e-05 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221736+0000", 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.556e-05 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.221841+0000", 2024-04-26T12:40:02.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105023 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.222174+0000", 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033372300000000002 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.222558+0000", 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038379499999999998 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.225058+0000", 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024996129999999999 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.226895+0000", 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001836924 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.227014+0000", 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011938 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.227119+0000", 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010509999999999999 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.5355.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114388457264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.614820+0000", 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 2.632923355, 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003817347, 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.355 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.5355", 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/1191346277", 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 45 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.614820+0000", 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.614820+0000", 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.614822+0000", 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.614831+0000", 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0929999999999992e-06 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.614862+0000", 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0605999999999998e-05 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.614886+0000", 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4581999999999999e-05 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.615023+0000", 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013656900000000001 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.615241+0000", 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218323 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.615651+0000", 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040933799999999998 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.617463+0000", 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018124580000000001 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.618258+0000", 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00079515800000000002 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.618409+0000", 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015039900000000001 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.618637+0000", 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022873699999999999 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.360 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:02.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:02.362 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:02.362+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:02.463 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:02.457+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:02.491 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:02.491 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:02.491 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:02.506 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:02.593 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:02.589+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:02.623 INFO:tasks.workunit.client.0.smithi016.stderr:200+0 records in 2024-04-26T12:40:02.623 INFO:tasks.workunit.client.0.smithi016.stderr:200+0 records out 2024-04-26T12:40:02.623 INFO:tasks.workunit.client.0.smithi016.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 1.25307 s, 1.7 GB/s 2024-04-26T12:40:02.664 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:02.661+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:02.671 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:02.672 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:02.672 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:02.672 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:02.672 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:02.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:02.766 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:02.766+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:02.766 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_40_02 2024-04-26T12:40:02.801 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:40:02.862 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.468420775, 2024-04-26T12:40:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:40:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:40:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:40:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:40:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:40:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:40:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:40:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:40:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:40:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:40:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:40:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:40:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.394964919, 2024-04-26T12:40:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:40:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:40:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:40:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:40:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:40:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:40:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:40:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.39477815399999, 2024-04-26T12:40:02.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.882 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:40:02.883 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:40:02.884 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.885 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.886 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:40:02.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:40:02.887 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.887 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.887 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.887 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:40:02.887 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.888 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.39473566700001, 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.889 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.890 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.891 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:40:02.892 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:40:02.893 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:40:02.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.895 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.312949645, 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.896 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:40:02.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:40:02.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:40:02.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:40:02.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.899 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:40:02.899 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:40:02.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.899 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:40:02.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:40:02.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:40:02.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.902 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.902 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:40:02.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.903 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.312832226, 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.904 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:40:02.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:40:02.909 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.164970999, 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.910 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:40:02.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:40:02.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.916 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.16477466400001, 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.917 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:40:02.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:40:02.922 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.16473905700001, 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.923 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:40:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:40:02.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:40:02.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.929 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.164701275, 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:40:02.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:40:02.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.164500516, 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.936 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:40:02.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.164393627, 2024-04-26T12:40:02.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:40:02.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:40:02.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:40:02.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.16435356, 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.948 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.949 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.949 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.949 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.949 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.949 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:40:02.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.949 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:40:02.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:40:02.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:40:02.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.954 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.16415834199999, 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.955 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:02.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:40:02.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:40:02.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:40:02.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:40:02.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:40:02.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.961 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 118.16412126500001, 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.962 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:40:02.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:40:02.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.967 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 117.712643821, 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.968 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:40:02.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:40:02.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.973 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 117.712498639, 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.974 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:40:02.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 116.906503883, 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.980 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:40:02.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:40:02.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 116.90642628099999, 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:40:02.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:40:02.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 116.906136086, 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.992 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:02.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:02.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:40:02.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:40:02.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:40:02.998 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.998 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.998 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.998 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:02.998 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:02.998 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:02.999 INFO:tasks.workunit.client.0.smithi016.stdout:quota set for the bucket: buck_2024_03_26_12_40_02 2024-04-26T12:40:03.000 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:02.993+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:03.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:03.101 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:03.097+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:03.112 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:03.112 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:03.112 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:03.112 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:03.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:03.201 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:03.201+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:03.235 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:03.235 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:03.235 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:03.235 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:03.236 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:03.248 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:03.302 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:03.302+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:03.377 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 104.855914789, 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:40:03.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:40:03.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.876706199, 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:40:03.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:40:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.389 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.857696893, 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:40:03.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.825775196, 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.81167715399999, 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:40:03.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:40:03.406 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.78195303, 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.412 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.763018093, 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.712107995, 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.418 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:40:03.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:40:03.423 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.63611333599999, 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.429 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.315123457, 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:40:03.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.257829028, 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:40:03.435 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:40:03.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:40:03.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:40:03.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.068670083, 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:40:03.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:40:03.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.5153796249999996, 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.447 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:40:03.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:40:03.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:40:03.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1332 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.075448+0000", 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.301557753, 2024-04-26T12:40:03.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031926900000000002, 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1332 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075448+0000", 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075448+0000", 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075449+0000", 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1200000000000001e-07 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075457+0000", 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7219999999999999e-06 2024-04-26T12:40:03.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075470+0000", 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2761e-05 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075483+0000", 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3035e-05 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075534+0000", 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1112999999999997e-05 2024-04-26T12:40:03.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075592+0000", 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8329999999999999e-05 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075729+0000", 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013689799999999999 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.077033+0000", 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001303834 2024-04-26T12:40:03.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.078585+0000", 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001552108 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.078618+0000", 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2876000000000002e-05 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.078641+0000", 2024-04-26T12:40:03.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3101000000000001e-05 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1542 4.1e 4:7acc3488:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989669+0000", 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.3873370339999997, 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038710400000000001, 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.458 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1542 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989669+0000", 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989669+0000", 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989670+0000", 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.266e-06 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989676+0000", 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3159999999999996e-06 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989692+0000", 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6004000000000001e-05 2024-04-26T12:40:03.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989700+0000", 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.541e-06 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989760+0000", 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9886999999999998e-05 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989838+0000", 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8112e-05 2024-04-26T12:40:03.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989942+0000", 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010424 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991610+0000", 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001667513 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.993436+0000", 2024-04-26T12:40:03.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018264170000000001 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.993496+0000", 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9604000000000001e-05 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.993540+0000", 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4140000000000001e-05 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1549 4.30 4:0c7bbd3f:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989767+0000", 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.3872390039999996, 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028875519999999998, 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1549 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989767+0000", 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989767+0000", 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989768+0000", 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6400000000000002e-07 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989771+0000", 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2030000000000001e-06 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989780+0000", 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1009999999999998e-06 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989788+0000", 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8930000000000005e-06 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989860+0000", 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2107000000000006e-05 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989940+0000", 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9858999999999996e-05 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990046+0000", 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0001061 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991103+0000", 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010572660000000001 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.992568+0000", 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001464735 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.992617+0000", 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9469999999999999e-05 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.992655+0000", 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7153999999999997e-05 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1551 4.1e 4:7b025b0c:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.3871984739999998, 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079217860000000001, 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1551 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6800000000000001e-07 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989811+0000", 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.712e-06 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989819+0000", 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9850000000000006e-06 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989826+0000", 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6490000000000008e-06 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990669+0000", 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084284900000000001 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990767+0000", 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7397000000000003e-05 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990891+0000", 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012400200000000001 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991618+0000", 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072717500000000004 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997665+0000", 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060475809999999998 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997696+0000", 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0753999999999997e-05 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997729+0000", 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3213999999999997e-05 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.474 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1552 4.1e 4:781f43ba:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989835+0000", 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.3871708729999996, 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080635410000000005, 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1552 2024-04-26T12:40:03.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989835+0000", 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989835+0000", 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989836+0000", 2024-04-26T12:40:03.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9699999999999996e-07 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989839+0000", 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4570000000000001e-06 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989846+0000", 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989851+0000", 2024-04-26T12:40:03.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2449999999999998e-06 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991169+0000", 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013175800000000001 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991259+0000", 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9920999999999995e-05 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991378+0000", 2024-04-26T12:40:03.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011955000000000001 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991796+0000", 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041727799999999998 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997793+0000", 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059976589999999998 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997853+0000", 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9531000000000003e-05 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997899+0000", 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5787000000000001e-05 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1563 4.3d 4:bf867911:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.4.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:59.222993+0000", 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.1540133079999997, 2024-04-26T12:40:03.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039164300000000003, 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1563 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222993+0000", 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222993+0000", 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222993+0000", 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9100000000000004e-07 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222996+0000", 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2399999999999999e-06 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223004+0000", 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3799999999999996e-06 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223010+0000", 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0889999999999996e-06 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223057+0000", 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7445999999999999e-05 2024-04-26T12:40:03.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223163+0000", 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010581099999999999 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223304+0000", 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014093100000000001 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.224310+0000", 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010061409999999999 2024-04-26T12:40:03.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.226844+0000", 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025337799999999998 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.226885+0000", 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0825000000000003e-05 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.226909+0000", 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4295999999999999e-05 2024-04-26T12:40:03.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.5355.0:64 8.6 8:62ecb7fc:root::.bucket.meta.buck_2024_03_26_12_39_59%3ad749f084-3851-4e95-9492-490675b43f90.4382.4:head [delete,create,call version.check_conds in=18b,call version.set in=10b,writefull 0~406,setxattr user.rgw.acl (147) in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:59.635253+0000", 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 3.7417525669999998, 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003234584, 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.5355", 2024-04-26T12:40:03.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/1191346277", 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 64 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635253+0000", 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635253+0000", 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635254+0000", 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635260+0000", 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635274+0000", 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3977e-05 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635281+0000", 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635333+0000", 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2358000000000003e-05 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635429+0000", 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6057999999999994e-05 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635681+0000", 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025201500000000002 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.636405+0000", 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072403599999999995 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.638386+0000", 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019804359999999999 2024-04-26T12:40:03.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.638446+0000", 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9960999999999997e-05 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.638488+0000", 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2323000000000001e-05 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.491 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.492 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:03.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:03.493 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:03.494+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:03.593 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:03.593+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:03.660 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:03.660 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:03.660 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:03.673 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:03.717 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:03.718+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:03.793 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:03.793 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:03.793 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:03.793 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:03.793 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:03.795 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:03.789+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:03.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:03.896 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:03.894+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:03.982 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 109.537918701, 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:40:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:03.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.480680517, 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.361538243, 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.997 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.470653482, 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:03.998 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:40:03.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.999 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:03.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:03.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:03.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:40:03.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:03.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:03.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.45253047200001, 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.010 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.425435857, 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.406629182, 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:40:04.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:40:04.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:40:04.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.021 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.37312583799999, 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.34338691000001, 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.032 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.337647148, 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:40:04.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:40:04.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:40:04.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:40:04.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:40:04.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.2936146, 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.043 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.291956179, 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:40:04.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.287723743, 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:40:04.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:40:04.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:40:04.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 102.000709136, 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.996616917, 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.060 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:40:04.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:40:04.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:40:04.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.89438426300001, 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.611435899, 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.071 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:40:04.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:40:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:40:04.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 101.607129927, 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:40:04.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:40:04.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.082 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1566 4.24 4:255757bc:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.4.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:59.222826+0000", 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7573260160000004, 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0061755179999999996, 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1566 2024-04-26T12:40:04.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222826+0000", 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222826+0000", 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222828+0000", 2024-04-26T12:40:04.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7710000000000001e-06 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222837+0000", 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2110000000000004e-06 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222858+0000", 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1030999999999999e-05 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222868+0000", 2024-04-26T12:40:04.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0181e-05 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222948+0000", 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0365999999999996e-05 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223070+0000", 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012178100000000001 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223222+0000", 2024-04-26T12:40:04.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015142199999999999 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.224032+0000", 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081078300000000003 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.228912+0000", 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048800340000000001 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.228955+0000", 2024-04-26T12:40:04.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2826e-05 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.229001+0000", 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6112000000000002e-05 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.5580.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:02.824152+0000", 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.1560002300000001, 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029455309999999999, 2024-04-26T12:40:04.088 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.5580", 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/3251089890", 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824152+0000", 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824152+0000", 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824153+0000", 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4759999999999999e-06 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824158+0000", 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8949999999999997e-06 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824167+0000", 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0629999999999995e-06 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824176+0000", 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2560000000000008e-06 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824233+0000", 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7074000000000003e-05 2024-04-26T12:40:04.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824238+0000", 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2919999999999997e-06 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.826990+0000", 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027519889999999998 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.827097+0000", 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010748599999999999 2024-04-26T12:40:04.092 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.093 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.093 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:04.093 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:04.093 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:04.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:04.095 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:04.094+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:04.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:04.194 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:04.189+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:04.260 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:04.260 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:04.261 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:04.275 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:04.296 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:04.289+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:04.313 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:04.313 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:04.331 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:04.331 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:04.348 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:04.349 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:04.365 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:04.366 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:04.386 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:04.389 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:04.389 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:04.396 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:04.394+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:04.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:04.408 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:04.428 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:04.429 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:04.450 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:04.451 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:04.497 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:04.493+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:04.523 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:04.524 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:04.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:04.597 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:04.598+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:04.653 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:04.653 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:04.667 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:04.709 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:04.710+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:04.800 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:04.798+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:04.827 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:40:04.832 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:04.832 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:04.846 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:04.934 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:04.934+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:05.002 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:05.002 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:05.002 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:05.001+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:05.015 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:05.103 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:05.102+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:05.146 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:05.146 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:05.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:05.204 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:05.202+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:05.285 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:05.285 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:05.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:05.305 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:05.306+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:05.406 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:05.401+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:05.421 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:05.421 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:05.435 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:05.507 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:05.506+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:05.599 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:05.600 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:05.608 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:05.601+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:05.613 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:05.709 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:05.710+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:05.778 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:05.779 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:05.793 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:40:05.840 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:05.837+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:05.909 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:05.909 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:05.910 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:05.910+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:05.922 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:06.013 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:06.009+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:06.092 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:06.092 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:06.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:06.113 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:06.114+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:06.214 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:06.214+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:06.268 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:06.269 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:06.281 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:06.329 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:06.325+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:06.399 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:06.399 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:06.414 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:06.415 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:06.409+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:06.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:06.515 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:06.509+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:06.579 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:06.580 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:06.594 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:06.610 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:06.610 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:06.615 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:06.614+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:06.628 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:06.644 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:06.644 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:06.660 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:06.660 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:06.680 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:06.680 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:06.698 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:06.698 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:06.716 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:06.714+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:06.717 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:06.717 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:06.737 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:06.737 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:06.753 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:06.753 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:06.753 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:06.753 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:06.753 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:06.767 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:06.817 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:06.813+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.50029234599999, 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:40:06.893 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.895 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.896 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:40:06.897 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:40:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:40:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:40:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.898 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.899 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:40:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:40:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:40:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:40:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.900 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.901 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.42683649, 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.902 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.903 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.904 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.905 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:40:06.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:40:06.907 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.426649725, 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.908 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.910 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.911 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.912 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.913 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.426607238, 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:40:06.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.916 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.344821216, 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:40:06.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:40:06.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.34470379699999, 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:40:06.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.19684257, 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:40:06.931 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.936 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.196646235, 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.937 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.942 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.196610628, 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:06.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:40:06.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:40:06.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:40:06.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:40:06.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.196572846, 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.948 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.953 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.196372087, 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.19626519800001, 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.959 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:06.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:40:06.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.964 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.19622513100001, 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.965 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:40:06.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:40:06.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:40:06.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:40:06.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.196029913, 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:40:06.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 122.195992836, 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.976 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.981 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 121.744515392, 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.982 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:40:06.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:40:06.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:40:06.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.987 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 121.74437021, 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:40:06.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:06.994 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 120.938375454, 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:40:06.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:40:06.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:40:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:40:06.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 120.93829785200001, 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:40:07.000 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:07.005 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 120.938007657, 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.006 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:40:07.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:40:07.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:40:07.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:07.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:07.011 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:07.012 INFO:tasks.workunit.client.0.smithi016.stdout:quota enabled for the bucket: buck_2024_03_26_12_40_02 2024-04-26T12:40:07.012 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 2Gb. 2024-04-26T12:40:07.012 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:07.012 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - set max size and ensure that objects upload beyond max size is not entertained 2024-04-26T12:40:07.012 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:07.012 INFO:tasks.workunit.client.0.smithi016.stdout:delete objects successful 2024-04-26T12:40:07.013 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:07.009+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:07.014 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:07.113 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:07.113+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:07.145 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:07.145 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:07.145 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:07.145 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:07.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:07.213 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:07.214+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:07.289 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:07.289 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:07.290 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:07.308 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:07.314 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:07.309+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:07.415 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:07.409+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:40:07.479 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 108.95684981300001, 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003247252, 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 60 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521091+0000", 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521095+0000", 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:40:07.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521106+0000", 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1e-05 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521135+0000", 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9487000000000001e-05 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521152+0000", 2024-04-26T12:40:07.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7223000000000001e-05 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521301+0000", 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000148999 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.521655+0000", 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035349399999999999 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.522010+0000", 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000355347 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.523309+0000", 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001299108 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524089+0000", 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078007399999999996 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524234+0000", 2024-04-26T12:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014430199999999999 2024-04-26T12:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.524338+0000", 2024-04-26T12:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104771 2024-04-26T12:40:07.485 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.97764122300001, 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039179699999999998, 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.486 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 206 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500300+0000", 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500304+0000", 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1500000000000001e-06 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500320+0000", 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6107e-05 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500361+0000", 2024-04-26T12:40:07.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500379+0000", 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7723e-05 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500547+0000", 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016841499999999999 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.500935+0000", 2024-04-26T12:40:07.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038826399999999998 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.501663+0000", 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072761400000000002 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503513+0000", 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018502460000000001 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.503974+0000", 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00046130699999999999 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504073+0000", 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9072000000000003e-05 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.504218+0000", 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014431599999999999 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.95863191700001, 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041144620000000002, 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 210 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519309+0000", 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519313+0000", 2024-04-26T12:40:07.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1069999999999998e-06 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519333+0000", 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9470000000000002e-05 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519380+0000", 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7376000000000002e-05 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519407+0000", 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519617+0000", 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021032599999999999 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.519996+0000", 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037854000000000002 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.520784+0000", 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00078841399999999998 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.522531+0000", 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001746926 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523271+0000", 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000739484 2024-04-26T12:40:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523353+0000", 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2029999999999999e-05 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.523424+0000", 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0952999999999996e-05 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.92671022, 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032148989999999998, 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 218 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551231+0000", 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551233+0000", 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.553e-06 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551246+0000", 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3020000000000001e-05 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551278+0000", 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2053e-05 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551293+0000", 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4994000000000001e-05 2024-04-26T12:40:07.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551409+0000", 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011593499999999999 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.551625+0000", 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021531600000000001 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.552059+0000", 2024-04-26T12:40:07.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000434156 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.553464+0000", 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00140518 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554291+0000", 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00082662600000000001 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554378+0000", 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7379999999999993e-05 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554446+0000", 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7686000000000002e-05 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.912612178, 2024-04-26T12:40:07.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036626520000000002, 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 222 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:40:07.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565329+0000", 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565332+0000", 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565343+0000", 2024-04-26T12:40:07.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1313e-05 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565373+0000", 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.025e-05 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565388+0000", 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5322999999999999e-05 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565554+0000", 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581199999999999 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.565906+0000", 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00035195799999999998 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.566654+0000", 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00074828399999999999 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568348+0000", 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016936029999999999 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568726+0000", 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037799099999999999 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568877+0000", 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150755 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.568992+0000", 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114673 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.88288805400001, 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040246750000000001, 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.509 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 230 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595053+0000", 2024-04-26T12:40:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595056+0000", 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.993e-06 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595067+0000", 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1297e-05 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595098+0000", 2024-04-26T12:40:07.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0446e-05 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595115+0000", 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7516999999999998e-05 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595263+0000", 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014759800000000001 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.595637+0000", 2024-04-26T12:40:07.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000373777 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.596436+0000", 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079961400000000003 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598006+0000", 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015696149999999999 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598780+0000", 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00077428100000000004 2024-04-26T12:40:07.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.598963+0000", 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018243799999999999 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.599078+0000", 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115099 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.514 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.86395311699999, 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032991909999999999, 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 235 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613988+0000", 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.613990+0000", 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.283e-06 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614001+0000", 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0793e-05 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614032+0000", 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0843000000000003e-05 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614046+0000", 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4644000000000001e-05 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614200+0000", 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015335199999999999 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614416+0000", 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021592099999999999 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.614831+0000", 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041499100000000003 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.616263+0000", 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001432455 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617126+0000", 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00086323300000000003 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617215+0000", 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8633000000000003e-05 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617287+0000", 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2043000000000001e-05 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:411 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.81304301900001, 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029395290000000002, 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.520 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 411 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664898+0000", 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664899+0000", 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664903+0000", 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.155e-06 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664914+0000", 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1296e-05 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664920+0000", 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4349999999999996e-06 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.664973+0000", 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3131999999999999e-05 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665060+0000", 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7233999999999999e-05 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665236+0000", 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175701 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.665881+0000", 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00064506800000000005 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667772+0000", 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018911620000000001 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667811+0000", 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.667838+0000", 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6543e-05 2024-04-26T12:40:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:523 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.73704836, 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004383067, 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 523 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740893+0000", 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3e-07 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740897+0000", 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9280000000000003e-06 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740910+0000", 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2384999999999999e-05 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740916+0000", 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9070000000000004e-06 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.740970+0000", 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4766999999999999e-05 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741025+0000", 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4456000000000002e-05 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741151+0000", 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012633800000000001 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.741635+0000", 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048369999999999999 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745128+0000", 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034929760000000001 2024-04-26T12:40:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745230+0000", 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010255300000000001 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.745276+0000", 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5327000000000002e-05 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.41605848099999, 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029400279999999999, 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 787 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061883+0000", 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061885+0000", 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8499999999999998e-06 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061898+0000", 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2126e-05 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061929+0000", 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1739999999999998e-05 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.061944+0000", 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5064e-05 2024-04-26T12:40:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062086+0000", 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141478 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062312+0000", 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022585500000000001 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.062631+0000", 2024-04-26T12:40:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000318831 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.063972+0000", 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001341266 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064668+0000", 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069578499999999998 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064755+0000", 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7656000000000002e-05 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.064823+0000", 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7377000000000002e-05 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.358764052, 2024-04-26T12:40:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028561799999999998, 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 811 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119177+0000", 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119179+0000", 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2359999999999999e-06 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119191+0000", 2024-04-26T12:40:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1667e-05 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119222+0000", 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1572000000000002e-05 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119237+0000", 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4209999999999999e-05 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119413+0000", 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017619599999999999 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119637+0000", 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022428500000000001 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.119954+0000", 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000317168 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121069+0000", 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011145110000000001 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121886+0000", 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081691999999999995 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.121971+0000", 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5566e-05 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.122033+0000", 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1848999999999997e-05 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:891 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.169605107, 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029606540000000001, 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.543 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 891 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308336+0000", 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308338+0000", 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.894e-06 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308349+0000", 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.099e-05 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308380+0000", 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.129e-05 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308398+0000", 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7856e-05 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308575+0000", 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017739200000000001 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308716+0000", 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000140865 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.308986+0000", 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026939800000000001 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.310022+0000", 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001036129 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311012+0000", 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00099053599999999998 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311167+0000", 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000154952 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.311297+0000", 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129352 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.6163146489999995, 2024-04-26T12:40:07.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:07.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:40:07.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1332 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.075448+0000", 2024-04-26T12:40:07.554 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.4024927770000009, 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031926900000000002, 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1332 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075448+0000", 2024-04-26T12:40:07.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075448+0000", 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075449+0000", 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1200000000000001e-07 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075457+0000", 2024-04-26T12:40:07.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7219999999999999e-06 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075470+0000", 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2761e-05 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075483+0000", 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3035e-05 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075534+0000", 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1112999999999997e-05 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075592+0000", 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8329999999999999e-05 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.075729+0000", 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013689799999999999 2024-04-26T12:40:07.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.077033+0000", 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001303834 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.078585+0000", 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001552108 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.078618+0000", 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2876000000000002e-05 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.078641+0000", 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3101000000000001e-05 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1542 4.1e 4:7acc3488:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989669+0000", 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.4882720579999997, 2024-04-26T12:40:07.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038710400000000001, 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1542 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989669+0000", 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989669+0000", 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989670+0000", 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.266e-06 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989676+0000", 2024-04-26T12:40:07.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3159999999999996e-06 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989692+0000", 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6004000000000001e-05 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989700+0000", 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.541e-06 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989760+0000", 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9886999999999998e-05 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989838+0000", 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8112e-05 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989942+0000", 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010424 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991610+0000", 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001667513 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.993436+0000", 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018264170000000001 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.993496+0000", 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9604000000000001e-05 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.993540+0000", 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4140000000000001e-05 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1549 4.30 4:0c7bbd3f:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989767+0000", 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.4881740279999995, 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028875519999999998, 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1549 2024-04-26T12:40:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989767+0000", 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989767+0000", 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989768+0000", 2024-04-26T12:40:07.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6400000000000002e-07 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989771+0000", 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2030000000000001e-06 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989780+0000", 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1009999999999998e-06 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989788+0000", 2024-04-26T12:40:07.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8930000000000005e-06 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989860+0000", 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2107000000000006e-05 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989940+0000", 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9858999999999996e-05 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990046+0000", 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0001061 2024-04-26T12:40:07.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991103+0000", 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010572660000000001 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.992568+0000", 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001464735 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.992617+0000", 2024-04-26T12:40:07.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9469999999999999e-05 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.992655+0000", 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7153999999999997e-05 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1551 4.1e 4:7b025b0c:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.4881334979999998, 2024-04-26T12:40:07.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079217860000000001, 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1551 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6800000000000001e-07 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989811+0000", 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.712e-06 2024-04-26T12:40:07.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989819+0000", 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9850000000000006e-06 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989826+0000", 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6490000000000008e-06 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990669+0000", 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084284900000000001 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990767+0000", 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7397000000000003e-05 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990891+0000", 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012400200000000001 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991618+0000", 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072717500000000004 2024-04-26T12:40:07.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997665+0000", 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060475809999999998 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997696+0000", 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0753999999999997e-05 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997729+0000", 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3213999999999997e-05 2024-04-26T12:40:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1552 4.1e 4:781f43ba:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989835+0000", 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.4881058970000005, 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080635410000000005, 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.577 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1552 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989835+0000", 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989835+0000", 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989836+0000", 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9699999999999996e-07 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989839+0000", 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4570000000000001e-06 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989846+0000", 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:40:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989851+0000", 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2449999999999998e-06 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991169+0000", 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013175800000000001 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991259+0000", 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9920999999999995e-05 2024-04-26T12:40:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991378+0000", 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011955000000000001 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991796+0000", 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041727799999999998 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997793+0000", 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059976589999999998 2024-04-26T12:40:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997853+0000", 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9531000000000003e-05 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997899+0000", 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5787000000000001e-05 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1563 4.3d 4:bf867911:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.4.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:59.222993+0000", 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.2549483319999997, 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039164300000000003, 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1563 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222993+0000", 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222993+0000", 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222993+0000", 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9100000000000004e-07 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222996+0000", 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2399999999999999e-06 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223004+0000", 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3799999999999996e-06 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223010+0000", 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0889999999999996e-06 2024-04-26T12:40:07.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223057+0000", 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7445999999999999e-05 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223163+0000", 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010581099999999999 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223304+0000", 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014093100000000001 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.224310+0000", 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010061409999999999 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.226844+0000", 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0025337799999999998 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.226885+0000", 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0825000000000003e-05 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.226909+0000", 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4295999999999999e-05 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.5355.0:64 8.6 8:62ecb7fc:root::.bucket.meta.buck_2024_03_26_12_39_59%3ad749f084-3851-4e95-9492-490675b43f90.4382.4:head [delete,create,call version.check_conds in=18b,call version.set in=10b,writefull 0~406,setxattr user.rgw.acl (147) in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:59.635253+0000", 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 7.8426875909999998, 2024-04-26T12:40:07.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003234584, 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.5355", 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/1191346277", 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 64 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635253+0000", 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635253+0000", 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635254+0000", 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6300000000000004e-07 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635260+0000", 2024-04-26T12:40:07.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2820000000000004e-06 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635274+0000", 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3977e-05 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635281+0000", 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2749999999999998e-06 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:07.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635333+0000", 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2358000000000003e-05 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635429+0000", 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6057999999999994e-05 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.635681+0000", 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025201500000000002 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:07.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.636405+0000", 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072403599999999995 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.638386+0000", 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019804359999999999 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.638446+0000", 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9960999999999997e-05 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:07.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.638488+0000", 2024-04-26T12:40:07.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2323000000000001e-05 2024-04-26T12:40:07.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.594 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:07.594 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:07.594 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:07.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:07.596 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:07.594+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:07.662 INFO:tasks.workunit.client.0.smithi016.stderr:100+0 records in 2024-04-26T12:40:07.663 INFO:tasks.workunit.client.0.smithi016.stderr:100+0 records out 2024-04-26T12:40:07.663 INFO:tasks.workunit.client.0.smithi016.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.668437 s, 1.6 GB/s 2024-04-26T12:40:07.697 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:07.693+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:07.753 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:07.753 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:07.753 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:07.754 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:07.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:07.810 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:07.810+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:07.842 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:40:07.898 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:07.893+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:07.928 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:07.928 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:07.928 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:07.928 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:07.928 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:07.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:07.999 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:07.998+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:08.058 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 113.61482802099999, 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:40:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:40:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:48 7.0 e26/25 7:05bf5b68:::notify.1:head v 26'1, mlcod=0'0)", 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 109.55758983699999, 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042624749999999999, 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499471+0000", 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499472+0000", 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7000000000000003e-07 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499494+0000", 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1727000000000001e-05 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499517+0000", 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.319e-05 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499540+0000", 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2623e-05 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499784+0000", 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000243921 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.499831+0000", 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7373000000000002e-05 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503571+0000", 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0037400319999999999 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.503734+0000", 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016263900000000001 2024-04-26T12:40:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 109.438447563, 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034047270000000002, 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 193 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618614+0000", 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618616+0000", 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3470000000000001e-06 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618628+0000", 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1883e-05 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618661+0000", 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2977e-05 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618679+0000", 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.618838+0000", 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015843199999999999 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619065+0000", 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022681200000000001 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.619320+0000", 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025513400000000001 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.620845+0000", 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001524975 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621855+0000", 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001010606 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.621944+0000", 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8221999999999997e-05 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.622018+0000", 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4735999999999997e-05 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.073 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.547562802, 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055102079999999999, 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 208 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509498+0000", 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509502+0000", 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.41e-06 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509515+0000", 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3023000000000001e-05 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509548+0000", 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3683000000000003e-05 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509571+0000", 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2480000000000002e-05 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.509750+0000", 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017943500000000001 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510135+0000", 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00038450099999999998 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.510968+0000", 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00083334000000000001 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.512795+0000", 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018266389999999999 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514769+0000", 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001973982 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.514887+0000", 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118529 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.515009+0000", 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121186 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.52943979200001, 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039024839999999999, 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.079 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 212 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527621+0000", 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527624+0000", 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527637+0000", 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.307e-05 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527670+0000", 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2373999999999999e-05 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527686+0000", 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6266e-05 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.527831+0000", 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000145322 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528176+0000", 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034439399999999998 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.528883+0000", 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00070732800000000001 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.530509+0000", 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016260339999999999 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531356+0000", 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084751300000000004 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531449+0000", 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2100000000000003e-05 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.531524+0000", 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5313000000000002e-05 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.084 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.502345177, 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0033568270000000002, 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.085 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 219 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554716+0000", 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554719+0000", 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.576e-06 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554732+0000", 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3529999999999999e-05 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554764+0000", 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2150000000000002e-05 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554780+0000", 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6133e-05 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.554930+0000", 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000149896 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555182+0000", 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025157499999999998 2024-04-26T12:40:08.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.555629+0000", 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044676900000000002 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.556971+0000", 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00134216 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.557914+0000", 2024-04-26T12:40:08.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094297599999999999 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558005+0000", 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1249000000000007e-05 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.558073+0000", 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7812999999999996e-05 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.483538502, 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032828969999999999, 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 224 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.091 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573523+0000", 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573525+0000", 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2900000000000001e-06 2024-04-26T12:40:08.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573537+0000", 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1613e-05 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573568+0000", 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1745999999999997e-05 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573584+0000", 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5843000000000001e-05 2024-04-26T12:40:08.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573709+0000", 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012468200000000001 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.573932+0000", 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223196 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.574387+0000", 2024-04-26T12:40:08.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045535900000000002 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.575719+0000", 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00133128 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576645+0000", 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00092583900000000002 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576738+0000", 2024-04-26T12:40:08.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3323000000000001e-05 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.576806+0000", 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7725999999999995e-05 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.45003515800001, 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031517889999999999, 2024-04-26T12:40:08.096 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 233 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607026+0000", 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607028+0000", 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2000000000000001e-06 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607039+0000", 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607070+0000", 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1335999999999999e-05 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607088+0000", 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8168999999999998e-05 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607213+0000", 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000124196 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607429+0000", 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000215952 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.607861+0000", 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043232299999999997 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.609283+0000", 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014221430000000001 2024-04-26T12:40:08.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610017+0000", 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073403400000000005 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610112+0000", 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4612999999999997e-05 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.610178+0000", 2024-04-26T12:40:08.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6025999999999994e-05 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:319 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.42029623000001, 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029746199999999999, 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 319 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636765+0000", 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636766+0000", 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4e-07 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636771+0000", 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2909999999999998e-06 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636786+0000", 2024-04-26T12:40:08.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5006e-05 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636795+0000", 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1039999999999996e-06 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636865+0000", 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0055999999999995e-05 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.636960+0000", 2024-04-26T12:40:08.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4920000000000006e-05 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637144+0000", 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018409200000000001 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.637879+0000", 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00073516900000000004 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639643+0000", 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017631599999999999 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639688+0000", 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5130999999999999e-05 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.639740+0000", 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1851000000000002e-05 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:354 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.414556468, 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030016660000000001, 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 354 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.108 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642505+0000", 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0299999999999998e-07 2024-04-26T12:40:08.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642511+0000", 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0849999999999996e-06 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642522+0000", 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1065e-05 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642528+0000", 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3350000000000003e-06 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642602+0000", 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4480999999999994e-05 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642663+0000", 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0980000000000002e-05 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.642827+0000", 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016357200000000001 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.643483+0000", 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000656406 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645430+0000", 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019462889999999999 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645464+0000", 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3899000000000002e-05 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.645506+0000", 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2750999999999998e-05 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:442 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.113 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.37052392, 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054885530000000002, 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 442 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686537+0000", 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686538+0000", 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5199999999999997e-07 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686542+0000", 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.783e-06 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686548+0000", 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.46e-06 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686553+0000", 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5020000000000003e-06 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686717+0000", 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016486699999999999 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686809+0000", 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2052999999999994e-05 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.686967+0000", 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157453 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.687636+0000", 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00066956100000000005 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691876+0000", 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042394900000000003 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.691963+0000", 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7405999999999996e-05 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692026+0000", 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2426000000000002e-05 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:446 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.36886549899999, 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065235270000000003, 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.119 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 446 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:40:08.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688196+0000", 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7000000000000004e-07 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688200+0000", 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8859999999999997e-06 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688210+0000", 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5929999999999995e-06 2024-04-26T12:40:08.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688215+0000", 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1839999999999998e-06 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688252+0000", 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6943000000000002e-05 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688302+0000", 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9524999999999998e-05 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688414+0000", 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011293700000000001 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.688866+0000", 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045109399999999997 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694637+0000", 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057715989999999997 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694690+0000", 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2834999999999998e-05 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.694719+0000", 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9161000000000001e-05 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:450 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.364633063, 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051062479999999999, 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 450 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692428+0000", 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692429+0000", 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0699999999999996e-07 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692434+0000", 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2469999999999999e-06 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692444+0000", 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3710000000000006e-06 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692449+0000", 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8610000000000003e-06 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692485+0000", 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5729000000000003e-05 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692539+0000", 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3461999999999997e-05 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.692654+0000", 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115742 2024-04-26T12:40:08.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.693104+0000", 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00044942199999999999 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697431+0000", 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043269459999999999 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697490+0000", 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9675e-05 2024-04-26T12:40:08.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.697534+0000", 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3886e-05 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.077618456, 2024-04-26T12:40:08.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031161700000000001, 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 751 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979443+0000", 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979445+0000", 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2539999999999999e-06 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979456+0000", 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0913e-05 2024-04-26T12:40:08.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979485+0000", 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9026e-05 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979500+0000", 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5383000000000002e-05 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979613+0000", 2024-04-26T12:40:08.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112446 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.979840+0000", 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022704499999999999 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.980162+0000", 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00032267100000000001 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.981298+0000", 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354480000000001 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982408+0000", 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011102950000000001 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982493+0000", 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4413000000000006e-05 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.982559+0000", 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6276e-05 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.073526237, 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029515140000000001, 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.136 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 753 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983535+0000", 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983537+0000", 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.86e-06 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983546+0000", 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.217e-06 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983571+0000", 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4528999999999998e-05 2024-04-26T12:40:08.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983587+0000", 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6837000000000002e-05 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983699+0000", 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111499 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.983829+0000", 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129999 2024-04-26T12:40:08.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.984097+0000", 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00026798499999999999 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.985170+0000", 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010732020000000001 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986323+0000", 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011530240000000001 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986421+0000", 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8005999999999996e-05 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.986486+0000", 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5356000000000002e-05 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.141 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.971293583, 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049713450000000003, 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 798 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085768+0000", 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085769+0000", 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085778+0000", 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7099999999999996e-06 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085800+0000", 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1996000000000001e-05 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085812+0000", 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2224e-05 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.085930+0000", 2024-04-26T12:40:08.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117415 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086065+0000", 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135329 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.086338+0000", 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027246200000000001 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.087553+0000", 2024-04-26T12:40:08.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012157699999999999 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090593+0000", 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030395069999999999 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090674+0000", 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1536e-05 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.090739+0000", 2024-04-26T12:40:08.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4548999999999995e-05 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.688345219, 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003307997, 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.147 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 916 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368716+0000", 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368718+0000", 2024-04-26T12:40:08.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3599999999999999e-06 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368730+0000", 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2065999999999999e-05 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368761+0000", 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1123e-05 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368777+0000", 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5642999999999999e-05 2024-04-26T12:40:08.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.368900+0000", 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122459 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369135+0000", 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023543199999999999 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.369495+0000", 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036026999999999999 2024-04-26T12:40:08.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.370622+0000", 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001126665 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371862+0000", 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00124007 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.371950+0000", 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8300000000000005e-05 2024-04-26T12:40:08.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.372024+0000", 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 105.684039247, 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029656470000000001, 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.152 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 918 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373022+0000", 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373024+0000", 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.857e-06 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373036+0000", 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.226e-05 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373062+0000", 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6080000000000001e-05 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373078+0000", 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5492999999999999e-05 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373190+0000", 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112256 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373326+0000", 2024-04-26T12:40:08.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013644199999999999 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.373600+0000", 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027394499999999999 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.374781+0000", 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011803569999999999 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375784+0000", 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010037430000000001 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375870+0000", 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5402000000000007e-05 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.375988+0000", 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117812 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.157 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1566 4.24 4:255757bc:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.4.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:59.222826+0000", 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.8342353360000008, 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0061755179999999996, 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1566 2024-04-26T12:40:08.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222826+0000", 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222826+0000", 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222828+0000", 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7710000000000001e-06 2024-04-26T12:40:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222837+0000", 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2110000000000004e-06 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222858+0000", 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1030999999999999e-05 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222868+0000", 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0181e-05 2024-04-26T12:40:08.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.222948+0000", 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0365999999999996e-05 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223070+0000", 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012178100000000001 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.223222+0000", 2024-04-26T12:40:08.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015142199999999999 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.224032+0000", 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00081078300000000003 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.228912+0000", 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048800340000000001 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.228955+0000", 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2826e-05 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:59.229001+0000", 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6112000000000002e-05 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.5580.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:02.824152+0000", 2024-04-26T12:40:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.2329095499999996, 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029455309999999999, 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.5580", 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/3251089890", 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824152+0000", 2024-04-26T12:40:08.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824152+0000", 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824153+0000", 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4759999999999999e-06 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824158+0000", 2024-04-26T12:40:08.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8949999999999997e-06 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824167+0000", 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0629999999999995e-06 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824176+0000", 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2560000000000008e-06 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824233+0000", 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7074000000000003e-05 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.824238+0000", 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2919999999999997e-06 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.826990+0000", 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027519889999999998 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.827097+0000", 2024-04-26T12:40:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010748599999999999 2024-04-26T12:40:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.168 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.168 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:08.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:08.170 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:08.170+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:08.214 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:40:08.271 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:08.265+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:08.331 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:08.331 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:08.331 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:08.344 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:08.389 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:08.390+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:08.467 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:08.467 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:08.467 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:08.467 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:08.467 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:08.473 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:08.469+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:08.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:08.574 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:08.569+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:08.658 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:08.658 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:40 5.6 5:66d44ff0:::zonegroup_info.6cf2425f-74db-47a8-896e-35ab7b9def6a:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 114.16000778, 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031402079999999998, 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:40:08.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 40 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497957+0000", 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497958+0000", 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.922e-06 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497970+0000", 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.136e-05 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.497995+0000", 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5279999999999999e-05 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498009+0000", 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3872e-05 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498111+0000", 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101927 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498303+0000", 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019180600000000001 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.498553+0000", 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024977300000000001 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.499918+0000", 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001365003 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500885+0000", 2024-04-26T12:40:08.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00096762599999999997 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.500997+0000", 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111742 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.501097+0000", 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9896999999999996e-05 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.664 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 110.15064234499999, 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047946860000000003, 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 52 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507322+0000", 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507325+0000", 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.717e-06 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507336+0000", 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1182999999999999e-05 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507370+0000", 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4230000000000003e-05 2024-04-26T12:40:08.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507388+0000", 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7453e-05 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507508+0000", 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012033599999999999 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507749+0000", 2024-04-26T12:40:08.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024146700000000001 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.507923+0000", 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017378700000000001 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.508980+0000", 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001056707 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.511982+0000", 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030022809999999999 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512050+0000", 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7457000000000001e-05 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:18.512117+0000", 2024-04-26T12:40:08.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7068000000000002e-05 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 107.04047547, 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0036369689999999999, 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 236 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617489+0000", 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617492+0000", 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7630000000000001e-06 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617505+0000", 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.306e-05 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617536+0000", 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1007000000000003e-05 2024-04-26T12:40:08.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617553+0000", 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7629999999999999e-05 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.617719+0000", 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016533800000000001 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618065+0000", 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034657399999999999 2024-04-26T12:40:08.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.618778+0000", 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00071317099999999997 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620613+0000", 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018347260000000001 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.620980+0000", 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00036717100000000001 2024-04-26T12:40:08.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621062+0000", 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1442999999999999e-05 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.621126+0000", 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4085999999999996e-05 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.69812075900001, 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035079099999999999, 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 742 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.677 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959844+0000", 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959846+0000", 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:40:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959860+0000", 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3329999999999999e-05 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959891+0000", 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1576999999999999e-05 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.959906+0000", 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4912999999999999e-05 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960018+0000", 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011209600000000001 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960260+0000", 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024201100000000001 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.960602+0000", 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034149700000000001 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.961961+0000", 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013591230000000001 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963193+0000", 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012322399999999999 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963281+0000", 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8306000000000005e-05 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:21.963352+0000", 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0216999999999995e-05 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.657313401, 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002916901, 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 760 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000651+0000", 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000653+0000", 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000665+0000", 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.187e-05 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000696+0000", 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0607e-05 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000712+0000", 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6192999999999999e-05 2024-04-26T12:40:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.000825+0000", 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113213 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001039+0000", 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021364100000000001 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.001352+0000", 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000313071 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.002433+0000", 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010811779999999999 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003365+0000", 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093210299999999999 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003449+0000", 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3973000000000004e-05 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.003568+0000", 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118542 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.525030758, 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028708179999999998, 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 817 2024-04-26T12:40:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132934+0000", 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132936+0000", 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132949+0000", 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2533e-05 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132980+0000", 2024-04-26T12:40:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1423000000000001e-05 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.132995+0000", 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5e-05 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133125+0000", 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012975899999999999 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133349+0000", 2024-04-26T12:40:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000223842 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.133698+0000", 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034930699999999998 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.134765+0000", 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001066808 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135647+0000", 2024-04-26T12:40:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00088210700000000003 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135735+0000", 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8206000000000002e-05 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.135804+0000", 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9103000000000006e-05 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.521202077, 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028524739999999998, 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 819 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136762+0000", 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136764+0000", 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9759999999999998e-06 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136776+0000", 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.133e-05 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136802+0000", 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6835999999999999e-05 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136822+0000", 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9247000000000001e-05 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.136933+0000", 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110946 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137069+0000", 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013615200000000001 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.137342+0000", 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00027280099999999998 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.138318+0000", 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00097641000000000004 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139458+0000", 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011402669999999999 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139545+0000", 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6948999999999997e-05 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.139615+0000", 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9560000000000005e-05 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.46699341599999, 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031280219999999998, 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 843 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190971+0000", 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190973+0000", 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8199999999999999e-06 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.190982+0000", 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1530000000000003e-06 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191006+0000", 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191018+0000", 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1963999999999999e-05 2024-04-26T12:40:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191149+0000", 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013097200000000001 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191397+0000", 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024733099999999999 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.191899+0000", 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00050217600000000001 2024-04-26T12:40:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193371+0000", 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014719959999999999 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.193942+0000", 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000571475 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194031+0000", 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8696000000000006e-05 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.194099+0000", 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7926e-05 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.45653470000001, 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034761900000000001, 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 847 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201430+0000", 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201432+0000", 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3630000000000001e-06 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201445+0000", 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3016999999999999e-05 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201475+0000", 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9719000000000001e-05 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201490+0000", 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4949999999999999e-05 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.201647+0000", 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156909 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202024+0000", 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00037773100000000002 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.202591+0000", 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000566992 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.203991+0000", 2024-04-26T12:40:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013995290000000001 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204629+0000", 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063768500000000003 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204786+0000", 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015742600000000001 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.204906+0000", 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119869 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.45184879599999, 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034202299999999998, 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 849 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206116+0000", 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206117+0000", 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.68e-06 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206126+0000", 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5900000000000008e-06 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206151+0000", 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4939e-05 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206163+0000", 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2597e-05 2024-04-26T12:40:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206291+0000", 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012768600000000001 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.206539+0000", 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000248061 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.207052+0000", 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051334299999999998 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.208330+0000", 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012775060000000001 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209262+0000", 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00093203999999999997 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209418+0000", 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015631900000000001 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.209536+0000", 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117469 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.311504636, 2024-04-26T12:40:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035106930000000001, 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 907 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346460+0000", 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346462+0000", 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5459999999999998e-06 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346475+0000", 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2764e-05 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346506+0000", 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1266000000000002e-05 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346521+0000", 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4887e-05 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.346676+0000", 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015471800000000001 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347095+0000", 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041862399999999998 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.347690+0000", 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059590499999999998 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349002+0000", 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00131185 2024-04-26T12:40:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349697+0000", 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069428800000000004 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349855+0000", 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015838899999999999 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.349970+0000", 2024-04-26T12:40:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115456 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.307033264, 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003318194, 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 909 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350931+0000", 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350933+0000", 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350942+0000", 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2429999999999994e-06 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350967+0000", 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4239999999999998e-05 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.350981+0000", 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4093e-05 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351122+0000", 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014118299999999999 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351371+0000", 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000249604 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.351883+0000", 2024-04-26T12:40:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00051186600000000004 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.353068+0000", 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011850980000000001 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354094+0000", 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010259290000000001 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354181+0000", 2024-04-26T12:40:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6812999999999997e-05 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.354249+0000", 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8162000000000002e-05 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.212057331, 2024-04-26T12:40:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028482690000000001, 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 949 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445907+0000", 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445910+0000", 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6570000000000001e-06 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445922+0000", 2024-04-26T12:40:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2806000000000001e-05 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445955+0000", 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2036999999999998e-05 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.445970+0000", 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5483000000000001e-05 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446092+0000", 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000121523 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446313+0000", 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022160800000000001 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.446651+0000", 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000338074 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.447983+0000", 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013322029999999999 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448614+0000", 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00063038899999999997 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448695+0000", 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1348999999999997e-05 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.448755+0000", 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0139999999999997e-05 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.208324639, 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003146959, 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 951 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449640+0000", 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449641+0000", 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3230000000000001e-06 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449648+0000", 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1300000000000003e-06 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449669+0000", 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0809999999999999e-05 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449680+0000", 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1416999999999999e-05 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449805+0000", 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012442200000000001 2024-04-26T12:40:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.449942+0000", 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013762299999999999 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.450223+0000", 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028021699999999998 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.451636+0000", 2024-04-26T12:40:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001413573 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452587+0000", 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000950799 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452672+0000", 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4735999999999996e-05 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.452787+0000", 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011490899999999999 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.19787500299999, 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0035247389999999998, 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 955 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460089+0000", 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460092+0000", 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460105+0000", 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3730000000000001e-05 2024-04-26T12:40:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460135+0000", 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9649e-05 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460154+0000", 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8953e-05 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460270+0000", 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011612600000000001 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460494+0000", 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022413199999999999 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.460813+0000", 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031844700000000002 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.462087+0000", 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001273927 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463222+0000", 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011354080000000001 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463434+0000", 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021214500000000001 2024-04-26T12:40:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.463614+0000", 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017984199999999999 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 106.193266016, 2024-04-26T12:40:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002995798, 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 957 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464698+0000", 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464700+0000", 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.844e-06 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464712+0000", 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1763000000000001e-05 2024-04-26T12:40:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464738+0000", 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5829999999999998e-05 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464751+0000", 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3456e-05 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.464895+0000", 2024-04-26T12:40:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143399 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465152+0000", 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025729799999999999 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.465636+0000", 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00048426300000000002 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.466751+0000", 2024-04-26T12:40:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0011144550000000001 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467488+0000", 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000737501 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467576+0000", 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8252999999999997e-05 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:22.467694+0000", 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117736 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4853.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93932591228000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.502709+0000", 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.155255789, 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00300329, 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4853", 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/1452224660", 2024-04-26T12:40:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 51 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.502709+0000", 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.502709+0000", 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.502709+0000", 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6100000000000001e-07 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.502712+0000", 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.954e-06 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.502721+0000", 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.397e-06 2024-04-26T12:40:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.502726+0000", 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6689999999999997e-06 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.502776+0000", 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0046000000000002e-05 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.502861+0000", 2024-04-26T12:40:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4654999999999995e-05 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.503017+0000", 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015646400000000001 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.503571+0000", 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055412500000000004 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.505589+0000", 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020174530000000002 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.505643+0000", 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4030999999999998e-05 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.505712+0000", 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8935000000000003e-05 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4952.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.509511+0000", 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.148453122999999, 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002896647, 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4952", 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/1831512700", 2024-04-26T12:40:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 50 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.509511+0000", 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.509511+0000", 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.509512+0000", 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1800000000000005e-07 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.509517+0000", 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0189999999999997e-06 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.509527+0000", 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0062e-05 2024-04-26T12:40:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.509532+0000", 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.938e-06 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.509573+0000", 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1192999999999997e-05 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.509620+0000", 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7163999999999998e-05 2024-04-26T12:40:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.509696+0000", 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5573000000000003e-05 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.510122+0000", 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042638700000000002 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.512354+0000", 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022314119999999999 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.512382+0000", 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7773e-05 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.512408+0000", 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6308e-05 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1544 4.d 4:b0f5eef4:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.6682535260000009, 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078556990000000007, 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1544 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989713+0000", 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989720+0000", 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1439999999999997e-06 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989735+0000", 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4318000000000001e-05 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989743+0000", 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3520000000000007e-06 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989816+0000", 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2733999999999999e-05 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989896+0000", 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0635000000000003e-05 2024-04-26T12:40:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989995+0000", 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8276999999999994e-05 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990617+0000", 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062210300000000004 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997488+0000", 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068714170000000003 2024-04-26T12:40:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997521+0000", 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3120999999999997e-05 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997567+0000", 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5259000000000002e-05 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.5243.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93870073881056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:02.881985+0000", 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.7759790610000001, 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039059059999999998, 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.5243", 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/2224236219", 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 51 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.881985+0000", 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.881985+0000", 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.881986+0000", 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7199999999999998e-07 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.881989+0000", 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.027e-06 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.881998+0000", 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.882005+0000", 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0090000000000001e-06 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.882042+0000", 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6705999999999997e-05 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.882085+0000", 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3554999999999999e-05 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.882163+0000", 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7163999999999995e-05 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.882585+0000", 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042210899999999999 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.885799+0000", 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032145810000000002 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.885830+0000", 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0756000000000002e-05 2024-04-26T12:40:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:02.885891+0000", 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1142999999999994e-05 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:08.776 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:08.777 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:08.778 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:08.779 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:08.778+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:08.878 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:08.873+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:08.955 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:08.955 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:08.956 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:08.956 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:08.956 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:08.969 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:08.973 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:08.974 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:08.979 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:08.978+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:08.991 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:08.991 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:09.009 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:09.009 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:09.029 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:09.030 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:09.049 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:09.049 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:09.070 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:09.070 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:09.080 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:09.078+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:09.081 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:09.081 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:09.091 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:09.092 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:09.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:09.181 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:09.177+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:09.260 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:09.261 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:09.274 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:09.282 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:09.282+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:09.383 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:09.377+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:09.404 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:09.404 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:09.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:09.505 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:09.501+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:09.583 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:09.584 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:09.584 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:09.582+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:09.597 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:09.684 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:09.682+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:09.769 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:09.769 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:09.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:09.786 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:09.781+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:09.886 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:09.881+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:09.959 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:09.959 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:09.977 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:09.987 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:09.986+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:10.087 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:10.086+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:10.148 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:10.148 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:10.163 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:10.209 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:10.205+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:10.241 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:40:10.289 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:10.285+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:10.290 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:10.290 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:10.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:10.397 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:10.393+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:10.492 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:10.490+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:10.495 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:10.495 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:10.512 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:10.597 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:10.593+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:10.657 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T12:40:10.657 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:40:10.694 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:10.694 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:10.702 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:10.702+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:40:10.714 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:10.805 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:10.801+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:10.896 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:10.894+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:10.906 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:10.907 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:10.921 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:10.997 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:10.998+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:11.099 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:11.093+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:11.099 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:11.099 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:11.109 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:11.121 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:11.199 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:11.198+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:11.281 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:11.281 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:11.301 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:11.297+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:11.303 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:11.303 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:11.306 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:11.306 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:11.324 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:11.324 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:11.326 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:11.343 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:11.344 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:11.367 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:11.391 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:11.391 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:11.411 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:11.412 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:11.417 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:11.413+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:11.435 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:11.435 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:11.501 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:11.497+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 127.119783505, 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:40:11.511 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:40:11.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:40:11.517 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 127.04632764900001, 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010619922, 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.518 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 35 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.461862+0000", 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1699999999999997e-07 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462004+0000", 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014111199999999999 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462018+0000", 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4613999999999999e-05 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462033+0000", 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4919000000000001e-05 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468176+0000", 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061433360000000001 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468297+0000", 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120946 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.468507+0000", 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021000899999999999 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470576+0000", 2024-04-26T12:40:11.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0020686300000000001 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472333+0000", 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017569 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472410+0000", 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7281999999999996e-05 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472482+0000", 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1457000000000004e-05 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 127.046140884, 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011089422, 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.524 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 36 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462048+0000", 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462049+0000", 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7700000000000004e-07 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462056+0000", 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6830000000000002e-06 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462070+0000", 2024-04-26T12:40:11.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3643e-05 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462078+0000", 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5599999999999994e-06 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469528+0000", 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074498000000000003 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469659+0000", 2024-04-26T12:40:11.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013076200000000001 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.469861+0000", 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020236200000000001 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471653+0000", 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017916259999999999 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473006+0000", 2024-04-26T12:40:11.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013529029999999999 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473080+0000", 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4182000000000002e-05 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473138+0000", 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8124000000000001e-05 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.529 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 127.04609839699999, 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011172694, 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.530 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 37 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462091+0000", 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462092+0000", 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462099+0000", 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.396e-06 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462111+0000", 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1727e-05 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.462119+0000", 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0669999999999992e-06 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470816+0000", 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086969630000000003 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.470946+0000", 2024-04-26T12:40:11.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013072499999999999 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.471158+0000", 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021135500000000001 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.472313+0000", 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011549710000000001 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473147+0000", 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00083386699999999996 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473211+0000", 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3983e-05 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.473264+0000", 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.2979999999999998e-05 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.535 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.96431237500001, 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010928795999999999, 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.536 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 87 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543877+0000", 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543878+0000", 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543961+0000", 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3821999999999998e-05 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543973+0000", 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1337e-05 2024-04-26T12:40:11.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543981+0000", 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2360000000000004e-06 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551448+0000", 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074672269999999999 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551575+0000", 2024-04-26T12:40:11.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000127062 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.551782+0000", 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020667799999999999 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553701+0000", 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0019185420000000001 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554661+0000", 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00096039599999999997 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554749+0000", 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8401999999999998e-05 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554806+0000", 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6387000000000001e-05 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.964194956, 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011485094, 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 88 2024-04-26T12:40:11.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543994+0000", 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.543995+0000", 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.23e-07 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544001+0000", 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.857e-06 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544010+0000", 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2329999999999995e-06 2024-04-26T12:40:11.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.544021+0000", 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1029999999999999e-05 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553763+0000", 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097419120000000001 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.553889+0000", 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012570600000000001 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.554094+0000", 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020526799999999999 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555096+0000", 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001001718 2024-04-26T12:40:11.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555355+0000", 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000259268 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555423+0000", 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7916999999999994e-05 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.555479+0000", 2024-04-26T12:40:11.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6462000000000003e-05 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.81633372899999, 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011468305, 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.548 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.549 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.549 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.549 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 109 2024-04-26T12:40:11.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.549 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:11.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.691856+0000", 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4300000000000003e-07 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692014+0000", 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015782200000000001 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692027+0000", 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2594e-05 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692036+0000", 2024-04-26T12:40:11.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9830000000000002e-06 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699456+0000", 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074199799999999996 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699658+0000", 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020209399999999999 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.699934+0000", 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027598199999999997 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702989+0000", 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0030555360000000002 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703029+0000", 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0200000000000001e-05 2024-04-26T12:40:11.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703172+0000", 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014293899999999999 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703324+0000", 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015153200000000001 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.554 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.81613739399999, 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015799924999999999, 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 110 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692052+0000", 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692053+0000", 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5700000000000002e-07 2024-04-26T12:40:11.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692059+0000", 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0270000000000001e-06 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692068+0000", 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5599999999999999e-06 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692076+0000", 2024-04-26T12:40:11.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3529999999999997e-06 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.701881+0000", 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098049409999999993 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702097+0000", 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021659500000000001 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.702291+0000", 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193885 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704604+0000", 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0023130550000000001 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707560+0000", 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029559669999999999 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707737+0000", 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017718200000000001 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707852+0000", 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114603 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.560 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.81610178699999, 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016247807, 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 111 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692088+0000", 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6000000000000003e-07 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692096+0000", 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1289999999999996e-06 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692106+0000", 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8039999999999996e-06 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692114+0000", 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.469e-06 2024-04-26T12:40:11.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703447+0000", 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333077 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703600+0000", 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015320500000000001 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.703813+0000", 2024-04-26T12:40:11.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000213272 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.707985+0000", 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0041715509999999999 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708030+0000", 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5472000000000001e-05 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708220+0000", 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000189483 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708335+0000", 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115685 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:40:11.566 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.816064005, 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016505550000000001, 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 112 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692125+0000", 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692126+0000", 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3e-07 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.568 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692284+0000", 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015837300000000001 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692297+0000", 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2496e-05 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692306+0000", 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8869999999999998e-06 2024-04-26T12:40:11.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704711+0000", 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012405421 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.704951+0000", 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000239378 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.705183+0000", 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023280499999999999 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708358+0000", 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003174835 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708471+0000", 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113053 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708562+0000", 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0854999999999997e-05 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708631+0000", 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8817000000000002e-05 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:40:11.572 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.81586324600001, 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016551581999999999, 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 113 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:40:11.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692326+0000", 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692327+0000", 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2699999999999998e-07 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692333+0000", 2024-04-26T12:40:11.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9959999999999999e-06 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692343+0000", 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6269999999999995e-06 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692350+0000", 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8460000000000008e-06 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706325+0000", 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013974195999999999 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706564+0000", 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023951800000000001 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.706943+0000", 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037907700000000002 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708734+0000", 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0017905429999999999 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708753+0000", 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9327e-05 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708821+0000", 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8229e-05 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708878+0000", 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6396e-05 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.815756357, 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:40:11.578 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:40:11.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:40:11.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.81571629, 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:40:11.584 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:40:11.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:40:11.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:40:11.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.815521072, 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.590 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:11.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:40:11.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:40:11.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.81548399499999, 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.596 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:40:11.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:40:11.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:40:11.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.364006551, 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010820734, 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 140 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144183+0000", 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8599999999999998e-07 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144269+0000", 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5902999999999994e-05 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144292+0000", 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2983e-05 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144304+0000", 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1477e-05 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151793+0000", 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0074894269999999999 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151864+0000", 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0927999999999996e-05 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.151942+0000", 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8139999999999994e-05 2024-04-26T12:40:11.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153191+0000", 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012488270000000001 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154867+0000", 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001675532 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.154955+0000", 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8075e-05 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.155004+0000", 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8755999999999999e-05 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:40:11.607 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 126.36386136900001, 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173383, 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 141 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144328+0000", 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144329+0000", 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144335+0000", 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2600000000000002e-06 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144350+0000", 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5305999999999999e-05 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.144359+0000", 2024-04-26T12:40:11.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1840000000000005e-06 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152353+0000", 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079935030000000008 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152439+0000", 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6217999999999993e-05 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.152548+0000", 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109152 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.153580+0000", 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010312030000000001 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157438+0000", 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038582859999999998 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157475+0000", 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7147999999999997e-05 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.157501+0000", 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6380000000000002e-05 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.613 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 125.557866613, 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010151848, 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 157 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950323+0000", 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950324+0000", 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1799999999999999e-06 2024-04-26T12:40:11.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950340+0000", 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6345999999999999e-05 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950360+0000", 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.982e-05 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950375+0000", 2024-04-26T12:40:11.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4742999999999999e-05 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956651+0000", 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062761450000000003 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.956785+0000", 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013372199999999999 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957011+0000", 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022597200000000001 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960111+0000", 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031003490000000001 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960301+0000", 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000190469 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960411+0000", 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010904900000000001 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960475+0000", 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4053000000000005e-05 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.619 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 125.557789011, 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011440852, 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 158 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:40:11.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950400+0000", 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950401+0000", 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.097e-06 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950601+0000", 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000199855 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950647+0000", 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5473000000000003e-05 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950663+0000", 2024-04-26T12:40:11.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6633000000000002e-05 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.957822+0000", 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071582579999999998 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958040+0000", 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218402 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.958410+0000", 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037031800000000001 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960258+0000", 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0018474050000000001 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961572+0000", 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013140999999999999 2024-04-26T12:40:11.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961742+0000", 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170199 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.961841+0000", 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9111999999999996e-05 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.625 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 125.55749881600001, 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013045101999999999, 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:11.626 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 159 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950691+0000", 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:11.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950692+0000", 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9099999999999999e-06 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950703+0000", 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1039999999999999e-05 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950723+0000", 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.950739+0000", 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5387e-05 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960529+0000", 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097900739999999993 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960657+0000", 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128689 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.960853+0000", 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000195126 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.962273+0000", 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001420272 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963597+0000", 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001324443 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963678+0000", 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1116000000000001e-05 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:05.963736+0000", 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7206000000000001e-05 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:11.631 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:11.633 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:11.629+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:11.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:11.717 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:40:11.733 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:11.729+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:11.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:40:11.793 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:11.794 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:11.794 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:11.794 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:11.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:11.865 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:11.866+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:11.935 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:11.929+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:12.013 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:12.014 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:12.014 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:12.014 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:12.014 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:12.030 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:12.077 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:12.078+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:12.137 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:12.134+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:12.176 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:12.176 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:12.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:12.176 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:12.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.176 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:12.176 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.313323068000001, 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:40:12.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:40:12.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:12.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.182 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1551 4.1e 4:7b025b0c:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.185141916999999, 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079217860000000001, 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.183 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1551 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989808+0000", 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6800000000000001e-07 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989811+0000", 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.712e-06 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989819+0000", 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9850000000000006e-06 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989826+0000", 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6490000000000008e-06 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990669+0000", 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00084284900000000001 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990767+0000", 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7397000000000003e-05 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990891+0000", 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012400200000000001 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991618+0000", 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072717500000000004 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997665+0000", 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060475809999999998 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997696+0000", 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0753999999999997e-05 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997729+0000", 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3213999999999997e-05 2024-04-26T12:40:12.188 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1552 4.1e 4:781f43ba:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989835+0000", 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.185114316, 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080635410000000005, 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1552 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989835+0000", 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989835+0000", 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989836+0000", 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9699999999999996e-07 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989839+0000", 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4570000000000001e-06 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989846+0000", 2024-04-26T12:40:12.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0360000000000001e-06 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989851+0000", 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2449999999999998e-06 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991169+0000", 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013175800000000001 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991259+0000", 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9920999999999995e-05 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991378+0000", 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011955000000000001 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.991796+0000", 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00041727799999999998 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997793+0000", 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059976589999999998 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997853+0000", 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9531000000000003e-05 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997899+0000", 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5787000000000001e-05 2024-04-26T12:40:12.194 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2317 3.3 3:c029eb24:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.358005+0000", 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.81694441699999998, 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014127485, 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.195 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2317 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.358005+0000", 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.358005+0000", 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.358008+0000", 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.359971+0000", 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019633250000000001 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.359999+0000", 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8268000000000001e-05 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360013+0000", 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3733e-05 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360085+0000", 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1674000000000005e-05 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360215+0000", 2024-04-26T12:40:12.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013083499999999999 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360338+0000", 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122736 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.365479+0000", 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051403209999999998 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.372017+0000", 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065385319999999997 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.372084+0000", 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7371000000000003e-05 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.372133+0000", 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8090000000000002e-05 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2327 3.6 3:6033344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.459239+0000", 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.71571087499999997, 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094603900000000008, 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2327 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.201 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459239+0000", 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459239+0000", 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459241+0000", 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.04e-06 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.460737+0000", 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001496334 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.460760+0000", 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3391999999999999e-05 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.460773+0000", 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2938999999999999e-05 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.460847+0000", 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3286000000000003e-05 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.460986+0000", 2024-04-26T12:40:12.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013914099999999999 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.461101+0000", 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011564400000000001 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.468156+0000", 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0070550609999999996 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.468585+0000", 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00042844200000000002 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.468649+0000", 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4496e-05 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.468699+0000", 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9614999999999998e-05 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.206 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2333 3.12 3:49fff330:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.65559631100000004, 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014903046, 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.207 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2333 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519355+0000", 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1739999999999999e-06 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520939+0000", 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015836960000000001 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520971+0000", 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1930000000000001e-05 2024-04-26T12:40:12.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520986+0000", 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5420000000000001e-05 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521057+0000", 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0825e-05 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521178+0000", 2024-04-26T12:40:12.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120316 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521332+0000", 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015460800000000001 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.526796+0000", 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054637089999999998 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534174+0000", 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073778660000000003 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534216+0000", 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1869000000000002e-05 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534256+0000", 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0633000000000002e-05 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2336 3.10 e72/17 3:0adc5509:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_145:head v 72'5, mlcod=71'3)", 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.552471+0000", 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.62247811200000003, 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094054989999999995, 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.552471+0000", 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.552471+0000", 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.552473+0000", 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9190000000000002e-06 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.556651+0000", 2024-04-26T12:40:12.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041779 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.556675+0000", 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3890999999999999e-05 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.556685+0000", 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9089999999999995e-06 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.556754+0000", 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.868e-05 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.556773+0000", 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9839000000000001e-05 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.561831+0000", 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050577390000000003 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.561877+0000", 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5621999999999998e-05 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2337 3.1b 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.61651551100000002, 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018047987000000001, 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.217 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2337 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558438+0000", 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6239999999999999e-06 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559867+0000", 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014292490000000001 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559886+0000", 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8697000000000001e-05 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559898+0000", 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2542e-05 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559976+0000", 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7610999999999999e-05 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560136+0000", 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160443 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560298+0000", 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016194899999999999 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.566613+0000", 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063145279999999998 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576388+0000", 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097756340000000001 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576434+0000", 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6020000000000003e-05 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576482+0000", 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7689999999999999e-05 2024-04-26T12:40:12.222 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2339 3.32 3:4d9e1576:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.583264+0000", 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.59168590899999995, 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010204243999999999, 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.223 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2339 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.583264+0000", 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.583264+0000", 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.583265+0000", 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8700000000000001e-06 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.584937+0000", 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016719619999999999 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.584972+0000", 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4786000000000002e-05 2024-04-26T12:40:12.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.584990+0000", 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7983e-05 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.585073+0000", 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2861999999999994e-05 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.585225+0000", 2024-04-26T12:40:12.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015177800000000001 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.585328+0000", 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010282500000000001 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593356+0000", 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080280070000000002 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593365+0000", 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1989999999999995e-06 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593402+0000", 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6910999999999999e-05 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593468+0000", 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6061000000000003e-05 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2342 3.12 3:4a564d9a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.55434305100000003, 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020986402000000001, 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2342 2024-04-26T12:40:12.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620609+0000", 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622196+0000", 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587045 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622224+0000", 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8028e-05 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622234+0000", 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0577999999999999e-05 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622319+0000", 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4296999999999996e-05 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622520+0000", 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201571 2024-04-26T12:40:12.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622753+0000", 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000232501 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.629187+0000", 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064345679999999999 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641429+0000", 2024-04-26T12:40:12.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012241573 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641522+0000", 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3239999999999995e-05 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641593+0000", 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0683000000000001e-05 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2344 3.3 3:c3214891:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.52673766600000005, 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017793122000000001, 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2344 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.235 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648214+0000", 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:40:12.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649908+0000", 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693069 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649940+0000", 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1974999999999998e-05 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649956+0000", 2024-04-26T12:40:12.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6429000000000001e-05 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650027+0000", 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1346000000000004e-05 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650146+0000", 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118581 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650277+0000", 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013136300000000001 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.654910+0000", 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046332300000000003 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665861+0000", 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01095054 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665942+0000", 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0782e-05 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.666005+0000", 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3146999999999997e-05 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2346 3.10 e72/17 3:093f8fa5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_155:head v 72'6, mlcod=71'4)", 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.677209+0000", 2024-04-26T12:40:12.240 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.49774026300000002, 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010565477, 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.677209+0000", 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.677209+0000", 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.677211+0000", 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9539999999999998e-06 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682070+0000", 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048585859999999998 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682099+0000", 2024-04-26T12:40:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9065999999999999e-05 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682110+0000", 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1409999999999999e-05 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682193+0000", 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2670999999999995e-05 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682218+0000", 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5601000000000001e-05 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.687717+0000", 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054984739999999997 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.687775+0000", 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7714999999999999e-05 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.244 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2350 3.12 3:494cd927:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.46117013899999998, 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019319528999999998, 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2350 2024-04-26T12:40:12.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713782+0000", 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0759999999999999e-06 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714797+0000", 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010147159999999999 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714824+0000", 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.658e-05 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714838+0000", 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4609e-05 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714950+0000", 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112185 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715172+0000", 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022140199999999999 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715311+0000", 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000138639 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.721604+0000", 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062931289999999997 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.732954+0000", 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011350314 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733038+0000", 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4445999999999998e-05 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733099+0000", 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0433000000000002e-05 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.250 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2353 3.2b 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.427868676, 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029788120000000001, 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2353 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747083+0000", 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748701+0000", 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016182550000000001 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748730+0000", 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8809000000000001e-05 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748741+0000", 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0949e-05 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748822+0000", 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0777000000000003e-05 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748827+0000", 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752276+0000", 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034484350000000001 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752425+0000", 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014880699999999999 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752572+0000", 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014723899999999999 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.757807+0000", 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052354319999999999 2024-04-26T12:40:12.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776737+0000", 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018929437 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776811+0000", 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4651000000000001e-05 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776869+0000", 2024-04-26T12:40:12.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7541999999999999e-05 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2364 3.3a e73/41 3:5f88866d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_173:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.873757+0000", 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.30119221600000001, 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078560569999999996, 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.257 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.873757+0000", 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.873757+0000", 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.873758+0000", 2024-04-26T12:40:12.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8999999999999998e-07 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.876825+0000", 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030673100000000002 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.876848+0000", 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3281e-05 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.876861+0000", 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3006e-05 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.876944+0000", 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2552000000000005e-05 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.876970+0000", 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5839000000000001e-05 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881553+0000", 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045831639999999998 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881613+0000", 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0615000000000002e-05 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2365 3.10 e73/17 3:0b48e491:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_174:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.880494+0000", 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.29445549599999998, 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0090756559999999997, 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.880494+0000", 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.880494+0000", 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.880494+0000", 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.53e-07 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.884845+0000", 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043511440000000004 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.884874+0000", 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8269e-05 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.884887+0000", 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3521e-05 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.884956+0000", 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8397000000000003e-05 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.884974+0000", 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8825e-05 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889508+0000", 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045334520000000003 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889570+0000", 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1694999999999998e-05 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2369 3.12 3:4bcc53b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.25538465799999999, 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014928745, 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.266 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2369 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919568+0000", 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0110000000000001e-06 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921453+0000", 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018855079999999999 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921476+0000", 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2705e-05 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921490+0000", 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4049999999999999e-05 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921560+0000", 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9580999999999997e-05 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921710+0000", 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150261 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921810+0000", 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100351 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.926466+0000", 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046561160000000001 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934371+0000", 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079049830000000008 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934442+0000", 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0607999999999999e-05 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934494+0000", 2024-04-26T12:40:12.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1570999999999998e-05 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2371 3.12 3:4aa38e60:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.234771385, 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016346532, 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.272 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2371 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940181+0000", 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941785+0000", 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016038700000000001 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941813+0000", 2024-04-26T12:40:12.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827e-05 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941828+0000", 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5545000000000001e-05 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941914+0000", 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5353999999999996e-05 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942093+0000", 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000179004 2024-04-26T12:40:12.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942264+0000", 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017166999999999999 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.946973+0000", 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047087179999999998 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956399+0000", 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094257760000000003 2024-04-26T12:40:12.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956471+0000", 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1740000000000001e-05 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956525+0000", 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4097000000000001e-05 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.277 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2377 3.10 e73/17 3:0bb0443e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_186:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.006303+0000", 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.168646244, 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094134990000000005, 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.006303+0000", 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.006303+0000", 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.006309+0000", 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7749999999999998e-06 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.010588+0000", 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042790270000000004 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.010608+0000", 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9624e-05 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.010619+0000", 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.181e-05 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.010698+0000", 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8213000000000005e-05 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.010718+0000", 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0818e-05 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.015658+0000", 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049398180000000003 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.015717+0000", 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8414e-05 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2383 3.3a e73/41 3:5e222c71:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_192:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.066188+0000", 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.108761947, 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0095063089999999992, 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.066188+0000", 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.066188+0000", 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.066189+0000", 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.632e-06 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.068089+0000", 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019002380000000001 2024-04-26T12:40:12.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.068120+0000", 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0182e-05 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.068135+0000", 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5509e-05 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.068245+0000", 2024-04-26T12:40:12.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011033500000000001 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.068293+0000", 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7923999999999997e-05 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075640+0000", 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073467660000000002 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075694+0000", 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3723e-05 2024-04-26T12:40:12.285 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.286 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.286 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.286 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.286 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.286 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:12.287 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:12.288 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:12.286+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:12.388 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:12.386+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:12.489 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:12.490+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:12.490 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:12.490 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:12.490 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:12.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:12.590 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:12.585+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:12.686 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:12.686 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:12.686 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:12.686 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:12.686 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:12.691 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:12.685+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:12.698 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:12.723 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:40:12.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:40:12.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:40:12.758 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 1Gb. 2024-04-26T12:40:12.758 INFO:tasks.workunit.client.0.smithi016.stdout:upload file successful 2024-04-26T12:40:12.758 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:12.758 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - set max size and ensure that the max size is in effect 2024-04-26T12:40:12.758 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:12.805 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:12.806+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 118.38529749200001, 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:40:12.828 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:12.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:40:12.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2319 3.1a 3:58f869a1:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.448580126, 2024-04-26T12:40:12.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013146055, 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2319 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:12.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378953+0000", 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.041e-06 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380420+0000", 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001467138 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380454+0000", 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4236999999999998e-05 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380470+0000", 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6578999999999998e-05 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380544+0000", 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3616999999999997e-05 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380697+0000", 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015309199999999999 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380801+0000", 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103513 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.385130+0000", 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00432906 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391960+0000", 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068303560000000001 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392034+0000", 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4119e-05 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392097+0000", 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2303000000000003e-05 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2326 3.0 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.3778230040000001, 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099133869999999992, 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.839 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2326 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449711+0000", 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5080000000000001e-06 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451146+0000", 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014349720000000001 2024-04-26T12:40:12.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451183+0000", 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6671999999999997e-05 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451199+0000", 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6257999999999999e-05 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451290+0000", 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0728000000000003e-05 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451468+0000", 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017821300000000001 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451632+0000", 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.458789+0000", 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071576060000000004 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459479+0000", 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069001700000000002 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459560+0000", 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0115000000000001e-05 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459621+0000", 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1408000000000006e-05 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2345 3.19 3:99eb3a17:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.1679609790000001, 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010166799000000001, 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.845 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2345 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659573+0000", 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6990000000000001e-06 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661691+0000", 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021175959999999998 2024-04-26T12:40:12.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661711+0000", 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0128000000000001e-05 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661724+0000", 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2906e-05 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661800+0000", 2024-04-26T12:40:12.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6505e-05 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661985+0000", 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018474600000000001 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.662135+0000", 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014955599999999999 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.668376+0000", 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062408280000000003 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669587+0000", 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012110739999999999 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669672+0000", 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5241999999999995e-05 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669736+0000", 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4518999999999997e-05 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.0921712180000001, 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.851 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:12.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:40:12.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.856 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.0159149510000001, 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:40:12.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.862 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.004190583, 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2362 3.19 3:98a41993:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.98333192800000002, 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0096554659999999997, 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.868 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2362 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:12.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844202+0000", 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0340000000000001e-06 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845840+0000", 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00163839 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845872+0000", 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1523999999999998e-05 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845888+0000", 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6208000000000001e-05 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845978+0000", 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9909999999999998e-05 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846168+0000", 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019002999999999999 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846343+0000", 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175071 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853321+0000", 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006978616 2024-04-26T12:40:12.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853780+0000", 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045818500000000001 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853821+0000", 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1248999999999998e-05 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853854+0000", 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3249e-05 2024-04-26T12:40:12.873 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2366 3.0 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.93954807399999996, 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013182772000000001, 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.874 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2366 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887986+0000", 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3469999999999999e-06 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889575+0000", 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00158928 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889602+0000", 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6840999999999999e-05 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889617+0000", 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4667e-05 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889721+0000", 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104255 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889920+0000", 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019873199999999999 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.890088+0000", 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016799 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895734+0000", 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056464139999999998 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901046+0000", 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053117019999999997 2024-04-26T12:40:12.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901114+0000", 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8232999999999995e-05 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901165+0000", 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1310999999999997e-05 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.74398215999999995, 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:40:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:40:12.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:40:12.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2386 3.19 3:9a588031:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.73276268899999997, 2024-04-26T12:40:12.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010161018000000001, 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2386 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094770+0000", 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3920000000000001e-06 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095718+0000", 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094744999999999996 2024-04-26T12:40:12.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095744+0000", 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6038999999999999e-05 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095757+0000", 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3451999999999999e-05 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095843+0000", 2024-04-26T12:40:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5877000000000005e-05 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095962+0000", 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011846899999999999 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.096054+0000", 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1963e-05 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104575+0000", 2024-04-26T12:40:12.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0085213179999999999 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104801+0000", 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022650599999999999 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104872+0000", 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0412000000000003e-05 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104929+0000", 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7139999999999998e-05 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2391 3.31 3:8f508897:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.67496369300000003, 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016948310000000001, 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.891 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2391 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:12.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152570+0000", 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154503+0000", 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001933234 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154536+0000", 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3321000000000002e-05 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154553+0000", 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6288000000000001e-05 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154639+0000", 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6236000000000006e-05 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154820+0000", 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181306 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154983+0000", 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162929 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.160656+0000", 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056726550000000004 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169397+0000", 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087409170000000008 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169465+0000", 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8730000000000001e-05 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169515+0000", 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9795e-05 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.896 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2393 3.0 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.65145143699999997, 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010859486999999999, 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2393 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176082+0000", 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3970000000000001e-06 2024-04-26T12:40:12.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178323+0000", 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002241818 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178348+0000", 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4335e-05 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178359+0000", 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1092e-05 2024-04-26T12:40:12.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178440+0000", 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0745e-05 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178581+0000", 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014098100000000001 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:12.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178682+0000", 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010178099999999999 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.184116+0000", 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054341090000000003 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186805+0000", 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026890529999999998 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186884+0000", 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8336000000000004e-05 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186939+0000", 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4839999999999997e-05 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.902 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.61533892000000001, 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:12.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:40:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2397 3.19 3:9b8be67a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.908 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.60615070500000001, 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00976898, 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2397 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221382+0000", 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.73e-06 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222800+0000", 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001418802 2024-04-26T12:40:12.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222828+0000", 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7790999999999999e-05 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222839+0000", 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0428000000000001e-05 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222926+0000", 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7541999999999996e-05 2024-04-26T12:40:12.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223135+0000", 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020900399999999999 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223316+0000", 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018074899999999999 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230660+0000", 2024-04-26T12:40:12.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073436259999999998 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231093+0000", 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043387800000000001 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231124+0000", 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939999999999999e-05 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231149+0000", 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4490000000000001e-05 2024-04-26T12:40:12.913 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.45803660299999999, 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.914 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:40:12.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2417 3.8 e73/17 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head v 73'4, mlcod=71'2)", 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.38524441199999998, 2024-04-26T12:40:12.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099003479999999998, 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442289+0000", 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4389999999999999e-06 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444260+0000", 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019712509999999998 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444281+0000", 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1512999999999999e-05 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444294+0000", 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2206e-05 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444378+0000", 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4658000000000002e-05 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444409+0000", 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1086e-05 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451996+0000", 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007586392 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452187+0000", 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000190803 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2418 3.25 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.37642754699999997, 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010790129000000001, 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2418 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451105+0000", 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.351e-06 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453261+0000", 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021551169999999998 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453277+0000", 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6935e-05 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453299+0000", 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1701000000000001e-05 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453368+0000", 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8591999999999997e-05 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453517+0000", 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014963699999999999 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453638+0000", 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120289 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461242+0000", 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0076041479999999998 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461821+0000", 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057901100000000004 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461860+0000", 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9498e-05 2024-04-26T12:40:12.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461893+0000", 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2849999999999999e-05 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.27463322200000001, 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:40:12.929 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:40:12.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:40:12.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.244321394, 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:40:12.935 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.940 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.941 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:12.941 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:12.941 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:12.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:12.943 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:12.937+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:13.043 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:13.037+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:13.043 INFO:tasks.workunit.client.0.smithi016.stdout:user qa_user deleted 2024-04-26T12:40:13.044 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:40:13.101 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:13.101 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:13.102 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:13.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:13.144 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:13.137+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:13.225 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:13.225 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:13.225 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:13.225 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:13.225 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:13.238 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:13.244 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:13.241+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:13.345 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:13.345+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1544 4.d 4:b0f5eef4:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.370720651999999, 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078556990000000007, 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.361 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1544 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989713+0000", 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989720+0000", 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1439999999999997e-06 2024-04-26T12:40:13.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989735+0000", 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4318000000000001e-05 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989743+0000", 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3520000000000007e-06 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989816+0000", 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2733999999999999e-05 2024-04-26T12:40:13.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989896+0000", 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0635000000000003e-05 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989995+0000", 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8276999999999994e-05 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990617+0000", 2024-04-26T12:40:13.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062210300000000004 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997488+0000", 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068714170000000003 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997521+0000", 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3120999999999997e-05 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997567+0000", 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5259000000000002e-05 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2323 3.3a 3:5f8d6128:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.9421908060000002, 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0089459429999999996, 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:13.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2323 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418243+0000", 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419683+0000", 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014398810000000001 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419708+0000", 2024-04-26T12:40:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4734000000000001e-05 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419718+0000", 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9450000000000005e-06 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419801+0000", 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3323000000000002e-05 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419969+0000", 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168064 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.420113+0000", 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014409000000000001 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.426671+0000", 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065582080000000003 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:13.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427066+0000", 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039501800000000002 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427130+0000", 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3206000000000004e-05 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427187+0000", 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6932999999999999e-05 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2326 3.0 e72/17 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head v 72'6, mlcod=72'4)", 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.9086861939999999, 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074245839999999997, 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:13.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451747+0000", 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.663e-06 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453207+0000", 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014601410000000001 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453232+0000", 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5372e-05 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453244+0000", 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1790999999999999e-05 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453323+0000", 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9140999999999993e-05 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453347+0000", 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3910999999999999e-05 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459105+0000", 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057577080000000003 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459170+0000", 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2328 3.3a 3:5e90e1f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.890537452, 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0090903670000000002, 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.377 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2328 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469896+0000", 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0229999999999999e-06 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471266+0000", 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001370303 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471294+0000", 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7571000000000001e-05 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471308+0000", 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4267000000000001e-05 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471388+0000", 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9939999999999997e-05 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471525+0000", 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013668400000000001 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471667+0000", 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014186299999999999 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478381+0000", 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067147750000000001 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478838+0000", 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045644799999999998 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478923+0000", 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4736999999999999e-05 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478984+0000", 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1755999999999996e-05 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2340 3.3b e72/17 3:dec2f466:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_149:head v 72'4, mlcod=71'2)", 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.7573331940000001, 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010101687, 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603101+0000", 2024-04-26T12:40:13.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.548e-06 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608217+0000", 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051159860000000003 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608250+0000", 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3411999999999998e-05 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608266+0000", 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5979000000000001e-05 2024-04-26T12:40:13.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608334+0000", 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8120999999999994e-05 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608357+0000", 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2719000000000001e-05 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613114+0000", 2024-04-26T12:40:13.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047573880000000004 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613200+0000", 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5533999999999998e-05 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2364 3.3a 3:5f88866d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.4955613240000001, 2024-04-26T12:40:13.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017066136999999999, 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2364 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864873+0000", 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0989999999999999e-06 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866782+0000", 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001908325 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866804+0000", 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2331999999999999e-05 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866817+0000", 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2951e-05 2024-04-26T12:40:13.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866910+0000", 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2817000000000003e-05 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866915+0000", 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0699999999999997e-06 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870125+0000", 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032105279999999998 2024-04-26T12:40:13.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870302+0000", 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017691699999999999 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870475+0000", 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258400000000001 2024-04-26T12:40:13.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.877926+0000", 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074516069999999998 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881845+0000", 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039187570000000001 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881885+0000", 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0234000000000001e-05 2024-04-26T12:40:13.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881936+0000", 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0915999999999998e-05 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2366 3.0 e73/17 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.4671525919999999, 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007540064, 2024-04-26T12:40:13.394 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9200000000000002e-07 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895376+0000", 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020964460000000001 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895399+0000", 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2886000000000001e-05 2024-04-26T12:40:13.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895411+0000", 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2845e-05 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895487+0000", 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5555000000000004e-05 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895512+0000", 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4751000000000001e-05 2024-04-26T12:40:13.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900733+0000", 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052214210000000004 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900819+0000", 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5867999999999998e-05 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2383 3.3a 3:5e222c71:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.297314192, 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012876257, 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2383 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063120+0000", 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-06 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065515+0000", 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023946839999999998 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065543+0000", 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8311e-05 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065556+0000", 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442e-05 2024-04-26T12:40:13.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065651+0000", 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5266000000000006e-05 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065849+0000", 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019847699999999999 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.066023+0000", 2024-04-26T12:40:13.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173072 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075353+0000", 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093303489999999999 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075875+0000", 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00052190799999999996 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075936+0000", 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1681999999999997e-05 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075994+0000", 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7092999999999997e-05 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2390 3.3b e73/17 3:de1f29f3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_199:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.214321473, 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011629304, 2024-04-26T12:40:13.404 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4900000000000001e-07 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150965+0000", 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048547080000000001 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150993+0000", 2024-04-26T12:40:13.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8087999999999999e-05 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151007+0000", 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3653e-05 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151087+0000", 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9856000000000003e-05 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151113+0000", 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6486e-05 2024-04-26T12:40:13.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157679+0000", 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065660960000000004 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157739+0000", 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0068000000000002e-05 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.408 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2393 3.0 e73/17 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.181605324, 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078009530000000002, 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178828+0000", 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181282+0000", 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024539710000000001 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181306+0000", 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4080999999999999e-05 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181319+0000", 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.294e-05 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181753+0000", 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043354299999999999 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181777+0000", 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4762000000000001e-05 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186543+0000", 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047658509999999998 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186627+0000", 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3957999999999998e-05 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.412 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2395 3.25 e73/41 3:a5fe4c99:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_204:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.159013844, 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068691029999999997, 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201419+0000", 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3850000000000001e-06 2024-04-26T12:40:13.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203007+0000", 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015877650000000001 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203033+0000", 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5981000000000001e-05 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203046+0000", 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3114e-05 2024-04-26T12:40:13.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203128+0000", 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2077999999999996e-05 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203153+0000", 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5086999999999999e-05 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208235+0000", 2024-04-26T12:40:13.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050818599999999997 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208287+0000", 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1833000000000003e-05 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.054065773, 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:40:13.417 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:40:13.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2413 3.2d e73/17 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.96108272500000003, 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097703479999999999, 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399350+0000", 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.711e-06 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403750+0000", 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043993160000000003 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403772+0000", 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1985999999999999e-05 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403782+0000", 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9340000000000001e-06 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403854+0000", 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2788999999999997e-05 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403881+0000", 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6826999999999999e-05 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409050+0000", 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051684189999999996 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409119+0000", 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9366e-05 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2415 3.0 e73/17 3:007bae19:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_224:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.93881155999999999, 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006983324, 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421622+0000", 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.841e-06 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423279+0000", 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016575139999999999 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423304+0000", 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5198000000000002e-05 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423318+0000", 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.328e-05 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423400+0000", 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2729e-05 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423428+0000", 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7222000000000001e-05 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428553+0000", 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051254450000000002 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428603+0000", 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0095000000000001e-05 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.431 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2418 3.25 e73/41 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.90669931800000003, 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079618780000000004, 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453733+0000", 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3200000000000004e-07 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455472+0000", 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017391749999999999 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455495+0000", 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2625000000000001e-05 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455509+0000", 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4056999999999999e-05 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455587+0000", 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8577000000000003e-05 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455619+0000", 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1443999999999999e-05 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461659+0000", 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060406499999999998 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461694+0000", 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4618e-05 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2419 3.4 e73/17 3:21b3cbd4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_228:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.89609055999999998, 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074141069999999996, 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.436 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464342+0000", 2024-04-26T12:40:13.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.142e-06 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466601+0000", 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022590190000000001 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466619+0000", 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8337000000000001e-05 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466628+0000", 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0089999999999996e-06 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466687+0000", 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8368000000000001e-05 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466712+0000", 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4836000000000001e-05 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471699+0000", 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049870019999999999 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471755+0000", 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6394000000000003e-05 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2426 3.f 3:f3fcc542:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:13.440 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.82673635400000001, 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017310012999999999, 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2426 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533698+0000", 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8389999999999998e-06 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535314+0000", 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016156949999999999 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535339+0000", 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5117e-05 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535349+0000", 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0569e-05 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535414+0000", 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5080999999999996e-05 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535529+0000", 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114302 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535625+0000", 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6210000000000002e-05 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.542763+0000", 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071382149999999998 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550914+0000", 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081504420000000008 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550953+0000", 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9597000000000001e-05 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.551005+0000", 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1946e-05 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2429 3.4 e73/17 3:208decb8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_238:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.79613781500000003, 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072608780000000001, 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564295+0000", 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566152+0000", 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001856871 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566180+0000", 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7338000000000002e-05 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566195+0000", 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5807999999999998e-05 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566279+0000", 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3462999999999997e-05 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566307+0000", 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7977999999999999e-05 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571500+0000", 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051927199999999996 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571555+0000", 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4987000000000001e-05 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2432 3.4 e73/17 3:22adec7f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_241:head v 73'4, mlcod=73'2)", 2024-04-26T12:40:13.450 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.76416605400000004, 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072901049999999998, 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596267+0000", 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9870000000000002e-06 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597800+0000", 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015329530000000001 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597825+0000", 2024-04-26T12:40:13.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4675e-05 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597838+0000", 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3335e-05 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597925+0000", 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6865000000000003e-05 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597966+0000", 2024-04-26T12:40:13.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0417000000000003e-05 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603515+0000", 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055488730000000002 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603556+0000", 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1e-05 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2435 3.2d e73/17 3:b50706f2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_244:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.72416349000000002, 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010411692, 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:13.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636271+0000", 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640883+0000", 2024-04-26T12:40:13.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046121540000000003 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640921+0000", 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8676e-05 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640940+0000", 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8991000000000002e-05 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641044+0000", 2024-04-26T12:40:13.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010401899999999999 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641074+0000", 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0037999999999999e-05 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646616+0000", 2024-04-26T12:40:13.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055411619999999997 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646680+0000", 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4083000000000003e-05 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:13.459 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:13.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:13.461 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:13.457+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:13.462 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:13.562 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:13.557+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:13.642 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:13.642 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:13.642 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:13.648 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:13.648 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:13.660 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:13.662 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:13.662+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:13.666 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:13.667 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:13.683 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:13.683 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:13.700 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:13.700 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:13.720 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:13.721 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:13.728 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:40:13.728 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:40:13.747 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:13.748 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:13.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-26T12:40:13.769 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:13.769 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:13.770 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:13.766+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:13.787 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:13.787 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:13.790 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:13.790 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:13.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:13.863 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:13.861+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:13.964 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:13.957+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:13.983 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:13.983 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:14.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:14.065 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:14.061+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:14.133 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:14.134 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:14.148 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:14.166 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:14.166+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:14.267 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:14.261+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:14.312 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:14.312 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:14.326 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:14.368 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:14.366+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:14.469 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:14.464+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:14.492 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:14.492 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:14.506 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:14.593 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:14.588+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:14.666 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:14.666 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:14.671 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:14.670+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:14.680 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:14.736 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.3 to 1 (10000) 2024-04-26T12:40:14.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-26T12:40:14.805 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:14.806+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:14.844 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:14.844 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:14.859 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:14.873 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:14.870+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:14.973 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:14.968+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:14.984 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:14.984 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:14.998 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:15.085 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:15.080+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:15.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:15.167 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:15.176 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:15.174+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:15.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:15.277 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:15.278+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:15.350 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:15.350 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:15.364 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:15.409 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:15.404+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:15.479 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:15.478+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:15.487 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:15.487 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:15.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:15.580 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:15.578+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:15.670 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:15.670 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:15.681 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:15.676+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:15.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:15.749 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.4 to 1 (10000) 2024-04-26T12:40:15.770 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:40:15.779 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-26T12:40:15.781 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:15.776+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:15.815 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:15.848 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:15.848 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:15.863 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:15.905 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:15.900+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:15.969 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:15.970 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:15.983 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:15.976+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:15.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:15.988 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:16.007 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:16.007 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:16.023 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:16.023 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:16.029 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:16.030 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:16.043 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:16.043 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:16.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:16.064 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:16.064 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:16.084 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:16.082+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:16.085 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:16.085 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:16.120 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:16.120 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:16.176 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:16.176 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:16.176 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:16.176 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:16.185 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:16.184+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:16.189 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:16.286 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:16.286+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:16.353 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:16.353 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:16.353 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:16.353 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:16.353 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:16.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:16.414 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:16.414+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:16.488 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:16.480+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:16.539 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:16.539 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.675468169999998, 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.540 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.545 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2317 3.3 3:c029eb24:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.358005+0000", 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.1790895189999997, 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014127485, 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2317 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.358005+0000", 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.358005+0000", 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.358008+0000", 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.359971+0000", 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019633250000000001 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.359999+0000", 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8268000000000001e-05 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360013+0000", 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3733e-05 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360085+0000", 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1674000000000005e-05 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360215+0000", 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013083499999999999 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360338+0000", 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122736 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.365479+0000", 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051403209999999998 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.372017+0000", 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065385319999999997 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.372084+0000", 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7371000000000003e-05 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.372133+0000", 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8090000000000002e-05 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2333 3.12 3:49fff330:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.0177414130000004, 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014903046, 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.551 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2333 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:16.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519355+0000", 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1739999999999999e-06 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520939+0000", 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015836960000000001 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520971+0000", 2024-04-26T12:40:16.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1930000000000001e-05 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520986+0000", 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5420000000000001e-05 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521057+0000", 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0825e-05 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521178+0000", 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120316 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521332+0000", 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015460800000000001 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.526796+0000", 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054637089999999998 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534174+0000", 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073778660000000003 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534216+0000", 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1869000000000002e-05 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534256+0000", 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0633000000000002e-05 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2337 3.1b 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.9786606129999997, 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018047987000000001, 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2337 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.557 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558438+0000", 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6239999999999999e-06 2024-04-26T12:40:16.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559867+0000", 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014292490000000001 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559886+0000", 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8697000000000001e-05 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559898+0000", 2024-04-26T12:40:16.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2542e-05 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559976+0000", 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7610999999999999e-05 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560136+0000", 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160443 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560298+0000", 2024-04-26T12:40:16.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016194899999999999 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.566613+0000", 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063145279999999998 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576388+0000", 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097756340000000001 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576434+0000", 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6020000000000003e-05 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576482+0000", 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7689999999999999e-05 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2339 3.32 3:4d9e1576:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.583264+0000", 2024-04-26T12:40:16.562 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.9538310110000001, 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010204243999999999, 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2339 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.583264+0000", 2024-04-26T12:40:16.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.583264+0000", 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.583265+0000", 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8700000000000001e-06 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.584937+0000", 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016719619999999999 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.584972+0000", 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4786000000000002e-05 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.584990+0000", 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7983e-05 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.585073+0000", 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2861999999999994e-05 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.585225+0000", 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015177800000000001 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.585328+0000", 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010282500000000001 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593356+0000", 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080280070000000002 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593365+0000", 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1989999999999995e-06 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593402+0000", 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6910999999999999e-05 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593468+0000", 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6061000000000003e-05 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2342 3.12 3:4a564d9a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.9164881529999995, 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020986402000000001, 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.568 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2342 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620609+0000", 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622196+0000", 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587045 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622224+0000", 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8028e-05 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622234+0000", 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0577999999999999e-05 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622319+0000", 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4296999999999996e-05 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622520+0000", 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201571 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622753+0000", 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000232501 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.629187+0000", 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064345679999999999 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641429+0000", 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012241573 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641522+0000", 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3239999999999995e-05 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641593+0000", 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0683000000000001e-05 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2344 3.3 3:c3214891:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.8888827680000002, 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017793122000000001, 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2344 2024-04-26T12:40:16.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648214+0000", 2024-04-26T12:40:16.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649908+0000", 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693069 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649940+0000", 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1974999999999998e-05 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649956+0000", 2024-04-26T12:40:16.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6429000000000001e-05 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650027+0000", 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1346000000000004e-05 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650146+0000", 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118581 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650277+0000", 2024-04-26T12:40:16.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013136300000000001 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.654910+0000", 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046332300000000003 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665861+0000", 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01095054 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665942+0000", 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0782e-05 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.666005+0000", 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3146999999999997e-05 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2346 3.10 e72/17 3:093f8fa5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_155:head v 72'6, mlcod=71'4)", 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.677209+0000", 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.8598853650000002, 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010565477, 2024-04-26T12:40:16.579 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.677209+0000", 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.677209+0000", 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.677211+0000", 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9539999999999998e-06 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682070+0000", 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048585859999999998 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682099+0000", 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9065999999999999e-05 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682110+0000", 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1409999999999999e-05 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682193+0000", 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2670999999999995e-05 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682218+0000", 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5601000000000001e-05 2024-04-26T12:40:16.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.687717+0000", 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054984739999999997 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.687775+0000", 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7714999999999999e-05 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.583 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2350 3.12 3:494cd927:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.8233152409999995, 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019319528999999998, 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2350 2024-04-26T12:40:16.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713782+0000", 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0759999999999999e-06 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714797+0000", 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010147159999999999 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714824+0000", 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.658e-05 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714838+0000", 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4609e-05 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714950+0000", 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112185 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715172+0000", 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022140199999999999 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715311+0000", 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000138639 2024-04-26T12:40:16.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.721604+0000", 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062931289999999997 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.732954+0000", 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011350314 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733038+0000", 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4445999999999998e-05 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733099+0000", 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0433000000000002e-05 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2353 3.2b 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7900137780000005, 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029788120000000001, 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.591 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2353 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:16.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747083+0000", 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748701+0000", 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016182550000000001 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748730+0000", 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8809000000000001e-05 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748741+0000", 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0949e-05 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748822+0000", 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0777000000000003e-05 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748827+0000", 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752276+0000", 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034484350000000001 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752425+0000", 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014880699999999999 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752572+0000", 2024-04-26T12:40:16.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014723899999999999 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.757807+0000", 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052354319999999999 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776737+0000", 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018929437 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776811+0000", 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4651000000000001e-05 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776869+0000", 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7541999999999999e-05 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2369 3.12 3:4bcc53b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.61752976, 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014928745, 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2369 2024-04-26T12:40:16.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919568+0000", 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0110000000000001e-06 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921453+0000", 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018855079999999999 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921476+0000", 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2705e-05 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921490+0000", 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4049999999999999e-05 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921560+0000", 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9580999999999997e-05 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921710+0000", 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150261 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921810+0000", 2024-04-26T12:40:16.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100351 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.926466+0000", 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046561160000000001 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934371+0000", 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079049830000000008 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934442+0000", 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0607999999999999e-05 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934494+0000", 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1570999999999998e-05 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.605 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2371 3.12 3:4aa38e60:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.5969164869999997, 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016346532, 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2371 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.606 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940181+0000", 2024-04-26T12:40:16.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941785+0000", 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016038700000000001 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941813+0000", 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827e-05 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941828+0000", 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5545000000000001e-05 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941914+0000", 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5353999999999996e-05 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942093+0000", 2024-04-26T12:40:16.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000179004 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942264+0000", 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017166999999999999 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.946973+0000", 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047087179999999998 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956399+0000", 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094257760000000003 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956471+0000", 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1740000000000001e-05 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956525+0000", 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4097000000000001e-05 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2392 3.30 e73/17 3:0e664f76:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_201:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.169447+0000", 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.3676477800000004, 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014147065, 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.612 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169447+0000", 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169447+0000", 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169448+0000", 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.268e-06 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175108+0000", 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056603809999999999 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175128+0000", 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9558000000000001e-05 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175139+0000", 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1409999999999999e-05 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175205+0000", 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5321999999999996e-05 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175223+0000", 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8737999999999999e-05 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.183527+0000", 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083033150000000003 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.183594+0000", 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7073e-05 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2403 3.3 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:16.617 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.2594095230000004, 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019288092999999999, 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2403 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277689+0000", 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.941e-06 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279232+0000", 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015426719999999999 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279255+0000", 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3059000000000001e-05 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279265+0000", 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9599999999999995e-06 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279330+0000", 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5282000000000003e-05 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279465+0000", 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135413 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279583+0000", 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011731900000000001 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.284332+0000", 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047490700000000002 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296834+0000", 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012501864 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296908+0000", 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3994999999999999e-05 2024-04-26T12:40:16.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296973+0000", 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5518000000000005e-05 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2420 3.1f 3:f85890ec:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.0617800920000002, 2024-04-26T12:40:16.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016319348000000001, 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2420 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475317+0000", 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5170000000000002e-06 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476909+0000", 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015916389999999999 2024-04-26T12:40:16.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476934+0000", 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5602999999999999e-05 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476944+0000", 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5980000000000003e-06 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477024+0000", 2024-04-26T12:40:16.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9969999999999995e-05 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477203+0000", 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017948000000000001 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477363+0000", 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160008 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.482189+0000", 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048257430000000004 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491558+0000", 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093691820000000002 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491601+0000", 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3099000000000002e-05 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491634+0000", 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2509000000000003e-05 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2422 3.39 e73/17 3:9d730a95:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_231:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.500922+0000", 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.0361722599999998, 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012449823, 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.500922+0000", 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.500922+0000", 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.500924+0000", 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.606e-06 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506165+0000", 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052407540000000002 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506178+0000", 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3580999999999999e-05 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506192+0000", 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3822000000000001e-05 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506251+0000", 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9058999999999998e-05 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506271+0000", 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9386999999999999e-05 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.513320+0000", 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0070490179999999998 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.513372+0000", 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2596000000000003e-05 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.633 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2424 3.3 3:c1866c22:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.0217779939999998, 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016771441000000002, 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2424 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515318+0000", 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516904+0000", 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015852570000000001 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516913+0000", 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1679999999999993e-06 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516921+0000", 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6319999999999997e-06 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516980+0000", 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9151999999999999e-05 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517101+0000", 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012034199999999999 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517259+0000", 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015827300000000001 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.522184+0000", 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004925296 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.531965+0000", 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009780647 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532033+0000", 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7546999999999996e-05 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532088+0000", 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5452999999999999e-05 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2436 3.39 e73/17 3:9debb9ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_245:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.647025+0000", 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 3.890069547, 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011632162999999999, 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.639 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.647025+0000", 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.647025+0000", 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.647027+0000", 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.829e-06 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651508+0000", 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044807370000000003 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651540+0000", 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2642999999999999e-05 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651555+0000", 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4569999999999999e-05 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651702+0000", 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014761099999999999 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651766+0000", 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3811000000000003e-05 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.658598+0000", 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068315429999999998 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.658657+0000", 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9419000000000001e-05 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2439 3.30 e73/17 3:0d1f1f0d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_248:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:16.643 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.676802+0000", 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 3.8602922450000001, 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010025348999999999, 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.676802+0000", 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.676802+0000", 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.676804+0000", 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5519999999999999e-06 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.681958+0000", 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051541670000000003 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.681978+0000", 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9796000000000002e-05 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.681987+0000", 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4159999999999993e-06 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.682061+0000", 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3560999999999996e-05 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.682087+0000", 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999999e-05 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.686786+0000", 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046989149999999997 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.686828+0000", 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1301999999999999e-05 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.647 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2442 3.6 3:60c3292b:::d749f084-3851-4e95-9492-490675b43f90.4382.9_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.748822+0000", 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 3.7882722639999997, 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010241254999999999, 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:16.648 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2442 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.748822+0000", 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.748822+0000", 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.748824+0000", 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.142e-06 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.749954+0000", 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001129974 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.749979+0000", 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4825999999999999e-05 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.749989+0000", 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8309999999999996e-06 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.750141+0000", 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015240699999999999 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.750349+0000", 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020764000000000001 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.750901+0000", 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055208500000000001 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.758957+0000", 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080558190000000005 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.758965+0000", 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3080000000000008e-06 2024-04-26T12:40:16.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.759025+0000", 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9771000000000001e-05 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.759064+0000", 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8451999999999997e-05 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:16.653 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:16.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:16.655 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:16.652+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:16.756 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:16.754+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.5 to 1 (10000) 2024-04-26T12:40:16.777 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:40:16.794 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:16.794 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:16.794 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:16.795 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:16.797 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-26T12:40:16.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:16.857 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:16.852+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:16.958 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:16.958+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:16.973 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:16.973 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:16.974 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:16.974 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:16.974 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:16.988 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:17.060 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:17.056+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:17.153 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:17.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 122.71049116099999, 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:40:17.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2319 3.1a 3:58f869a1:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.7737737950000003, 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013146055, 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2319 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378953+0000", 2024-04-26T12:40:17.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.041e-06 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380420+0000", 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001467138 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380454+0000", 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4236999999999998e-05 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380470+0000", 2024-04-26T12:40:17.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6578999999999998e-05 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380544+0000", 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3616999999999997e-05 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380697+0000", 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015309199999999999 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380801+0000", 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103513 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.385130+0000", 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00432906 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391960+0000", 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068303560000000001 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392034+0000", 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4119e-05 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392097+0000", 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2303000000000003e-05 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2326 3.0 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:17.164 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.7030166730000005, 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099133869999999992, 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2326 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449711+0000", 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5080000000000001e-06 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451146+0000", 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014349720000000001 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451183+0000", 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6671999999999997e-05 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451199+0000", 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6257999999999999e-05 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451290+0000", 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0728000000000003e-05 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451468+0000", 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017821300000000001 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451632+0000", 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389 2024-04-26T12:40:17.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.458789+0000", 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071576060000000004 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459479+0000", 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069001700000000002 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459560+0000", 2024-04-26T12:40:17.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0115000000000001e-05 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459621+0000", 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1408000000000006e-05 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2345 3.19 3:99eb3a17:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.493154648, 2024-04-26T12:40:17.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010166799000000001, 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2345 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659573+0000", 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6990000000000001e-06 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661691+0000", 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021175959999999998 2024-04-26T12:40:17.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661711+0000", 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0128000000000001e-05 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661724+0000", 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2906e-05 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661800+0000", 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6505e-05 2024-04-26T12:40:17.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661985+0000", 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018474600000000001 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.662135+0000", 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014955599999999999 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.668376+0000", 2024-04-26T12:40:17.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062408280000000003 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669587+0000", 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012110739999999999 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669672+0000", 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5241999999999995e-05 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669736+0000", 2024-04-26T12:40:17.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4518999999999997e-05 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.4173648869999997, 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:40:17.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:40:17.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.181 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.34110862, 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:40:17.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:40:17.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:17.187 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.3293842519999997, 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:40:17.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:40:17.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:40:17.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2362 3.19 3:98a41993:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:17.193 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.308525597, 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0096554659999999997, 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2362 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:17.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844202+0000", 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0340000000000001e-06 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845840+0000", 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00163839 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845872+0000", 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1523999999999998e-05 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845888+0000", 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6208000000000001e-05 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845978+0000", 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9909999999999998e-05 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846168+0000", 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019002999999999999 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846343+0000", 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175071 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853321+0000", 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006978616 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853780+0000", 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045818500000000001 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853821+0000", 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1248999999999998e-05 2024-04-26T12:40:17.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853854+0000", 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3249e-05 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2366 3.0 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.2647417430000001, 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013182772000000001, 2024-04-26T12:40:17.199 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2366 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887986+0000", 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3469999999999999e-06 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889575+0000", 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00158928 2024-04-26T12:40:17.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889602+0000", 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6840999999999999e-05 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889617+0000", 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4667e-05 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889721+0000", 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104255 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889920+0000", 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019873199999999999 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.890088+0000", 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016799 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895734+0000", 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056464139999999998 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901046+0000", 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053117019999999997 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901114+0000", 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8232999999999995e-05 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901165+0000", 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1310999999999997e-05 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.0691758289999997, 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.205 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:40:17.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:40:17.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2386 3.19 3:9a588031:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.0579563580000002, 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010161018000000001, 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.211 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2386 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:17.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094770+0000", 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3920000000000001e-06 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095718+0000", 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094744999999999996 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095744+0000", 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6038999999999999e-05 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095757+0000", 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3451999999999999e-05 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095843+0000", 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5877000000000005e-05 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095962+0000", 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011846899999999999 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.096054+0000", 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1963e-05 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104575+0000", 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0085213179999999999 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104801+0000", 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022650599999999999 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104872+0000", 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0412000000000003e-05 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104929+0000", 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7139999999999998e-05 2024-04-26T12:40:17.216 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2391 3.31 3:8f508897:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.0001573620000004, 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016948310000000001, 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2391 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152570+0000", 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154503+0000", 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001933234 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154536+0000", 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3321000000000002e-05 2024-04-26T12:40:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154553+0000", 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6288000000000001e-05 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154639+0000", 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6236000000000006e-05 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154820+0000", 2024-04-26T12:40:17.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181306 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154983+0000", 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162929 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.160656+0000", 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056726550000000004 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169397+0000", 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087409170000000008 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169465+0000", 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8730000000000001e-05 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169515+0000", 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9795e-05 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.222 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2393 3.0 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.9766451060000003, 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010859486999999999, 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2393 2024-04-26T12:40:17.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176082+0000", 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3970000000000001e-06 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178323+0000", 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002241818 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178348+0000", 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4335e-05 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178359+0000", 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1092e-05 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178440+0000", 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0745e-05 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178581+0000", 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014098100000000001 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178682+0000", 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010178099999999999 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.184116+0000", 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054341090000000003 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186805+0000", 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026890529999999998 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186884+0000", 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8336000000000004e-05 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186939+0000", 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4839999999999997e-05 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.228 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.940532589, 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:17.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2397 3.19 3:9b8be67a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.931344374, 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00976898, 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.234 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2397 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221382+0000", 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.73e-06 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222800+0000", 2024-04-26T12:40:17.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001418802 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222828+0000", 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7790999999999999e-05 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222839+0000", 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0428000000000001e-05 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222926+0000", 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7541999999999996e-05 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223135+0000", 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020900399999999999 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223316+0000", 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018074899999999999 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230660+0000", 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073436259999999998 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231093+0000", 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043387800000000001 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231124+0000", 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939999999999999e-05 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231149+0000", 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4490000000000001e-05 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7832302719999999, 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.241 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:17.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:40:17.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:40:17.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.246 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2417 3.8 e73/17 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head v 73'4, mlcod=71'2)", 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7104380810000004, 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099003479999999998, 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:17.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442289+0000", 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4389999999999999e-06 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444260+0000", 2024-04-26T12:40:17.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019712509999999998 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444281+0000", 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1512999999999999e-05 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444294+0000", 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2206e-05 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444378+0000", 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4658000000000002e-05 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444409+0000", 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1086e-05 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451996+0000", 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007586392 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452187+0000", 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000190803 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2418 3.25 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7016212160000004, 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010790129000000001, 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.251 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2418 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451105+0000", 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.351e-06 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453261+0000", 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021551169999999998 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453277+0000", 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6935e-05 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453299+0000", 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1701000000000001e-05 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453368+0000", 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8591999999999997e-05 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453517+0000", 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014963699999999999 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453638+0000", 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120289 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461242+0000", 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0076041479999999998 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461821+0000", 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057901100000000004 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461860+0000", 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9498e-05 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461893+0000", 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2849999999999999e-05 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.5998268910000002, 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:40:17.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:40:17.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.262 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.5695150629999999, 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:40:17.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:40:17.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.268 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:17.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:17.270 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:17.268+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:17.371 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:17.368+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:17.405 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:17.406 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:17.419 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:17.471 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:17.470+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:17.539 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:17.539 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:17.539 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:17.553 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:17.572 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:17.568+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:17.673 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:17.672+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:17.724 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1544 4.d 4:b0f5eef4:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.734683514, 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078556990000000007, 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.725 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1544 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989713+0000", 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989720+0000", 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1439999999999997e-06 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989735+0000", 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4318000000000001e-05 2024-04-26T12:40:17.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989743+0000", 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3520000000000007e-06 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989816+0000", 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2733999999999999e-05 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989896+0000", 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0635000000000003e-05 2024-04-26T12:40:17.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989995+0000", 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8276999999999994e-05 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990617+0000", 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062210300000000004 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997488+0000", 2024-04-26T12:40:17.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068714170000000003 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997521+0000", 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3120999999999997e-05 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997567+0000", 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5259000000000002e-05 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2323 3.3a 3:5f8d6128:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.3061536680000003, 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0089459429999999996, 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2323 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.731 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418243+0000", 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:17.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419683+0000", 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014398810000000001 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419708+0000", 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4734000000000001e-05 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419718+0000", 2024-04-26T12:40:17.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9450000000000005e-06 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419801+0000", 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3323000000000002e-05 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419969+0000", 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168064 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:17.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.420113+0000", 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014409000000000001 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.426671+0000", 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065582080000000003 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427066+0000", 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039501800000000002 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427130+0000", 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3206000000000004e-05 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427187+0000", 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6932999999999999e-05 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2326 3.0 e72/17 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head v 72'6, mlcod=72'4)", 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:17.736 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.2726490559999997, 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074245839999999997, 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451747+0000", 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.663e-06 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453207+0000", 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014601410000000001 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453232+0000", 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5372e-05 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453244+0000", 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1790999999999999e-05 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453323+0000", 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9140999999999993e-05 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453347+0000", 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3910999999999999e-05 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459105+0000", 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057577080000000003 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459170+0000", 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2328 3.3a 3:5e90e1f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.2545003140000004, 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0090903670000000002, 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2328 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.741 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469896+0000", 2024-04-26T12:40:17.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0229999999999999e-06 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471266+0000", 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001370303 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471294+0000", 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7571000000000001e-05 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471308+0000", 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4267000000000001e-05 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471388+0000", 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9939999999999997e-05 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471525+0000", 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013668400000000001 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:17.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471667+0000", 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014186299999999999 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478381+0000", 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067147750000000001 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478838+0000", 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045644799999999998 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478923+0000", 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4736999999999999e-05 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478984+0000", 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1755999999999996e-05 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2340 3.3b e72/17 3:dec2f466:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_149:head v 72'4, mlcod=71'2)", 2024-04-26T12:40:17.746 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.1212960560000003, 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010101687, 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603101+0000", 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.548e-06 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608217+0000", 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051159860000000003 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608250+0000", 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3411999999999998e-05 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608266+0000", 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5979000000000001e-05 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608334+0000", 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8120999999999994e-05 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608357+0000", 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2719000000000001e-05 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613114+0000", 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047573880000000004 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613200+0000", 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5533999999999998e-05 2024-04-26T12:40:17.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2364 3.3a 3:5f88866d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.8595241859999998, 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017066136999999999, 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2364 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864873+0000", 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0989999999999999e-06 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866782+0000", 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001908325 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866804+0000", 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2331999999999999e-05 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866817+0000", 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2951e-05 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866910+0000", 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2817000000000003e-05 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866915+0000", 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0699999999999997e-06 2024-04-26T12:40:17.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870125+0000", 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032105279999999998 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870302+0000", 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017691699999999999 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870475+0000", 2024-04-26T12:40:17.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258400000000001 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.877926+0000", 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074516069999999998 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881845+0000", 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039187570000000001 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881885+0000", 2024-04-26T12:40:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0234000000000001e-05 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881936+0000", 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0915999999999998e-05 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2366 3.0 e73/17 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.8311154539999999, 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007540064, 2024-04-26T12:40:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9200000000000002e-07 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895376+0000", 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020964460000000001 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895399+0000", 2024-04-26T12:40:17.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2886000000000001e-05 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895411+0000", 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2845e-05 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895487+0000", 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5555000000000004e-05 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895512+0000", 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4751000000000001e-05 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900733+0000", 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052214210000000004 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900819+0000", 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5867999999999998e-05 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2383 3.3a 3:5e222c71:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.6612770540000001, 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012876257, 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2383 2024-04-26T12:40:17.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063120+0000", 2024-04-26T12:40:17.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-06 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065515+0000", 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023946839999999998 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065543+0000", 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8311e-05 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065556+0000", 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442e-05 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065651+0000", 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5266000000000006e-05 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065849+0000", 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019847699999999999 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.066023+0000", 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173072 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075353+0000", 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093303489999999999 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075875+0000", 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00052190799999999996 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075936+0000", 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1681999999999997e-05 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075994+0000", 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7092999999999997e-05 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.767 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2390 3.3b e73/17 3:de1f29f3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_199:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.5782843350000002, 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011629304, 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4900000000000001e-07 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150965+0000", 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048547080000000001 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150993+0000", 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8087999999999999e-05 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151007+0000", 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3653e-05 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151087+0000", 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9856000000000003e-05 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151113+0000", 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6486e-05 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157679+0000", 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065660960000000004 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157739+0000", 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0068000000000002e-05 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.771 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2393 3.0 e73/17 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.5455681859999997, 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078009530000000002, 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:17.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178828+0000", 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181282+0000", 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024539710000000001 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181306+0000", 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4080999999999999e-05 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181319+0000", 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.294e-05 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181753+0000", 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043354299999999999 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181777+0000", 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4762000000000001e-05 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186543+0000", 2024-04-26T12:40:17.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047658509999999998 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186627+0000", 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3957999999999998e-05 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2395 3.25 e73/41 3:a5fe4c99:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_204:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.5229767059999997, 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068691029999999997, 2024-04-26T12:40:17.776 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201419+0000", 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3850000000000001e-06 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203007+0000", 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015877650000000001 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203033+0000", 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5981000000000001e-05 2024-04-26T12:40:17.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203046+0000", 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3114e-05 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203128+0000", 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2077999999999996e-05 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203153+0000", 2024-04-26T12:40:17.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5086999999999999e-05 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208235+0000", 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050818599999999997 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208287+0000", 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1833000000000003e-05 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.4180286349999998, 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:40:17.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:40:17.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:40:17.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:40:17.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2413 3.2d e73/17 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.325045587, 2024-04-26T12:40:17.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097703479999999999, 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399350+0000", 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.711e-06 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403750+0000", 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043993160000000003 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403772+0000", 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1985999999999999e-05 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403782+0000", 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9340000000000001e-06 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403854+0000", 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2788999999999997e-05 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403881+0000", 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6826999999999999e-05 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409050+0000", 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051684189999999996 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409119+0000", 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9366e-05 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.790 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2415 3.0 e73/17 3:007bae19:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_224:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.3027744219999997, 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006983324, 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421622+0000", 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.841e-06 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423279+0000", 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016575139999999999 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423304+0000", 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5198000000000002e-05 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423318+0000", 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.328e-05 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423400+0000", 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2729e-05 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423428+0000", 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7222000000000001e-05 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428553+0000", 2024-04-26T12:40:17.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051254450000000002 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428603+0000", 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0095000000000001e-05 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2418 3.25 e73/41 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.2706621800000004, 2024-04-26T12:40:17.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079618780000000004, 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453733+0000", 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3200000000000004e-07 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455472+0000", 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017391749999999999 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455495+0000", 2024-04-26T12:40:17.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2625000000000001e-05 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455509+0000", 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4056999999999999e-05 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455587+0000", 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8577000000000003e-05 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455619+0000", 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1443999999999999e-05 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461659+0000", 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060406499999999998 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461694+0000", 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4618e-05 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2419 3.4 e73/17 3:21b3cbd4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_228:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.2600534220000004, 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074141069999999996, 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464342+0000", 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.142e-06 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466601+0000", 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022590190000000001 2024-04-26T12:40:17.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466619+0000", 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8337000000000001e-05 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466628+0000", 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0089999999999996e-06 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466687+0000", 2024-04-26T12:40:17.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8368000000000001e-05 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466712+0000", 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4836000000000001e-05 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471699+0000", 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049870019999999999 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471755+0000", 2024-04-26T12:40:17.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6394000000000003e-05 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2426 3.f 3:f3fcc542:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.1906992159999996, 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017310012999999999, 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:17.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2426 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533698+0000", 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8389999999999998e-06 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535314+0000", 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016156949999999999 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535339+0000", 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5117e-05 2024-04-26T12:40:17.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535349+0000", 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0569e-05 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535414+0000", 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5080999999999996e-05 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535529+0000", 2024-04-26T12:40:17.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114302 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535625+0000", 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6210000000000002e-05 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.542763+0000", 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071382149999999998 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550914+0000", 2024-04-26T12:40:17.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081504420000000008 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550953+0000", 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9597000000000001e-05 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.551005+0000", 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1946e-05 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2429 3.4 e73/17 3:208decb8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_238:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.160100677, 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072608780000000001, 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564295+0000", 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566152+0000", 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001856871 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566180+0000", 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7338000000000002e-05 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566195+0000", 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5807999999999998e-05 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566279+0000", 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3462999999999997e-05 2024-04-26T12:40:17.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566307+0000", 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7977999999999999e-05 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571500+0000", 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051927199999999996 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571555+0000", 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4987000000000001e-05 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2432 3.4 e73/17 3:22adec7f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_241:head v 73'4, mlcod=73'2)", 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.1281289159999996, 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072901049999999998, 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.814 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596267+0000", 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9870000000000002e-06 2024-04-26T12:40:17.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597800+0000", 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015329530000000001 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597825+0000", 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4675e-05 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597838+0000", 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3335e-05 2024-04-26T12:40:17.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597925+0000", 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6865000000000003e-05 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597966+0000", 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0417000000000003e-05 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603515+0000", 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055488730000000002 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603556+0000", 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1e-05 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2435 3.2d e73/17 3:b50706f2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_244:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.0881263519999997, 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010411692, 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636271+0000", 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640883+0000", 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046121540000000003 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640921+0000", 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8676e-05 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640940+0000", 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8991000000000002e-05 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641044+0000", 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010401899999999999 2024-04-26T12:40:17.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641074+0000", 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0037999999999999e-05 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646616+0000", 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055411619999999997 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646680+0000", 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4083000000000003e-05 2024-04-26T12:40:17.822 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:17.823 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:17.823 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:17.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:17.825 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.6 to 1 (10000) 2024-04-26T12:40:17.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-26T12:40:17.826 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:17.820+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:17.925 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:17.926+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:17.990 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:17.990 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:18.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:18.026 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:18.024+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:18.127 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:18.124+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:18.144 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:18.166 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:18.166 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:18.166 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:18.166 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:18.166 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:18.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:18.227 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:18.224+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:18.296 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:18.296 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:18.314 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:18.315 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:18.329 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:18.324+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:18.331 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:18.332 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:18.349 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:18.349 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:18.354 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:18.354 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:18.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:18.370 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:18.370 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:18.392 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:18.392 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:18.412 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:18.413 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:18.429 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:18.428+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:18.431 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:18.431 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:18.505 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:18.506 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:18.520 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:18.561 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:18.560+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:18.632 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:18.630+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:18.681 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:18.681 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:18.695 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:18.733 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:18.730+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:18.780 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.7 to 1 (10000) 2024-04-26T12:40:18.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:40:18.813 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:40:18.813 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:40:18.822 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:18.822 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:18.834 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:18.832+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:18.837 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:18.934 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:18.932+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:19.008 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:19.009 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:19.023 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:19.036 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:19.034+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:19.137 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:19.138+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:19.188 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:19.188 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:19.203 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:19.225 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:40:19.233 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:40:19.245 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-26T12:40:18.783167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070219428,"num_objects":455,"num_object_clones":0,"num_object_copies":910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":0,"num_read":2595,"num_read_kb":2302,"num_write":1361,"num_write_kb":1067562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2056,"ondisk_log_size":2056,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2363848,"kb_used_data":2097744,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":752610872,"statfs":{"total":773094113280,"available":770673532928,"internally_reserved":0,"allocated":2148089856,"data_stored":2144592704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4133264,"num_objects":-14,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14,"num_whiteouts":0,"num_read":149,"num_read_kb":146,"num_write":27,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044429"},"pg_stats":[{"pgid":"3.3f","version":"73'1","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.588198+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:40:17.588198+0000","last_peered":"2024-04-26T12:40:17.588198+0000","last_clean":"2024-04-26T12:40:17.588198+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:40:17.588198+0000","last_undegraded":"2024-04-26T12:40:17.588198+0000","last_fullsized":"2024-04-26T12:40:17.588198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"68'4","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583700+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:40:17.583700+0000","last_peered":"2024-04-26T12:40:17.583700+0000","last_clean":"2024-04-26T12:40:17.583700+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:40:17.583700+0000","last_undegraded":"2024-04-26T12:40:17.583700+0000","last_fullsized":"2024-04-26T12:40:17.583700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"71'1","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777242+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:40:17.777242+0000","last_peered":"2024-04-26T12:40:17.777242+0000","last_clean":"2024-04-26T12:40:17.777242+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:40:17.777242+0000","last_undegraded":"2024-04-26T12:40:17.777242+0000","last_fullsized":"2024-04-26T12:40:17.777242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":142,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583549+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:40:17.583549+0000","last_peered":"2024-04-26T12:40:17.583549+0000","last_clean":"2024-04-26T12:40:17.583549+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:40:17.583549+0000","last_undegraded":"2024-04-26T12:40:17.583549+0000","last_fullsized":"2024-04-26T12:40:17.583549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"72'2","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863768+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:40:16.863768+0000","last_peered":"2024-04-26T12:40:16.863768+0000","last_clean":"2024-04-26T12:40:16.863768+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:40:16.863768+0000","last_undegraded":"2024-04-26T12:40:16.863768+0000","last_fullsized":"2024-04-26T12:40:16.863768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862894+0000","last_change":"2024-04-26T12:38:32.099160+0000","last_active":"2024-04-26T12:40:16.862894+0000","last_peered":"2024-04-26T12:40:16.862894+0000","last_clean":"2024-04-26T12:40:16.862894+0000","last_became_active":"2024-04-26T12:38:32.093033+0000","last_became_peered":"2024-04-26T12:38:32.093033+0000","last_unstale":"2024-04-26T12:40:16.862894+0000","last_undegraded":"2024-04-26T12:40:16.862894+0000","last_fullsized":"2024-04-26T12:40:16.862894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:22.221188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"73'8","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586525+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:40:17.586525+0000","last_peered":"2024-04-26T12:40:17.586525+0000","last_clean":"2024-04-26T12:40:17.586525+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:40:17.586525+0000","last_undegraded":"2024-04-26T12:40:17.586525+0000","last_fullsized":"2024-04-26T12:40:17.586525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862951+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:40:16.862951+0000","last_peered":"2024-04-26T12:40:16.862951+0000","last_clean":"2024-04-26T12:40:16.862951+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:40:16.862951+0000","last_undegraded":"2024-04-26T12:40:16.862951+0000","last_fullsized":"2024-04-26T12:40:16.862951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"73'5","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585514+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:40:17.585514+0000","last_peered":"2024-04-26T12:40:17.585514+0000","last_clean":"2024-04-26T12:40:17.585514+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:40:17.585514+0000","last_undegraded":"2024-04-26T12:40:17.585514+0000","last_fullsized":"2024-04-26T12:40:17.585514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"68'2","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772735+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:40:16.772735+0000","last_peered":"2024-04-26T12:40:16.772735+0000","last_clean":"2024-04-26T12:40:16.772735+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:40:16.772735+0000","last_undegraded":"2024-04-26T12:40:16.772735+0000","last_fullsized":"2024-04-26T12:40:16.772735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'5","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583724+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:40:17.583724+0000","last_peered":"2024-04-26T12:40:17.583724+0000","last_clean":"2024-04-26T12:40:17.583724+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:40:17.583724+0000","last_undegraded":"2024-04-26T12:40:17.583724+0000","last_fullsized":"2024-04-26T12:40:17.583724+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863624+0000","last_change":"2024-04-26T12:38:32.092960+0000","last_active":"2024-04-26T12:40:16.863624+0000","last_peered":"2024-04-26T12:40:16.863624+0000","last_clean":"2024-04-26T12:40:16.863624+0000","last_became_active":"2024-04-26T12:38:32.092562+0000","last_became_peered":"2024-04-26T12:38:32.092562+0000","last_unstale":"2024-04-26T12:40:16.863624+0000","last_undegraded":"2024-04-26T12:40:16.863624+0000","last_fullsized":"2024-04-26T12:40:16.863624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:43.474569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"73'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583830+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:40:17.583830+0000","last_peered":"2024-04-26T12:40:17.583830+0000","last_clean":"2024-04-26T12:40:17.583830+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:40:17.583830+0000","last_undegraded":"2024-04-26T12:40:17.583830+0000","last_fullsized":"2024-04-26T12:40:17.583830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585742+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:40:17.585742+0000","last_peered":"2024-04-26T12:40:17.585742+0000","last_clean":"2024-04-26T12:40:17.585742+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:40:17.585742+0000","last_undegraded":"2024-04-26T12:40:17.585742+0000","last_fullsized":"2024-04-26T12:40:17.585742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'4","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776183+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:40:17.776183+0000","last_peered":"2024-04-26T12:40:17.776183+0000","last_clean":"2024-04-26T12:40:17.776183+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:40:17.776183+0000","last_undegraded":"2024-04-26T12:40:17.776183+0000","last_fullsized":"2024-04-26T12:40:17.776183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":145,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584829+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:40:17.584829+0000","last_peered":"2024-04-26T12:40:17.584829+0000","last_clean":"2024-04-26T12:40:17.584829+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:40:17.584829+0000","last_undegraded":"2024-04-26T12:40:17.584829+0000","last_fullsized":"2024-04-26T12:40:17.584829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"67'2","reported_seq":111,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862605+0000","last_change":"2024-04-26T12:38:32.098437+0000","last_active":"2024-04-26T12:40:16.862605+0000","last_peered":"2024-04-26T12:40:16.862605+0000","last_clean":"2024-04-26T12:40:16.862605+0000","last_became_active":"2024-04-26T12:38:32.093038+0000","last_became_peered":"2024-04-26T12:38:32.093038+0000","last_unstale":"2024-04-26T12:40:16.862605+0000","last_undegraded":"2024-04-26T12:40:16.862605+0000","last_fullsized":"2024-04-26T12:40:16.862605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:11.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"73'8","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.588325+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:40:17.588325+0000","last_peered":"2024-04-26T12:40:17.588325+0000","last_clean":"2024-04-26T12:40:17.588325+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:40:17.588325+0000","last_undegraded":"2024-04-26T12:40:17.588325+0000","last_fullsized":"2024-04-26T12:40:17.588325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"68'2","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583712+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:40:17.583712+0000","last_peered":"2024-04-26T12:40:17.583712+0000","last_clean":"2024-04-26T12:40:17.583712+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:40:17.583712+0000","last_undegraded":"2024-04-26T12:40:17.583712+0000","last_fullsized":"2024-04-26T12:40:17.583712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"73'5","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773694+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:40:16.773694+0000","last_peered":"2024-04-26T12:40:16.773694+0000","last_clean":"2024-04-26T12:40:16.773694+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:40:16.773694+0000","last_undegraded":"2024-04-26T12:40:16.773694+0000","last_fullsized":"2024-04-26T12:40:16.773694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585466+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:40:17.585466+0000","last_peered":"2024-04-26T12:40:17.585466+0000","last_clean":"2024-04-26T12:40:17.585466+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:40:17.585466+0000","last_undegraded":"2024-04-26T12:40:17.585466+0000","last_fullsized":"2024-04-26T12:40:17.585466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773822+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:40:16.773822+0000","last_peered":"2024-04-26T12:40:16.773822+0000","last_clean":"2024-04-26T12:40:16.773822+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:40:16.773822+0000","last_undegraded":"2024-04-26T12:40:16.773822+0000","last_fullsized":"2024-04-26T12:40:16.773822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"68'6","reported_seq":150,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584096+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:40:17.584096+0000","last_peered":"2024-04-26T12:40:17.584096+0000","last_clean":"2024-04-26T12:40:17.584096+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:40:17.584096+0000","last_undegraded":"2024-04-26T12:40:17.584096+0000","last_fullsized":"2024-04-26T12:40:17.584096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"72'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773035+0000","last_change":"2024-04-26T12:38:32.097333+0000","last_active":"2024-04-26T12:40:16.773035+0000","last_peered":"2024-04-26T12:40:16.773035+0000","last_clean":"2024-04-26T12:40:16.773035+0000","last_became_active":"2024-04-26T12:38:32.097076+0000","last_became_peered":"2024-04-26T12:38:32.097076+0000","last_unstale":"2024-04-26T12:40:16.773035+0000","last_undegraded":"2024-04-26T12:40:16.773035+0000","last_fullsized":"2024-04-26T12:40:16.773035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:52.365241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"74'6","reported_seq":152,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584313+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:40:17.584313+0000","last_peered":"2024-04-26T12:40:17.584313+0000","last_clean":"2024-04-26T12:40:17.584313+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:40:17.584313+0000","last_undegraded":"2024-04-26T12:40:17.584313+0000","last_fullsized":"2024-04-26T12:40:17.584313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"73'5","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778277+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:40:17.778277+0000","last_peered":"2024-04-26T12:40:17.778277+0000","last_clean":"2024-04-26T12:40:17.778277+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:40:17.778277+0000","last_undegraded":"2024-04-26T12:40:17.778277+0000","last_fullsized":"2024-04-26T12:40:17.778277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776994+0000","last_change":"2024-04-26T12:38:32.098711+0000","last_active":"2024-04-26T12:40:17.776994+0000","last_peered":"2024-04-26T12:40:17.776994+0000","last_clean":"2024-04-26T12:40:17.776994+0000","last_became_active":"2024-04-26T12:38:32.097887+0000","last_became_peered":"2024-04-26T12:38:32.097887+0000","last_unstale":"2024-04-26T12:40:17.776994+0000","last_undegraded":"2024-04-26T12:40:17.776994+0000","last_fullsized":"2024-04-26T12:40:17.776994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:43.980582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"72'4","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862946+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:40:16.862946+0000","last_peered":"2024-04-26T12:40:16.862946+0000","last_clean":"2024-04-26T12:40:16.862946+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:40:16.862946+0000","last_undegraded":"2024-04-26T12:40:16.862946+0000","last_fullsized":"2024-04-26T12:40:16.862946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":109,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775388+0000","last_change":"2024-04-26T12:38:32.091108+0000","last_active":"2024-04-26T12:40:17.775388+0000","last_peered":"2024-04-26T12:40:17.775388+0000","last_clean":"2024-04-26T12:40:17.775388+0000","last_became_active":"2024-04-26T12:38:32.090800+0000","last_became_peered":"2024-04-26T12:38:32.090800+0000","last_unstale":"2024-04-26T12:40:17.775388+0000","last_undegraded":"2024-04-26T12:40:17.775388+0000","last_fullsized":"2024-04-26T12:40:17.775388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:54.159328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":145,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779095+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:40:17.779095+0000","last_peered":"2024-04-26T12:40:17.779095+0000","last_clean":"2024-04-26T12:40:17.779095+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:40:17.779095+0000","last_undegraded":"2024-04-26T12:40:17.779095+0000","last_fullsized":"2024-04-26T12:40:17.779095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"73'1","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585884+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:40:17.585884+0000","last_peered":"2024-04-26T12:40:17.585884+0000","last_clean":"2024-04-26T12:40:17.585884+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:40:17.585884+0000","last_undegraded":"2024-04-26T12:40:17.585884+0000","last_fullsized":"2024-04-26T12:40:17.585884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585574+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:40:17.585574+0000","last_peered":"2024-04-26T12:40:17.585574+0000","last_clean":"2024-04-26T12:40:17.585574+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:40:17.585574+0000","last_undegraded":"2024-04-26T12:40:17.585574+0000","last_fullsized":"2024-04-26T12:40:17.585574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"74'15","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863623+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:40:16.863623+0000","last_peered":"2024-04-26T12:40:16.863623+0000","last_clean":"2024-04-26T12:40:16.863623+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:40:16.863623+0000","last_undegraded":"2024-04-26T12:40:16.863623+0000","last_fullsized":"2024-04-26T12:40:16.863623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587561+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:40:17.587561+0000","last_peered":"2024-04-26T12:40:17.587561+0000","last_clean":"2024-04-26T12:40:17.587561+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:40:17.587561+0000","last_undegraded":"2024-04-26T12:40:17.587561+0000","last_fullsized":"2024-04-26T12:40:17.587561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"74'36","reported_seq":159,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584322+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:40:17.584322+0000","last_peered":"2024-04-26T12:40:17.584322+0000","last_clean":"2024-04-26T12:40:17.584322+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:40:17.584322+0000","last_undegraded":"2024-04-26T12:40:17.584322+0000","last_fullsized":"2024-04-26T12:40:17.584322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586524+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:40:17.586524+0000","last_peered":"2024-04-26T12:40:17.586524+0000","last_clean":"2024-04-26T12:40:17.586524+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:40:17.586524+0000","last_undegraded":"2024-04-26T12:40:17.586524+0000","last_fullsized":"2024-04-26T12:40:17.586524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'7","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863010+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:40:16.863010+0000","last_peered":"2024-04-26T12:40:16.863010+0000","last_clean":"2024-04-26T12:40:16.863010+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:40:16.863010+0000","last_undegraded":"2024-04-26T12:40:16.863010+0000","last_fullsized":"2024-04-26T12:40:16.863010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778963+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:40:17.778963+0000","last_peered":"2024-04-26T12:40:17.778963+0000","last_clean":"2024-04-26T12:40:17.778963+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:40:17.778963+0000","last_undegraded":"2024-04-26T12:40:17.778963+0000","last_fullsized":"2024-04-26T12:40:17.778963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584625+0000","last_change":"2024-04-26T12:38:32.099862+0000","last_active":"2024-04-26T12:40:17.584625+0000","last_peered":"2024-04-26T12:40:17.584625+0000","last_clean":"2024-04-26T12:40:17.584625+0000","last_became_active":"2024-04-26T12:38:32.098951+0000","last_became_peered":"2024-04-26T12:38:32.098951+0000","last_unstale":"2024-04-26T12:40:17.584625+0000","last_undegraded":"2024-04-26T12:40:17.584625+0000","last_fullsized":"2024-04-26T12:40:17.584625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:37.401523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863575+0000","last_change":"2024-04-26T12:38:32.100120+0000","last_active":"2024-04-26T12:40:16.863575+0000","last_peered":"2024-04-26T12:40:16.863575+0000","last_clean":"2024-04-26T12:40:16.863575+0000","last_became_active":"2024-04-26T12:38:32.099583+0000","last_became_peered":"2024-04-26T12:38:32.099583+0000","last_unstale":"2024-04-26T12:40:16.863575+0000","last_undegraded":"2024-04-26T12:40:16.863575+0000","last_fullsized":"2024-04-26T12:40:16.863575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:16.598403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862746+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:40:16.862746+0000","last_peered":"2024-04-26T12:40:16.862746+0000","last_clean":"2024-04-26T12:40:16.862746+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:40:16.862746+0000","last_undegraded":"2024-04-26T12:40:16.862746+0000","last_fullsized":"2024-04-26T12:40:16.862746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"67'2","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864107+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:40:16.864107+0000","last_peered":"2024-04-26T12:40:16.864107+0000","last_clean":"2024-04-26T12:40:16.864107+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:40:16.864107+0000","last_undegraded":"2024-04-26T12:40:16.864107+0000","last_fullsized":"2024-04-26T12:40:16.864107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"73'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583873+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:40:17.583873+0000","last_peered":"2024-04-26T12:40:17.583873+0000","last_clean":"2024-04-26T12:40:17.583873+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:40:17.583873+0000","last_undegraded":"2024-04-26T12:40:17.583873+0000","last_fullsized":"2024-04-26T12:40:17.583873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779788+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:40:17.779788+0000","last_peered":"2024-04-26T12:40:17.779788+0000","last_clean":"2024-04-26T12:40:17.779788+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:40:17.779788+0000","last_undegraded":"2024-04-26T12:40:17.779788+0000","last_fullsized":"2024-04-26T12:40:17.779788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584133+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:40:17.584133+0000","last_peered":"2024-04-26T12:40:17.584133+0000","last_clean":"2024-04-26T12:40:17.584133+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:40:17.584133+0000","last_undegraded":"2024-04-26T12:40:17.584133+0000","last_fullsized":"2024-04-26T12:40:17.584133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"74'92","reported_seq":308,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589188+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:40:17.589188+0000","last_peered":"2024-04-26T12:40:17.589188+0000","last_clean":"2024-04-26T12:40:17.589188+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:40:17.589188+0000","last_undegraded":"2024-04-26T12:40:17.589188+0000","last_fullsized":"2024-04-26T12:40:17.589188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584063+0000","last_change":"2024-04-26T12:38:32.097189+0000","last_active":"2024-04-26T12:40:17.584063+0000","last_peered":"2024-04-26T12:40:17.584063+0000","last_clean":"2024-04-26T12:40:17.584063+0000","last_became_active":"2024-04-26T12:38:32.096313+0000","last_became_peered":"2024-04-26T12:38:32.096313+0000","last_unstale":"2024-04-26T12:40:17.584063+0000","last_undegraded":"2024-04-26T12:40:17.584063+0000","last_fullsized":"2024-04-26T12:40:17.584063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:26.879794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779357+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:40:17.779357+0000","last_peered":"2024-04-26T12:40:17.779357+0000","last_clean":"2024-04-26T12:40:17.779357+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:40:17.779357+0000","last_undegraded":"2024-04-26T12:40:17.779357+0000","last_fullsized":"2024-04-26T12:40:17.779357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'8","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772034+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:40:16.772034+0000","last_peered":"2024-04-26T12:40:16.772034+0000","last_clean":"2024-04-26T12:40:16.772034+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:40:16.772034+0000","last_undegraded":"2024-04-26T12:40:16.772034+0000","last_fullsized":"2024-04-26T12:40:16.772034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585549+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:40:17.585549+0000","last_peered":"2024-04-26T12:40:17.585549+0000","last_clean":"2024-04-26T12:40:17.585549+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:40:17.585549+0000","last_undegraded":"2024-04-26T12:40:17.585549+0000","last_fullsized":"2024-04-26T12:40:17.585549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"74'14","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589447+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:40:17.589447+0000","last_peered":"2024-04-26T12:40:17.589447+0000","last_clean":"2024-04-26T12:40:17.589447+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:40:17.589447+0000","last_undegraded":"2024-04-26T12:40:17.589447+0000","last_fullsized":"2024-04-26T12:40:17.589447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"74'92","reported_seq":232,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778661+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:40:17.778661+0000","last_peered":"2024-04-26T12:40:17.778661+0000","last_clean":"2024-04-26T12:40:17.778661+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:40:17.778661+0000","last_undegraded":"2024-04-26T12:40:17.778661+0000","last_fullsized":"2024-04-26T12:40:17.778661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584064+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:40:17.584064+0000","last_peered":"2024-04-26T12:40:17.584064+0000","last_clean":"2024-04-26T12:40:17.584064+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:40:17.584064+0000","last_undegraded":"2024-04-26T12:40:17.584064+0000","last_fullsized":"2024-04-26T12:40:17.584064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"73'1","reported_seq":83,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584606+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:40:17.584606+0000","last_peered":"2024-04-26T12:40:17.584606+0000","last_clean":"2024-04-26T12:40:17.584606+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:40:17.584606+0000","last_undegraded":"2024-04-26T12:40:17.584606+0000","last_fullsized":"2024-04-26T12:40:17.584606+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583217+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:40:17.583217+0000","last_peered":"2024-04-26T12:40:17.583217+0000","last_clean":"2024-04-26T12:40:17.583217+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:40:17.583217+0000","last_undegraded":"2024-04-26T12:40:17.583217+0000","last_fullsized":"2024-04-26T12:40:17.583217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"74'24","reported_seq":154,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584639+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:40:17.584639+0000","last_peered":"2024-04-26T12:40:17.584639+0000","last_clean":"2024-04-26T12:40:17.584639+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:40:17.584639+0000","last_undegraded":"2024-04-26T12:40:17.584639+0000","last_fullsized":"2024-04-26T12:40:17.584639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775160+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:40:17.775160+0000","last_peered":"2024-04-26T12:40:17.775160+0000","last_clean":"2024-04-26T12:40:17.775160+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:40:17.775160+0000","last_undegraded":"2024-04-26T12:40:17.775160+0000","last_fullsized":"2024-04-26T12:40:17.775160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585097+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:40:17.585097+0000","last_peered":"2024-04-26T12:40:17.585097+0000","last_clean":"2024-04-26T12:40:17.585097+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:40:17.585097+0000","last_undegraded":"2024-04-26T12:40:17.585097+0000","last_fullsized":"2024-04-26T12:40:17.585097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"68'6","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775518+0000","last_change":"2024-04-26T12:38:32.097378+0000","last_active":"2024-04-26T12:40:17.775518+0000","last_peered":"2024-04-26T12:40:17.775518+0000","last_clean":"2024-04-26T12:40:17.775518+0000","last_became_active":"2024-04-26T12:38:32.096994+0000","last_became_peered":"2024-04-26T12:38:32.096994+0000","last_unstale":"2024-04-26T12:40:17.775518+0000","last_undegraded":"2024-04-26T12:40:17.775518+0000","last_fullsized":"2024-04-26T12:40:17.775518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:26.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"72'5","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587289+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:40:17.587289+0000","last_peered":"2024-04-26T12:40:17.587289+0000","last_clean":"2024-04-26T12:40:17.587289+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:40:17.587289+0000","last_undegraded":"2024-04-26T12:40:17.587289+0000","last_fullsized":"2024-04-26T12:40:17.587289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583766+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:40:17.583766+0000","last_peered":"2024-04-26T12:40:17.583766+0000","last_clean":"2024-04-26T12:40:17.583766+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:40:17.583766+0000","last_undegraded":"2024-04-26T12:40:17.583766+0000","last_fullsized":"2024-04-26T12:40:17.583766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"74'16","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778775+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:40:17.778775+0000","last_peered":"2024-04-26T12:40:17.778775+0000","last_clean":"2024-04-26T12:40:17.778775+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:40:17.778775+0000","last_undegraded":"2024-04-26T12:40:17.778775+0000","last_fullsized":"2024-04-26T12:40:17.778775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777990+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:40:17.777990+0000","last_peered":"2024-04-26T12:40:17.777990+0000","last_clean":"2024-04-26T12:40:17.777990+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:40:17.777990+0000","last_undegraded":"2024-04-26T12:40:17.777990+0000","last_fullsized":"2024-04-26T12:40:17.777990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"68'3","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773311+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:40:16.773311+0000","last_peered":"2024-04-26T12:40:16.773311+0000","last_clean":"2024-04-26T12:40:16.773311+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:40:16.773311+0000","last_undegraded":"2024-04-26T12:40:16.773311+0000","last_fullsized":"2024-04-26T12:40:16.773311+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":144,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773046+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:40:16.773046+0000","last_peered":"2024-04-26T12:40:16.773046+0000","last_clean":"2024-04-26T12:40:16.773046+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:40:16.773046+0000","last_undegraded":"2024-04-26T12:40:16.773046+0000","last_fullsized":"2024-04-26T12:40:16.773046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.590110+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:40:17.590110+0000","last_peered":"2024-04-26T12:40:17.590110+0000","last_clean":"2024-04-26T12:40:17.590110+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:40:17.590110+0000","last_undegraded":"2024-04-26T12:40:17.590110+0000","last_fullsized":"2024-04-26T12:40:17.590110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584507+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:40:17.584507+0000","last_peered":"2024-04-26T12:40:17.584507+0000","last_clean":"2024-04-26T12:40:17.584507+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:40:17.584507+0000","last_undegraded":"2024-04-26T12:40:17.584507+0000","last_fullsized":"2024-04-26T12:40:17.584507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"74'21","reported_seq":149,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583518+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:40:17.583518+0000","last_peered":"2024-04-26T12:40:17.583518+0000","last_clean":"2024-04-26T12:40:17.583518+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:40:17.583518+0000","last_undegraded":"2024-04-26T12:40:17.583518+0000","last_fullsized":"2024-04-26T12:40:17.583518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"74'92","reported_seq":229,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862495+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:40:16.862495+0000","last_peered":"2024-04-26T12:40:16.862495+0000","last_clean":"2024-04-26T12:40:16.862495+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:40:16.862495+0000","last_undegraded":"2024-04-26T12:40:16.862495+0000","last_fullsized":"2024-04-26T12:40:16.862495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":115,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863675+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:40:16.863675+0000","last_peered":"2024-04-26T12:40:16.863675+0000","last_clean":"2024-04-26T12:40:16.863675+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:40:16.863675+0000","last_undegraded":"2024-04-26T12:40:16.863675+0000","last_fullsized":"2024-04-26T12:40:16.863675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":141,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863459+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:40:16.863459+0000","last_peered":"2024-04-26T12:40:16.863459+0000","last_clean":"2024-04-26T12:40:16.863459+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:40:16.863459+0000","last_undegraded":"2024-04-26T12:40:16.863459+0000","last_fullsized":"2024-04-26T12:40:16.863459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'4","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586848+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:40:17.586848+0000","last_peered":"2024-04-26T12:40:17.586848+0000","last_clean":"2024-04-26T12:40:17.586848+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:40:17.586848+0000","last_undegraded":"2024-04-26T12:40:17.586848+0000","last_fullsized":"2024-04-26T12:40:17.586848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583977+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:40:17.583977+0000","last_peered":"2024-04-26T12:40:17.583977+0000","last_clean":"2024-04-26T12:40:17.583977+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:40:17.583977+0000","last_undegraded":"2024-04-26T12:40:17.583977+0000","last_fullsized":"2024-04-26T12:40:17.583977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"74'22","reported_seq":150,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862696+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:40:16.862696+0000","last_peered":"2024-04-26T12:40:16.862696+0000","last_clean":"2024-04-26T12:40:16.862696+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:40:16.862696+0000","last_undegraded":"2024-04-26T12:40:16.862696+0000","last_fullsized":"2024-04-26T12:40:16.862696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583588+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:40:17.583588+0000","last_peered":"2024-04-26T12:40:17.583588+0000","last_clean":"2024-04-26T12:40:17.583588+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:40:17.583588+0000","last_undegraded":"2024-04-26T12:40:17.583588+0000","last_fullsized":"2024-04-26T12:40:17.583588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"68'5","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776035+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:40:17.776035+0000","last_peered":"2024-04-26T12:40:17.776035+0000","last_clean":"2024-04-26T12:40:17.776035+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:40:17.776035+0000","last_undegraded":"2024-04-26T12:40:17.776035+0000","last_fullsized":"2024-04-26T12:40:17.776035+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"68'2","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778994+0000","last_change":"2024-04-26T12:38:32.098058+0000","last_active":"2024-04-26T12:40:17.778994+0000","last_peered":"2024-04-26T12:40:17.778994+0000","last_clean":"2024-04-26T12:40:17.778994+0000","last_became_active":"2024-04-26T12:38:32.095643+0000","last_became_peered":"2024-04-26T12:38:32.095643+0000","last_unstale":"2024-04-26T12:40:17.778994+0000","last_undegraded":"2024-04-26T12:40:17.778994+0000","last_fullsized":"2024-04-26T12:40:17.778994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:56.628368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"73'5","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778115+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:40:17.778115+0000","last_peered":"2024-04-26T12:40:17.778115+0000","last_clean":"2024-04-26T12:40:17.778115+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:40:17.778115+0000","last_undegraded":"2024-04-26T12:40:17.778115+0000","last_fullsized":"2024-04-26T12:40:17.778115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584280+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:40:17.584280+0000","last_peered":"2024-04-26T12:40:17.584280+0000","last_clean":"2024-04-26T12:40:17.584280+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:40:17.584280+0000","last_undegraded":"2024-04-26T12:40:17.584280+0000","last_fullsized":"2024-04-26T12:40:17.584280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"74'16","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776802+0000","last_change":"2024-04-26T12:38:32.096426+0000","last_active":"2024-04-26T12:40:17.776802+0000","last_peered":"2024-04-26T12:40:17.776802+0000","last_clean":"2024-04-26T12:40:17.776802+0000","last_became_active":"2024-04-26T12:38:32.095992+0000","last_became_peered":"2024-04-26T12:38:32.095992+0000","last_unstale":"2024-04-26T12:40:17.776802+0000","last_undegraded":"2024-04-26T12:40:17.776802+0000","last_fullsized":"2024-04-26T12:40:17.776802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:27.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864064+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:40:16.864064+0000","last_peered":"2024-04-26T12:40:16.864064+0000","last_clean":"2024-04-26T12:40:16.864064+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:40:16.864064+0000","last_undegraded":"2024-04-26T12:40:16.864064+0000","last_fullsized":"2024-04-26T12:40:16.864064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775538+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:40:17.775538+0000","last_peered":"2024-04-26T12:40:17.775538+0000","last_clean":"2024-04-26T12:40:17.775538+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:40:17.775538+0000","last_undegraded":"2024-04-26T12:40:17.775538+0000","last_fullsized":"2024-04-26T12:40:17.775538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584385+0000","last_change":"2024-04-26T12:38:32.097968+0000","last_active":"2024-04-26T12:40:17.584385+0000","last_peered":"2024-04-26T12:40:17.584385+0000","last_clean":"2024-04-26T12:40:17.584385+0000","last_became_active":"2024-04-26T12:38:32.095619+0000","last_became_peered":"2024-04-26T12:38:32.095619+0000","last_unstale":"2024-04-26T12:40:17.584385+0000","last_undegraded":"2024-04-26T12:40:17.584385+0000","last_fullsized":"2024-04-26T12:40:17.584385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"72'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773485+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:40:16.773485+0000","last_peered":"2024-04-26T12:40:16.773485+0000","last_clean":"2024-04-26T12:40:16.773485+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:40:16.773485+0000","last_undegraded":"2024-04-26T12:40:16.773485+0000","last_fullsized":"2024-04-26T12:40:16.773485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775232+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:40:17.775232+0000","last_peered":"2024-04-26T12:40:17.775232+0000","last_clean":"2024-04-26T12:40:17.775232+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:40:17.775232+0000","last_undegraded":"2024-04-26T12:40:17.775232+0000","last_fullsized":"2024-04-26T12:40:17.775232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"74'20","reported_seq":148,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584732+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:40:17.584732+0000","last_peered":"2024-04-26T12:40:17.584732+0000","last_clean":"2024-04-26T12:40:17.584732+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:40:17.584732+0000","last_undegraded":"2024-04-26T12:40:17.584732+0000","last_fullsized":"2024-04-26T12:40:17.584732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"74'92","reported_seq":239,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584453+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:40:17.584453+0000","last_peered":"2024-04-26T12:40:17.584453+0000","last_clean":"2024-04-26T12:40:17.584453+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:40:17.584453+0000","last_undegraded":"2024-04-26T12:40:17.584453+0000","last_fullsized":"2024-04-26T12:40:17.584453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775393+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:40:17.775393+0000","last_peered":"2024-04-26T12:40:17.775393+0000","last_clean":"2024-04-26T12:40:17.775393+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:40:17.775393+0000","last_undegraded":"2024-04-26T12:40:17.775393+0000","last_fullsized":"2024-04-26T12:40:17.775393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'4","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773085+0000","last_change":"2024-04-26T12:38:32.098436+0000","last_active":"2024-04-26T12:40:16.773085+0000","last_peered":"2024-04-26T12:40:16.773085+0000","last_clean":"2024-04-26T12:40:16.773085+0000","last_became_active":"2024-04-26T12:38:32.097675+0000","last_became_peered":"2024-04-26T12:38:32.097675+0000","last_unstale":"2024-04-26T12:40:16.773085+0000","last_undegraded":"2024-04-26T12:40:16.773085+0000","last_fullsized":"2024-04-26T12:40:16.773085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:10.967994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"73'3","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583615+0000","last_change":"2024-04-26T12:38:32.091912+0000","last_active":"2024-04-26T12:40:17.583615+0000","last_peered":"2024-04-26T12:40:17.583615+0000","last_clean":"2024-04-26T12:40:17.583615+0000","last_became_active":"2024-04-26T12:38:32.091595+0000","last_became_peered":"2024-04-26T12:38:32.091595+0000","last_unstale":"2024-04-26T12:40:17.583615+0000","last_undegraded":"2024-04-26T12:40:17.583615+0000","last_fullsized":"2024-04-26T12:40:17.583615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:30.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":246,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586646+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:40:17.586646+0000","last_peered":"2024-04-26T12:40:17.586646+0000","last_clean":"2024-04-26T12:40:17.586646+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:40:17.586646+0000","last_undegraded":"2024-04-26T12:40:17.586646+0000","last_fullsized":"2024-04-26T12:40:17.586646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778741+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:40:17.778741+0000","last_peered":"2024-04-26T12:40:17.778741+0000","last_clean":"2024-04-26T12:40:17.778741+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:40:17.778741+0000","last_undegraded":"2024-04-26T12:40:17.778741+0000","last_fullsized":"2024-04-26T12:40:17.778741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"74'92","reported_seq":266,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772990+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:40:16.772990+0000","last_peered":"2024-04-26T12:40:16.772990+0000","last_clean":"2024-04-26T12:40:16.772990+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:40:16.772990+0000","last_undegraded":"2024-04-26T12:40:16.772990+0000","last_fullsized":"2024-04-26T12:40:16.772990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862828+0000","last_change":"2024-04-26T12:38:32.092303+0000","last_active":"2024-04-26T12:40:16.862828+0000","last_peered":"2024-04-26T12:40:16.862828+0000","last_clean":"2024-04-26T12:40:16.862828+0000","last_became_active":"2024-04-26T12:38:32.091872+0000","last_became_peered":"2024-04-26T12:38:32.091872+0000","last_unstale":"2024-04-26T12:40:16.862828+0000","last_undegraded":"2024-04-26T12:40:16.862828+0000","last_fullsized":"2024-04-26T12:40:16.862828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776331+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:40:17.776331+0000","last_peered":"2024-04-26T12:40:17.776331+0000","last_clean":"2024-04-26T12:40:17.776331+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:40:17.776331+0000","last_undegraded":"2024-04-26T12:40:17.776331+0000","last_fullsized":"2024-04-26T12:40:17.776331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'4","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776321+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:40:17.776321+0000","last_peered":"2024-04-26T12:40:17.776321+0000","last_clean":"2024-04-26T12:40:17.776321+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:40:17.776321+0000","last_undegraded":"2024-04-26T12:40:17.776321+0000","last_fullsized":"2024-04-26T12:40:17.776321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585811+0000","last_change":"2024-04-26T12:38:32.094763+0000","last_active":"2024-04-26T12:40:17.585811+0000","last_peered":"2024-04-26T12:40:17.585811+0000","last_clean":"2024-04-26T12:40:17.585811+0000","last_became_active":"2024-04-26T12:38:32.094384+0000","last_became_peered":"2024-04-26T12:38:32.094384+0000","last_unstale":"2024-04-26T12:40:17.585811+0000","last_undegraded":"2024-04-26T12:40:17.585811+0000","last_fullsized":"2024-04-26T12:40:17.585811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"74'23","reported_seq":152,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585311+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:40:17.585311+0000","last_peered":"2024-04-26T12:40:17.585311+0000","last_clean":"2024-04-26T12:40:17.585311+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:40:17.585311+0000","last_undegraded":"2024-04-26T12:40:17.585311+0000","last_fullsized":"2024-04-26T12:40:17.585311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772092+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:40:16.772092+0000","last_peered":"2024-04-26T12:40:16.772092+0000","last_clean":"2024-04-26T12:40:16.772092+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:40:16.772092+0000","last_undegraded":"2024-04-26T12:40:16.772092+0000","last_fullsized":"2024-04-26T12:40:16.772092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":111,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775023+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:40:17.775023+0000","last_peered":"2024-04-26T12:40:17.775023+0000","last_clean":"2024-04-26T12:40:17.775023+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:40:17.775023+0000","last_undegraded":"2024-04-26T12:40:17.775023+0000","last_fullsized":"2024-04-26T12:40:17.775023+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":163,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773718+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:40:16.773718+0000","last_peered":"2024-04-26T12:40:16.773718+0000","last_clean":"2024-04-26T12:40:16.773718+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:40:16.773718+0000","last_undegraded":"2024-04-26T12:40:16.773718+0000","last_fullsized":"2024-04-26T12:40:16.773718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":287,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583788+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:40:17.583788+0000","last_peered":"2024-04-26T12:40:17.583788+0000","last_clean":"2024-04-26T12:40:17.583788+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:40:17.583788+0000","last_undegraded":"2024-04-26T12:40:17.583788+0000","last_fullsized":"2024-04-26T12:40:17.583788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585363+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:40:17.585363+0000","last_peered":"2024-04-26T12:40:17.585363+0000","last_clean":"2024-04-26T12:40:17.585363+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:40:17.585363+0000","last_undegraded":"2024-04-26T12:40:17.585363+0000","last_fullsized":"2024-04-26T12:40:17.585363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"73'5","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778357+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:40:17.778357+0000","last_peered":"2024-04-26T12:40:17.778357+0000","last_clean":"2024-04-26T12:40:17.778357+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:40:17.778357+0000","last_undegraded":"2024-04-26T12:40:17.778357+0000","last_fullsized":"2024-04-26T12:40:17.778357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585660+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:40:17.585660+0000","last_peered":"2024-04-26T12:40:17.585660+0000","last_clean":"2024-04-26T12:40:17.585660+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:40:17.585660+0000","last_undegraded":"2024-04-26T12:40:17.585660+0000","last_fullsized":"2024-04-26T12:40:17.585660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"74'29","reported_seq":161,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587192+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:40:17.587192+0000","last_peered":"2024-04-26T12:40:17.587192+0000","last_clean":"2024-04-26T12:40:17.587192+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:40:17.587192+0000","last_undegraded":"2024-04-26T12:40:17.587192+0000","last_fullsized":"2024-04-26T12:40:17.587192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863727+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:40:16.863727+0000","last_peered":"2024-04-26T12:40:16.863727+0000","last_clean":"2024-04-26T12:40:16.863727+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:40:16.863727+0000","last_undegraded":"2024-04-26T12:40:16.863727+0000","last_fullsized":"2024-04-26T12:40:16.863727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771666+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:40:16.771666+0000","last_peered":"2024-04-26T12:40:16.771666+0000","last_clean":"2024-04-26T12:40:16.771666+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:40:16.771666+0000","last_undegraded":"2024-04-26T12:40:16.771666+0000","last_fullsized":"2024-04-26T12:40:16.771666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863987+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:40:16.863987+0000","last_peered":"2024-04-26T12:40:16.863987+0000","last_clean":"2024-04-26T12:40:16.863987+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:40:16.863987+0000","last_undegraded":"2024-04-26T12:40:16.863987+0000","last_fullsized":"2024-04-26T12:40:16.863987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583513+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:40:17.583513+0000","last_peered":"2024-04-26T12:40:17.583513+0000","last_clean":"2024-04-26T12:40:17.583513+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:40:17.583513+0000","last_undegraded":"2024-04-26T12:40:17.583513+0000","last_fullsized":"2024-04-26T12:40:17.583513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862758+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:40:16.862758+0000","last_peered":"2024-04-26T12:40:16.862758+0000","last_clean":"2024-04-26T12:40:16.862758+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:40:16.862758+0000","last_undegraded":"2024-04-26T12:40:16.862758+0000","last_fullsized":"2024-04-26T12:40:16.862758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587495+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:40:17.587495+0000","last_peered":"2024-04-26T12:40:17.587495+0000","last_clean":"2024-04-26T12:40:17.587495+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:40:17.587495+0000","last_undegraded":"2024-04-26T12:40:17.587495+0000","last_fullsized":"2024-04-26T12:40:17.587495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"74'99","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775130+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:40:17.775130+0000","last_peered":"2024-04-26T12:40:17.775130+0000","last_clean":"2024-04-26T12:40:17.775130+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:40:17.775130+0000","last_undegraded":"2024-04-26T12:40:17.775130+0000","last_fullsized":"2024-04-26T12:40:17.775130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":134,"num_read_kb":119,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589329+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:40:17.589329+0000","last_peered":"2024-04-26T12:40:17.589329+0000","last_clean":"2024-04-26T12:40:17.589329+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:40:17.589329+0000","last_undegraded":"2024-04-26T12:40:17.589329+0000","last_fullsized":"2024-04-26T12:40:17.589329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":111,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774225+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:40:17.774225+0000","last_peered":"2024-04-26T12:40:17.774225+0000","last_clean":"2024-04-26T12:40:17.774225+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:40:17.774225+0000","last_undegraded":"2024-04-26T12:40:17.774225+0000","last_fullsized":"2024-04-26T12:40:17.774225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"74'8","reported_seq":148,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776422+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:40:17.776422+0000","last_peered":"2024-04-26T12:40:17.776422+0000","last_clean":"2024-04-26T12:40:17.776422+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:40:17.776422+0000","last_undegraded":"2024-04-26T12:40:17.776422+0000","last_fullsized":"2024-04-26T12:40:17.776422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583775+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:40:17.583775+0000","last_peered":"2024-04-26T12:40:17.583775+0000","last_clean":"2024-04-26T12:40:17.583775+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:40:17.583775+0000","last_undegraded":"2024-04-26T12:40:17.583775+0000","last_fullsized":"2024-04-26T12:40:17.583775+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"73'9","reported_seq":142,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774292+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:40:17.774292+0000","last_peered":"2024-04-26T12:40:17.774292+0000","last_clean":"2024-04-26T12:40:17.774292+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:40:17.774292+0000","last_undegraded":"2024-04-26T12:40:17.774292+0000","last_fullsized":"2024-04-26T12:40:17.774292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":185,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584570+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:40:17.584570+0000","last_peered":"2024-04-26T12:40:17.584570+0000","last_clean":"2024-04-26T12:40:17.584570+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:40:17.584570+0000","last_undegraded":"2024-04-26T12:40:17.584570+0000","last_fullsized":"2024-04-26T12:40:17.584570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"67'16","reported_seq":164,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589726+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:40:17.589726+0000","last_peered":"2024-04-26T12:40:17.589726+0000","last_clean":"2024-04-26T12:40:17.589726+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:40:17.589726+0000","last_undegraded":"2024-04-26T12:40:17.589726+0000","last_fullsized":"2024-04-26T12:40:17.589726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863155+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:40:16.863155+0000","last_peered":"2024-04-26T12:40:16.863155+0000","last_clean":"2024-04-26T12:40:16.863155+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:40:16.863155+0000","last_undegraded":"2024-04-26T12:40:16.863155+0000","last_fullsized":"2024-04-26T12:40:16.863155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778713+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:40:17.778713+0000","last_peered":"2024-04-26T12:40:17.778713+0000","last_clean":"2024-04-26T12:40:17.778713+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:40:17.778713+0000","last_undegraded":"2024-04-26T12:40:17.778713+0000","last_fullsized":"2024-04-26T12:40:17.778713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":150,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775786+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:40:17.775786+0000","last_peered":"2024-04-26T12:40:17.775786+0000","last_clean":"2024-04-26T12:40:17.775786+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:40:17.775786+0000","last_undegraded":"2024-04-26T12:40:17.775786+0000","last_fullsized":"2024-04-26T12:40:17.775786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586216+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:40:17.586216+0000","last_peered":"2024-04-26T12:40:17.586216+0000","last_clean":"2024-04-26T12:40:17.586216+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:40:17.586216+0000","last_undegraded":"2024-04-26T12:40:17.586216+0000","last_fullsized":"2024-04-26T12:40:17.586216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'4","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863386+0000","last_change":"2024-04-26T12:38:32.099375+0000","last_active":"2024-04-26T12:40:16.863386+0000","last_peered":"2024-04-26T12:40:16.863386+0000","last_clean":"2024-04-26T12:40:16.863386+0000","last_became_active":"2024-04-26T12:38:32.098983+0000","last_became_peered":"2024-04-26T12:38:32.098983+0000","last_unstale":"2024-04-26T12:40:16.863386+0000","last_undegraded":"2024-04-26T12:40:16.863386+0000","last_fullsized":"2024-04-26T12:40:16.863386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.281648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863528+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:40:16.863528+0000","last_peered":"2024-04-26T12:40:16.863528+0000","last_clean":"2024-04-26T12:40:16.863528+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:40:16.863528+0000","last_undegraded":"2024-04-26T12:40:16.863528+0000","last_fullsized":"2024-04-26T12:40:16.863528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":139,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779248+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:40:17.779248+0000","last_peered":"2024-04-26T12:40:17.779248+0000","last_clean":"2024-04-26T12:40:17.779248+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:40:17.779248+0000","last_undegraded":"2024-04-26T12:40:17.779248+0000","last_fullsized":"2024-04-26T12:40:17.779248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773518+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:40:16.773518+0000","last_peered":"2024-04-26T12:40:16.773518+0000","last_clean":"2024-04-26T12:40:16.773518+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:40:16.773518+0000","last_undegraded":"2024-04-26T12:40:16.773518+0000","last_fullsized":"2024-04-26T12:40:16.773518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":116,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583396+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:40:17.583396+0000","last_peered":"2024-04-26T12:40:17.583396+0000","last_clean":"2024-04-26T12:40:17.583396+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:40:17.583396+0000","last_undegraded":"2024-04-26T12:40:17.583396+0000","last_fullsized":"2024-04-26T12:40:17.583396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774632+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:40:17.774632+0000","last_peered":"2024-04-26T12:40:17.774632+0000","last_clean":"2024-04-26T12:40:17.774632+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:40:17.774632+0000","last_undegraded":"2024-04-26T12:40:17.774632+0000","last_fullsized":"2024-04-26T12:40:17.774632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'4","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587139+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:40:17.587139+0000","last_peered":"2024-04-26T12:40:17.587139+0000","last_clean":"2024-04-26T12:40:17.587139+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:40:17.587139+0000","last_undegraded":"2024-04-26T12:40:17.587139+0000","last_fullsized":"2024-04-26T12:40:17.587139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775939+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:40:17.775939+0000","last_peered":"2024-04-26T12:40:17.775939+0000","last_clean":"2024-04-26T12:40:17.775939+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:40:17.775939+0000","last_undegraded":"2024-04-26T12:40:17.775939+0000","last_fullsized":"2024-04-26T12:40:17.775939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863188+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:40:16.863188+0000","last_peered":"2024-04-26T12:40:16.863188+0000","last_clean":"2024-04-26T12:40:16.863188+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:40:16.863188+0000","last_undegraded":"2024-04-26T12:40:16.863188+0000","last_fullsized":"2024-04-26T12:40:16.863188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"74'28","reported_seq":160,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862952+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:40:16.862952+0000","last_peered":"2024-04-26T12:40:16.862952+0000","last_clean":"2024-04-26T12:40:16.862952+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:40:16.862952+0000","last_undegraded":"2024-04-26T12:40:16.862952+0000","last_fullsized":"2024-04-26T12:40:16.862952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":106,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777931+0000","last_change":"2024-04-26T12:38:32.094008+0000","last_active":"2024-04-26T12:40:17.777931+0000","last_peered":"2024-04-26T12:40:17.777931+0000","last_clean":"2024-04-26T12:40:17.777931+0000","last_became_active":"2024-04-26T12:38:32.092362+0000","last_became_peered":"2024-04-26T12:38:32.092362+0000","last_unstale":"2024-04-26T12:40:17.777931+0000","last_undegraded":"2024-04-26T12:40:17.777931+0000","last_fullsized":"2024-04-26T12:40:17.777931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.395782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863517+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:40:16.863517+0000","last_peered":"2024-04-26T12:40:16.863517+0000","last_clean":"2024-04-26T12:40:16.863517+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:40:16.863517+0000","last_undegraded":"2024-04-26T12:40:16.863517+0000","last_fullsized":"2024-04-26T12:40:16.863517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863473+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:40:16.863473+0000","last_peered":"2024-04-26T12:40:16.863473+0000","last_clean":"2024-04-26T12:40:16.863473+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:40:16.863473+0000","last_undegraded":"2024-04-26T12:40:16.863473+0000","last_fullsized":"2024-04-26T12:40:16.863473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'4","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775886+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:40:17.775886+0000","last_peered":"2024-04-26T12:40:17.775886+0000","last_clean":"2024-04-26T12:40:17.775886+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:40:17.775886+0000","last_undegraded":"2024-04-26T12:40:17.775886+0000","last_fullsized":"2024-04-26T12:40:17.775886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.590430+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:40:17.590430+0000","last_peered":"2024-04-26T12:40:17.590430+0000","last_clean":"2024-04-26T12:40:17.590430+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:40:17.590430+0000","last_undegraded":"2024-04-26T12:40:17.590430+0000","last_fullsized":"2024-04-26T12:40:17.590430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772580+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:40:16.772580+0000","last_peered":"2024-04-26T12:40:16.772580+0000","last_clean":"2024-04-26T12:40:16.772580+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:40:16.772580+0000","last_undegraded":"2024-04-26T12:40:16.772580+0000","last_fullsized":"2024-04-26T12:40:16.772580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774157+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:40:17.774157+0000","last_peered":"2024-04-26T12:40:17.774157+0000","last_clean":"2024-04-26T12:40:17.774157+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:40:17.774157+0000","last_undegraded":"2024-04-26T12:40:17.774157+0000","last_fullsized":"2024-04-26T12:40:17.774157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"74'92","reported_seq":231,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583916+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:40:17.583916+0000","last_peered":"2024-04-26T12:40:17.583916+0000","last_clean":"2024-04-26T12:40:17.583916+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:40:17.583916+0000","last_undegraded":"2024-04-26T12:40:17.583916+0000","last_fullsized":"2024-04-26T12:40:17.583916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779565+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:40:17.779565+0000","last_peered":"2024-04-26T12:40:17.779565+0000","last_clean":"2024-04-26T12:40:17.779565+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:40:17.779565+0000","last_undegraded":"2024-04-26T12:40:17.779565+0000","last_fullsized":"2024-04-26T12:40:17.779565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":147,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775954+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:40:17.775954+0000","last_peered":"2024-04-26T12:40:17.775954+0000","last_clean":"2024-04-26T12:40:17.775954+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:40:17.775954+0000","last_undegraded":"2024-04-26T12:40:17.775954+0000","last_fullsized":"2024-04-26T12:40:17.775954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'2","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779116+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:40:17.779116+0000","last_peered":"2024-04-26T12:40:17.779116+0000","last_clean":"2024-04-26T12:40:17.779116+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:40:17.779116+0000","last_undegraded":"2024-04-26T12:40:17.779116+0000","last_fullsized":"2024-04-26T12:40:17.779116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777311+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:40:17.777311+0000","last_peered":"2024-04-26T12:40:17.777311+0000","last_clean":"2024-04-26T12:40:17.777311+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:40:17.777311+0000","last_undegraded":"2024-04-26T12:40:17.777311+0000","last_fullsized":"2024-04-26T12:40:17.777311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777900+0000","last_change":"2024-04-26T12:38:32.094625+0000","last_active":"2024-04-26T12:40:17.777900+0000","last_peered":"2024-04-26T12:40:17.777900+0000","last_clean":"2024-04-26T12:40:17.777900+0000","last_became_active":"2024-04-26T12:38:32.093266+0000","last_became_peered":"2024-04-26T12:38:32.093266+0000","last_unstale":"2024-04-26T12:40:17.777900+0000","last_undegraded":"2024-04-26T12:40:17.777900+0000","last_fullsized":"2024-04-26T12:40:17.777900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:18:18.695479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778131+0000","last_change":"2024-04-26T12:38:32.097625+0000","last_active":"2024-04-26T12:40:17.778131+0000","last_peered":"2024-04-26T12:40:17.778131+0000","last_clean":"2024-04-26T12:40:17.778131+0000","last_became_active":"2024-04-26T12:38:32.097186+0000","last_became_peered":"2024-04-26T12:38:32.097186+0000","last_unstale":"2024-04-26T12:40:17.778131+0000","last_undegraded":"2024-04-26T12:40:17.778131+0000","last_fullsized":"2024-04-26T12:40:17.778131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:09.866995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"74'92","reported_seq":232,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779046+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:40:17.779046+0000","last_peered":"2024-04-26T12:40:17.779046+0000","last_clean":"2024-04-26T12:40:17.779046+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:40:17.779046+0000","last_undegraded":"2024-04-26T12:40:17.779046+0000","last_fullsized":"2024-04-26T12:40:17.779046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863313+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:40:16.863313+0000","last_peered":"2024-04-26T12:40:16.863313+0000","last_clean":"2024-04-26T12:40:16.863313+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:40:16.863313+0000","last_undegraded":"2024-04-26T12:40:16.863313+0000","last_fullsized":"2024-04-26T12:40:16.863313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585200+0000","last_change":"2024-04-26T12:38:32.089371+0000","last_active":"2024-04-26T12:40:17.585200+0000","last_peered":"2024-04-26T12:40:17.585200+0000","last_clean":"2024-04-26T12:40:17.585200+0000","last_became_active":"2024-04-26T12:38:32.088665+0000","last_became_peered":"2024-04-26T12:38:32.088665+0000","last_unstale":"2024-04-26T12:40:17.585200+0000","last_undegraded":"2024-04-26T12:40:17.585200+0000","last_fullsized":"2024-04-26T12:40:17.585200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:48.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"74'5","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864175+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:40:16.864175+0000","last_peered":"2024-04-26T12:40:16.864175+0000","last_clean":"2024-04-26T12:40:16.864175+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:40:16.864175+0000","last_undegraded":"2024-04-26T12:40:16.864175+0000","last_fullsized":"2024-04-26T12:40:16.864175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.774306+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:40:16.774306+0000","last_peered":"2024-04-26T12:40:16.774306+0000","last_clean":"2024-04-26T12:40:16.774306+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:40:16.774306+0000","last_undegraded":"2024-04-26T12:40:16.774306+0000","last_fullsized":"2024-04-26T12:40:16.774306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776016+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:40:17.776016+0000","last_peered":"2024-04-26T12:40:17.776016+0000","last_clean":"2024-04-26T12:40:17.776016+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:40:17.776016+0000","last_undegraded":"2024-04-26T12:40:17.776016+0000","last_fullsized":"2024-04-26T12:40:17.776016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"74'34","reported_seq":169,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584498+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:40:17.584498+0000","last_peered":"2024-04-26T12:40:17.584498+0000","last_clean":"2024-04-26T12:40:17.584498+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:40:17.584498+0000","last_undegraded":"2024-04-26T12:40:17.584498+0000","last_fullsized":"2024-04-26T12:40:17.584498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778005+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:40:17.778005+0000","last_peered":"2024-04-26T12:40:17.778005+0000","last_clean":"2024-04-26T12:40:17.778005+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:40:17.778005+0000","last_undegraded":"2024-04-26T12:40:17.778005+0000","last_fullsized":"2024-04-26T12:40:17.778005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585018+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:40:17.585018+0000","last_peered":"2024-04-26T12:40:17.585018+0000","last_clean":"2024-04-26T12:40:17.585018+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:40:17.585018+0000","last_undegraded":"2024-04-26T12:40:17.585018+0000","last_fullsized":"2024-04-26T12:40:17.585018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"68'3","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863964+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:40:16.863964+0000","last_peered":"2024-04-26T12:40:16.863964+0000","last_clean":"2024-04-26T12:40:16.863964+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:40:16.863964+0000","last_undegraded":"2024-04-26T12:40:16.863964+0000","last_fullsized":"2024-04-26T12:40:16.863964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772458+0000","last_change":"2024-04-26T12:38:32.098082+0000","last_active":"2024-04-26T12:40:16.772458+0000","last_peered":"2024-04-26T12:40:16.772458+0000","last_clean":"2024-04-26T12:40:16.772458+0000","last_became_active":"2024-04-26T12:38:32.097658+0000","last_became_peered":"2024-04-26T12:38:32.097658+0000","last_unstale":"2024-04-26T12:40:16.772458+0000","last_undegraded":"2024-04-26T12:40:16.772458+0000","last_fullsized":"2024-04-26T12:40:16.772458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:15.092930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"72'4","reported_seq":107,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586025+0000","last_change":"2024-04-26T12:38:32.090992+0000","last_active":"2024-04-26T12:40:17.586025+0000","last_peered":"2024-04-26T12:40:17.586025+0000","last_clean":"2024-04-26T12:40:17.586025+0000","last_became_active":"2024-04-26T12:38:32.090197+0000","last_became_peered":"2024-04-26T12:38:32.090197+0000","last_unstale":"2024-04-26T12:40:17.586025+0000","last_undegraded":"2024-04-26T12:40:17.586025+0000","last_fullsized":"2024-04-26T12:40:17.586025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:51.388263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774684+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:40:17.774684+0000","last_peered":"2024-04-26T12:40:17.774684+0000","last_clean":"2024-04-26T12:40:17.774684+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:40:17.774684+0000","last_undegraded":"2024-04-26T12:40:17.774684+0000","last_fullsized":"2024-04-26T12:40:17.774684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"74'16","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775279+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:40:17.775279+0000","last_peered":"2024-04-26T12:40:17.775279+0000","last_clean":"2024-04-26T12:40:17.775279+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:40:17.775279+0000","last_undegraded":"2024-04-26T12:40:17.775279+0000","last_fullsized":"2024-04-26T12:40:17.775279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775673+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:40:17.775673+0000","last_peered":"2024-04-26T12:40:17.775673+0000","last_clean":"2024-04-26T12:40:17.775673+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:40:17.775673+0000","last_undegraded":"2024-04-26T12:40:17.775673+0000","last_fullsized":"2024-04-26T12:40:17.775673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":112,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778932+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:40:17.778932+0000","last_peered":"2024-04-26T12:40:17.778932+0000","last_clean":"2024-04-26T12:40:17.778932+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:40:17.778932+0000","last_undegraded":"2024-04-26T12:40:17.778932+0000","last_fullsized":"2024-04-26T12:40:17.778932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774502+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:40:17.774502+0000","last_peered":"2024-04-26T12:40:17.774502+0000","last_clean":"2024-04-26T12:40:17.774502+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:40:17.774502+0000","last_undegraded":"2024-04-26T12:40:17.774502+0000","last_fullsized":"2024-04-26T12:40:17.774502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"71'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589986+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:40:17.589986+0000","last_peered":"2024-04-26T12:40:17.589986+0000","last_clean":"2024-04-26T12:40:17.589986+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:40:17.589986+0000","last_undegraded":"2024-04-26T12:40:17.589986+0000","last_fullsized":"2024-04-26T12:40:17.589986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778350+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:40:17.778350+0000","last_peered":"2024-04-26T12:40:17.778350+0000","last_clean":"2024-04-26T12:40:17.778350+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:40:17.778350+0000","last_undegraded":"2024-04-26T12:40:17.778350+0000","last_fullsized":"2024-04-26T12:40:17.778350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'5","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862691+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:40:16.862691+0000","last_peered":"2024-04-26T12:40:16.862691+0000","last_clean":"2024-04-26T12:40:16.862691+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:40:16.862691+0000","last_undegraded":"2024-04-26T12:40:16.862691+0000","last_fullsized":"2024-04-26T12:40:16.862691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583478+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:40:17.583478+0000","last_peered":"2024-04-26T12:40:17.583478+0000","last_clean":"2024-04-26T12:40:17.583478+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:40:17.583478+0000","last_undegraded":"2024-04-26T12:40:17.583478+0000","last_fullsized":"2024-04-26T12:40:17.583478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":117,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863403+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:40:16.863403+0000","last_peered":"2024-04-26T12:40:16.863403+0000","last_clean":"2024-04-26T12:40:16.863403+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:40:16.863403+0000","last_undegraded":"2024-04-26T12:40:16.863403+0000","last_fullsized":"2024-04-26T12:40:16.863403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":159,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778216+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:40:17.778216+0000","last_peered":"2024-04-26T12:40:17.778216+0000","last_clean":"2024-04-26T12:40:17.778216+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:40:17.778216+0000","last_undegraded":"2024-04-26T12:40:17.778216+0000","last_fullsized":"2024-04-26T12:40:17.778216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"73'1","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586179+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:40:17.586179+0000","last_peered":"2024-04-26T12:40:17.586179+0000","last_clean":"2024-04-26T12:40:17.586179+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:40:17.586179+0000","last_undegraded":"2024-04-26T12:40:17.586179+0000","last_fullsized":"2024-04-26T12:40:17.586179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.582831+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:40:17.582831+0000","last_peered":"2024-04-26T12:40:17.582831+0000","last_clean":"2024-04-26T12:40:17.582831+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:40:17.582831+0000","last_undegraded":"2024-04-26T12:40:17.582831+0000","last_fullsized":"2024-04-26T12:40:17.582831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"74'16","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778235+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:40:17.778235+0000","last_peered":"2024-04-26T12:40:17.778235+0000","last_clean":"2024-04-26T12:40:17.778235+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:40:17.778235+0000","last_undegraded":"2024-04-26T12:40:17.778235+0000","last_fullsized":"2024-04-26T12:40:17.778235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772598+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:40:16.772598+0000","last_peered":"2024-04-26T12:40:16.772598+0000","last_clean":"2024-04-26T12:40:16.772598+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:40:16.772598+0000","last_undegraded":"2024-04-26T12:40:16.772598+0000","last_fullsized":"2024-04-26T12:40:16.772598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584805+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:40:17.584805+0000","last_peered":"2024-04-26T12:40:17.584805+0000","last_clean":"2024-04-26T12:40:17.584805+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:40:17.584805+0000","last_undegraded":"2024-04-26T12:40:17.584805+0000","last_fullsized":"2024-04-26T12:40:17.584805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776151+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:40:17.776151+0000","last_peered":"2024-04-26T12:40:17.776151+0000","last_clean":"2024-04-26T12:40:17.776151+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:40:17.776151+0000","last_undegraded":"2024-04-26T12:40:17.776151+0000","last_fullsized":"2024-04-26T12:40:17.776151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"71'3","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864198+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:40:16.864198+0000","last_peered":"2024-04-26T12:40:16.864198+0000","last_clean":"2024-04-26T12:40:16.864198+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:40:16.864198+0000","last_undegraded":"2024-04-26T12:40:16.864198+0000","last_fullsized":"2024-04-26T12:40:16.864198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772116+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:40:16.772116+0000","last_peered":"2024-04-26T12:40:16.772116+0000","last_clean":"2024-04-26T12:40:16.772116+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:40:16.772116+0000","last_undegraded":"2024-04-26T12:40:16.772116+0000","last_fullsized":"2024-04-26T12:40:16.772116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"74'16","reported_seq":141,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584198+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:40:17.584198+0000","last_peered":"2024-04-26T12:40:17.584198+0000","last_clean":"2024-04-26T12:40:17.584198+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:40:17.584198+0000","last_undegraded":"2024-04-26T12:40:17.584198+0000","last_fullsized":"2024-04-26T12:40:17.584198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862692+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:40:16.862692+0000","last_peered":"2024-04-26T12:40:16.862692+0000","last_clean":"2024-04-26T12:40:16.862692+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:40:16.862692+0000","last_undegraded":"2024-04-26T12:40:16.862692+0000","last_fullsized":"2024-04-26T12:40:16.862692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.774162+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:40:16.774162+0000","last_peered":"2024-04-26T12:40:16.774162+0000","last_clean":"2024-04-26T12:40:16.774162+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:40:16.774162+0000","last_undegraded":"2024-04-26T12:40:16.774162+0000","last_fullsized":"2024-04-26T12:40:16.774162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"73'2","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776283+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:40:17.776283+0000","last_peered":"2024-04-26T12:40:17.776283+0000","last_clean":"2024-04-26T12:40:17.776283+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:40:17.776283+0000","last_undegraded":"2024-04-26T12:40:17.776283+0000","last_fullsized":"2024-04-26T12:40:17.776283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863916+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:40:16.863916+0000","last_peered":"2024-04-26T12:40:16.863916+0000","last_clean":"2024-04-26T12:40:16.863916+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:40:16.863916+0000","last_undegraded":"2024-04-26T12:40:16.863916+0000","last_fullsized":"2024-04-26T12:40:16.863916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"74'22","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776693+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:40:17.776693+0000","last_peered":"2024-04-26T12:40:17.776693+0000","last_clean":"2024-04-26T12:40:17.776693+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:40:17.776693+0000","last_undegraded":"2024-04-26T12:40:17.776693+0000","last_fullsized":"2024-04-26T12:40:17.776693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586291+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:40:17.586291+0000","last_peered":"2024-04-26T12:40:17.586291+0000","last_clean":"2024-04-26T12:40:17.586291+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:40:17.586291+0000","last_undegraded":"2024-04-26T12:40:17.586291+0000","last_fullsized":"2024-04-26T12:40:17.586291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":112,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778044+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:40:17.778044+0000","last_peered":"2024-04-26T12:40:17.778044+0000","last_clean":"2024-04-26T12:40:17.778044+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:40:17.778044+0000","last_undegraded":"2024-04-26T12:40:17.778044+0000","last_fullsized":"2024-04-26T12:40:17.778044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"74'14","reported_seq":174,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863979+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:40:16.863979+0000","last_peered":"2024-04-26T12:40:16.863979+0000","last_clean":"2024-04-26T12:40:16.863979+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:40:16.863979+0000","last_undegraded":"2024-04-26T12:40:16.863979+0000","last_fullsized":"2024-04-26T12:40:16.863979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"73'5","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775580+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:40:17.775580+0000","last_peered":"2024-04-26T12:40:17.775580+0000","last_clean":"2024-04-26T12:40:17.775580+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:40:17.775580+0000","last_undegraded":"2024-04-26T12:40:17.775580+0000","last_fullsized":"2024-04-26T12:40:17.775580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773748+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:40:16.773748+0000","last_peered":"2024-04-26T12:40:16.773748+0000","last_clean":"2024-04-26T12:40:16.773748+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:40:16.773748+0000","last_undegraded":"2024-04-26T12:40:16.773748+0000","last_fullsized":"2024-04-26T12:40:16.773748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"74'20","reported_seq":148,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585290+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:40:17.585290+0000","last_peered":"2024-04-26T12:40:17.585290+0000","last_clean":"2024-04-26T12:40:17.585290+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:40:17.585290+0000","last_undegraded":"2024-04-26T12:40:17.585290+0000","last_fullsized":"2024-04-26T12:40:17.585290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776744+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:40:17.776744+0000","last_peered":"2024-04-26T12:40:17.776744+0000","last_clean":"2024-04-26T12:40:17.776744+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:40:17.776744+0000","last_undegraded":"2024-04-26T12:40:17.776744+0000","last_fullsized":"2024-04-26T12:40:17.776744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772054+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:40:16.772054+0000","last_peered":"2024-04-26T12:40:16.772054+0000","last_clean":"2024-04-26T12:40:16.772054+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:40:16.772054+0000","last_undegraded":"2024-04-26T12:40:16.772054+0000","last_fullsized":"2024-04-26T12:40:16.772054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779162+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:40:17.779162+0000","last_peered":"2024-04-26T12:40:17.779162+0000","last_clean":"2024-04-26T12:40:17.779162+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:40:17.779162+0000","last_undegraded":"2024-04-26T12:40:17.779162+0000","last_fullsized":"2024-04-26T12:40:17.779162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"73'3","reported_seq":107,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774841+0000","last_change":"2024-04-26T12:38:32.097004+0000","last_active":"2024-04-26T12:40:17.774841+0000","last_peered":"2024-04-26T12:40:17.774841+0000","last_clean":"2024-04-26T12:40:17.774841+0000","last_became_active":"2024-04-26T12:38:32.096196+0000","last_became_peered":"2024-04-26T12:38:32.096196+0000","last_unstale":"2024-04-26T12:40:17.774841+0000","last_undegraded":"2024-04-26T12:40:17.774841+0000","last_fullsized":"2024-04-26T12:40:17.774841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:00.173484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778815+0000","last_change":"2024-04-26T12:38:32.100356+0000","last_active":"2024-04-26T12:40:17.778815+0000","last_peered":"2024-04-26T12:40:17.778815+0000","last_clean":"2024-04-26T12:40:17.778815+0000","last_became_active":"2024-04-26T12:38:32.099529+0000","last_became_peered":"2024-04-26T12:38:32.099529+0000","last_unstale":"2024-04-26T12:40:17.778815+0000","last_undegraded":"2024-04-26T12:40:17.778815+0000","last_fullsized":"2024-04-26T12:40:17.778815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:32.397561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"74'16","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779723+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:40:17.779723+0000","last_peered":"2024-04-26T12:40:17.779723+0000","last_clean":"2024-04-26T12:40:17.779723+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:40:17.779723+0000","last_undegraded":"2024-04-26T12:40:17.779723+0000","last_fullsized":"2024-04-26T12:40:17.779723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776546+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:40:17.776546+0000","last_peered":"2024-04-26T12:40:17.776546+0000","last_clean":"2024-04-26T12:40:17.776546+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:40:17.776546+0000","last_undegraded":"2024-04-26T12:40:17.776546+0000","last_fullsized":"2024-04-26T12:40:17.776546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584604+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:40:17.584604+0000","last_peered":"2024-04-26T12:40:17.584604+0000","last_clean":"2024-04-26T12:40:17.584604+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:40:17.584604+0000","last_undegraded":"2024-04-26T12:40:17.584604+0000","last_fullsized":"2024-04-26T12:40:17.584604+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584315+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:40:17.584315+0000","last_peered":"2024-04-26T12:40:17.584315+0000","last_clean":"2024-04-26T12:40:17.584315+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:40:17.584315+0000","last_undegraded":"2024-04-26T12:40:17.584315+0000","last_fullsized":"2024-04-26T12:40:17.584315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'2","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862975+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:40:16.862975+0000","last_peered":"2024-04-26T12:40:16.862975+0000","last_clean":"2024-04-26T12:40:16.862975+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:40:16.862975+0000","last_undegraded":"2024-04-26T12:40:16.862975+0000","last_fullsized":"2024-04-26T12:40:16.862975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776913+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:40:17.776913+0000","last_peered":"2024-04-26T12:40:17.776913+0000","last_clean":"2024-04-26T12:40:17.776913+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:40:17.776913+0000","last_undegraded":"2024-04-26T12:40:17.776913+0000","last_fullsized":"2024-04-26T12:40:17.776913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"68'11","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773754+0000","last_change":"2024-04-26T12:38:32.098589+0000","last_active":"2024-04-26T12:40:16.773754+0000","last_peered":"2024-04-26T12:40:16.773754+0000","last_clean":"2024-04-26T12:40:16.773754+0000","last_became_active":"2024-04-26T12:38:32.097940+0000","last_became_peered":"2024-04-26T12:38:32.097940+0000","last_unstale":"2024-04-26T12:40:16.773754+0000","last_undegraded":"2024-04-26T12:40:16.773754+0000","last_fullsized":"2024-04-26T12:40:16.773754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"74'92","reported_seq":233,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773237+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:40:16.773237+0000","last_peered":"2024-04-26T12:40:16.773237+0000","last_clean":"2024-04-26T12:40:16.773237+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:40:16.773237+0000","last_undegraded":"2024-04-26T12:40:16.773237+0000","last_fullsized":"2024-04-26T12:40:16.773237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.582794+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:40:17.582794+0000","last_peered":"2024-04-26T12:40:17.582794+0000","last_clean":"2024-04-26T12:40:17.582794+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:40:17.582794+0000","last_undegraded":"2024-04-26T12:40:17.582794+0000","last_fullsized":"2024-04-26T12:40:17.582794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"68'2","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778828+0000","last_change":"2024-04-26T12:38:32.097299+0000","last_active":"2024-04-26T12:40:17.778828+0000","last_peered":"2024-04-26T12:40:17.778828+0000","last_clean":"2024-04-26T12:40:17.778828+0000","last_became_active":"2024-04-26T12:38:32.096485+0000","last_became_peered":"2024-04-26T12:38:32.096485+0000","last_unstale":"2024-04-26T12:40:17.778828+0000","last_undegraded":"2024-04-26T12:40:17.778828+0000","last_fullsized":"2024-04-26T12:40:17.778828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:18.433433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586585+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:40:17.586585+0000","last_peered":"2024-04-26T12:40:17.586585+0000","last_clean":"2024-04-26T12:40:17.586585+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:40:17.586585+0000","last_undegraded":"2024-04-26T12:40:17.586585+0000","last_fullsized":"2024-04-26T12:40:17.586585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584329+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:40:17.584329+0000","last_peered":"2024-04-26T12:40:17.584329+0000","last_clean":"2024-04-26T12:40:17.584329+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:40:17.584329+0000","last_undegraded":"2024-04-26T12:40:17.584329+0000","last_fullsized":"2024-04-26T12:40:17.584329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"74'21","reported_seq":149,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584900+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:40:17.584900+0000","last_peered":"2024-04-26T12:40:17.584900+0000","last_clean":"2024-04-26T12:40:17.584900+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:40:17.584900+0000","last_undegraded":"2024-04-26T12:40:17.584900+0000","last_fullsized":"2024-04-26T12:40:17.584900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862402+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:40:16.862402+0000","last_peered":"2024-04-26T12:40:16.862402+0000","last_clean":"2024-04-26T12:40:16.862402+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:40:16.862402+0000","last_undegraded":"2024-04-26T12:40:16.862402+0000","last_fullsized":"2024-04-26T12:40:16.862402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.588562+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:40:17.588562+0000","last_peered":"2024-04-26T12:40:17.588562+0000","last_clean":"2024-04-26T12:40:17.588562+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:40:17.588562+0000","last_undegraded":"2024-04-26T12:40:17.588562+0000","last_fullsized":"2024-04-26T12:40:17.588562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'2","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778148+0000","last_change":"2024-04-26T12:38:32.097693+0000","last_active":"2024-04-26T12:40:17.778148+0000","last_peered":"2024-04-26T12:40:17.778148+0000","last_clean":"2024-04-26T12:40:17.778148+0000","last_became_active":"2024-04-26T12:38:32.096141+0000","last_became_peered":"2024-04-26T12:38:32.096141+0000","last_unstale":"2024-04-26T12:40:17.778148+0000","last_undegraded":"2024-04-26T12:40:17.778148+0000","last_fullsized":"2024-04-26T12:40:17.778148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.450059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586753+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:40:17.586753+0000","last_peered":"2024-04-26T12:40:17.586753+0000","last_clean":"2024-04-26T12:40:17.586753+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:40:17.586753+0000","last_undegraded":"2024-04-26T12:40:17.586753+0000","last_fullsized":"2024-04-26T12:40:17.586753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584881+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:40:17.584881+0000","last_peered":"2024-04-26T12:40:17.584881+0000","last_clean":"2024-04-26T12:40:17.584881+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:40:17.584881+0000","last_undegraded":"2024-04-26T12:40:17.584881+0000","last_fullsized":"2024-04-26T12:40:17.584881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"74'14","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862402+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:40:16.862402+0000","last_peered":"2024-04-26T12:40:16.862402+0000","last_clean":"2024-04-26T12:40:16.862402+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:40:16.862402+0000","last_undegraded":"2024-04-26T12:40:16.862402+0000","last_fullsized":"2024-04-26T12:40:16.862402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771840+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:40:16.771840+0000","last_peered":"2024-04-26T12:40:16.771840+0000","last_clean":"2024-04-26T12:40:16.771840+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:40:16.771840+0000","last_undegraded":"2024-04-26T12:40:16.771840+0000","last_fullsized":"2024-04-26T12:40:16.771840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":112,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779085+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:40:17.779085+0000","last_peered":"2024-04-26T12:40:17.779085+0000","last_clean":"2024-04-26T12:40:17.779085+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:40:17.779085+0000","last_undegraded":"2024-04-26T12:40:17.779085+0000","last_fullsized":"2024-04-26T12:40:17.779085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778298+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:40:17.778298+0000","last_peered":"2024-04-26T12:40:17.778298+0000","last_clean":"2024-04-26T12:40:17.778298+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:40:17.778298+0000","last_undegraded":"2024-04-26T12:40:17.778298+0000","last_fullsized":"2024-04-26T12:40:17.778298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'5","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779408+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:40:17.779408+0000","last_peered":"2024-04-26T12:40:17.779408+0000","last_clean":"2024-04-26T12:40:17.779408+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:40:17.779408+0000","last_undegraded":"2024-04-26T12:40:17.779408+0000","last_fullsized":"2024-04-26T12:40:17.779408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771500+0000","last_change":"2024-04-26T12:38:32.098077+0000","last_active":"2024-04-26T12:40:16.771500+0000","last_peered":"2024-04-26T12:40:16.771500+0000","last_clean":"2024-04-26T12:40:16.771500+0000","last_became_active":"2024-04-26T12:38:32.097608+0000","last_became_peered":"2024-04-26T12:38:32.097608+0000","last_unstale":"2024-04-26T12:40:16.771500+0000","last_undegraded":"2024-04-26T12:40:16.771500+0000","last_fullsized":"2024-04-26T12:40:16.771500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:52.163433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"74'11","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778935+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:40:17.778935+0000","last_peered":"2024-04-26T12:40:17.778935+0000","last_clean":"2024-04-26T12:40:17.778935+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:40:17.778935+0000","last_undegraded":"2024-04-26T12:40:17.778935+0000","last_fullsized":"2024-04-26T12:40:17.778935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772350+0000","last_change":"2024-04-26T12:38:32.097869+0000","last_active":"2024-04-26T12:40:16.772350+0000","last_peered":"2024-04-26T12:40:16.772350+0000","last_clean":"2024-04-26T12:40:16.772350+0000","last_became_active":"2024-04-26T12:38:32.097545+0000","last_became_peered":"2024-04-26T12:38:32.097545+0000","last_unstale":"2024-04-26T12:40:16.772350+0000","last_undegraded":"2024-04-26T12:40:16.772350+0000","last_fullsized":"2024-04-26T12:40:16.772350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:00.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589586+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:40:17.589586+0000","last_peered":"2024-04-26T12:40:17.589586+0000","last_clean":"2024-04-26T12:40:17.589586+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:40:17.589586+0000","last_undegraded":"2024-04-26T12:40:17.589586+0000","last_fullsized":"2024-04-26T12:40:17.589586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"68'12","reported_seq":142,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771635+0000","last_change":"2024-04-26T12:38:32.098742+0000","last_active":"2024-04-26T12:40:16.771635+0000","last_peered":"2024-04-26T12:40:16.771635+0000","last_clean":"2024-04-26T12:40:16.771635+0000","last_became_active":"2024-04-26T12:38:32.098197+0000","last_became_peered":"2024-04-26T12:38:32.098197+0000","last_unstale":"2024-04-26T12:40:16.771635+0000","last_undegraded":"2024-04-26T12:40:16.771635+0000","last_fullsized":"2024-04-26T12:40:16.771635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.480181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"73'5","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864208+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:40:16.864208+0000","last_peered":"2024-04-26T12:40:16.864208+0000","last_clean":"2024-04-26T12:40:16.864208+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:40:16.864208+0000","last_undegraded":"2024-04-26T12:40:16.864208+0000","last_fullsized":"2024-04-26T12:40:16.864208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":186,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774537+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:40:17.774537+0000","last_peered":"2024-04-26T12:40:17.774537+0000","last_clean":"2024-04-26T12:40:17.774537+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:40:17.774537+0000","last_undegraded":"2024-04-26T12:40:17.774537+0000","last_fullsized":"2024-04-26T12:40:17.774537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"74'14","reported_seq":142,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585191+0000","last_change":"2024-04-26T12:38:32.089759+0000","last_active":"2024-04-26T12:40:17.585191+0000","last_peered":"2024-04-26T12:40:17.585191+0000","last_clean":"2024-04-26T12:40:17.585191+0000","last_became_active":"2024-04-26T12:38:32.088214+0000","last_became_peered":"2024-04-26T12:38:32.088214+0000","last_unstale":"2024-04-26T12:40:17.585191+0000","last_undegraded":"2024-04-26T12:40:17.585191+0000","last_fullsized":"2024-04-26T12:40:17.585191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:38.656355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862844+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:40:16.862844+0000","last_peered":"2024-04-26T12:40:16.862844+0000","last_clean":"2024-04-26T12:40:16.862844+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:40:16.862844+0000","last_undegraded":"2024-04-26T12:40:16.862844+0000","last_fullsized":"2024-04-26T12:40:16.862844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863004+0000","last_change":"2024-04-26T12:38:32.098228+0000","last_active":"2024-04-26T12:40:16.863004+0000","last_peered":"2024-04-26T12:40:16.863004+0000","last_clean":"2024-04-26T12:40:16.863004+0000","last_became_active":"2024-04-26T12:38:32.092404+0000","last_became_peered":"2024-04-26T12:38:32.092404+0000","last_unstale":"2024-04-26T12:40:16.863004+0000","last_undegraded":"2024-04-26T12:40:16.863004+0000","last_fullsized":"2024-04-26T12:40:16.863004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"68'4","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776233+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:40:17.776233+0000","last_peered":"2024-04-26T12:40:17.776233+0000","last_clean":"2024-04-26T12:40:17.776233+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:40:17.776233+0000","last_undegraded":"2024-04-26T12:40:17.776233+0000","last_fullsized":"2024-04-26T12:40:17.776233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'4","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772358+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:40:16.772358+0000","last_peered":"2024-04-26T12:40:16.772358+0000","last_clean":"2024-04-26T12:40:16.772358+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:40:16.772358+0000","last_undegraded":"2024-04-26T12:40:16.772358+0000","last_fullsized":"2024-04-26T12:40:16.772358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":176,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776952+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:40:17.776952+0000","last_peered":"2024-04-26T12:40:17.776952+0000","last_clean":"2024-04-26T12:40:17.776952+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:40:17.776952+0000","last_undegraded":"2024-04-26T12:40:17.776952+0000","last_fullsized":"2024-04-26T12:40:17.776952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"71'4","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583679+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:40:17.583679+0000","last_peered":"2024-04-26T12:40:17.583679+0000","last_clean":"2024-04-26T12:40:17.583679+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:40:17.583679+0000","last_undegraded":"2024-04-26T12:40:17.583679+0000","last_fullsized":"2024-04-26T12:40:17.583679+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"74'2","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585809+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:40:17.585809+0000","last_peered":"2024-04-26T12:40:17.585809+0000","last_clean":"2024-04-26T12:40:17.585809+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:40:17.585809+0000","last_undegraded":"2024-04-26T12:40:17.585809+0000","last_fullsized":"2024-04-26T12:40:17.585809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"73'7","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586091+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:40:17.586091+0000","last_peered":"2024-04-26T12:40:17.586091+0000","last_clean":"2024-04-26T12:40:17.586091+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:40:17.586091+0000","last_undegraded":"2024-04-26T12:40:17.586091+0000","last_fullsized":"2024-04-26T12:40:17.586091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"68'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775912+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:40:17.775912+0000","last_peered":"2024-04-26T12:40:17.775912+0000","last_clean":"2024-04-26T12:40:17.775912+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:40:17.775912+0000","last_undegraded":"2024-04-26T12:40:17.775912+0000","last_fullsized":"2024-04-26T12:40:17.775912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'4","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863136+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:40:16.863136+0000","last_peered":"2024-04-26T12:40:16.863136+0000","last_clean":"2024-04-26T12:40:16.863136+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:40:16.863136+0000","last_undegraded":"2024-04-26T12:40:16.863136+0000","last_fullsized":"2024-04-26T12:40:16.863136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":147,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778706+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:40:17.778706+0000","last_peered":"2024-04-26T12:40:17.778706+0000","last_clean":"2024-04-26T12:40:17.778706+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:40:17.778706+0000","last_undegraded":"2024-04-26T12:40:17.778706+0000","last_fullsized":"2024-04-26T12:40:17.778706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"72'1","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779328+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:40:17.779328+0000","last_peered":"2024-04-26T12:40:17.779328+0000","last_clean":"2024-04-26T12:40:17.779328+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:40:17.779328+0000","last_undegraded":"2024-04-26T12:40:17.779328+0000","last_fullsized":"2024-04-26T12:40:17.779328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772858+0000","last_change":"2024-04-26T12:38:32.099762+0000","last_active":"2024-04-26T12:40:16.772858+0000","last_peered":"2024-04-26T12:40:16.772858+0000","last_clean":"2024-04-26T12:40:16.772858+0000","last_became_active":"2024-04-26T12:38:32.099061+0000","last_became_peered":"2024-04-26T12:38:32.099061+0000","last_unstale":"2024-04-26T12:40:16.772858+0000","last_undegraded":"2024-04-26T12:40:16.772858+0000","last_fullsized":"2024-04-26T12:40:16.772858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:17.530530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"73'3","reported_seq":139,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777074+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:40:17.777074+0000","last_peered":"2024-04-26T12:40:17.777074+0000","last_clean":"2024-04-26T12:40:17.777074+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:40:17.777074+0000","last_undegraded":"2024-04-26T12:40:17.777074+0000","last_fullsized":"2024-04-26T12:40:17.777074+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778162+0000","last_change":"2024-04-26T12:38:58.795730+0000","last_active":"2024-04-26T12:40:17.778162+0000","last_peered":"2024-04-26T12:40:17.778162+0000","last_clean":"2024-04-26T12:40:17.778162+0000","last_became_active":"2024-04-26T12:38:58.795097+0000","last_became_peered":"2024-04-26T12:38:58.795097+0000","last_unstale":"2024-04-26T12:40:17.778162+0000","last_undegraded":"2024-04-26T12:40:17.778162+0000","last_fullsized":"2024-04-26T12:40:17.778162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.166788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773961+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:40:16.773961+0000","last_peered":"2024-04-26T12:40:16.773961+0000","last_clean":"2024-04-26T12:40:16.773961+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:40:16.773961+0000","last_undegraded":"2024-04-26T12:40:16.773961+0000","last_fullsized":"2024-04-26T12:40:16.773961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"74'10","reported_seq":169,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771891+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:40:16.771891+0000","last_peered":"2024-04-26T12:40:16.771891+0000","last_clean":"2024-04-26T12:40:16.771891+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:40:16.771891+0000","last_undegraded":"2024-04-26T12:40:16.771891+0000","last_fullsized":"2024-04-26T12:40:16.771891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"73'6","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779507+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:40:17.779507+0000","last_peered":"2024-04-26T12:40:17.779507+0000","last_clean":"2024-04-26T12:40:17.779507+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:40:17.779507+0000","last_undegraded":"2024-04-26T12:40:17.779507+0000","last_fullsized":"2024-04-26T12:40:17.779507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"68'6","reported_seq":151,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864118+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:40:16.864118+0000","last_peered":"2024-04-26T12:40:16.864118+0000","last_clean":"2024-04-26T12:40:16.864118+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:40:16.864118+0000","last_undegraded":"2024-04-26T12:40:16.864118+0000","last_fullsized":"2024-04-26T12:40:16.864118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584350+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:40:17.584350+0000","last_peered":"2024-04-26T12:40:17.584350+0000","last_clean":"2024-04-26T12:40:17.584350+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:40:17.584350+0000","last_undegraded":"2024-04-26T12:40:17.584350+0000","last_fullsized":"2024-04-26T12:40:17.584350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":111,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584615+0000","last_change":"2024-04-26T12:38:32.101184+0000","last_active":"2024-04-26T12:40:17.584615+0000","last_peered":"2024-04-26T12:40:17.584615+0000","last_clean":"2024-04-26T12:40:17.584615+0000","last_became_active":"2024-04-26T12:38:32.100885+0000","last_became_peered":"2024-04-26T12:38:32.100885+0000","last_unstale":"2024-04-26T12:40:17.584615+0000","last_undegraded":"2024-04-26T12:40:17.584615+0000","last_fullsized":"2024-04-26T12:40:17.584615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:14.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"72'2","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778404+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:40:17.778404+0000","last_peered":"2024-04-26T12:40:17.778404+0000","last_clean":"2024-04-26T12:40:17.778404+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:40:17.778404+0000","last_undegraded":"2024-04-26T12:40:17.778404+0000","last_fullsized":"2024-04-26T12:40:17.778404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"68'2","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584566+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:40:17.584566+0000","last_peered":"2024-04-26T12:40:17.584566+0000","last_clean":"2024-04-26T12:40:17.584566+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:40:17.584566+0000","last_undegraded":"2024-04-26T12:40:17.584566+0000","last_fullsized":"2024-04-26T12:40:17.584566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'8","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585711+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:40:17.585711+0000","last_peered":"2024-04-26T12:40:17.585711+0000","last_clean":"2024-04-26T12:40:17.585711+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:40:17.585711+0000","last_undegraded":"2024-04-26T12:40:17.585711+0000","last_fullsized":"2024-04-26T12:40:17.585711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"68'4","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772797+0000","last_change":"2024-04-26T12:38:32.097249+0000","last_active":"2024-04-26T12:40:16.772797+0000","last_peered":"2024-04-26T12:40:16.772797+0000","last_clean":"2024-04-26T12:40:16.772797+0000","last_became_active":"2024-04-26T12:38:32.096972+0000","last_became_peered":"2024-04-26T12:38:32.096972+0000","last_unstale":"2024-04-26T12:40:16.772797+0000","last_undegraded":"2024-04-26T12:40:16.772797+0000","last_fullsized":"2024-04-26T12:40:16.772797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:06.018406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"73'2","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863196+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:40:16.863196+0000","last_peered":"2024-04-26T12:40:16.863196+0000","last_clean":"2024-04-26T12:40:16.863196+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:40:16.863196+0000","last_undegraded":"2024-04-26T12:40:16.863196+0000","last_fullsized":"2024-04-26T12:40:16.863196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":149,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585117+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:40:17.585117+0000","last_peered":"2024-04-26T12:40:17.585117+0000","last_clean":"2024-04-26T12:40:17.585117+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:40:17.585117+0000","last_undegraded":"2024-04-26T12:40:17.585117+0000","last_fullsized":"2024-04-26T12:40:17.585117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'2","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773089+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:40:16.773089+0000","last_peered":"2024-04-26T12:40:16.773089+0000","last_clean":"2024-04-26T12:40:16.773089+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:40:16.773089+0000","last_undegraded":"2024-04-26T12:40:16.773089+0000","last_fullsized":"2024-04-26T12:40:16.773089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"68'4","reported_seq":141,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862625+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:40:16.862625+0000","last_peered":"2024-04-26T12:40:16.862625+0000","last_clean":"2024-04-26T12:40:16.862625+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:40:16.862625+0000","last_undegraded":"2024-04-26T12:40:16.862625+0000","last_fullsized":"2024-04-26T12:40:16.862625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"73'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.590307+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:40:17.590307+0000","last_peered":"2024-04-26T12:40:17.590307+0000","last_clean":"2024-04-26T12:40:17.590307+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:40:17.590307+0000","last_undegraded":"2024-04-26T12:40:17.590307+0000","last_fullsized":"2024-04-26T12:40:17.590307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778013+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:40:17.778013+0000","last_peered":"2024-04-26T12:40:17.778013+0000","last_clean":"2024-04-26T12:40:17.778013+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:40:17.778013+0000","last_undegraded":"2024-04-26T12:40:17.778013+0000","last_fullsized":"2024-04-26T12:40:17.778013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584802+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:40:17.584802+0000","last_peered":"2024-04-26T12:40:17.584802+0000","last_clean":"2024-04-26T12:40:17.584802+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:40:17.584802+0000","last_undegraded":"2024-04-26T12:40:17.584802+0000","last_fullsized":"2024-04-26T12:40:17.584802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583262+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:40:17.583262+0000","last_peered":"2024-04-26T12:40:17.583262+0000","last_clean":"2024-04-26T12:40:17.583262+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:40:17.583262+0000","last_undegraded":"2024-04-26T12:40:17.583262+0000","last_fullsized":"2024-04-26T12:40:17.583262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"71'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587756+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:40:17.587756+0000","last_peered":"2024-04-26T12:40:17.587756+0000","last_clean":"2024-04-26T12:40:17.587756+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:40:17.587756+0000","last_undegraded":"2024-04-26T12:40:17.587756+0000","last_fullsized":"2024-04-26T12:40:17.587756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584122+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:40:17.584122+0000","last_peered":"2024-04-26T12:40:17.584122+0000","last_clean":"2024-04-26T12:40:17.584122+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:40:17.584122+0000","last_undegraded":"2024-04-26T12:40:17.584122+0000","last_fullsized":"2024-04-26T12:40:17.584122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864091+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:40:16.864091+0000","last_peered":"2024-04-26T12:40:16.864091+0000","last_clean":"2024-04-26T12:40:16.864091+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:40:16.864091+0000","last_undegraded":"2024-04-26T12:40:16.864091+0000","last_fullsized":"2024-04-26T12:40:16.864091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'11","reported_seq":142,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775458+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:40:17.775458+0000","last_peered":"2024-04-26T12:40:17.775458+0000","last_clean":"2024-04-26T12:40:17.775458+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:40:17.775458+0000","last_undegraded":"2024-04-26T12:40:17.775458+0000","last_fullsized":"2024-04-26T12:40:17.775458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585938+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:40:17.585938+0000","last_peered":"2024-04-26T12:40:17.585938+0000","last_clean":"2024-04-26T12:40:17.585938+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:40:17.585938+0000","last_undegraded":"2024-04-26T12:40:17.585938+0000","last_fullsized":"2024-04-26T12:40:17.585938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":242,"num_write":218,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":736,"ondisk_log_size":736,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":79524,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":784,"num_read_kb":546,"num_write":429,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":127160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622,"ondisk_log_size":622,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":304,"num_read_kb":304,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":1095,"num_write":228,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":317,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323536,"kb_used_data":292348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048304,"statfs":{"total":96636764160,"available":96305463296,"internally_reserved":0,"allocated":299364352,"data_stored":298913717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218476,"kb_used_data":187292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94153364,"statfs":{"total":96636764160,"available":96413044736,"internally_reserved":0,"allocated":191787008,"data_stored":191366825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421332,"kb_used_data":390152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93950508,"statfs":{"total":96636764160,"available":96205320192,"internally_reserved":0,"allocated":399515648,"data_stored":399038048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304480,"kb_used_data":273300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94067360,"statfs":{"total":96636764160,"available":96324976640,"internally_reserved":0,"allocated":279859200,"data_stored":279446718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364032,"kb_used_data":328692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94007808,"statfs":{"total":96636764160,"available":96263995392,"internally_reserved":0,"allocated":336580608,"data_stored":336129876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200092,"kb_used_data":164744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94171748,"statfs":{"total":96636764160,"available":96431869952,"internally_reserved":0,"allocated":168697856,"data_stored":168290303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237000,"kb_used_data":201660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94134840,"statfs":{"total":96636764160,"available":96394076160,"internally_reserved":0,"allocated":206499840,"data_stored":206049638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294900,"kb_used_data":259556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94076940,"statfs":{"total":96636764160,"available":96334786560,"internally_reserved":0,"allocated":265785344,"data_stored":265357579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":264241152,"data_stored":264241152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":205520896,"data_stored":205520896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":335544320,"data_stored":335544320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":278921216,"data_stored":278921216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":398458880,"data_stored":398458880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":190840832,"data_stored":190840832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":60224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:40:19.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:40:19.257 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:19.252+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:19.323 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:19.323 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:19.338 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:19.381 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:19.380+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:19.440 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:19.438+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:19.505 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:19.505 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:19.519 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:19.542 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:19.542+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:19.636 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:19.637 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:19.642 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:40:19.648 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:40:19.650 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:19.661 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-04-26T12:40:18.783167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070219428,"num_objects":455,"num_object_clones":0,"num_object_copies":910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":455,"num_whiteouts":0,"num_read":2595,"num_read_kb":2302,"num_write":1361,"num_write_kb":1067562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2056,"ondisk_log_size":2056,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2363848,"kb_used_data":2097744,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":752610872,"statfs":{"total":773094113280,"available":770673532928,"internally_reserved":0,"allocated":2148089856,"data_stored":2144592704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4133264,"num_objects":-14,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14,"num_whiteouts":0,"num_read":149,"num_read_kb":146,"num_write":27,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.044429"},"pg_stats":[{"pgid":"3.3f","version":"73'1","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.588198+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:40:17.588198+0000","last_peered":"2024-04-26T12:40:17.588198+0000","last_clean":"2024-04-26T12:40:17.588198+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:40:17.588198+0000","last_undegraded":"2024-04-26T12:40:17.588198+0000","last_fullsized":"2024-04-26T12:40:17.588198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"68'4","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583700+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:40:17.583700+0000","last_peered":"2024-04-26T12:40:17.583700+0000","last_clean":"2024-04-26T12:40:17.583700+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:40:17.583700+0000","last_undegraded":"2024-04-26T12:40:17.583700+0000","last_fullsized":"2024-04-26T12:40:17.583700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"71'1","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777242+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:40:17.777242+0000","last_peered":"2024-04-26T12:40:17.777242+0000","last_clean":"2024-04-26T12:40:17.777242+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:40:17.777242+0000","last_undegraded":"2024-04-26T12:40:17.777242+0000","last_fullsized":"2024-04-26T12:40:17.777242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":142,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583549+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:40:17.583549+0000","last_peered":"2024-04-26T12:40:17.583549+0000","last_clean":"2024-04-26T12:40:17.583549+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:40:17.583549+0000","last_undegraded":"2024-04-26T12:40:17.583549+0000","last_fullsized":"2024-04-26T12:40:17.583549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"72'2","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863768+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:40:16.863768+0000","last_peered":"2024-04-26T12:40:16.863768+0000","last_clean":"2024-04-26T12:40:16.863768+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:40:16.863768+0000","last_undegraded":"2024-04-26T12:40:16.863768+0000","last_fullsized":"2024-04-26T12:40:16.863768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862894+0000","last_change":"2024-04-26T12:38:32.099160+0000","last_active":"2024-04-26T12:40:16.862894+0000","last_peered":"2024-04-26T12:40:16.862894+0000","last_clean":"2024-04-26T12:40:16.862894+0000","last_became_active":"2024-04-26T12:38:32.093033+0000","last_became_peered":"2024-04-26T12:38:32.093033+0000","last_unstale":"2024-04-26T12:40:16.862894+0000","last_undegraded":"2024-04-26T12:40:16.862894+0000","last_fullsized":"2024-04-26T12:40:16.862894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:22.221188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"73'8","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586525+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:40:17.586525+0000","last_peered":"2024-04-26T12:40:17.586525+0000","last_clean":"2024-04-26T12:40:17.586525+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:40:17.586525+0000","last_undegraded":"2024-04-26T12:40:17.586525+0000","last_fullsized":"2024-04-26T12:40:17.586525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862951+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:40:16.862951+0000","last_peered":"2024-04-26T12:40:16.862951+0000","last_clean":"2024-04-26T12:40:16.862951+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:40:16.862951+0000","last_undegraded":"2024-04-26T12:40:16.862951+0000","last_fullsized":"2024-04-26T12:40:16.862951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"73'5","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585514+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:40:17.585514+0000","last_peered":"2024-04-26T12:40:17.585514+0000","last_clean":"2024-04-26T12:40:17.585514+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:40:17.585514+0000","last_undegraded":"2024-04-26T12:40:17.585514+0000","last_fullsized":"2024-04-26T12:40:17.585514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"68'2","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772735+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:40:16.772735+0000","last_peered":"2024-04-26T12:40:16.772735+0000","last_clean":"2024-04-26T12:40:16.772735+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:40:16.772735+0000","last_undegraded":"2024-04-26T12:40:16.772735+0000","last_fullsized":"2024-04-26T12:40:16.772735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'5","reported_seq":87,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583724+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:40:17.583724+0000","last_peered":"2024-04-26T12:40:17.583724+0000","last_clean":"2024-04-26T12:40:17.583724+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:40:17.583724+0000","last_undegraded":"2024-04-26T12:40:17.583724+0000","last_fullsized":"2024-04-26T12:40:17.583724+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863624+0000","last_change":"2024-04-26T12:38:32.092960+0000","last_active":"2024-04-26T12:40:16.863624+0000","last_peered":"2024-04-26T12:40:16.863624+0000","last_clean":"2024-04-26T12:40:16.863624+0000","last_became_active":"2024-04-26T12:38:32.092562+0000","last_became_peered":"2024-04-26T12:38:32.092562+0000","last_unstale":"2024-04-26T12:40:16.863624+0000","last_undegraded":"2024-04-26T12:40:16.863624+0000","last_fullsized":"2024-04-26T12:40:16.863624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:43.474569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"73'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583830+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:40:17.583830+0000","last_peered":"2024-04-26T12:40:17.583830+0000","last_clean":"2024-04-26T12:40:17.583830+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:40:17.583830+0000","last_undegraded":"2024-04-26T12:40:17.583830+0000","last_fullsized":"2024-04-26T12:40:17.583830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585742+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:40:17.585742+0000","last_peered":"2024-04-26T12:40:17.585742+0000","last_clean":"2024-04-26T12:40:17.585742+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:40:17.585742+0000","last_undegraded":"2024-04-26T12:40:17.585742+0000","last_fullsized":"2024-04-26T12:40:17.585742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'4","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776183+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:40:17.776183+0000","last_peered":"2024-04-26T12:40:17.776183+0000","last_clean":"2024-04-26T12:40:17.776183+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:40:17.776183+0000","last_undegraded":"2024-04-26T12:40:17.776183+0000","last_fullsized":"2024-04-26T12:40:17.776183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":145,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584829+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:40:17.584829+0000","last_peered":"2024-04-26T12:40:17.584829+0000","last_clean":"2024-04-26T12:40:17.584829+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:40:17.584829+0000","last_undegraded":"2024-04-26T12:40:17.584829+0000","last_fullsized":"2024-04-26T12:40:17.584829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"67'2","reported_seq":111,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862605+0000","last_change":"2024-04-26T12:38:32.098437+0000","last_active":"2024-04-26T12:40:16.862605+0000","last_peered":"2024-04-26T12:40:16.862605+0000","last_clean":"2024-04-26T12:40:16.862605+0000","last_became_active":"2024-04-26T12:38:32.093038+0000","last_became_peered":"2024-04-26T12:38:32.093038+0000","last_unstale":"2024-04-26T12:40:16.862605+0000","last_undegraded":"2024-04-26T12:40:16.862605+0000","last_fullsized":"2024-04-26T12:40:16.862605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:11.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"73'8","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.588325+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:40:17.588325+0000","last_peered":"2024-04-26T12:40:17.588325+0000","last_clean":"2024-04-26T12:40:17.588325+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:40:17.588325+0000","last_undegraded":"2024-04-26T12:40:17.588325+0000","last_fullsized":"2024-04-26T12:40:17.588325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"68'2","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583712+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:40:17.583712+0000","last_peered":"2024-04-26T12:40:17.583712+0000","last_clean":"2024-04-26T12:40:17.583712+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:40:17.583712+0000","last_undegraded":"2024-04-26T12:40:17.583712+0000","last_fullsized":"2024-04-26T12:40:17.583712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"73'5","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773694+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:40:16.773694+0000","last_peered":"2024-04-26T12:40:16.773694+0000","last_clean":"2024-04-26T12:40:16.773694+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:40:16.773694+0000","last_undegraded":"2024-04-26T12:40:16.773694+0000","last_fullsized":"2024-04-26T12:40:16.773694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585466+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:40:17.585466+0000","last_peered":"2024-04-26T12:40:17.585466+0000","last_clean":"2024-04-26T12:40:17.585466+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:40:17.585466+0000","last_undegraded":"2024-04-26T12:40:17.585466+0000","last_fullsized":"2024-04-26T12:40:17.585466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773822+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:40:16.773822+0000","last_peered":"2024-04-26T12:40:16.773822+0000","last_clean":"2024-04-26T12:40:16.773822+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:40:16.773822+0000","last_undegraded":"2024-04-26T12:40:16.773822+0000","last_fullsized":"2024-04-26T12:40:16.773822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"68'6","reported_seq":150,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584096+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:40:17.584096+0000","last_peered":"2024-04-26T12:40:17.584096+0000","last_clean":"2024-04-26T12:40:17.584096+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:40:17.584096+0000","last_undegraded":"2024-04-26T12:40:17.584096+0000","last_fullsized":"2024-04-26T12:40:17.584096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"72'2","reported_seq":105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773035+0000","last_change":"2024-04-26T12:38:32.097333+0000","last_active":"2024-04-26T12:40:16.773035+0000","last_peered":"2024-04-26T12:40:16.773035+0000","last_clean":"2024-04-26T12:40:16.773035+0000","last_became_active":"2024-04-26T12:38:32.097076+0000","last_became_peered":"2024-04-26T12:38:32.097076+0000","last_unstale":"2024-04-26T12:40:16.773035+0000","last_undegraded":"2024-04-26T12:40:16.773035+0000","last_fullsized":"2024-04-26T12:40:16.773035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:52.365241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"74'6","reported_seq":152,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584313+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:40:17.584313+0000","last_peered":"2024-04-26T12:40:17.584313+0000","last_clean":"2024-04-26T12:40:17.584313+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:40:17.584313+0000","last_undegraded":"2024-04-26T12:40:17.584313+0000","last_fullsized":"2024-04-26T12:40:17.584313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"73'5","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778277+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:40:17.778277+0000","last_peered":"2024-04-26T12:40:17.778277+0000","last_clean":"2024-04-26T12:40:17.778277+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:40:17.778277+0000","last_undegraded":"2024-04-26T12:40:17.778277+0000","last_fullsized":"2024-04-26T12:40:17.778277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776994+0000","last_change":"2024-04-26T12:38:32.098711+0000","last_active":"2024-04-26T12:40:17.776994+0000","last_peered":"2024-04-26T12:40:17.776994+0000","last_clean":"2024-04-26T12:40:17.776994+0000","last_became_active":"2024-04-26T12:38:32.097887+0000","last_became_peered":"2024-04-26T12:38:32.097887+0000","last_unstale":"2024-04-26T12:40:17.776994+0000","last_undegraded":"2024-04-26T12:40:17.776994+0000","last_fullsized":"2024-04-26T12:40:17.776994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:43.980582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"72'4","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862946+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:40:16.862946+0000","last_peered":"2024-04-26T12:40:16.862946+0000","last_clean":"2024-04-26T12:40:16.862946+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:40:16.862946+0000","last_undegraded":"2024-04-26T12:40:16.862946+0000","last_fullsized":"2024-04-26T12:40:16.862946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":109,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775388+0000","last_change":"2024-04-26T12:38:32.091108+0000","last_active":"2024-04-26T12:40:17.775388+0000","last_peered":"2024-04-26T12:40:17.775388+0000","last_clean":"2024-04-26T12:40:17.775388+0000","last_became_active":"2024-04-26T12:38:32.090800+0000","last_became_peered":"2024-04-26T12:38:32.090800+0000","last_unstale":"2024-04-26T12:40:17.775388+0000","last_undegraded":"2024-04-26T12:40:17.775388+0000","last_fullsized":"2024-04-26T12:40:17.775388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:54.159328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":145,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779095+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:40:17.779095+0000","last_peered":"2024-04-26T12:40:17.779095+0000","last_clean":"2024-04-26T12:40:17.779095+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:40:17.779095+0000","last_undegraded":"2024-04-26T12:40:17.779095+0000","last_fullsized":"2024-04-26T12:40:17.779095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"73'1","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585884+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:40:17.585884+0000","last_peered":"2024-04-26T12:40:17.585884+0000","last_clean":"2024-04-26T12:40:17.585884+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:40:17.585884+0000","last_undegraded":"2024-04-26T12:40:17.585884+0000","last_fullsized":"2024-04-26T12:40:17.585884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585574+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:40:17.585574+0000","last_peered":"2024-04-26T12:40:17.585574+0000","last_clean":"2024-04-26T12:40:17.585574+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:40:17.585574+0000","last_undegraded":"2024-04-26T12:40:17.585574+0000","last_fullsized":"2024-04-26T12:40:17.585574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"74'15","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863623+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:40:16.863623+0000","last_peered":"2024-04-26T12:40:16.863623+0000","last_clean":"2024-04-26T12:40:16.863623+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:40:16.863623+0000","last_undegraded":"2024-04-26T12:40:16.863623+0000","last_fullsized":"2024-04-26T12:40:16.863623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587561+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:40:17.587561+0000","last_peered":"2024-04-26T12:40:17.587561+0000","last_clean":"2024-04-26T12:40:17.587561+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:40:17.587561+0000","last_undegraded":"2024-04-26T12:40:17.587561+0000","last_fullsized":"2024-04-26T12:40:17.587561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"74'36","reported_seq":159,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584322+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:40:17.584322+0000","last_peered":"2024-04-26T12:40:17.584322+0000","last_clean":"2024-04-26T12:40:17.584322+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:40:17.584322+0000","last_undegraded":"2024-04-26T12:40:17.584322+0000","last_fullsized":"2024-04-26T12:40:17.584322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":72,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586524+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:40:17.586524+0000","last_peered":"2024-04-26T12:40:17.586524+0000","last_clean":"2024-04-26T12:40:17.586524+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:40:17.586524+0000","last_undegraded":"2024-04-26T12:40:17.586524+0000","last_fullsized":"2024-04-26T12:40:17.586524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'7","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863010+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:40:16.863010+0000","last_peered":"2024-04-26T12:40:16.863010+0000","last_clean":"2024-04-26T12:40:16.863010+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:40:16.863010+0000","last_undegraded":"2024-04-26T12:40:16.863010+0000","last_fullsized":"2024-04-26T12:40:16.863010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778963+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:40:17.778963+0000","last_peered":"2024-04-26T12:40:17.778963+0000","last_clean":"2024-04-26T12:40:17.778963+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:40:17.778963+0000","last_undegraded":"2024-04-26T12:40:17.778963+0000","last_fullsized":"2024-04-26T12:40:17.778963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584625+0000","last_change":"2024-04-26T12:38:32.099862+0000","last_active":"2024-04-26T12:40:17.584625+0000","last_peered":"2024-04-26T12:40:17.584625+0000","last_clean":"2024-04-26T12:40:17.584625+0000","last_became_active":"2024-04-26T12:38:32.098951+0000","last_became_peered":"2024-04-26T12:38:32.098951+0000","last_unstale":"2024-04-26T12:40:17.584625+0000","last_undegraded":"2024-04-26T12:40:17.584625+0000","last_fullsized":"2024-04-26T12:40:17.584625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:37.401523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863575+0000","last_change":"2024-04-26T12:38:32.100120+0000","last_active":"2024-04-26T12:40:16.863575+0000","last_peered":"2024-04-26T12:40:16.863575+0000","last_clean":"2024-04-26T12:40:16.863575+0000","last_became_active":"2024-04-26T12:38:32.099583+0000","last_became_peered":"2024-04-26T12:38:32.099583+0000","last_unstale":"2024-04-26T12:40:16.863575+0000","last_undegraded":"2024-04-26T12:40:16.863575+0000","last_fullsized":"2024-04-26T12:40:16.863575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:16.598403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862746+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:40:16.862746+0000","last_peered":"2024-04-26T12:40:16.862746+0000","last_clean":"2024-04-26T12:40:16.862746+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:40:16.862746+0000","last_undegraded":"2024-04-26T12:40:16.862746+0000","last_fullsized":"2024-04-26T12:40:16.862746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"67'2","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864107+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:40:16.864107+0000","last_peered":"2024-04-26T12:40:16.864107+0000","last_clean":"2024-04-26T12:40:16.864107+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:40:16.864107+0000","last_undegraded":"2024-04-26T12:40:16.864107+0000","last_fullsized":"2024-04-26T12:40:16.864107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"73'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583873+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:40:17.583873+0000","last_peered":"2024-04-26T12:40:17.583873+0000","last_clean":"2024-04-26T12:40:17.583873+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:40:17.583873+0000","last_undegraded":"2024-04-26T12:40:17.583873+0000","last_fullsized":"2024-04-26T12:40:17.583873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779788+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:40:17.779788+0000","last_peered":"2024-04-26T12:40:17.779788+0000","last_clean":"2024-04-26T12:40:17.779788+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:40:17.779788+0000","last_undegraded":"2024-04-26T12:40:17.779788+0000","last_fullsized":"2024-04-26T12:40:17.779788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584133+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:40:17.584133+0000","last_peered":"2024-04-26T12:40:17.584133+0000","last_clean":"2024-04-26T12:40:17.584133+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:40:17.584133+0000","last_undegraded":"2024-04-26T12:40:17.584133+0000","last_fullsized":"2024-04-26T12:40:17.584133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"74'92","reported_seq":308,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589188+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:40:17.589188+0000","last_peered":"2024-04-26T12:40:17.589188+0000","last_clean":"2024-04-26T12:40:17.589188+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:40:17.589188+0000","last_undegraded":"2024-04-26T12:40:17.589188+0000","last_fullsized":"2024-04-26T12:40:17.589188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584063+0000","last_change":"2024-04-26T12:38:32.097189+0000","last_active":"2024-04-26T12:40:17.584063+0000","last_peered":"2024-04-26T12:40:17.584063+0000","last_clean":"2024-04-26T12:40:17.584063+0000","last_became_active":"2024-04-26T12:38:32.096313+0000","last_became_peered":"2024-04-26T12:38:32.096313+0000","last_unstale":"2024-04-26T12:40:17.584063+0000","last_undegraded":"2024-04-26T12:40:17.584063+0000","last_fullsized":"2024-04-26T12:40:17.584063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:26.879794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779357+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:40:17.779357+0000","last_peered":"2024-04-26T12:40:17.779357+0000","last_clean":"2024-04-26T12:40:17.779357+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:40:17.779357+0000","last_undegraded":"2024-04-26T12:40:17.779357+0000","last_fullsized":"2024-04-26T12:40:17.779357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'8","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772034+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:40:16.772034+0000","last_peered":"2024-04-26T12:40:16.772034+0000","last_clean":"2024-04-26T12:40:16.772034+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:40:16.772034+0000","last_undegraded":"2024-04-26T12:40:16.772034+0000","last_fullsized":"2024-04-26T12:40:16.772034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585549+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:40:17.585549+0000","last_peered":"2024-04-26T12:40:17.585549+0000","last_clean":"2024-04-26T12:40:17.585549+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:40:17.585549+0000","last_undegraded":"2024-04-26T12:40:17.585549+0000","last_fullsized":"2024-04-26T12:40:17.585549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"74'14","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589447+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:40:17.589447+0000","last_peered":"2024-04-26T12:40:17.589447+0000","last_clean":"2024-04-26T12:40:17.589447+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:40:17.589447+0000","last_undegraded":"2024-04-26T12:40:17.589447+0000","last_fullsized":"2024-04-26T12:40:17.589447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"74'92","reported_seq":232,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778661+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:40:17.778661+0000","last_peered":"2024-04-26T12:40:17.778661+0000","last_clean":"2024-04-26T12:40:17.778661+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:40:17.778661+0000","last_undegraded":"2024-04-26T12:40:17.778661+0000","last_fullsized":"2024-04-26T12:40:17.778661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584064+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:40:17.584064+0000","last_peered":"2024-04-26T12:40:17.584064+0000","last_clean":"2024-04-26T12:40:17.584064+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:40:17.584064+0000","last_undegraded":"2024-04-26T12:40:17.584064+0000","last_fullsized":"2024-04-26T12:40:17.584064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"73'1","reported_seq":83,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584606+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:40:17.584606+0000","last_peered":"2024-04-26T12:40:17.584606+0000","last_clean":"2024-04-26T12:40:17.584606+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:40:17.584606+0000","last_undegraded":"2024-04-26T12:40:17.584606+0000","last_fullsized":"2024-04-26T12:40:17.584606+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583217+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:40:17.583217+0000","last_peered":"2024-04-26T12:40:17.583217+0000","last_clean":"2024-04-26T12:40:17.583217+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:40:17.583217+0000","last_undegraded":"2024-04-26T12:40:17.583217+0000","last_fullsized":"2024-04-26T12:40:17.583217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"74'24","reported_seq":154,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584639+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:40:17.584639+0000","last_peered":"2024-04-26T12:40:17.584639+0000","last_clean":"2024-04-26T12:40:17.584639+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:40:17.584639+0000","last_undegraded":"2024-04-26T12:40:17.584639+0000","last_fullsized":"2024-04-26T12:40:17.584639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775160+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:40:17.775160+0000","last_peered":"2024-04-26T12:40:17.775160+0000","last_clean":"2024-04-26T12:40:17.775160+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:40:17.775160+0000","last_undegraded":"2024-04-26T12:40:17.775160+0000","last_fullsized":"2024-04-26T12:40:17.775160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585097+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:40:17.585097+0000","last_peered":"2024-04-26T12:40:17.585097+0000","last_clean":"2024-04-26T12:40:17.585097+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:40:17.585097+0000","last_undegraded":"2024-04-26T12:40:17.585097+0000","last_fullsized":"2024-04-26T12:40:17.585097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"68'6","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775518+0000","last_change":"2024-04-26T12:38:32.097378+0000","last_active":"2024-04-26T12:40:17.775518+0000","last_peered":"2024-04-26T12:40:17.775518+0000","last_clean":"2024-04-26T12:40:17.775518+0000","last_became_active":"2024-04-26T12:38:32.096994+0000","last_became_peered":"2024-04-26T12:38:32.096994+0000","last_unstale":"2024-04-26T12:40:17.775518+0000","last_undegraded":"2024-04-26T12:40:17.775518+0000","last_fullsized":"2024-04-26T12:40:17.775518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:26.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"72'5","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587289+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:40:17.587289+0000","last_peered":"2024-04-26T12:40:17.587289+0000","last_clean":"2024-04-26T12:40:17.587289+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:40:17.587289+0000","last_undegraded":"2024-04-26T12:40:17.587289+0000","last_fullsized":"2024-04-26T12:40:17.587289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583766+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:40:17.583766+0000","last_peered":"2024-04-26T12:40:17.583766+0000","last_clean":"2024-04-26T12:40:17.583766+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:40:17.583766+0000","last_undegraded":"2024-04-26T12:40:17.583766+0000","last_fullsized":"2024-04-26T12:40:17.583766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"74'16","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778775+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:40:17.778775+0000","last_peered":"2024-04-26T12:40:17.778775+0000","last_clean":"2024-04-26T12:40:17.778775+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:40:17.778775+0000","last_undegraded":"2024-04-26T12:40:17.778775+0000","last_fullsized":"2024-04-26T12:40:17.778775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777990+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:40:17.777990+0000","last_peered":"2024-04-26T12:40:17.777990+0000","last_clean":"2024-04-26T12:40:17.777990+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:40:17.777990+0000","last_undegraded":"2024-04-26T12:40:17.777990+0000","last_fullsized":"2024-04-26T12:40:17.777990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"68'3","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773311+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:40:16.773311+0000","last_peered":"2024-04-26T12:40:16.773311+0000","last_clean":"2024-04-26T12:40:16.773311+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:40:16.773311+0000","last_undegraded":"2024-04-26T12:40:16.773311+0000","last_fullsized":"2024-04-26T12:40:16.773311+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":144,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773046+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:40:16.773046+0000","last_peered":"2024-04-26T12:40:16.773046+0000","last_clean":"2024-04-26T12:40:16.773046+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:40:16.773046+0000","last_undegraded":"2024-04-26T12:40:16.773046+0000","last_fullsized":"2024-04-26T12:40:16.773046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.590110+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:40:17.590110+0000","last_peered":"2024-04-26T12:40:17.590110+0000","last_clean":"2024-04-26T12:40:17.590110+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:40:17.590110+0000","last_undegraded":"2024-04-26T12:40:17.590110+0000","last_fullsized":"2024-04-26T12:40:17.590110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584507+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:40:17.584507+0000","last_peered":"2024-04-26T12:40:17.584507+0000","last_clean":"2024-04-26T12:40:17.584507+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:40:17.584507+0000","last_undegraded":"2024-04-26T12:40:17.584507+0000","last_fullsized":"2024-04-26T12:40:17.584507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"74'21","reported_seq":149,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583518+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:40:17.583518+0000","last_peered":"2024-04-26T12:40:17.583518+0000","last_clean":"2024-04-26T12:40:17.583518+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:40:17.583518+0000","last_undegraded":"2024-04-26T12:40:17.583518+0000","last_fullsized":"2024-04-26T12:40:17.583518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"74'92","reported_seq":229,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862495+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:40:16.862495+0000","last_peered":"2024-04-26T12:40:16.862495+0000","last_clean":"2024-04-26T12:40:16.862495+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:40:16.862495+0000","last_undegraded":"2024-04-26T12:40:16.862495+0000","last_fullsized":"2024-04-26T12:40:16.862495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":115,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863675+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:40:16.863675+0000","last_peered":"2024-04-26T12:40:16.863675+0000","last_clean":"2024-04-26T12:40:16.863675+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:40:16.863675+0000","last_undegraded":"2024-04-26T12:40:16.863675+0000","last_fullsized":"2024-04-26T12:40:16.863675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":141,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863459+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:40:16.863459+0000","last_peered":"2024-04-26T12:40:16.863459+0000","last_clean":"2024-04-26T12:40:16.863459+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:40:16.863459+0000","last_undegraded":"2024-04-26T12:40:16.863459+0000","last_fullsized":"2024-04-26T12:40:16.863459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'4","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586848+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:40:17.586848+0000","last_peered":"2024-04-26T12:40:17.586848+0000","last_clean":"2024-04-26T12:40:17.586848+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:40:17.586848+0000","last_undegraded":"2024-04-26T12:40:17.586848+0000","last_fullsized":"2024-04-26T12:40:17.586848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583977+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:40:17.583977+0000","last_peered":"2024-04-26T12:40:17.583977+0000","last_clean":"2024-04-26T12:40:17.583977+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:40:17.583977+0000","last_undegraded":"2024-04-26T12:40:17.583977+0000","last_fullsized":"2024-04-26T12:40:17.583977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"74'22","reported_seq":150,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862696+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:40:16.862696+0000","last_peered":"2024-04-26T12:40:16.862696+0000","last_clean":"2024-04-26T12:40:16.862696+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:40:16.862696+0000","last_undegraded":"2024-04-26T12:40:16.862696+0000","last_fullsized":"2024-04-26T12:40:16.862696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583588+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:40:17.583588+0000","last_peered":"2024-04-26T12:40:17.583588+0000","last_clean":"2024-04-26T12:40:17.583588+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:40:17.583588+0000","last_undegraded":"2024-04-26T12:40:17.583588+0000","last_fullsized":"2024-04-26T12:40:17.583588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"68'5","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776035+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:40:17.776035+0000","last_peered":"2024-04-26T12:40:17.776035+0000","last_clean":"2024-04-26T12:40:17.776035+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:40:17.776035+0000","last_undegraded":"2024-04-26T12:40:17.776035+0000","last_fullsized":"2024-04-26T12:40:17.776035+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"68'2","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778994+0000","last_change":"2024-04-26T12:38:32.098058+0000","last_active":"2024-04-26T12:40:17.778994+0000","last_peered":"2024-04-26T12:40:17.778994+0000","last_clean":"2024-04-26T12:40:17.778994+0000","last_became_active":"2024-04-26T12:38:32.095643+0000","last_became_peered":"2024-04-26T12:38:32.095643+0000","last_unstale":"2024-04-26T12:40:17.778994+0000","last_undegraded":"2024-04-26T12:40:17.778994+0000","last_fullsized":"2024-04-26T12:40:17.778994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:56.628368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"73'5","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778115+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:40:17.778115+0000","last_peered":"2024-04-26T12:40:17.778115+0000","last_clean":"2024-04-26T12:40:17.778115+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:40:17.778115+0000","last_undegraded":"2024-04-26T12:40:17.778115+0000","last_fullsized":"2024-04-26T12:40:17.778115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584280+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:40:17.584280+0000","last_peered":"2024-04-26T12:40:17.584280+0000","last_clean":"2024-04-26T12:40:17.584280+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:40:17.584280+0000","last_undegraded":"2024-04-26T12:40:17.584280+0000","last_fullsized":"2024-04-26T12:40:17.584280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"74'16","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776802+0000","last_change":"2024-04-26T12:38:32.096426+0000","last_active":"2024-04-26T12:40:17.776802+0000","last_peered":"2024-04-26T12:40:17.776802+0000","last_clean":"2024-04-26T12:40:17.776802+0000","last_became_active":"2024-04-26T12:38:32.095992+0000","last_became_peered":"2024-04-26T12:38:32.095992+0000","last_unstale":"2024-04-26T12:40:17.776802+0000","last_undegraded":"2024-04-26T12:40:17.776802+0000","last_fullsized":"2024-04-26T12:40:17.776802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:27.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864064+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:40:16.864064+0000","last_peered":"2024-04-26T12:40:16.864064+0000","last_clean":"2024-04-26T12:40:16.864064+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:40:16.864064+0000","last_undegraded":"2024-04-26T12:40:16.864064+0000","last_fullsized":"2024-04-26T12:40:16.864064+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775538+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:40:17.775538+0000","last_peered":"2024-04-26T12:40:17.775538+0000","last_clean":"2024-04-26T12:40:17.775538+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:40:17.775538+0000","last_undegraded":"2024-04-26T12:40:17.775538+0000","last_fullsized":"2024-04-26T12:40:17.775538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584385+0000","last_change":"2024-04-26T12:38:32.097968+0000","last_active":"2024-04-26T12:40:17.584385+0000","last_peered":"2024-04-26T12:40:17.584385+0000","last_clean":"2024-04-26T12:40:17.584385+0000","last_became_active":"2024-04-26T12:38:32.095619+0000","last_became_peered":"2024-04-26T12:38:32.095619+0000","last_unstale":"2024-04-26T12:40:17.584385+0000","last_undegraded":"2024-04-26T12:40:17.584385+0000","last_fullsized":"2024-04-26T12:40:17.584385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"72'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773485+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:40:16.773485+0000","last_peered":"2024-04-26T12:40:16.773485+0000","last_clean":"2024-04-26T12:40:16.773485+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:40:16.773485+0000","last_undegraded":"2024-04-26T12:40:16.773485+0000","last_fullsized":"2024-04-26T12:40:16.773485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775232+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:40:17.775232+0000","last_peered":"2024-04-26T12:40:17.775232+0000","last_clean":"2024-04-26T12:40:17.775232+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:40:17.775232+0000","last_undegraded":"2024-04-26T12:40:17.775232+0000","last_fullsized":"2024-04-26T12:40:17.775232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"74'20","reported_seq":148,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584732+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:40:17.584732+0000","last_peered":"2024-04-26T12:40:17.584732+0000","last_clean":"2024-04-26T12:40:17.584732+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:40:17.584732+0000","last_undegraded":"2024-04-26T12:40:17.584732+0000","last_fullsized":"2024-04-26T12:40:17.584732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"74'92","reported_seq":239,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584453+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:40:17.584453+0000","last_peered":"2024-04-26T12:40:17.584453+0000","last_clean":"2024-04-26T12:40:17.584453+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:40:17.584453+0000","last_undegraded":"2024-04-26T12:40:17.584453+0000","last_fullsized":"2024-04-26T12:40:17.584453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775393+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:40:17.775393+0000","last_peered":"2024-04-26T12:40:17.775393+0000","last_clean":"2024-04-26T12:40:17.775393+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:40:17.775393+0000","last_undegraded":"2024-04-26T12:40:17.775393+0000","last_fullsized":"2024-04-26T12:40:17.775393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'4","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773085+0000","last_change":"2024-04-26T12:38:32.098436+0000","last_active":"2024-04-26T12:40:16.773085+0000","last_peered":"2024-04-26T12:40:16.773085+0000","last_clean":"2024-04-26T12:40:16.773085+0000","last_became_active":"2024-04-26T12:38:32.097675+0000","last_became_peered":"2024-04-26T12:38:32.097675+0000","last_unstale":"2024-04-26T12:40:16.773085+0000","last_undegraded":"2024-04-26T12:40:16.773085+0000","last_fullsized":"2024-04-26T12:40:16.773085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:10.967994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"73'3","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583615+0000","last_change":"2024-04-26T12:38:32.091912+0000","last_active":"2024-04-26T12:40:17.583615+0000","last_peered":"2024-04-26T12:40:17.583615+0000","last_clean":"2024-04-26T12:40:17.583615+0000","last_became_active":"2024-04-26T12:38:32.091595+0000","last_became_peered":"2024-04-26T12:38:32.091595+0000","last_unstale":"2024-04-26T12:40:17.583615+0000","last_undegraded":"2024-04-26T12:40:17.583615+0000","last_fullsized":"2024-04-26T12:40:17.583615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:30.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":246,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586646+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:40:17.586646+0000","last_peered":"2024-04-26T12:40:17.586646+0000","last_clean":"2024-04-26T12:40:17.586646+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:40:17.586646+0000","last_undegraded":"2024-04-26T12:40:17.586646+0000","last_fullsized":"2024-04-26T12:40:17.586646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778741+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:40:17.778741+0000","last_peered":"2024-04-26T12:40:17.778741+0000","last_clean":"2024-04-26T12:40:17.778741+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:40:17.778741+0000","last_undegraded":"2024-04-26T12:40:17.778741+0000","last_fullsized":"2024-04-26T12:40:17.778741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"74'92","reported_seq":266,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772990+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:40:16.772990+0000","last_peered":"2024-04-26T12:40:16.772990+0000","last_clean":"2024-04-26T12:40:16.772990+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:40:16.772990+0000","last_undegraded":"2024-04-26T12:40:16.772990+0000","last_fullsized":"2024-04-26T12:40:16.772990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862828+0000","last_change":"2024-04-26T12:38:32.092303+0000","last_active":"2024-04-26T12:40:16.862828+0000","last_peered":"2024-04-26T12:40:16.862828+0000","last_clean":"2024-04-26T12:40:16.862828+0000","last_became_active":"2024-04-26T12:38:32.091872+0000","last_became_peered":"2024-04-26T12:38:32.091872+0000","last_unstale":"2024-04-26T12:40:16.862828+0000","last_undegraded":"2024-04-26T12:40:16.862828+0000","last_fullsized":"2024-04-26T12:40:16.862828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776331+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:40:17.776331+0000","last_peered":"2024-04-26T12:40:17.776331+0000","last_clean":"2024-04-26T12:40:17.776331+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:40:17.776331+0000","last_undegraded":"2024-04-26T12:40:17.776331+0000","last_fullsized":"2024-04-26T12:40:17.776331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'4","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776321+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:40:17.776321+0000","last_peered":"2024-04-26T12:40:17.776321+0000","last_clean":"2024-04-26T12:40:17.776321+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:40:17.776321+0000","last_undegraded":"2024-04-26T12:40:17.776321+0000","last_fullsized":"2024-04-26T12:40:17.776321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585811+0000","last_change":"2024-04-26T12:38:32.094763+0000","last_active":"2024-04-26T12:40:17.585811+0000","last_peered":"2024-04-26T12:40:17.585811+0000","last_clean":"2024-04-26T12:40:17.585811+0000","last_became_active":"2024-04-26T12:38:32.094384+0000","last_became_peered":"2024-04-26T12:38:32.094384+0000","last_unstale":"2024-04-26T12:40:17.585811+0000","last_undegraded":"2024-04-26T12:40:17.585811+0000","last_fullsized":"2024-04-26T12:40:17.585811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"74'23","reported_seq":152,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585311+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:40:17.585311+0000","last_peered":"2024-04-26T12:40:17.585311+0000","last_clean":"2024-04-26T12:40:17.585311+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:40:17.585311+0000","last_undegraded":"2024-04-26T12:40:17.585311+0000","last_fullsized":"2024-04-26T12:40:17.585311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772092+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:40:16.772092+0000","last_peered":"2024-04-26T12:40:16.772092+0000","last_clean":"2024-04-26T12:40:16.772092+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:40:16.772092+0000","last_undegraded":"2024-04-26T12:40:16.772092+0000","last_fullsized":"2024-04-26T12:40:16.772092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":111,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775023+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:40:17.775023+0000","last_peered":"2024-04-26T12:40:17.775023+0000","last_clean":"2024-04-26T12:40:17.775023+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:40:17.775023+0000","last_undegraded":"2024-04-26T12:40:17.775023+0000","last_fullsized":"2024-04-26T12:40:17.775023+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":163,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773718+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:40:16.773718+0000","last_peered":"2024-04-26T12:40:16.773718+0000","last_clean":"2024-04-26T12:40:16.773718+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:40:16.773718+0000","last_undegraded":"2024-04-26T12:40:16.773718+0000","last_fullsized":"2024-04-26T12:40:16.773718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":287,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583788+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:40:17.583788+0000","last_peered":"2024-04-26T12:40:17.583788+0000","last_clean":"2024-04-26T12:40:17.583788+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:40:17.583788+0000","last_undegraded":"2024-04-26T12:40:17.583788+0000","last_fullsized":"2024-04-26T12:40:17.583788+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585363+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:40:17.585363+0000","last_peered":"2024-04-26T12:40:17.585363+0000","last_clean":"2024-04-26T12:40:17.585363+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:40:17.585363+0000","last_undegraded":"2024-04-26T12:40:17.585363+0000","last_fullsized":"2024-04-26T12:40:17.585363+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"73'5","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778357+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:40:17.778357+0000","last_peered":"2024-04-26T12:40:17.778357+0000","last_clean":"2024-04-26T12:40:17.778357+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:40:17.778357+0000","last_undegraded":"2024-04-26T12:40:17.778357+0000","last_fullsized":"2024-04-26T12:40:17.778357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585660+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:40:17.585660+0000","last_peered":"2024-04-26T12:40:17.585660+0000","last_clean":"2024-04-26T12:40:17.585660+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:40:17.585660+0000","last_undegraded":"2024-04-26T12:40:17.585660+0000","last_fullsized":"2024-04-26T12:40:17.585660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"74'29","reported_seq":161,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587192+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:40:17.587192+0000","last_peered":"2024-04-26T12:40:17.587192+0000","last_clean":"2024-04-26T12:40:17.587192+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:40:17.587192+0000","last_undegraded":"2024-04-26T12:40:17.587192+0000","last_fullsized":"2024-04-26T12:40:17.587192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863727+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:40:16.863727+0000","last_peered":"2024-04-26T12:40:16.863727+0000","last_clean":"2024-04-26T12:40:16.863727+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:40:16.863727+0000","last_undegraded":"2024-04-26T12:40:16.863727+0000","last_fullsized":"2024-04-26T12:40:16.863727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771666+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:40:16.771666+0000","last_peered":"2024-04-26T12:40:16.771666+0000","last_clean":"2024-04-26T12:40:16.771666+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:40:16.771666+0000","last_undegraded":"2024-04-26T12:40:16.771666+0000","last_fullsized":"2024-04-26T12:40:16.771666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863987+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:40:16.863987+0000","last_peered":"2024-04-26T12:40:16.863987+0000","last_clean":"2024-04-26T12:40:16.863987+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:40:16.863987+0000","last_undegraded":"2024-04-26T12:40:16.863987+0000","last_fullsized":"2024-04-26T12:40:16.863987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583513+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:40:17.583513+0000","last_peered":"2024-04-26T12:40:17.583513+0000","last_clean":"2024-04-26T12:40:17.583513+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:40:17.583513+0000","last_undegraded":"2024-04-26T12:40:17.583513+0000","last_fullsized":"2024-04-26T12:40:17.583513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862758+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:40:16.862758+0000","last_peered":"2024-04-26T12:40:16.862758+0000","last_clean":"2024-04-26T12:40:16.862758+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:40:16.862758+0000","last_undegraded":"2024-04-26T12:40:16.862758+0000","last_fullsized":"2024-04-26T12:40:16.862758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587495+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:40:17.587495+0000","last_peered":"2024-04-26T12:40:17.587495+0000","last_clean":"2024-04-26T12:40:17.587495+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:40:17.587495+0000","last_undegraded":"2024-04-26T12:40:17.587495+0000","last_fullsized":"2024-04-26T12:40:17.587495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"74'99","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775130+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:40:17.775130+0000","last_peered":"2024-04-26T12:40:17.775130+0000","last_clean":"2024-04-26T12:40:17.775130+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:40:17.775130+0000","last_undegraded":"2024-04-26T12:40:17.775130+0000","last_fullsized":"2024-04-26T12:40:17.775130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":134,"num_read_kb":119,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589329+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:40:17.589329+0000","last_peered":"2024-04-26T12:40:17.589329+0000","last_clean":"2024-04-26T12:40:17.589329+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:40:17.589329+0000","last_undegraded":"2024-04-26T12:40:17.589329+0000","last_fullsized":"2024-04-26T12:40:17.589329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":111,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774225+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:40:17.774225+0000","last_peered":"2024-04-26T12:40:17.774225+0000","last_clean":"2024-04-26T12:40:17.774225+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:40:17.774225+0000","last_undegraded":"2024-04-26T12:40:17.774225+0000","last_fullsized":"2024-04-26T12:40:17.774225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"74'8","reported_seq":148,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776422+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:40:17.776422+0000","last_peered":"2024-04-26T12:40:17.776422+0000","last_clean":"2024-04-26T12:40:17.776422+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:40:17.776422+0000","last_undegraded":"2024-04-26T12:40:17.776422+0000","last_fullsized":"2024-04-26T12:40:17.776422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583775+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:40:17.583775+0000","last_peered":"2024-04-26T12:40:17.583775+0000","last_clean":"2024-04-26T12:40:17.583775+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:40:17.583775+0000","last_undegraded":"2024-04-26T12:40:17.583775+0000","last_fullsized":"2024-04-26T12:40:17.583775+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"73'9","reported_seq":142,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774292+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:40:17.774292+0000","last_peered":"2024-04-26T12:40:17.774292+0000","last_clean":"2024-04-26T12:40:17.774292+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:40:17.774292+0000","last_undegraded":"2024-04-26T12:40:17.774292+0000","last_fullsized":"2024-04-26T12:40:17.774292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":185,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584570+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:40:17.584570+0000","last_peered":"2024-04-26T12:40:17.584570+0000","last_clean":"2024-04-26T12:40:17.584570+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:40:17.584570+0000","last_undegraded":"2024-04-26T12:40:17.584570+0000","last_fullsized":"2024-04-26T12:40:17.584570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"67'16","reported_seq":164,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589726+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:40:17.589726+0000","last_peered":"2024-04-26T12:40:17.589726+0000","last_clean":"2024-04-26T12:40:17.589726+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:40:17.589726+0000","last_undegraded":"2024-04-26T12:40:17.589726+0000","last_fullsized":"2024-04-26T12:40:17.589726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863155+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:40:16.863155+0000","last_peered":"2024-04-26T12:40:16.863155+0000","last_clean":"2024-04-26T12:40:16.863155+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:40:16.863155+0000","last_undegraded":"2024-04-26T12:40:16.863155+0000","last_fullsized":"2024-04-26T12:40:16.863155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778713+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:40:17.778713+0000","last_peered":"2024-04-26T12:40:17.778713+0000","last_clean":"2024-04-26T12:40:17.778713+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:40:17.778713+0000","last_undegraded":"2024-04-26T12:40:17.778713+0000","last_fullsized":"2024-04-26T12:40:17.778713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":150,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775786+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:40:17.775786+0000","last_peered":"2024-04-26T12:40:17.775786+0000","last_clean":"2024-04-26T12:40:17.775786+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:40:17.775786+0000","last_undegraded":"2024-04-26T12:40:17.775786+0000","last_fullsized":"2024-04-26T12:40:17.775786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586216+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:40:17.586216+0000","last_peered":"2024-04-26T12:40:17.586216+0000","last_clean":"2024-04-26T12:40:17.586216+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:40:17.586216+0000","last_undegraded":"2024-04-26T12:40:17.586216+0000","last_fullsized":"2024-04-26T12:40:17.586216+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'4","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863386+0000","last_change":"2024-04-26T12:38:32.099375+0000","last_active":"2024-04-26T12:40:16.863386+0000","last_peered":"2024-04-26T12:40:16.863386+0000","last_clean":"2024-04-26T12:40:16.863386+0000","last_became_active":"2024-04-26T12:38:32.098983+0000","last_became_peered":"2024-04-26T12:38:32.098983+0000","last_unstale":"2024-04-26T12:40:16.863386+0000","last_undegraded":"2024-04-26T12:40:16.863386+0000","last_fullsized":"2024-04-26T12:40:16.863386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.281648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863528+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:40:16.863528+0000","last_peered":"2024-04-26T12:40:16.863528+0000","last_clean":"2024-04-26T12:40:16.863528+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:40:16.863528+0000","last_undegraded":"2024-04-26T12:40:16.863528+0000","last_fullsized":"2024-04-26T12:40:16.863528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":139,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779248+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:40:17.779248+0000","last_peered":"2024-04-26T12:40:17.779248+0000","last_clean":"2024-04-26T12:40:17.779248+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:40:17.779248+0000","last_undegraded":"2024-04-26T12:40:17.779248+0000","last_fullsized":"2024-04-26T12:40:17.779248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773518+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:40:16.773518+0000","last_peered":"2024-04-26T12:40:16.773518+0000","last_clean":"2024-04-26T12:40:16.773518+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:40:16.773518+0000","last_undegraded":"2024-04-26T12:40:16.773518+0000","last_fullsized":"2024-04-26T12:40:16.773518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":116,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583396+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:40:17.583396+0000","last_peered":"2024-04-26T12:40:17.583396+0000","last_clean":"2024-04-26T12:40:17.583396+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:40:17.583396+0000","last_undegraded":"2024-04-26T12:40:17.583396+0000","last_fullsized":"2024-04-26T12:40:17.583396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774632+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:40:17.774632+0000","last_peered":"2024-04-26T12:40:17.774632+0000","last_clean":"2024-04-26T12:40:17.774632+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:40:17.774632+0000","last_undegraded":"2024-04-26T12:40:17.774632+0000","last_fullsized":"2024-04-26T12:40:17.774632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'4","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587139+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:40:17.587139+0000","last_peered":"2024-04-26T12:40:17.587139+0000","last_clean":"2024-04-26T12:40:17.587139+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:40:17.587139+0000","last_undegraded":"2024-04-26T12:40:17.587139+0000","last_fullsized":"2024-04-26T12:40:17.587139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775939+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:40:17.775939+0000","last_peered":"2024-04-26T12:40:17.775939+0000","last_clean":"2024-04-26T12:40:17.775939+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:40:17.775939+0000","last_undegraded":"2024-04-26T12:40:17.775939+0000","last_fullsized":"2024-04-26T12:40:17.775939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863188+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:40:16.863188+0000","last_peered":"2024-04-26T12:40:16.863188+0000","last_clean":"2024-04-26T12:40:16.863188+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:40:16.863188+0000","last_undegraded":"2024-04-26T12:40:16.863188+0000","last_fullsized":"2024-04-26T12:40:16.863188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"74'28","reported_seq":160,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862952+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:40:16.862952+0000","last_peered":"2024-04-26T12:40:16.862952+0000","last_clean":"2024-04-26T12:40:16.862952+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:40:16.862952+0000","last_undegraded":"2024-04-26T12:40:16.862952+0000","last_fullsized":"2024-04-26T12:40:16.862952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":106,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777931+0000","last_change":"2024-04-26T12:38:32.094008+0000","last_active":"2024-04-26T12:40:17.777931+0000","last_peered":"2024-04-26T12:40:17.777931+0000","last_clean":"2024-04-26T12:40:17.777931+0000","last_became_active":"2024-04-26T12:38:32.092362+0000","last_became_peered":"2024-04-26T12:38:32.092362+0000","last_unstale":"2024-04-26T12:40:17.777931+0000","last_undegraded":"2024-04-26T12:40:17.777931+0000","last_fullsized":"2024-04-26T12:40:17.777931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.395782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863517+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:40:16.863517+0000","last_peered":"2024-04-26T12:40:16.863517+0000","last_clean":"2024-04-26T12:40:16.863517+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:40:16.863517+0000","last_undegraded":"2024-04-26T12:40:16.863517+0000","last_fullsized":"2024-04-26T12:40:16.863517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863473+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:40:16.863473+0000","last_peered":"2024-04-26T12:40:16.863473+0000","last_clean":"2024-04-26T12:40:16.863473+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:40:16.863473+0000","last_undegraded":"2024-04-26T12:40:16.863473+0000","last_fullsized":"2024-04-26T12:40:16.863473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'4","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775886+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:40:17.775886+0000","last_peered":"2024-04-26T12:40:17.775886+0000","last_clean":"2024-04-26T12:40:17.775886+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:40:17.775886+0000","last_undegraded":"2024-04-26T12:40:17.775886+0000","last_fullsized":"2024-04-26T12:40:17.775886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.590430+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:40:17.590430+0000","last_peered":"2024-04-26T12:40:17.590430+0000","last_clean":"2024-04-26T12:40:17.590430+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:40:17.590430+0000","last_undegraded":"2024-04-26T12:40:17.590430+0000","last_fullsized":"2024-04-26T12:40:17.590430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772580+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:40:16.772580+0000","last_peered":"2024-04-26T12:40:16.772580+0000","last_clean":"2024-04-26T12:40:16.772580+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:40:16.772580+0000","last_undegraded":"2024-04-26T12:40:16.772580+0000","last_fullsized":"2024-04-26T12:40:16.772580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774157+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:40:17.774157+0000","last_peered":"2024-04-26T12:40:17.774157+0000","last_clean":"2024-04-26T12:40:17.774157+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:40:17.774157+0000","last_undegraded":"2024-04-26T12:40:17.774157+0000","last_fullsized":"2024-04-26T12:40:17.774157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"74'92","reported_seq":231,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583916+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:40:17.583916+0000","last_peered":"2024-04-26T12:40:17.583916+0000","last_clean":"2024-04-26T12:40:17.583916+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:40:17.583916+0000","last_undegraded":"2024-04-26T12:40:17.583916+0000","last_fullsized":"2024-04-26T12:40:17.583916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779565+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:40:17.779565+0000","last_peered":"2024-04-26T12:40:17.779565+0000","last_clean":"2024-04-26T12:40:17.779565+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:40:17.779565+0000","last_undegraded":"2024-04-26T12:40:17.779565+0000","last_fullsized":"2024-04-26T12:40:17.779565+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":147,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775954+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:40:17.775954+0000","last_peered":"2024-04-26T12:40:17.775954+0000","last_clean":"2024-04-26T12:40:17.775954+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:40:17.775954+0000","last_undegraded":"2024-04-26T12:40:17.775954+0000","last_fullsized":"2024-04-26T12:40:17.775954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'2","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779116+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:40:17.779116+0000","last_peered":"2024-04-26T12:40:17.779116+0000","last_clean":"2024-04-26T12:40:17.779116+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:40:17.779116+0000","last_undegraded":"2024-04-26T12:40:17.779116+0000","last_fullsized":"2024-04-26T12:40:17.779116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777311+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:40:17.777311+0000","last_peered":"2024-04-26T12:40:17.777311+0000","last_clean":"2024-04-26T12:40:17.777311+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:40:17.777311+0000","last_undegraded":"2024-04-26T12:40:17.777311+0000","last_fullsized":"2024-04-26T12:40:17.777311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777900+0000","last_change":"2024-04-26T12:38:32.094625+0000","last_active":"2024-04-26T12:40:17.777900+0000","last_peered":"2024-04-26T12:40:17.777900+0000","last_clean":"2024-04-26T12:40:17.777900+0000","last_became_active":"2024-04-26T12:38:32.093266+0000","last_became_peered":"2024-04-26T12:38:32.093266+0000","last_unstale":"2024-04-26T12:40:17.777900+0000","last_undegraded":"2024-04-26T12:40:17.777900+0000","last_fullsized":"2024-04-26T12:40:17.777900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:18:18.695479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778131+0000","last_change":"2024-04-26T12:38:32.097625+0000","last_active":"2024-04-26T12:40:17.778131+0000","last_peered":"2024-04-26T12:40:17.778131+0000","last_clean":"2024-04-26T12:40:17.778131+0000","last_became_active":"2024-04-26T12:38:32.097186+0000","last_became_peered":"2024-04-26T12:38:32.097186+0000","last_unstale":"2024-04-26T12:40:17.778131+0000","last_undegraded":"2024-04-26T12:40:17.778131+0000","last_fullsized":"2024-04-26T12:40:17.778131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:09.866995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"74'92","reported_seq":232,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779046+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:40:17.779046+0000","last_peered":"2024-04-26T12:40:17.779046+0000","last_clean":"2024-04-26T12:40:17.779046+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:40:17.779046+0000","last_undegraded":"2024-04-26T12:40:17.779046+0000","last_fullsized":"2024-04-26T12:40:17.779046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863313+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:40:16.863313+0000","last_peered":"2024-04-26T12:40:16.863313+0000","last_clean":"2024-04-26T12:40:16.863313+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:40:16.863313+0000","last_undegraded":"2024-04-26T12:40:16.863313+0000","last_fullsized":"2024-04-26T12:40:16.863313+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585200+0000","last_change":"2024-04-26T12:38:32.089371+0000","last_active":"2024-04-26T12:40:17.585200+0000","last_peered":"2024-04-26T12:40:17.585200+0000","last_clean":"2024-04-26T12:40:17.585200+0000","last_became_active":"2024-04-26T12:38:32.088665+0000","last_became_peered":"2024-04-26T12:38:32.088665+0000","last_unstale":"2024-04-26T12:40:17.585200+0000","last_undegraded":"2024-04-26T12:40:17.585200+0000","last_fullsized":"2024-04-26T12:40:17.585200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:48.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"74'5","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864175+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:40:16.864175+0000","last_peered":"2024-04-26T12:40:16.864175+0000","last_clean":"2024-04-26T12:40:16.864175+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:40:16.864175+0000","last_undegraded":"2024-04-26T12:40:16.864175+0000","last_fullsized":"2024-04-26T12:40:16.864175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.774306+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:40:16.774306+0000","last_peered":"2024-04-26T12:40:16.774306+0000","last_clean":"2024-04-26T12:40:16.774306+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:40:16.774306+0000","last_undegraded":"2024-04-26T12:40:16.774306+0000","last_fullsized":"2024-04-26T12:40:16.774306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776016+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:40:17.776016+0000","last_peered":"2024-04-26T12:40:17.776016+0000","last_clean":"2024-04-26T12:40:17.776016+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:40:17.776016+0000","last_undegraded":"2024-04-26T12:40:17.776016+0000","last_fullsized":"2024-04-26T12:40:17.776016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"74'34","reported_seq":169,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584498+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:40:17.584498+0000","last_peered":"2024-04-26T12:40:17.584498+0000","last_clean":"2024-04-26T12:40:17.584498+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:40:17.584498+0000","last_undegraded":"2024-04-26T12:40:17.584498+0000","last_fullsized":"2024-04-26T12:40:17.584498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778005+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:40:17.778005+0000","last_peered":"2024-04-26T12:40:17.778005+0000","last_clean":"2024-04-26T12:40:17.778005+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:40:17.778005+0000","last_undegraded":"2024-04-26T12:40:17.778005+0000","last_fullsized":"2024-04-26T12:40:17.778005+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585018+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:40:17.585018+0000","last_peered":"2024-04-26T12:40:17.585018+0000","last_clean":"2024-04-26T12:40:17.585018+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:40:17.585018+0000","last_undegraded":"2024-04-26T12:40:17.585018+0000","last_fullsized":"2024-04-26T12:40:17.585018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"68'3","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863964+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:40:16.863964+0000","last_peered":"2024-04-26T12:40:16.863964+0000","last_clean":"2024-04-26T12:40:16.863964+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:40:16.863964+0000","last_undegraded":"2024-04-26T12:40:16.863964+0000","last_fullsized":"2024-04-26T12:40:16.863964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772458+0000","last_change":"2024-04-26T12:38:32.098082+0000","last_active":"2024-04-26T12:40:16.772458+0000","last_peered":"2024-04-26T12:40:16.772458+0000","last_clean":"2024-04-26T12:40:16.772458+0000","last_became_active":"2024-04-26T12:38:32.097658+0000","last_became_peered":"2024-04-26T12:38:32.097658+0000","last_unstale":"2024-04-26T12:40:16.772458+0000","last_undegraded":"2024-04-26T12:40:16.772458+0000","last_fullsized":"2024-04-26T12:40:16.772458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:15.092930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"72'4","reported_seq":107,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586025+0000","last_change":"2024-04-26T12:38:32.090992+0000","last_active":"2024-04-26T12:40:17.586025+0000","last_peered":"2024-04-26T12:40:17.586025+0000","last_clean":"2024-04-26T12:40:17.586025+0000","last_became_active":"2024-04-26T12:38:32.090197+0000","last_became_peered":"2024-04-26T12:38:32.090197+0000","last_unstale":"2024-04-26T12:40:17.586025+0000","last_undegraded":"2024-04-26T12:40:17.586025+0000","last_fullsized":"2024-04-26T12:40:17.586025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:51.388263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774684+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:40:17.774684+0000","last_peered":"2024-04-26T12:40:17.774684+0000","last_clean":"2024-04-26T12:40:17.774684+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:40:17.774684+0000","last_undegraded":"2024-04-26T12:40:17.774684+0000","last_fullsized":"2024-04-26T12:40:17.774684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"74'16","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775279+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:40:17.775279+0000","last_peered":"2024-04-26T12:40:17.775279+0000","last_clean":"2024-04-26T12:40:17.775279+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:40:17.775279+0000","last_undegraded":"2024-04-26T12:40:17.775279+0000","last_fullsized":"2024-04-26T12:40:17.775279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775673+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:40:17.775673+0000","last_peered":"2024-04-26T12:40:17.775673+0000","last_clean":"2024-04-26T12:40:17.775673+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:40:17.775673+0000","last_undegraded":"2024-04-26T12:40:17.775673+0000","last_fullsized":"2024-04-26T12:40:17.775673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":112,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778932+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:40:17.778932+0000","last_peered":"2024-04-26T12:40:17.778932+0000","last_clean":"2024-04-26T12:40:17.778932+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:40:17.778932+0000","last_undegraded":"2024-04-26T12:40:17.778932+0000","last_fullsized":"2024-04-26T12:40:17.778932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774502+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:40:17.774502+0000","last_peered":"2024-04-26T12:40:17.774502+0000","last_clean":"2024-04-26T12:40:17.774502+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:40:17.774502+0000","last_undegraded":"2024-04-26T12:40:17.774502+0000","last_fullsized":"2024-04-26T12:40:17.774502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"71'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589986+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:40:17.589986+0000","last_peered":"2024-04-26T12:40:17.589986+0000","last_clean":"2024-04-26T12:40:17.589986+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:40:17.589986+0000","last_undegraded":"2024-04-26T12:40:17.589986+0000","last_fullsized":"2024-04-26T12:40:17.589986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778350+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:40:17.778350+0000","last_peered":"2024-04-26T12:40:17.778350+0000","last_clean":"2024-04-26T12:40:17.778350+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:40:17.778350+0000","last_undegraded":"2024-04-26T12:40:17.778350+0000","last_fullsized":"2024-04-26T12:40:17.778350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"39'5","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862691+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:40:16.862691+0000","last_peered":"2024-04-26T12:40:16.862691+0000","last_clean":"2024-04-26T12:40:16.862691+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:40:16.862691+0000","last_undegraded":"2024-04-26T12:40:16.862691+0000","last_fullsized":"2024-04-26T12:40:16.862691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583478+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:40:17.583478+0000","last_peered":"2024-04-26T12:40:17.583478+0000","last_clean":"2024-04-26T12:40:17.583478+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:40:17.583478+0000","last_undegraded":"2024-04-26T12:40:17.583478+0000","last_fullsized":"2024-04-26T12:40:17.583478+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":117,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863403+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:40:16.863403+0000","last_peered":"2024-04-26T12:40:16.863403+0000","last_clean":"2024-04-26T12:40:16.863403+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:40:16.863403+0000","last_undegraded":"2024-04-26T12:40:16.863403+0000","last_fullsized":"2024-04-26T12:40:16.863403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":159,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778216+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:40:17.778216+0000","last_peered":"2024-04-26T12:40:17.778216+0000","last_clean":"2024-04-26T12:40:17.778216+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:40:17.778216+0000","last_undegraded":"2024-04-26T12:40:17.778216+0000","last_fullsized":"2024-04-26T12:40:17.778216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"73'1","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586179+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:40:17.586179+0000","last_peered":"2024-04-26T12:40:17.586179+0000","last_clean":"2024-04-26T12:40:17.586179+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:40:17.586179+0000","last_undegraded":"2024-04-26T12:40:17.586179+0000","last_fullsized":"2024-04-26T12:40:17.586179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.582831+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:40:17.582831+0000","last_peered":"2024-04-26T12:40:17.582831+0000","last_clean":"2024-04-26T12:40:17.582831+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:40:17.582831+0000","last_undegraded":"2024-04-26T12:40:17.582831+0000","last_fullsized":"2024-04-26T12:40:17.582831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"74'16","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778235+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:40:17.778235+0000","last_peered":"2024-04-26T12:40:17.778235+0000","last_clean":"2024-04-26T12:40:17.778235+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:40:17.778235+0000","last_undegraded":"2024-04-26T12:40:17.778235+0000","last_fullsized":"2024-04-26T12:40:17.778235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772598+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:40:16.772598+0000","last_peered":"2024-04-26T12:40:16.772598+0000","last_clean":"2024-04-26T12:40:16.772598+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:40:16.772598+0000","last_undegraded":"2024-04-26T12:40:16.772598+0000","last_fullsized":"2024-04-26T12:40:16.772598+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584805+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:40:17.584805+0000","last_peered":"2024-04-26T12:40:17.584805+0000","last_clean":"2024-04-26T12:40:17.584805+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:40:17.584805+0000","last_undegraded":"2024-04-26T12:40:17.584805+0000","last_fullsized":"2024-04-26T12:40:17.584805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776151+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:40:17.776151+0000","last_peered":"2024-04-26T12:40:17.776151+0000","last_clean":"2024-04-26T12:40:17.776151+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:40:17.776151+0000","last_undegraded":"2024-04-26T12:40:17.776151+0000","last_fullsized":"2024-04-26T12:40:17.776151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"71'3","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864198+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:40:16.864198+0000","last_peered":"2024-04-26T12:40:16.864198+0000","last_clean":"2024-04-26T12:40:16.864198+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:40:16.864198+0000","last_undegraded":"2024-04-26T12:40:16.864198+0000","last_fullsized":"2024-04-26T12:40:16.864198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772116+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:40:16.772116+0000","last_peered":"2024-04-26T12:40:16.772116+0000","last_clean":"2024-04-26T12:40:16.772116+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:40:16.772116+0000","last_undegraded":"2024-04-26T12:40:16.772116+0000","last_fullsized":"2024-04-26T12:40:16.772116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"74'16","reported_seq":141,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584198+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:40:17.584198+0000","last_peered":"2024-04-26T12:40:17.584198+0000","last_clean":"2024-04-26T12:40:17.584198+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:40:17.584198+0000","last_undegraded":"2024-04-26T12:40:17.584198+0000","last_fullsized":"2024-04-26T12:40:17.584198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862692+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:40:16.862692+0000","last_peered":"2024-04-26T12:40:16.862692+0000","last_clean":"2024-04-26T12:40:16.862692+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:40:16.862692+0000","last_undegraded":"2024-04-26T12:40:16.862692+0000","last_fullsized":"2024-04-26T12:40:16.862692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.774162+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:40:16.774162+0000","last_peered":"2024-04-26T12:40:16.774162+0000","last_clean":"2024-04-26T12:40:16.774162+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:40:16.774162+0000","last_undegraded":"2024-04-26T12:40:16.774162+0000","last_fullsized":"2024-04-26T12:40:16.774162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"73'2","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776283+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:40:17.776283+0000","last_peered":"2024-04-26T12:40:17.776283+0000","last_clean":"2024-04-26T12:40:17.776283+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:40:17.776283+0000","last_undegraded":"2024-04-26T12:40:17.776283+0000","last_fullsized":"2024-04-26T12:40:17.776283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863916+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:40:16.863916+0000","last_peered":"2024-04-26T12:40:16.863916+0000","last_clean":"2024-04-26T12:40:16.863916+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:40:16.863916+0000","last_undegraded":"2024-04-26T12:40:16.863916+0000","last_fullsized":"2024-04-26T12:40:16.863916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"74'22","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776693+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:40:17.776693+0000","last_peered":"2024-04-26T12:40:17.776693+0000","last_clean":"2024-04-26T12:40:17.776693+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:40:17.776693+0000","last_undegraded":"2024-04-26T12:40:17.776693+0000","last_fullsized":"2024-04-26T12:40:17.776693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586291+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:40:17.586291+0000","last_peered":"2024-04-26T12:40:17.586291+0000","last_clean":"2024-04-26T12:40:17.586291+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:40:17.586291+0000","last_undegraded":"2024-04-26T12:40:17.586291+0000","last_fullsized":"2024-04-26T12:40:17.586291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":112,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778044+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:40:17.778044+0000","last_peered":"2024-04-26T12:40:17.778044+0000","last_clean":"2024-04-26T12:40:17.778044+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:40:17.778044+0000","last_undegraded":"2024-04-26T12:40:17.778044+0000","last_fullsized":"2024-04-26T12:40:17.778044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"74'14","reported_seq":174,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863979+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:40:16.863979+0000","last_peered":"2024-04-26T12:40:16.863979+0000","last_clean":"2024-04-26T12:40:16.863979+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:40:16.863979+0000","last_undegraded":"2024-04-26T12:40:16.863979+0000","last_fullsized":"2024-04-26T12:40:16.863979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":64,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"73'5","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775580+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:40:17.775580+0000","last_peered":"2024-04-26T12:40:17.775580+0000","last_clean":"2024-04-26T12:40:17.775580+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:40:17.775580+0000","last_undegraded":"2024-04-26T12:40:17.775580+0000","last_fullsized":"2024-04-26T12:40:17.775580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773748+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:40:16.773748+0000","last_peered":"2024-04-26T12:40:16.773748+0000","last_clean":"2024-04-26T12:40:16.773748+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:40:16.773748+0000","last_undegraded":"2024-04-26T12:40:16.773748+0000","last_fullsized":"2024-04-26T12:40:16.773748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"74'20","reported_seq":148,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585290+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:40:17.585290+0000","last_peered":"2024-04-26T12:40:17.585290+0000","last_clean":"2024-04-26T12:40:17.585290+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:40:17.585290+0000","last_undegraded":"2024-04-26T12:40:17.585290+0000","last_fullsized":"2024-04-26T12:40:17.585290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":115,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776744+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:40:17.776744+0000","last_peered":"2024-04-26T12:40:17.776744+0000","last_clean":"2024-04-26T12:40:17.776744+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:40:17.776744+0000","last_undegraded":"2024-04-26T12:40:17.776744+0000","last_fullsized":"2024-04-26T12:40:17.776744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772054+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:40:16.772054+0000","last_peered":"2024-04-26T12:40:16.772054+0000","last_clean":"2024-04-26T12:40:16.772054+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:40:16.772054+0000","last_undegraded":"2024-04-26T12:40:16.772054+0000","last_fullsized":"2024-04-26T12:40:16.772054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779162+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:40:17.779162+0000","last_peered":"2024-04-26T12:40:17.779162+0000","last_clean":"2024-04-26T12:40:17.779162+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:40:17.779162+0000","last_undegraded":"2024-04-26T12:40:17.779162+0000","last_fullsized":"2024-04-26T12:40:17.779162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"73'3","reported_seq":107,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774841+0000","last_change":"2024-04-26T12:38:32.097004+0000","last_active":"2024-04-26T12:40:17.774841+0000","last_peered":"2024-04-26T12:40:17.774841+0000","last_clean":"2024-04-26T12:40:17.774841+0000","last_became_active":"2024-04-26T12:38:32.096196+0000","last_became_peered":"2024-04-26T12:38:32.096196+0000","last_unstale":"2024-04-26T12:40:17.774841+0000","last_undegraded":"2024-04-26T12:40:17.774841+0000","last_fullsized":"2024-04-26T12:40:17.774841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:00.173484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778815+0000","last_change":"2024-04-26T12:38:32.100356+0000","last_active":"2024-04-26T12:40:17.778815+0000","last_peered":"2024-04-26T12:40:17.778815+0000","last_clean":"2024-04-26T12:40:17.778815+0000","last_became_active":"2024-04-26T12:38:32.099529+0000","last_became_peered":"2024-04-26T12:38:32.099529+0000","last_unstale":"2024-04-26T12:40:17.778815+0000","last_undegraded":"2024-04-26T12:40:17.778815+0000","last_fullsized":"2024-04-26T12:40:17.778815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:32.397561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"74'16","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779723+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:40:17.779723+0000","last_peered":"2024-04-26T12:40:17.779723+0000","last_clean":"2024-04-26T12:40:17.779723+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:40:17.779723+0000","last_undegraded":"2024-04-26T12:40:17.779723+0000","last_fullsized":"2024-04-26T12:40:17.779723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":116,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776546+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:40:17.776546+0000","last_peered":"2024-04-26T12:40:17.776546+0000","last_clean":"2024-04-26T12:40:17.776546+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:40:17.776546+0000","last_undegraded":"2024-04-26T12:40:17.776546+0000","last_fullsized":"2024-04-26T12:40:17.776546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584604+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:40:17.584604+0000","last_peered":"2024-04-26T12:40:17.584604+0000","last_clean":"2024-04-26T12:40:17.584604+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:40:17.584604+0000","last_undegraded":"2024-04-26T12:40:17.584604+0000","last_fullsized":"2024-04-26T12:40:17.584604+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584315+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:40:17.584315+0000","last_peered":"2024-04-26T12:40:17.584315+0000","last_clean":"2024-04-26T12:40:17.584315+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:40:17.584315+0000","last_undegraded":"2024-04-26T12:40:17.584315+0000","last_fullsized":"2024-04-26T12:40:17.584315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"72'2","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862975+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:40:16.862975+0000","last_peered":"2024-04-26T12:40:16.862975+0000","last_clean":"2024-04-26T12:40:16.862975+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:40:16.862975+0000","last_undegraded":"2024-04-26T12:40:16.862975+0000","last_fullsized":"2024-04-26T12:40:16.862975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776913+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:40:17.776913+0000","last_peered":"2024-04-26T12:40:17.776913+0000","last_clean":"2024-04-26T12:40:17.776913+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:40:17.776913+0000","last_undegraded":"2024-04-26T12:40:17.776913+0000","last_fullsized":"2024-04-26T12:40:17.776913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"68'11","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773754+0000","last_change":"2024-04-26T12:38:32.098589+0000","last_active":"2024-04-26T12:40:16.773754+0000","last_peered":"2024-04-26T12:40:16.773754+0000","last_clean":"2024-04-26T12:40:16.773754+0000","last_became_active":"2024-04-26T12:38:32.097940+0000","last_became_peered":"2024-04-26T12:38:32.097940+0000","last_unstale":"2024-04-26T12:40:16.773754+0000","last_undegraded":"2024-04-26T12:40:16.773754+0000","last_fullsized":"2024-04-26T12:40:16.773754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"74'92","reported_seq":233,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773237+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:40:16.773237+0000","last_peered":"2024-04-26T12:40:16.773237+0000","last_clean":"2024-04-26T12:40:16.773237+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:40:16.773237+0000","last_undegraded":"2024-04-26T12:40:16.773237+0000","last_fullsized":"2024-04-26T12:40:16.773237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.582794+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:40:17.582794+0000","last_peered":"2024-04-26T12:40:17.582794+0000","last_clean":"2024-04-26T12:40:17.582794+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:40:17.582794+0000","last_undegraded":"2024-04-26T12:40:17.582794+0000","last_fullsized":"2024-04-26T12:40:17.582794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"68'2","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778828+0000","last_change":"2024-04-26T12:38:32.097299+0000","last_active":"2024-04-26T12:40:17.778828+0000","last_peered":"2024-04-26T12:40:17.778828+0000","last_clean":"2024-04-26T12:40:17.778828+0000","last_became_active":"2024-04-26T12:38:32.096485+0000","last_became_peered":"2024-04-26T12:38:32.096485+0000","last_unstale":"2024-04-26T12:40:17.778828+0000","last_undegraded":"2024-04-26T12:40:17.778828+0000","last_fullsized":"2024-04-26T12:40:17.778828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:18.433433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586585+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:40:17.586585+0000","last_peered":"2024-04-26T12:40:17.586585+0000","last_clean":"2024-04-26T12:40:17.586585+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:40:17.586585+0000","last_undegraded":"2024-04-26T12:40:17.586585+0000","last_fullsized":"2024-04-26T12:40:17.586585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584329+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:40:17.584329+0000","last_peered":"2024-04-26T12:40:17.584329+0000","last_clean":"2024-04-26T12:40:17.584329+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:40:17.584329+0000","last_undegraded":"2024-04-26T12:40:17.584329+0000","last_fullsized":"2024-04-26T12:40:17.584329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"74'21","reported_seq":149,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584900+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:40:17.584900+0000","last_peered":"2024-04-26T12:40:17.584900+0000","last_clean":"2024-04-26T12:40:17.584900+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:40:17.584900+0000","last_undegraded":"2024-04-26T12:40:17.584900+0000","last_fullsized":"2024-04-26T12:40:17.584900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862402+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:40:16.862402+0000","last_peered":"2024-04-26T12:40:16.862402+0000","last_clean":"2024-04-26T12:40:16.862402+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:40:16.862402+0000","last_undegraded":"2024-04-26T12:40:16.862402+0000","last_fullsized":"2024-04-26T12:40:16.862402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.588562+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:40:17.588562+0000","last_peered":"2024-04-26T12:40:17.588562+0000","last_clean":"2024-04-26T12:40:17.588562+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:40:17.588562+0000","last_undegraded":"2024-04-26T12:40:17.588562+0000","last_fullsized":"2024-04-26T12:40:17.588562+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'2","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778148+0000","last_change":"2024-04-26T12:38:32.097693+0000","last_active":"2024-04-26T12:40:17.778148+0000","last_peered":"2024-04-26T12:40:17.778148+0000","last_clean":"2024-04-26T12:40:17.778148+0000","last_became_active":"2024-04-26T12:38:32.096141+0000","last_became_peered":"2024-04-26T12:38:32.096141+0000","last_unstale":"2024-04-26T12:40:17.778148+0000","last_undegraded":"2024-04-26T12:40:17.778148+0000","last_fullsized":"2024-04-26T12:40:17.778148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.450059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586753+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:40:17.586753+0000","last_peered":"2024-04-26T12:40:17.586753+0000","last_clean":"2024-04-26T12:40:17.586753+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:40:17.586753+0000","last_undegraded":"2024-04-26T12:40:17.586753+0000","last_fullsized":"2024-04-26T12:40:17.586753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584881+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:40:17.584881+0000","last_peered":"2024-04-26T12:40:17.584881+0000","last_clean":"2024-04-26T12:40:17.584881+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:40:17.584881+0000","last_undegraded":"2024-04-26T12:40:17.584881+0000","last_fullsized":"2024-04-26T12:40:17.584881+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"74'14","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862402+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:40:16.862402+0000","last_peered":"2024-04-26T12:40:16.862402+0000","last_clean":"2024-04-26T12:40:16.862402+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:40:16.862402+0000","last_undegraded":"2024-04-26T12:40:16.862402+0000","last_fullsized":"2024-04-26T12:40:16.862402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771840+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:40:16.771840+0000","last_peered":"2024-04-26T12:40:16.771840+0000","last_clean":"2024-04-26T12:40:16.771840+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:40:16.771840+0000","last_undegraded":"2024-04-26T12:40:16.771840+0000","last_fullsized":"2024-04-26T12:40:16.771840+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":112,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779085+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:40:17.779085+0000","last_peered":"2024-04-26T12:40:17.779085+0000","last_clean":"2024-04-26T12:40:17.779085+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:40:17.779085+0000","last_undegraded":"2024-04-26T12:40:17.779085+0000","last_fullsized":"2024-04-26T12:40:17.779085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778298+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:40:17.778298+0000","last_peered":"2024-04-26T12:40:17.778298+0000","last_clean":"2024-04-26T12:40:17.778298+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:40:17.778298+0000","last_undegraded":"2024-04-26T12:40:17.778298+0000","last_fullsized":"2024-04-26T12:40:17.778298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"73'5","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779408+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:40:17.779408+0000","last_peered":"2024-04-26T12:40:17.779408+0000","last_clean":"2024-04-26T12:40:17.779408+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:40:17.779408+0000","last_undegraded":"2024-04-26T12:40:17.779408+0000","last_fullsized":"2024-04-26T12:40:17.779408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771500+0000","last_change":"2024-04-26T12:38:32.098077+0000","last_active":"2024-04-26T12:40:16.771500+0000","last_peered":"2024-04-26T12:40:16.771500+0000","last_clean":"2024-04-26T12:40:16.771500+0000","last_became_active":"2024-04-26T12:38:32.097608+0000","last_became_peered":"2024-04-26T12:38:32.097608+0000","last_unstale":"2024-04-26T12:40:16.771500+0000","last_undegraded":"2024-04-26T12:40:16.771500+0000","last_fullsized":"2024-04-26T12:40:16.771500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:52.163433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"74'11","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778935+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:40:17.778935+0000","last_peered":"2024-04-26T12:40:17.778935+0000","last_clean":"2024-04-26T12:40:17.778935+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:40:17.778935+0000","last_undegraded":"2024-04-26T12:40:17.778935+0000","last_fullsized":"2024-04-26T12:40:17.778935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":104,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772350+0000","last_change":"2024-04-26T12:38:32.097869+0000","last_active":"2024-04-26T12:40:16.772350+0000","last_peered":"2024-04-26T12:40:16.772350+0000","last_clean":"2024-04-26T12:40:16.772350+0000","last_became_active":"2024-04-26T12:38:32.097545+0000","last_became_peered":"2024-04-26T12:38:32.097545+0000","last_unstale":"2024-04-26T12:40:16.772350+0000","last_undegraded":"2024-04-26T12:40:16.772350+0000","last_fullsized":"2024-04-26T12:40:16.772350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:00.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.589586+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:40:17.589586+0000","last_peered":"2024-04-26T12:40:17.589586+0000","last_clean":"2024-04-26T12:40:17.589586+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:40:17.589586+0000","last_undegraded":"2024-04-26T12:40:17.589586+0000","last_fullsized":"2024-04-26T12:40:17.589586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"68'12","reported_seq":142,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771635+0000","last_change":"2024-04-26T12:38:32.098742+0000","last_active":"2024-04-26T12:40:16.771635+0000","last_peered":"2024-04-26T12:40:16.771635+0000","last_clean":"2024-04-26T12:40:16.771635+0000","last_became_active":"2024-04-26T12:38:32.098197+0000","last_became_peered":"2024-04-26T12:38:32.098197+0000","last_unstale":"2024-04-26T12:40:16.771635+0000","last_undegraded":"2024-04-26T12:40:16.771635+0000","last_fullsized":"2024-04-26T12:40:16.771635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.480181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"73'5","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864208+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:40:16.864208+0000","last_peered":"2024-04-26T12:40:16.864208+0000","last_clean":"2024-04-26T12:40:16.864208+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:40:16.864208+0000","last_undegraded":"2024-04-26T12:40:16.864208+0000","last_fullsized":"2024-04-26T12:40:16.864208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":186,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.774537+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:40:17.774537+0000","last_peered":"2024-04-26T12:40:17.774537+0000","last_clean":"2024-04-26T12:40:17.774537+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:40:17.774537+0000","last_undegraded":"2024-04-26T12:40:17.774537+0000","last_fullsized":"2024-04-26T12:40:17.774537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"74'14","reported_seq":142,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585191+0000","last_change":"2024-04-26T12:38:32.089759+0000","last_active":"2024-04-26T12:40:17.585191+0000","last_peered":"2024-04-26T12:40:17.585191+0000","last_clean":"2024-04-26T12:40:17.585191+0000","last_became_active":"2024-04-26T12:38:32.088214+0000","last_became_peered":"2024-04-26T12:38:32.088214+0000","last_unstale":"2024-04-26T12:40:17.585191+0000","last_undegraded":"2024-04-26T12:40:17.585191+0000","last_fullsized":"2024-04-26T12:40:17.585191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:38.656355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862844+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:40:16.862844+0000","last_peered":"2024-04-26T12:40:16.862844+0000","last_clean":"2024-04-26T12:40:16.862844+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:40:16.862844+0000","last_undegraded":"2024-04-26T12:40:16.862844+0000","last_fullsized":"2024-04-26T12:40:16.862844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863004+0000","last_change":"2024-04-26T12:38:32.098228+0000","last_active":"2024-04-26T12:40:16.863004+0000","last_peered":"2024-04-26T12:40:16.863004+0000","last_clean":"2024-04-26T12:40:16.863004+0000","last_became_active":"2024-04-26T12:38:32.092404+0000","last_became_peered":"2024-04-26T12:38:32.092404+0000","last_unstale":"2024-04-26T12:40:16.863004+0000","last_undegraded":"2024-04-26T12:40:16.863004+0000","last_fullsized":"2024-04-26T12:40:16.863004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"68'4","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776233+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:40:17.776233+0000","last_peered":"2024-04-26T12:40:17.776233+0000","last_clean":"2024-04-26T12:40:17.776233+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:40:17.776233+0000","last_undegraded":"2024-04-26T12:40:17.776233+0000","last_fullsized":"2024-04-26T12:40:17.776233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'4","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772358+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:40:16.772358+0000","last_peered":"2024-04-26T12:40:16.772358+0000","last_clean":"2024-04-26T12:40:16.772358+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:40:16.772358+0000","last_undegraded":"2024-04-26T12:40:16.772358+0000","last_fullsized":"2024-04-26T12:40:16.772358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":176,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.776952+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:40:17.776952+0000","last_peered":"2024-04-26T12:40:17.776952+0000","last_clean":"2024-04-26T12:40:17.776952+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:40:17.776952+0000","last_undegraded":"2024-04-26T12:40:17.776952+0000","last_fullsized":"2024-04-26T12:40:17.776952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"71'4","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583679+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:40:17.583679+0000","last_peered":"2024-04-26T12:40:17.583679+0000","last_clean":"2024-04-26T12:40:17.583679+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:40:17.583679+0000","last_undegraded":"2024-04-26T12:40:17.583679+0000","last_fullsized":"2024-04-26T12:40:17.583679+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"74'2","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585809+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:40:17.585809+0000","last_peered":"2024-04-26T12:40:17.585809+0000","last_clean":"2024-04-26T12:40:17.585809+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:40:17.585809+0000","last_undegraded":"2024-04-26T12:40:17.585809+0000","last_fullsized":"2024-04-26T12:40:17.585809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"73'7","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.586091+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:40:17.586091+0000","last_peered":"2024-04-26T12:40:17.586091+0000","last_clean":"2024-04-26T12:40:17.586091+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:40:17.586091+0000","last_undegraded":"2024-04-26T12:40:17.586091+0000","last_fullsized":"2024-04-26T12:40:17.586091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"68'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775912+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:40:17.775912+0000","last_peered":"2024-04-26T12:40:17.775912+0000","last_clean":"2024-04-26T12:40:17.775912+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:40:17.775912+0000","last_undegraded":"2024-04-26T12:40:17.775912+0000","last_fullsized":"2024-04-26T12:40:17.775912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'4","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863136+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:40:16.863136+0000","last_peered":"2024-04-26T12:40:16.863136+0000","last_clean":"2024-04-26T12:40:16.863136+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:40:16.863136+0000","last_undegraded":"2024-04-26T12:40:16.863136+0000","last_fullsized":"2024-04-26T12:40:16.863136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":147,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778706+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:40:17.778706+0000","last_peered":"2024-04-26T12:40:17.778706+0000","last_clean":"2024-04-26T12:40:17.778706+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:40:17.778706+0000","last_undegraded":"2024-04-26T12:40:17.778706+0000","last_fullsized":"2024-04-26T12:40:17.778706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"72'1","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779328+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:40:17.779328+0000","last_peered":"2024-04-26T12:40:17.779328+0000","last_clean":"2024-04-26T12:40:17.779328+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:40:17.779328+0000","last_undegraded":"2024-04-26T12:40:17.779328+0000","last_fullsized":"2024-04-26T12:40:17.779328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":103,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772858+0000","last_change":"2024-04-26T12:38:32.099762+0000","last_active":"2024-04-26T12:40:16.772858+0000","last_peered":"2024-04-26T12:40:16.772858+0000","last_clean":"2024-04-26T12:40:16.772858+0000","last_became_active":"2024-04-26T12:38:32.099061+0000","last_became_peered":"2024-04-26T12:38:32.099061+0000","last_unstale":"2024-04-26T12:40:16.772858+0000","last_undegraded":"2024-04-26T12:40:16.772858+0000","last_fullsized":"2024-04-26T12:40:16.772858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:17.530530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"73'3","reported_seq":139,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.777074+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:40:17.777074+0000","last_peered":"2024-04-26T12:40:17.777074+0000","last_clean":"2024-04-26T12:40:17.777074+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:40:17.777074+0000","last_undegraded":"2024-04-26T12:40:17.777074+0000","last_fullsized":"2024-04-26T12:40:17.777074+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778162+0000","last_change":"2024-04-26T12:38:58.795730+0000","last_active":"2024-04-26T12:40:17.778162+0000","last_peered":"2024-04-26T12:40:17.778162+0000","last_clean":"2024-04-26T12:40:17.778162+0000","last_became_active":"2024-04-26T12:38:58.795097+0000","last_became_peered":"2024-04-26T12:38:58.795097+0000","last_unstale":"2024-04-26T12:40:17.778162+0000","last_undegraded":"2024-04-26T12:40:17.778162+0000","last_fullsized":"2024-04-26T12:40:17.778162+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.166788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773961+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:40:16.773961+0000","last_peered":"2024-04-26T12:40:16.773961+0000","last_clean":"2024-04-26T12:40:16.773961+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:40:16.773961+0000","last_undegraded":"2024-04-26T12:40:16.773961+0000","last_fullsized":"2024-04-26T12:40:16.773961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"74'10","reported_seq":169,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.771891+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:40:16.771891+0000","last_peered":"2024-04-26T12:40:16.771891+0000","last_clean":"2024-04-26T12:40:16.771891+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:40:16.771891+0000","last_undegraded":"2024-04-26T12:40:16.771891+0000","last_fullsized":"2024-04-26T12:40:16.771891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"73'6","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.779507+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:40:17.779507+0000","last_peered":"2024-04-26T12:40:17.779507+0000","last_clean":"2024-04-26T12:40:17.779507+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:40:17.779507+0000","last_undegraded":"2024-04-26T12:40:17.779507+0000","last_fullsized":"2024-04-26T12:40:17.779507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"68'6","reported_seq":151,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864118+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:40:16.864118+0000","last_peered":"2024-04-26T12:40:16.864118+0000","last_clean":"2024-04-26T12:40:16.864118+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:40:16.864118+0000","last_undegraded":"2024-04-26T12:40:16.864118+0000","last_fullsized":"2024-04-26T12:40:16.864118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"73'6","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584350+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:40:17.584350+0000","last_peered":"2024-04-26T12:40:17.584350+0000","last_clean":"2024-04-26T12:40:17.584350+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:40:17.584350+0000","last_undegraded":"2024-04-26T12:40:17.584350+0000","last_fullsized":"2024-04-26T12:40:17.584350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":111,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584615+0000","last_change":"2024-04-26T12:38:32.101184+0000","last_active":"2024-04-26T12:40:17.584615+0000","last_peered":"2024-04-26T12:40:17.584615+0000","last_clean":"2024-04-26T12:40:17.584615+0000","last_became_active":"2024-04-26T12:38:32.100885+0000","last_became_peered":"2024-04-26T12:38:32.100885+0000","last_unstale":"2024-04-26T12:40:17.584615+0000","last_undegraded":"2024-04-26T12:40:17.584615+0000","last_fullsized":"2024-04-26T12:40:17.584615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:14.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"72'2","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778404+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:40:17.778404+0000","last_peered":"2024-04-26T12:40:17.778404+0000","last_clean":"2024-04-26T12:40:17.778404+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:40:17.778404+0000","last_undegraded":"2024-04-26T12:40:17.778404+0000","last_fullsized":"2024-04-26T12:40:17.778404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"68'2","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584566+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:40:17.584566+0000","last_peered":"2024-04-26T12:40:17.584566+0000","last_clean":"2024-04-26T12:40:17.584566+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:40:17.584566+0000","last_undegraded":"2024-04-26T12:40:17.584566+0000","last_fullsized":"2024-04-26T12:40:17.584566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'8","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585711+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:40:17.585711+0000","last_peered":"2024-04-26T12:40:17.585711+0000","last_clean":"2024-04-26T12:40:17.585711+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:40:17.585711+0000","last_undegraded":"2024-04-26T12:40:17.585711+0000","last_fullsized":"2024-04-26T12:40:17.585711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"68'4","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.772797+0000","last_change":"2024-04-26T12:38:32.097249+0000","last_active":"2024-04-26T12:40:16.772797+0000","last_peered":"2024-04-26T12:40:16.772797+0000","last_clean":"2024-04-26T12:40:16.772797+0000","last_became_active":"2024-04-26T12:38:32.096972+0000","last_became_peered":"2024-04-26T12:38:32.096972+0000","last_unstale":"2024-04-26T12:40:16.772797+0000","last_undegraded":"2024-04-26T12:40:16.772797+0000","last_fullsized":"2024-04-26T12:40:16.772797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:06.018406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"73'2","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.863196+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:40:16.863196+0000","last_peered":"2024-04-26T12:40:16.863196+0000","last_clean":"2024-04-26T12:40:16.863196+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:40:16.863196+0000","last_undegraded":"2024-04-26T12:40:16.863196+0000","last_fullsized":"2024-04-26T12:40:16.863196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":149,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585117+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:40:17.585117+0000","last_peered":"2024-04-26T12:40:17.585117+0000","last_clean":"2024-04-26T12:40:17.585117+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:40:17.585117+0000","last_undegraded":"2024-04-26T12:40:17.585117+0000","last_fullsized":"2024-04-26T12:40:17.585117+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'2","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.773089+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:40:16.773089+0000","last_peered":"2024-04-26T12:40:16.773089+0000","last_clean":"2024-04-26T12:40:16.773089+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:40:16.773089+0000","last_undegraded":"2024-04-26T12:40:16.773089+0000","last_fullsized":"2024-04-26T12:40:16.773089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"68'4","reported_seq":141,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.862625+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:40:16.862625+0000","last_peered":"2024-04-26T12:40:16.862625+0000","last_clean":"2024-04-26T12:40:16.862625+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:40:16.862625+0000","last_undegraded":"2024-04-26T12:40:16.862625+0000","last_fullsized":"2024-04-26T12:40:16.862625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"73'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.590307+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:40:17.590307+0000","last_peered":"2024-04-26T12:40:17.590307+0000","last_clean":"2024-04-26T12:40:17.590307+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:40:17.590307+0000","last_undegraded":"2024-04-26T12:40:17.590307+0000","last_fullsized":"2024-04-26T12:40:17.590307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.778013+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:40:17.778013+0000","last_peered":"2024-04-26T12:40:17.778013+0000","last_clean":"2024-04-26T12:40:17.778013+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:40:17.778013+0000","last_undegraded":"2024-04-26T12:40:17.778013+0000","last_fullsized":"2024-04-26T12:40:17.778013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584802+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:40:17.584802+0000","last_peered":"2024-04-26T12:40:17.584802+0000","last_clean":"2024-04-26T12:40:17.584802+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:40:17.584802+0000","last_undegraded":"2024-04-26T12:40:17.584802+0000","last_fullsized":"2024-04-26T12:40:17.584802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.583262+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:40:17.583262+0000","last_peered":"2024-04-26T12:40:17.583262+0000","last_clean":"2024-04-26T12:40:17.583262+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:40:17.583262+0000","last_undegraded":"2024-04-26T12:40:17.583262+0000","last_fullsized":"2024-04-26T12:40:17.583262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"71'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.587756+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:40:17.587756+0000","last_peered":"2024-04-26T12:40:17.587756+0000","last_clean":"2024-04-26T12:40:17.587756+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:40:17.587756+0000","last_undegraded":"2024-04-26T12:40:17.587756+0000","last_fullsized":"2024-04-26T12:40:17.587756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'3","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.584122+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:40:17.584122+0000","last_peered":"2024-04-26T12:40:17.584122+0000","last_clean":"2024-04-26T12:40:17.584122+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:40:17.584122+0000","last_undegraded":"2024-04-26T12:40:17.584122+0000","last_fullsized":"2024-04-26T12:40:17.584122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:16.864091+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:40:16.864091+0000","last_peered":"2024-04-26T12:40:16.864091+0000","last_clean":"2024-04-26T12:40:16.864091+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:40:16.864091+0000","last_undegraded":"2024-04-26T12:40:16.864091+0000","last_fullsized":"2024-04-26T12:40:16.864091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'11","reported_seq":142,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.775458+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:40:17.775458+0000","last_peered":"2024-04-26T12:40:17.775458+0000","last_clean":"2024-04-26T12:40:17.775458+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:40:17.775458+0000","last_undegraded":"2024-04-26T12:40:17.775458+0000","last_fullsized":"2024-04-26T12:40:17.775458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T12:40:17.585938+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:40:17.585938+0000","last_peered":"2024-04-26T12:40:17.585938+0000","last_clean":"2024-04-26T12:40:17.585938+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:40:17.585938+0000","last_undegraded":"2024-04-26T12:40:17.585938+0000","last_fullsized":"2024-04-26T12:40:17.585938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":242,"num_write":218,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":736,"ondisk_log_size":736,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":79524,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":784,"num_read_kb":546,"num_write":429,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":127160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":622,"ondisk_log_size":622,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":304,"num_read_kb":304,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1115,"num_read_kb":1095,"num_write":228,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":317,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323536,"kb_used_data":292348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048304,"statfs":{"total":96636764160,"available":96305463296,"internally_reserved":0,"allocated":299364352,"data_stored":298913717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218476,"kb_used_data":187292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94153364,"statfs":{"total":96636764160,"available":96413044736,"internally_reserved":0,"allocated":191787008,"data_stored":191366825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421332,"kb_used_data":390152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93950508,"statfs":{"total":96636764160,"available":96205320192,"internally_reserved":0,"allocated":399515648,"data_stored":399038048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304480,"kb_used_data":273300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94067360,"statfs":{"total":96636764160,"available":96324976640,"internally_reserved":0,"allocated":279859200,"data_stored":279446718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364032,"kb_used_data":328692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94007808,"statfs":{"total":96636764160,"available":96263995392,"internally_reserved":0,"allocated":336580608,"data_stored":336129876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200092,"kb_used_data":164744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94171748,"statfs":{"total":96636764160,"available":96431869952,"internally_reserved":0,"allocated":168697856,"data_stored":168290303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237000,"kb_used_data":201660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94134840,"statfs":{"total":96636764160,"available":96394076160,"internally_reserved":0,"allocated":206499840,"data_stored":206049638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294900,"kb_used_data":259556,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94076940,"statfs":{"total":96636764160,"available":96334786560,"internally_reserved":0,"allocated":265785344,"data_stored":265357579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":264241152,"data_stored":264241152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":205520896,"data_stored":205520896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":335544320,"data_stored":335544320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":278921216,"data_stored":278921216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":398458880,"data_stored":398458880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":190840832,"data_stored":190840832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":60224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:40:19.671 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:40:19.671 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:19.658+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:19.672 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T12:40:19.672 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T12:40:19.672 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T12:40:19.672 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T12:40:19.672 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T12:40:19.750 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:19.750+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:19.767 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:19.767 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:19.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:19.797 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:40:19.840 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:19.840 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T12:40:19.840 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:19.851 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:19.850+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:19.900 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:19.900 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:19.914 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:19.961 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:19.960+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:20.032 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:20.033 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:20.046 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:20.053 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:20.054+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:20.154 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:20.152+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:20.212 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:20.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:20.269 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:20.268+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:20.356 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:20.354+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:20.359 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:20.359 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:20.374 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:20.450 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:20.457 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:20.456+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:20.547 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:20.547 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:20.557 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:20.556+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:20.562 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:20.610 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:20.610 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:20.629 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:20.630 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:20.646 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:20.647 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:20.658 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:20.656+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:20.666 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:20.666 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:20.683 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:20.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.820884752000001, 2024-04-26T12:40:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:40:20.684 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:40:20.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:40:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:40:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:40:20.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:40:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:40:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:40:20.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:40:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:40:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:40:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:40:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:40:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:40:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:40:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:40:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:40:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:40:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:40:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:40:20.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:40:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:40:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:40:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:40:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2317 3.3 3:c029eb24:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.358005+0000", 2024-04-26T12:40:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.3245061010000008, 2024-04-26T12:40:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014127485, 2024-04-26T12:40:20.696 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2317 2024-04-26T12:40:20.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.358005+0000", 2024-04-26T12:40:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.358005+0000", 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.358008+0000", 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6000000000000001e-06 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.359971+0000", 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019633250000000001 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.359999+0000", 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8268000000000001e-05 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360013+0000", 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3733e-05 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360085+0000", 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1674000000000005e-05 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360215+0000", 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013083499999999999 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.360338+0000", 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122736 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.365479+0000", 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051403209999999998 2024-04-26T12:40:20.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.372017+0000", 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065385319999999997 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.372084+0000", 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7371000000000003e-05 2024-04-26T12:40:20.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.372133+0000", 2024-04-26T12:40:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8090000000000002e-05 2024-04-26T12:40:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.703 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2333 3.12 3:49fff330:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.1631579950000006, 2024-04-26T12:40:20.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014903046, 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2333 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:20.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519355+0000", 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1739999999999999e-06 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520939+0000", 2024-04-26T12:40:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015836960000000001 2024-04-26T12:40:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520971+0000", 2024-04-26T12:40:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1930000000000001e-05 2024-04-26T12:40:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520986+0000", 2024-04-26T12:40:20.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5420000000000001e-05 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521057+0000", 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0825e-05 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521178+0000", 2024-04-26T12:40:20.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120316 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521332+0000", 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015460800000000001 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.526796+0000", 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054637089999999998 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534174+0000", 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073778660000000003 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534216+0000", 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1869000000000002e-05 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534256+0000", 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0633000000000002e-05 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.711 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2337 3.1b 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.1240771949999999, 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018047987000000001, 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2337 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.712 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558438+0000", 2024-04-26T12:40:20.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6239999999999999e-06 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559867+0000", 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014292490000000001 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559886+0000", 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8697000000000001e-05 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559898+0000", 2024-04-26T12:40:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2542e-05 2024-04-26T12:40:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559976+0000", 2024-04-26T12:40:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7610999999999999e-05 2024-04-26T12:40:20.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560136+0000", 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160443 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560298+0000", 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016194899999999999 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.566613+0000", 2024-04-26T12:40:20.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063145279999999998 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576388+0000", 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097756340000000001 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576434+0000", 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6020000000000003e-05 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576482+0000", 2024-04-26T12:40:20.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7689999999999999e-05 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2339 3.32 3:4d9e1576:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.583264+0000", 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.0992475929999994, 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010204243999999999, 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.718 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2339 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.583264+0000", 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.583264+0000", 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.583265+0000", 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8700000000000001e-06 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.584937+0000", 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016719619999999999 2024-04-26T12:40:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.584972+0000", 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4786000000000002e-05 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.584990+0000", 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7983e-05 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.585073+0000", 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2861999999999994e-05 2024-04-26T12:40:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.585225+0000", 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015177800000000001 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.585328+0000", 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010282500000000001 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593356+0000", 2024-04-26T12:40:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080280070000000002 2024-04-26T12:40:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593365+0000", 2024-04-26T12:40:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1989999999999995e-06 2024-04-26T12:40:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593402+0000", 2024-04-26T12:40:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6910999999999999e-05 2024-04-26T12:40:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.593468+0000", 2024-04-26T12:40:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6061000000000003e-05 2024-04-26T12:40:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2342 3.12 3:4a564d9a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.0619047350000006, 2024-04-26T12:40:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020986402000000001, 2024-04-26T12:40:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.726 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2342 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620609+0000", 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622196+0000", 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587045 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622224+0000", 2024-04-26T12:40:20.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8028e-05 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622234+0000", 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0577999999999999e-05 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622319+0000", 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4296999999999996e-05 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622520+0000", 2024-04-26T12:40:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201571 2024-04-26T12:40:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622753+0000", 2024-04-26T12:40:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000232501 2024-04-26T12:40:20.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.629187+0000", 2024-04-26T12:40:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064345679999999999 2024-04-26T12:40:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641429+0000", 2024-04-26T12:40:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012241573 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641522+0000", 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3239999999999995e-05 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641593+0000", 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0683000000000001e-05 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2344 3.3 3:c3214891:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.0342993499999995, 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017793122000000001, 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2344 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648214+0000", 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:40:20.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649908+0000", 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693069 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649940+0000", 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1974999999999998e-05 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649956+0000", 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6429000000000001e-05 2024-04-26T12:40:20.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650027+0000", 2024-04-26T12:40:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1346000000000004e-05 2024-04-26T12:40:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650146+0000", 2024-04-26T12:40:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118581 2024-04-26T12:40:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650277+0000", 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013136300000000001 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.654910+0000", 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046332300000000003 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665861+0000", 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01095054 2024-04-26T12:40:20.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665942+0000", 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0782e-05 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.666005+0000", 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3146999999999997e-05 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.739 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2346 3.10 e72/17 3:093f8fa5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_155:head v 72'6, mlcod=71'4)", 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.677209+0000", 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.0053019469999995, 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010565477, 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.677209+0000", 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.677209+0000", 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.677211+0000", 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9539999999999998e-06 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682070+0000", 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048585859999999998 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682099+0000", 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9065999999999999e-05 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682110+0000", 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1409999999999999e-05 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682193+0000", 2024-04-26T12:40:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2670999999999995e-05 2024-04-26T12:40:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.682218+0000", 2024-04-26T12:40:20.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5601000000000001e-05 2024-04-26T12:40:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.687717+0000", 2024-04-26T12:40:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054984739999999997 2024-04-26T12:40:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.687775+0000", 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7714999999999999e-05 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2350 3.12 3:494cd927:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.9687318230000006, 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019319528999999998, 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2350 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713782+0000", 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0759999999999999e-06 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714797+0000", 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010147159999999999 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714824+0000", 2024-04-26T12:40:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.658e-05 2024-04-26T12:40:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714838+0000", 2024-04-26T12:40:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4609e-05 2024-04-26T12:40:20.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714950+0000", 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112185 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715172+0000", 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022140199999999999 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715311+0000", 2024-04-26T12:40:20.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000138639 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.721604+0000", 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062931289999999997 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.732954+0000", 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011350314 2024-04-26T12:40:20.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733038+0000", 2024-04-26T12:40:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4445999999999998e-05 2024-04-26T12:40:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733099+0000", 2024-04-26T12:40:20.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0433000000000002e-05 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2353 3.2b 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.9354303599999998, 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029788120000000001, 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2353 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747083+0000", 2024-04-26T12:40:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:40:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748701+0000", 2024-04-26T12:40:20.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016182550000000001 2024-04-26T12:40:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748730+0000", 2024-04-26T12:40:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8809000000000001e-05 2024-04-26T12:40:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748741+0000", 2024-04-26T12:40:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0949e-05 2024-04-26T12:40:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748822+0000", 2024-04-26T12:40:20.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0777000000000003e-05 2024-04-26T12:40:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748827+0000", 2024-04-26T12:40:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:40:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752276+0000", 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034484350000000001 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752425+0000", 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014880699999999999 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752572+0000", 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014723899999999999 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.757807+0000", 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052354319999999999 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776737+0000", 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018929437 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776811+0000", 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4651000000000001e-05 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776869+0000", 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7541999999999999e-05 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.761 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2369 3.12 3:4bcc53b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.7629463419999993, 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014928745, 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.762 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2369 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919568+0000", 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0110000000000001e-06 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921453+0000", 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018855079999999999 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921476+0000", 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2705e-05 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921490+0000", 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4049999999999999e-05 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921560+0000", 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9580999999999997e-05 2024-04-26T12:40:20.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921710+0000", 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150261 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921810+0000", 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100351 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.926466+0000", 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046561160000000001 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934371+0000", 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079049830000000008 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934442+0000", 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0607999999999999e-05 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934494+0000", 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1570999999999998e-05 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2371 3.12 3:4aa38e60:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.7423330690000007, 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016346532, 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.768 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2371 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940181+0000", 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941785+0000", 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016038700000000001 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941813+0000", 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827e-05 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941828+0000", 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5545000000000001e-05 2024-04-26T12:40:20.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941914+0000", 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5353999999999996e-05 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942093+0000", 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000179004 2024-04-26T12:40:20.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942264+0000", 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017166999999999999 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.946973+0000", 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047087179999999998 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956399+0000", 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094257760000000003 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956471+0000", 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1740000000000001e-05 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956525+0000", 2024-04-26T12:40:20.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4097000000000001e-05 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2392 3.30 e73/17 3:0e664f76:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_201:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.169447+0000", 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.5130643619999997, 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014147065, 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169447+0000", 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169447+0000", 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169448+0000", 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.268e-06 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175108+0000", 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056603809999999999 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175128+0000", 2024-04-26T12:40:20.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9558000000000001e-05 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175139+0000", 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1409999999999999e-05 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175205+0000", 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5321999999999996e-05 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.175223+0000", 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8737999999999999e-05 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.183527+0000", 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083033150000000003 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.183594+0000", 2024-04-26T12:40:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7073e-05 2024-04-26T12:40:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2403 3.3 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:20.780 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.4048261049999997, 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019288092999999999, 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2403 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277689+0000", 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.941e-06 2024-04-26T12:40:20.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279232+0000", 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015426719999999999 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279255+0000", 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3059000000000001e-05 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279265+0000", 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9599999999999995e-06 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279330+0000", 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5282000000000003e-05 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279465+0000", 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135413 2024-04-26T12:40:20.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279583+0000", 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011731900000000001 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.284332+0000", 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047490700000000002 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296834+0000", 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012501864 2024-04-26T12:40:20.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296908+0000", 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3994999999999999e-05 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296973+0000", 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5518000000000005e-05 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2420 3.1f 3:f85890ec:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.2071966740000004, 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016319348000000001, 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2420 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475317+0000", 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5170000000000002e-06 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476909+0000", 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015916389999999999 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476934+0000", 2024-04-26T12:40:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5602999999999999e-05 2024-04-26T12:40:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476944+0000", 2024-04-26T12:40:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5980000000000003e-06 2024-04-26T12:40:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477024+0000", 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9969999999999995e-05 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477203+0000", 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017948000000000001 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477363+0000", 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160008 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.482189+0000", 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048257430000000004 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491558+0000", 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093691820000000002 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491601+0000", 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3099000000000002e-05 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491634+0000", 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2509000000000003e-05 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2422 3.39 e73/17 3:9d730a95:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_231:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.500922+0000", 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.181588842, 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012449823, 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.500922+0000", 2024-04-26T12:40:20.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.500922+0000", 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.500924+0000", 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.606e-06 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506165+0000", 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052407540000000002 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506178+0000", 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3580999999999999e-05 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506192+0000", 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3822000000000001e-05 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506251+0000", 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9058999999999998e-05 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506271+0000", 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9386999999999999e-05 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.513320+0000", 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0070490179999999998 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.513372+0000", 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2596000000000003e-05 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2424 3.3 3:c1866c22:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.167194576, 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016771441000000002, 2024-04-26T12:40:20.798 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2424 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515318+0000", 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516904+0000", 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015852570000000001 2024-04-26T12:40:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516913+0000", 2024-04-26T12:40:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1679999999999993e-06 2024-04-26T12:40:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516921+0000", 2024-04-26T12:40:20.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6319999999999997e-06 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516980+0000", 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9151999999999999e-05 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517101+0000", 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012034199999999999 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517259+0000", 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015827300000000001 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.522184+0000", 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004925296 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.531965+0000", 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009780647 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532033+0000", 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7546999999999996e-05 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532088+0000", 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5452999999999999e-05 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2436 3.39 e73/17 3:9debb9ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_245:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.647025+0000", 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.0354861290000006, 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011632162999999999, 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.647025+0000", 2024-04-26T12:40:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.647025+0000", 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.647027+0000", 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.829e-06 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651508+0000", 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044807370000000003 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651540+0000", 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2642999999999999e-05 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651555+0000", 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4569999999999999e-05 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651702+0000", 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014761099999999999 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.651766+0000", 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3811000000000003e-05 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.658598+0000", 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068315429999999998 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.658657+0000", 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9419000000000001e-05 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2439 3.30 e73/17 3:0d1f1f0d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_248:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.676802+0000", 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.0057088269999994, 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010025348999999999, 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.809 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.676802+0000", 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.676802+0000", 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.676804+0000", 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5519999999999999e-06 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.681958+0000", 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051541670000000003 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.681978+0000", 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9796000000000002e-05 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.681987+0000", 2024-04-26T12:40:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4159999999999993e-06 2024-04-26T12:40:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.682061+0000", 2024-04-26T12:40:20.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3560999999999996e-05 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.682087+0000", 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6639999999999999e-05 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.686786+0000", 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046989149999999997 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.686828+0000", 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1301999999999999e-05 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2442 3.6 3:60c3292b:::d749f084-3851-4e95-9492-490675b43f90.4382.9_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.748822+0000", 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 7.9336888459999999, 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010241254999999999, 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:20.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2442 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.748822+0000", 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.748822+0000", 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.748824+0000", 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.142e-06 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.749954+0000", 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001129974 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.749979+0000", 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4825999999999999e-05 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.749989+0000", 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8309999999999996e-06 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.750141+0000", 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015240699999999999 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.750349+0000", 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020764000000000001 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.750901+0000", 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00055208500000000001 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.758957+0000", 2024-04-26T12:40:20.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080558190000000005 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.758965+0000", 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3080000000000008e-06 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.759025+0000", 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9771000000000001e-05 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.759064+0000", 2024-04-26T12:40:20.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8451999999999997e-05 2024-04-26T12:40:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:20.820 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:20.820 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:20.821 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:20.821 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:20.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:20.822 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:20.823 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:20.823 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:20.824 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:20.824 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:20.825 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:20.825 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:20.820+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:20.922 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:20.922+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:21.002 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:21.002 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:21.002 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:21.015 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:21.022 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:21.020+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:21.123 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:21.120+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:21.188 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:21.188 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:21.188 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:21.202 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:21.249 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:21.250+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:21.325 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:21.324+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:21.331 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.331 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:40:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 126.88796172000001, 2024-04-26T12:40:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:40:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.332 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:40:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:40:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:40:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:40:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.333 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:40:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:40:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:40:21.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:40:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:40:21.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:40:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:40:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:40:21.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:40:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:40:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:40:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:40:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:40:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:40:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:40:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:40:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:40:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2319 3.1a 3:58f869a1:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.951244354, 2024-04-26T12:40:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013146055, 2024-04-26T12:40:21.343 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.344 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2319 2024-04-26T12:40:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378953+0000", 2024-04-26T12:40:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.041e-06 2024-04-26T12:40:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380420+0000", 2024-04-26T12:40:21.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001467138 2024-04-26T12:40:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380454+0000", 2024-04-26T12:40:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4236999999999998e-05 2024-04-26T12:40:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380470+0000", 2024-04-26T12:40:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6578999999999998e-05 2024-04-26T12:40:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380544+0000", 2024-04-26T12:40:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3616999999999997e-05 2024-04-26T12:40:21.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380697+0000", 2024-04-26T12:40:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015309199999999999 2024-04-26T12:40:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380801+0000", 2024-04-26T12:40:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103513 2024-04-26T12:40:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.385130+0000", 2024-04-26T12:40:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00432906 2024-04-26T12:40:21.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391960+0000", 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068303560000000001 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392034+0000", 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4119e-05 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392097+0000", 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2303000000000003e-05 2024-04-26T12:40:21.354 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2326 3.0 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.8804872320000001, 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099133869999999992, 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.355 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2326 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449711+0000", 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5080000000000001e-06 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451146+0000", 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014349720000000001 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451183+0000", 2024-04-26T12:40:21.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6671999999999997e-05 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451199+0000", 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6257999999999999e-05 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451290+0000", 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0728000000000003e-05 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451468+0000", 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017821300000000001 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451632+0000", 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.458789+0000", 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071576060000000004 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459479+0000", 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069001700000000002 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459560+0000", 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0115000000000001e-05 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459621+0000", 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1408000000000006e-05 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.360 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2345 3.19 3:99eb3a17:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.6706252070000005, 2024-04-26T12:40:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010166799000000001, 2024-04-26T12:40:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.361 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2345 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659573+0000", 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6990000000000001e-06 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661691+0000", 2024-04-26T12:40:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021175959999999998 2024-04-26T12:40:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661711+0000", 2024-04-26T12:40:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0128000000000001e-05 2024-04-26T12:40:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661724+0000", 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2906e-05 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661800+0000", 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6505e-05 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661985+0000", 2024-04-26T12:40:21.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018474600000000001 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.662135+0000", 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014955599999999999 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.668376+0000", 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062408280000000003 2024-04-26T12:40:21.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669587+0000", 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012110739999999999 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669672+0000", 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5241999999999995e-05 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669736+0000", 2024-04-26T12:40:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4518999999999997e-05 2024-04-26T12:40:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.368 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.5948354459999994, 2024-04-26T12:40:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:40:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.369 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:40:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:40:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:40:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:40:21.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:40:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:40:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:40:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:40:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:40:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:40:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:40:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:40:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:40:21.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:40:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:40:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:40:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:40:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:40:21.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:40:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:40:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:40:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:40:21.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:40:21.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.379 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.5185791789999996, 2024-04-26T12:40:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:40:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.380 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:21.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:40:21.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:40:21.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.386 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.5068548110000002, 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.387 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:40:21.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:40:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:40:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:40:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:40:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:40:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:40:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:40:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:40:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:40:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:40:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:40:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:40:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2362 3.19 3:98a41993:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.4859961560000006, 2024-04-26T12:40:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0096554659999999997, 2024-04-26T12:40:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.395 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2362 2024-04-26T12:40:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844202+0000", 2024-04-26T12:40:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0340000000000001e-06 2024-04-26T12:40:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845840+0000", 2024-04-26T12:40:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00163839 2024-04-26T12:40:21.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845872+0000", 2024-04-26T12:40:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1523999999999998e-05 2024-04-26T12:40:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845888+0000", 2024-04-26T12:40:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6208000000000001e-05 2024-04-26T12:40:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845978+0000", 2024-04-26T12:40:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9909999999999998e-05 2024-04-26T12:40:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846168+0000", 2024-04-26T12:40:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019002999999999999 2024-04-26T12:40:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846343+0000", 2024-04-26T12:40:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175071 2024-04-26T12:40:21.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853321+0000", 2024-04-26T12:40:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006978616 2024-04-26T12:40:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853780+0000", 2024-04-26T12:40:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045818500000000001 2024-04-26T12:40:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853821+0000", 2024-04-26T12:40:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1248999999999998e-05 2024-04-26T12:40:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853854+0000", 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3249e-05 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2366 3.0 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.4422123019999997, 2024-04-26T12:40:21.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013182772000000001, 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2366 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887986+0000", 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3469999999999999e-06 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889575+0000", 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00158928 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889602+0000", 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6840999999999999e-05 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889617+0000", 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4667e-05 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889721+0000", 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104255 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889920+0000", 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019873199999999999 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.890088+0000", 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016799 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895734+0000", 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056464139999999998 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901046+0000", 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053117019999999997 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901114+0000", 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8232999999999995e-05 2024-04-26T12:40:21.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901165+0000", 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1310999999999997e-05 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.2466463880000003, 2024-04-26T12:40:21.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:40:21.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:40:21.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2386 3.19 3:9a588031:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.2354269169999998, 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010161018000000001, 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2386 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.417 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094770+0000", 2024-04-26T12:40:21.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3920000000000001e-06 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095718+0000", 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094744999999999996 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095744+0000", 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6038999999999999e-05 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095757+0000", 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3451999999999999e-05 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095843+0000", 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5877000000000005e-05 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095962+0000", 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011846899999999999 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.096054+0000", 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1963e-05 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104575+0000", 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0085213179999999999 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104801+0000", 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022650599999999999 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104872+0000", 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0412000000000003e-05 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104929+0000", 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7139999999999998e-05 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2391 3.31 3:8f508897:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:21.422 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.1776279209999991, 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016948310000000001, 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2391 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152570+0000", 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154503+0000", 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001933234 2024-04-26T12:40:21.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154536+0000", 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3321000000000002e-05 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154553+0000", 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6288000000000001e-05 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154639+0000", 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6236000000000006e-05 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154820+0000", 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181306 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154983+0000", 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162929 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.160656+0000", 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056726550000000004 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169397+0000", 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087409170000000008 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169465+0000", 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8730000000000001e-05 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169515+0000", 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9795e-05 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2393 3.0 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.1541156650000008, 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010859486999999999, 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2393 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176082+0000", 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3970000000000001e-06 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178323+0000", 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002241818 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178348+0000", 2024-04-26T12:40:21.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4335e-05 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178359+0000", 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1092e-05 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178440+0000", 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0745e-05 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178581+0000", 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014098100000000001 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178682+0000", 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010178099999999999 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.184116+0000", 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054341090000000003 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186805+0000", 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026890529999999998 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186884+0000", 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8336000000000004e-05 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186939+0000", 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4839999999999997e-05 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.1180031479999997, 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:40:21.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:40:21.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:40:21.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2397 3.19 3:9b8be67a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.1088149329999997, 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00976898, 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2397 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221382+0000", 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.73e-06 2024-04-26T12:40:21.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222800+0000", 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001418802 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222828+0000", 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7790999999999999e-05 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222839+0000", 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0428000000000001e-05 2024-04-26T12:40:21.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222926+0000", 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7541999999999996e-05 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223135+0000", 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020900399999999999 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223316+0000", 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018074899999999999 2024-04-26T12:40:21.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230660+0000", 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073436259999999998 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231093+0000", 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043387800000000001 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231124+0000", 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939999999999999e-05 2024-04-26T12:40:21.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231149+0000", 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4490000000000001e-05 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.9607008310000005, 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:40:21.445 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:40:21.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:21.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:40:21.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.451 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2417 3.8 e73/17 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head v 73'4, mlcod=71'2)", 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.8879086399999991, 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099003479999999998, 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442289+0000", 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4389999999999999e-06 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444260+0000", 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019712509999999998 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444281+0000", 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1512999999999999e-05 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444294+0000", 2024-04-26T12:40:21.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2206e-05 2024-04-26T12:40:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444378+0000", 2024-04-26T12:40:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4658000000000002e-05 2024-04-26T12:40:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444409+0000", 2024-04-26T12:40:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1086e-05 2024-04-26T12:40:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451996+0000", 2024-04-26T12:40:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007586392 2024-04-26T12:40:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452187+0000", 2024-04-26T12:40:21.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000190803 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2418 3.25 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.8790917749999991, 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010790129000000001, 2024-04-26T12:40:21.458 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2418 2024-04-26T12:40:21.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451105+0000", 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.351e-06 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453261+0000", 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021551169999999998 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453277+0000", 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6935e-05 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453299+0000", 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1701000000000001e-05 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453368+0000", 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8591999999999997e-05 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453517+0000", 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014963699999999999 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453638+0000", 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120289 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461242+0000", 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0076041479999999998 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461821+0000", 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057901100000000004 2024-04-26T12:40:21.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461860+0000", 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9498e-05 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461893+0000", 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2849999999999999e-05 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.7772974500000007, 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.465 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:40:21.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:40:21.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:40:21.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:21.470 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.7469856220000004, 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:21.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:40:21.475 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:21.476 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:21.476 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:21.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:21.478 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:21.478+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:21.578 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:21.578+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:21.657 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:21.657 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:21.672 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:21.713 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:21.714+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:21.779 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:21.778+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:21.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:40:21.843 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:21.843 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:21.843 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:21.843 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:21.843 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:21.859 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:21.880 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:21.880+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:21.981 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:21.982+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:22.032 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1544 4.d 4:b0f5eef4:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.042860972, 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078556990000000007, 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1544 2024-04-26T12:40:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989713+0000", 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989720+0000", 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1439999999999997e-06 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989735+0000", 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4318000000000001e-05 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989743+0000", 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3520000000000007e-06 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989816+0000", 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2733999999999999e-05 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989896+0000", 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0635000000000003e-05 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989995+0000", 2024-04-26T12:40:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8276999999999994e-05 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990617+0000", 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062210300000000004 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997488+0000", 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068714170000000003 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997521+0000", 2024-04-26T12:40:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3120999999999997e-05 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997567+0000", 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5259000000000002e-05 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2323 3.3a 3:5f8d6128:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.614331126, 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0089459429999999996, 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2323 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418243+0000", 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419683+0000", 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014398810000000001 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419708+0000", 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4734000000000001e-05 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419718+0000", 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9450000000000005e-06 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419801+0000", 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3323000000000002e-05 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419969+0000", 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168064 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.420113+0000", 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014409000000000001 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.426671+0000", 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065582080000000003 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427066+0000", 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039501800000000002 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427130+0000", 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3206000000000004e-05 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427187+0000", 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6932999999999999e-05 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2326 3.0 e72/17 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head v 72'6, mlcod=72'4)", 2024-04-26T12:40:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.580826514, 2024-04-26T12:40:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074245839999999997, 2024-04-26T12:40:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451747+0000", 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.663e-06 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453207+0000", 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014601410000000001 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453232+0000", 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5372e-05 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453244+0000", 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1790999999999999e-05 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453323+0000", 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9140999999999993e-05 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453347+0000", 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3910999999999999e-05 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459105+0000", 2024-04-26T12:40:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057577080000000003 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459170+0000", 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2328 3.3a 3:5e90e1f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.562677772000001, 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0090903670000000002, 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2328 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469896+0000", 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0229999999999999e-06 2024-04-26T12:40:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471266+0000", 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001370303 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471294+0000", 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7571000000000001e-05 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471308+0000", 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4267000000000001e-05 2024-04-26T12:40:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471388+0000", 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9939999999999997e-05 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471525+0000", 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013668400000000001 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471667+0000", 2024-04-26T12:40:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014186299999999999 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478381+0000", 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067147750000000001 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478838+0000", 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045644799999999998 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478923+0000", 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4736999999999999e-05 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478984+0000", 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1755999999999996e-05 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2340 3.3b e72/17 3:dec2f466:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_149:head v 72'4, mlcod=71'2)", 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.429473514, 2024-04-26T12:40:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010101687, 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603101+0000", 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.548e-06 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608217+0000", 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051159860000000003 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608250+0000", 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3411999999999998e-05 2024-04-26T12:40:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608266+0000", 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5979000000000001e-05 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608334+0000", 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8120999999999994e-05 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608357+0000", 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2719000000000001e-05 2024-04-26T12:40:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613114+0000", 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047573880000000004 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613200+0000", 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5533999999999998e-05 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2364 3.3a 3:5f88866d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.167701643999999, 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017066136999999999, 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2364 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864873+0000", 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0989999999999999e-06 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866782+0000", 2024-04-26T12:40:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001908325 2024-04-26T12:40:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866804+0000", 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2331999999999999e-05 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866817+0000", 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2951e-05 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866910+0000", 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2817000000000003e-05 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866915+0000", 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0699999999999997e-06 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870125+0000", 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032105279999999998 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870302+0000", 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017691699999999999 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870475+0000", 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258400000000001 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.877926+0000", 2024-04-26T12:40:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074516069999999998 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881845+0000", 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039187570000000001 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881885+0000", 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0234000000000001e-05 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881936+0000", 2024-04-26T12:40:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0915999999999998e-05 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2366 3.0 e73/17 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.139292912, 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007540064, 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9200000000000002e-07 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895376+0000", 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020964460000000001 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895399+0000", 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2886000000000001e-05 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895411+0000", 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2845e-05 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895487+0000", 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5555000000000004e-05 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895512+0000", 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4751000000000001e-05 2024-04-26T12:40:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900733+0000", 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052214210000000004 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900819+0000", 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5867999999999998e-05 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2383 3.3a 3:5e222c71:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.9694545120000004, 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012876257, 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2383 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063120+0000", 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-06 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065515+0000", 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023946839999999998 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065543+0000", 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8311e-05 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065556+0000", 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442e-05 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065651+0000", 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5266000000000006e-05 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065849+0000", 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019847699999999999 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.066023+0000", 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173072 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075353+0000", 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093303489999999999 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075875+0000", 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00052190799999999996 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075936+0000", 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1681999999999997e-05 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075994+0000", 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7092999999999997e-05 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2390 3.3b e73/17 3:de1f29f3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_199:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.8864617930000005, 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011629304, 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4900000000000001e-07 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150965+0000", 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048547080000000001 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150993+0000", 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8087999999999999e-05 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151007+0000", 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3653e-05 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151087+0000", 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9856000000000003e-05 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151113+0000", 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6486e-05 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157679+0000", 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065660960000000004 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157739+0000", 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0068000000000002e-05 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2393 3.0 e73/17 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.853745644, 2024-04-26T12:40:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078009530000000002, 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178828+0000", 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181282+0000", 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024539710000000001 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181306+0000", 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4080999999999999e-05 2024-04-26T12:40:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181319+0000", 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.294e-05 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181753+0000", 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043354299999999999 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181777+0000", 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4762000000000001e-05 2024-04-26T12:40:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186543+0000", 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047658509999999998 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186627+0000", 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3957999999999998e-05 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2395 3.25 e73/41 3:a5fe4c99:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_204:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.8311541640000009, 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068691029999999997, 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201419+0000", 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3850000000000001e-06 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203007+0000", 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015877650000000001 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203033+0000", 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5981000000000001e-05 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203046+0000", 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3114e-05 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203128+0000", 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2077999999999996e-05 2024-04-26T12:40:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203153+0000", 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5086999999999999e-05 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208235+0000", 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050818599999999997 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208287+0000", 2024-04-26T12:40:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1833000000000003e-05 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.7262060930000001, 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2413 3.2d e73/17 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:22.096 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.6332230449999994, 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097703479999999999, 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399350+0000", 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.711e-06 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403750+0000", 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043993160000000003 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403772+0000", 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1985999999999999e-05 2024-04-26T12:40:22.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403782+0000", 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9340000000000001e-06 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403854+0000", 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2788999999999997e-05 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403881+0000", 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6826999999999999e-05 2024-04-26T12:40:22.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409050+0000", 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051684189999999996 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409119+0000", 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9366e-05 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.100 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2415 3.0 e73/17 3:007bae19:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_224:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.61095188, 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006983324, 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421622+0000", 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.841e-06 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423279+0000", 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016575139999999999 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423304+0000", 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5198000000000002e-05 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423318+0000", 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.328e-05 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423400+0000", 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2729e-05 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423428+0000", 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7222000000000001e-05 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428553+0000", 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051254450000000002 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428603+0000", 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0095000000000001e-05 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.104 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2418 3.25 e73/41 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.5788396379999998, 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079618780000000004, 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453733+0000", 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3200000000000004e-07 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455472+0000", 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017391749999999999 2024-04-26T12:40:22.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455495+0000", 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2625000000000001e-05 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455509+0000", 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4056999999999999e-05 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455587+0000", 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8577000000000003e-05 2024-04-26T12:40:22.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455619+0000", 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1443999999999999e-05 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461659+0000", 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060406499999999998 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461694+0000", 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4618e-05 2024-04-26T12:40:22.108 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2419 3.4 e73/17 3:21b3cbd4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_228:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.5682308799999998, 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074141069999999996, 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464342+0000", 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.142e-06 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466601+0000", 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022590190000000001 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466619+0000", 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8337000000000001e-05 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466628+0000", 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0089999999999996e-06 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466687+0000", 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8368000000000001e-05 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466712+0000", 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4836000000000001e-05 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471699+0000", 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049870019999999999 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471755+0000", 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6394000000000003e-05 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2426 3.f 3:f3fcc542:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.4988766739999999, 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017310012999999999, 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2426 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:22.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533698+0000", 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8389999999999998e-06 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535314+0000", 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016156949999999999 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535339+0000", 2024-04-26T12:40:22.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5117e-05 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535349+0000", 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0569e-05 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535414+0000", 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5080999999999996e-05 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535529+0000", 2024-04-26T12:40:22.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114302 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535625+0000", 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6210000000000002e-05 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.542763+0000", 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071382149999999998 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550914+0000", 2024-04-26T12:40:22.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081504420000000008 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550953+0000", 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9597000000000001e-05 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.551005+0000", 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1946e-05 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2429 3.4 e73/17 3:208decb8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_238:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.4682781350000003, 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072608780000000001, 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564295+0000", 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566152+0000", 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001856871 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566180+0000", 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7338000000000002e-05 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566195+0000", 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5807999999999998e-05 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566279+0000", 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3462999999999997e-05 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566307+0000", 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7977999999999999e-05 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571500+0000", 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051927199999999996 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571555+0000", 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4987000000000001e-05 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.122 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2432 3.4 e73/17 3:22adec7f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_241:head v 73'4, mlcod=73'2)", 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.4363063740000008, 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072901049999999998, 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:22.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596267+0000", 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9870000000000002e-06 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597800+0000", 2024-04-26T12:40:22.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015329530000000001 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597825+0000", 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4675e-05 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597838+0000", 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3335e-05 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597925+0000", 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6865000000000003e-05 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597966+0000", 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0417000000000003e-05 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603515+0000", 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055488730000000002 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603556+0000", 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1e-05 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2435 3.2d e73/17 3:b50706f2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_244:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.3963038099999991, 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010411692, 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.127 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636271+0000", 2024-04-26T12:40:22.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640883+0000", 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046121540000000003 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640921+0000", 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8676e-05 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640940+0000", 2024-04-26T12:40:22.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8991000000000002e-05 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641044+0000", 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010401899999999999 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641074+0000", 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0037999999999999e-05 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646616+0000", 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055411619999999997 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646680+0000", 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4083000000000003e-05 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.131 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:22.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:22.133 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:22.130+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:22.233 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:22.234+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:22.307 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:22.307 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:22.307 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:22.322 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:22.365 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:22.366+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:22.435 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:22.434+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:22.494 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:22.494 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:22.495 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:22.495 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:22.495 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:22.508 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:22.553 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:22.554+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:22.636 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:22.632+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:22.684 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1326 3.33 3:cd5db5f2:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.841178923000001, 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016038528, 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1326 2024-04-26T12:40:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842595+0000", 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9420000000000002e-06 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843194+0000", 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059943799999999999 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843214+0000", 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9970999999999999e-05 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843223+0000", 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0040000000000005e-06 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843310+0000", 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6973999999999998e-05 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843418+0000", 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010787 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843511+0000", 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3305000000000002e-05 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.846677+0000", 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031658749999999999 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858525+0000", 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011848348 2024-04-26T12:40:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858582+0000", 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6119000000000003e-05 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858631+0000", 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2320 3.27 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.294279213999999, 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020624966000000002, 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2320 2024-04-26T12:40:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389495+0000", 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390861+0000", 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013652849999999999 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390898+0000", 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6789000000000003e-05 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390908+0000", 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.065e-05 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390983+0000", 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391089+0000", 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105752 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391177+0000", 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7596999999999995e-05 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.395646+0000", 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044690889999999999 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410024+0000", 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014378050999999999 2024-04-26T12:40:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410065+0000", 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1056000000000001e-05 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410117+0000", 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2485000000000003e-05 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2325 3.2 3:40f43f1f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.244927308999999, 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013366813, 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2325 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438847+0000", 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7769999999999998e-06 2024-04-26T12:40:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440481+0000", 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001633731 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440511+0000", 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0247999999999999e-05 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440523+0000", 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1861999999999999e-05 2024-04-26T12:40:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440605+0000", 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2392000000000007e-05 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440774+0000", 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168985 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440934+0000", 2024-04-26T12:40:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159908 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.445923+0000", 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049891900000000001 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452114+0000", 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006190887 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452168+0000", 2024-04-26T12:40:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3749999999999999e-05 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452211+0000", 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3083000000000001e-05 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2329 3.38 3:1f4c78ed:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.204949904999999, 2024-04-26T12:40:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015527136, 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2329 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478825+0000", 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8959999999999999e-06 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480286+0000", 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001461644 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480319+0000", 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2527000000000002e-05 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480334+0000", 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.519e-05 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480420+0000", 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5643999999999995e-05 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480572+0000", 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000152237 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480724+0000", 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015249 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.484967+0000", 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042430879999999999 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494254+0000", 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092865980000000001 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494295+0000", 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0503000000000002e-05 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494349+0000", 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4318999999999999e-05 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2330 3.27 3:e503c54d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.195103763000001, 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014172947999999999, 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2330 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488670+0000", 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.751e-06 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.489978+0000", 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013084850000000001 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490008+0000", 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9967999999999998e-05 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490021+0000", 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2745000000000001e-05 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490094+0000", 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2849999999999995e-05 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490217+0000", 2024-04-26T12:40:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012377300000000001 2024-04-26T12:40:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490323+0000", 2024-04-26T12:40:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105132 2024-04-26T12:40:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494969+0000", 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046460959999999997 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502769+0000", 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078001370000000004 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502810+0000", 2024-04-26T12:40:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1412000000000003e-05 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502841+0000", 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0599000000000003e-05 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2338 3.2 3:40db620f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.113087861, 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017810332000000002, 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2338 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570686+0000", 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1229999999999998e-06 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572072+0000", 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001386125 2024-04-26T12:40:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572105+0000", 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3492999999999999e-05 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572116+0000", 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0627e-05 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572187+0000", 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0531999999999995e-05 2024-04-26T12:40:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572308+0000", 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012157700000000001 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572414+0000", 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105889 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576935+0000", 2024-04-26T12:40:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045206049999999996 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588421+0000", 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011486111 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588462+0000", 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1270000000000003e-05 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588494+0000", 2024-04-26T12:40:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1980000000000002e-05 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2348 3.29 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.991398811, 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019384129999999999, 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2348 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692376+0000", 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2320000000000001e-06 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.693975+0000", 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001598808 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694006+0000", 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1606000000000002e-05 2024-04-26T12:40:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694021+0000", 2024-04-26T12:40:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4783999999999999e-05 2024-04-26T12:40:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694117+0000", 2024-04-26T12:40:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5851000000000001e-05 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694259+0000", 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014201099999999999 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694400+0000", 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014122200000000001 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.698538+0000", 2024-04-26T12:40:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041381170000000002 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711595+0000", 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013056636 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711687+0000", 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1630000000000002e-05 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711757+0000", 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0233000000000003e-05 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2356 3.7 3:e10f5880:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.906402974000001, 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015864989999999999, 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2356 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777372+0000", 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8890000000000002e-06 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779070+0000", 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001698764 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779096+0000", 2024-04-26T12:40:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5959e-05 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779107+0000", 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779183+0000", 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5788e-05 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779320+0000", 2024-04-26T12:40:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137269 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779408+0000", 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7560999999999997e-05 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.783717+0000", 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043093230000000003 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793104+0000", 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009387411 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793178+0000", 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3843000000000004e-05 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793234+0000", 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5386000000000001e-05 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2372 3.1e 3:788eb98e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.732847018999999, 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019326650000000001, 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2372 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950927+0000", 2024-04-26T12:40:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4310000000000001e-06 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953107+0000", 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021800080000000002 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953135+0000", 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7529999999999999e-05 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953149+0000", 2024-04-26T12:40:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4171e-05 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953240+0000", 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983999999999995e-05 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953413+0000", 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017362399999999999 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953577+0000", 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000163864 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.959646+0000", 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060690620000000001 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970130+0000", 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010484228999999999 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970199+0000", 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8866000000000001e-05 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970251+0000", 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1881e-05 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2374 3.38 3:1c1a4d28:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.711124813, 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020357772999999999, 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2374 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972649+0000", 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974485+0000", 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018357899999999999 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974516+0000", 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1142000000000001e-05 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974531+0000", 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.455e-05 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974627+0000", 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6543e-05 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974833+0000", 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020613700000000001 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.975018+0000", 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000184267 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.981099+0000", 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00608093 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011762869 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992942+0000", 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0517000000000002e-05 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.993005+0000", 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2648000000000001e-05 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2376 3.5 e73/17 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.685510704, 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011508294000000001, 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998273+0000", 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1647999999999999e-05 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002533+0000", 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042605840000000004 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002562+0000", 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9343999999999999e-05 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002577+0000", 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4592e-05 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002663+0000", 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6013000000000005e-05 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002694+0000", 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0817e-05 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009691+0000", 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0069972710000000002 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009769+0000", 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8024999999999999e-05 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2382 3.3c e73/17 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.624888650000001, 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016599513, 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058885+0000", 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.062970+0000", 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040850720000000004 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063005+0000", 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5342999999999997e-05 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063021+0000", 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6019e-05 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063152+0000", 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013094699999999999 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063181+0000", 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8561999999999999e-05 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075419+0000", 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012238667 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075482+0000", 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3229000000000001e-05 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.751 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2388 3.2 3:404073be:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.567246487, 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019415504, 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2388 2024-04-26T12:40:22.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116528+0000", 2024-04-26T12:40:22.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118771+0000", 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002243091 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118792+0000", 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0990000000000001e-05 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118802+0000", 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0086e-05 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118912+0000", 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109497 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119038+0000", 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126198 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:22.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119125+0000", 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7186000000000002e-05 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.123050+0000", 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039251169999999997 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135829+0000", 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012779209 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135892+0000", 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2728e-05 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135941+0000", 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8485000000000001e-05 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2389 3.2 3:427feba5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:22.757 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.555615866, 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019131569000000001, 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2389 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:22.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128159+0000", 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.864e-06 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130062+0000", 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019030500000000001 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130088+0000", 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5890000000000001e-05 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130098+0000", 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0263e-05 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130167+0000", 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9643999999999999e-05 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130306+0000", 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013836499999999999 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130397+0000", 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1003999999999998e-05 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135001+0000", 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004604403 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147180+0000", 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012178362 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147227+0000", 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6981000000000003e-05 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147287+0000", 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0742999999999998e-05 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.433951127, 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.763 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.768 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2407 3.33 3:ce0fe289:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.366537946999999, 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018708978000000001, 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2407 2024-04-26T12:40:22.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317236+0000", 2024-04-26T12:40:22.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7539999999999998e-06 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318627+0000", 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013905600000000001 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318660+0000", 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3042e-05 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318676+0000", 2024-04-26T12:40:22.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5775999999999999e-05 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318777+0000", 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101152 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318986+0000", 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000208648 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.319165+0000", 2024-04-26T12:40:22.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017941699999999999 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.324600+0000", 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054352430000000002 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335812+0000", 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011211308999999999 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335886+0000", 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4263000000000004e-05 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335943+0000", 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6814000000000002e-05 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2409 3.1e 3:7ac1137c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:22.774 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.340511621999999, 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017629292000000001, 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2409 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:22.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343262+0000", 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9549999999999999e-06 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345627+0000", 2024-04-26T12:40:22.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023648459999999999 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345658+0000", 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1154e-05 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345675+0000", 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7456e-05 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345800+0000", 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012460300000000001 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346033+0000", 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023336599999999999 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346192+0000", 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015833500000000001 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.352130+0000", 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059381190000000004 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360741+0000", 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0086116479999999995 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360811+0000", 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9342000000000001e-05 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360889+0000", 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8467999999999995e-05 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2417 3.8 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.243898501, 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012677982000000001, 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.780 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2417 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:22.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439876+0000", 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441807+0000", 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001931239 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441829+0000", 2024-04-26T12:40:22.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1883999999999999e-05 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441839+0000", 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0084999999999999e-05 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441928+0000", 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8608000000000003e-05 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442072+0000", 2024-04-26T12:40:22.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144053 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442170+0000", 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7921e-05 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.449581+0000", 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074107469999999996 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452422+0000", 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028413570000000001 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452496+0000", 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3857999999999997e-05 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452551+0000", 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5299e-05 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.785 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.199288335, 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.786 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.791 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2423 3.b 3:d15dbab2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.179770999, 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012126067000000001, 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2423 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504003+0000", 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.452e-06 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:22.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506649+0000", 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026461879999999998 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506674+0000", 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4689e-05 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506686+0000", 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1595e-05 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506759+0000", 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658000000000005e-05 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506933+0000", 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017354100000000001 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.507051+0000", 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118578 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.513156+0000", 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0061047319999999999 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515986+0000", 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028303199999999999 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516064+0000", 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7466999999999995e-05 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:22.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:22.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516127+0000", 2024-04-26T12:40:22.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2847000000000003e-05 2024-04-26T12:40:22.797 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.797 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.797 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.797 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:22.797 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:22.797 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:22.799 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:22.799 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:22.798+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:22.803 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:40:22.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:22.900 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:22.898+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:22.924 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:22.924 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:22.924 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:22.925 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:22.938 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:22.972 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:22.972 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:22.988 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:22.989 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:23.000 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:22.996+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:23.005 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:23.021 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:23.021 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:23.038 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:23.039 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:23.057 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:23.057 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:23.061 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:23.061 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:23.076 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:23.076 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:23.077 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:23.093 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:23.093 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:23.117 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:23.116+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:23.202 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:23.202+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:23.238 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:23.238 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:23.253 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:23.302 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:23.300+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:23.373 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:23.373 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:23.387 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:23.429 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:23.428+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:23.505 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:23.504+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:23.546 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:23.546 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:23.560 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:23.606 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:23.604+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:23.707 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:23.704+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:23.732 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:23.732 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:23.747 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:23.833 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:23.832+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:23.909 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:23.910+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:23.913 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:23.914 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:23.928 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:24.013 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:24.012+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:24.090 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:24.090 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:24.105 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:24.111 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:24.110+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:24.212 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:24.210+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:24.269 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:24.269 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:24.283 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:24.329 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:24.328+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:24.402 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:24.402 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:24.414 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:24.414+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:24.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:24.515 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:24.514+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:24.584 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:24.584 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:24.598 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:24.616 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:24.614+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:24.716 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:24.716 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:24.716 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:24.716+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:24.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:24.817 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:24.818+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:24.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:40:24.867 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:24.867 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:24.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:24.918 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:24.916+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:25.019 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:25.018+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:25.048 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:25.048 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:25.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:25.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:25.121 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:25.116+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:25.221 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:25.220+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:25.231 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:25.231 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:25.250 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:25.298 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:25.299 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:25.315 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:25.316 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:25.321 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:25.320+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:25.332 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:25.332 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:25.349 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:25.350 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:25.371 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:25.371 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:25.377 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:25.377 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:25.378 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:25.378 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:25.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:25.393 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:25.393 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:25.414 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:25.415 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:25.422 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:25.422+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:25.437 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:25.437 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:25.510 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:25.510 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:25.510 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:25.511 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:25.511 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:25.523 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:25.522+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:25.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:25.624 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:25.622+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:25.702 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:25.702 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:25.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:25.702 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:25.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.702 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:40:25.702 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:25.702 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 131.25725423200001, 2024-04-26T12:40:25.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:40:25.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2319 3.1a 3:58f869a1:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.320536865999999, 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013146055, 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.707 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2319 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378953+0000", 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.041e-06 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380420+0000", 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001467138 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380454+0000", 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4236999999999998e-05 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380470+0000", 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6578999999999998e-05 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380544+0000", 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3616999999999997e-05 2024-04-26T12:40:25.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380697+0000", 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015309199999999999 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380801+0000", 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103513 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.385130+0000", 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00432906 2024-04-26T12:40:25.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391960+0000", 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068303560000000001 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392034+0000", 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4119e-05 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392097+0000", 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2303000000000003e-05 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.712 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2326 3.0 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.249779744, 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099133869999999992, 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2326 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.713 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449711+0000", 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5080000000000001e-06 2024-04-26T12:40:25.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451146+0000", 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014349720000000001 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451183+0000", 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6671999999999997e-05 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451199+0000", 2024-04-26T12:40:25.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6257999999999999e-05 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451290+0000", 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0728000000000003e-05 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451468+0000", 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017821300000000001 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451632+0000", 2024-04-26T12:40:25.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.458789+0000", 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071576060000000004 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459479+0000", 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069001700000000002 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459560+0000", 2024-04-26T12:40:25.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0115000000000001e-05 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459621+0000", 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1408000000000006e-05 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2345 3.19 3:99eb3a17:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.039917719, 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010166799000000001, 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2345 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:25.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659573+0000", 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6990000000000001e-06 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661691+0000", 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021175959999999998 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661711+0000", 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0128000000000001e-05 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661724+0000", 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2906e-05 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661800+0000", 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6505e-05 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661985+0000", 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018474600000000001 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.662135+0000", 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014955599999999999 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.668376+0000", 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062408280000000003 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669587+0000", 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012110739999999999 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669672+0000", 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5241999999999995e-05 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669736+0000", 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4518999999999997e-05 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.964127958000001, 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.724 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.887871691000001, 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.730 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:40:25.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:40:25.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:40:25.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.876147323, 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.736 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:40:25.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:40:25.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:40:25.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2362 3.19 3:98a41993:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.855288668, 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0096554659999999997, 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2362 2024-04-26T12:40:25.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844202+0000", 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0340000000000001e-06 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845840+0000", 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00163839 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845872+0000", 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1523999999999998e-05 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845888+0000", 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6208000000000001e-05 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845978+0000", 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9909999999999998e-05 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846168+0000", 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019002999999999999 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846343+0000", 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175071 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853321+0000", 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006978616 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853780+0000", 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045818500000000001 2024-04-26T12:40:25.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853821+0000", 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1248999999999998e-05 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853854+0000", 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3249e-05 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.747 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2366 3.0 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.811504813999999, 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013182772000000001, 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2366 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887986+0000", 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3469999999999999e-06 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889575+0000", 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00158928 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889602+0000", 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6840999999999999e-05 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889617+0000", 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4667e-05 2024-04-26T12:40:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889721+0000", 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104255 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889920+0000", 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019873199999999999 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:25.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.890088+0000", 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016799 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895734+0000", 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056464139999999998 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901046+0000", 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053117019999999997 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901114+0000", 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8232999999999995e-05 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901165+0000", 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1310999999999997e-05 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:25.753 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.6159389, 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:25.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:40:25.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2386 3.19 3:9a588031:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:25.759 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.604719428999999, 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010161018000000001, 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2386 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094770+0000", 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3920000000000001e-06 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095718+0000", 2024-04-26T12:40:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094744999999999996 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095744+0000", 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6038999999999999e-05 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095757+0000", 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3451999999999999e-05 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095843+0000", 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5877000000000005e-05 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095962+0000", 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011846899999999999 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.096054+0000", 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1963e-05 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104575+0000", 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0085213179999999999 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104801+0000", 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022650599999999999 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104872+0000", 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0412000000000003e-05 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104929+0000", 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7139999999999998e-05 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2391 3.31 3:8f508897:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.546920433, 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016948310000000001, 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2391 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152570+0000", 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154503+0000", 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001933234 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154536+0000", 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3321000000000002e-05 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154553+0000", 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6288000000000001e-05 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154639+0000", 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6236000000000006e-05 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154820+0000", 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181306 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154983+0000", 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162929 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.160656+0000", 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056726550000000004 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169397+0000", 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087409170000000008 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169465+0000", 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8730000000000001e-05 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169515+0000", 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9795e-05 2024-04-26T12:40:25.770 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2393 3.0 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.523408177, 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010859486999999999, 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.771 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2393 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:25.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176082+0000", 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3970000000000001e-06 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178323+0000", 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002241818 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178348+0000", 2024-04-26T12:40:25.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4335e-05 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178359+0000", 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1092e-05 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178440+0000", 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0745e-05 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178581+0000", 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014098100000000001 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178682+0000", 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010178099999999999 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.184116+0000", 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054341090000000003 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186805+0000", 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026890529999999998 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186884+0000", 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8336000000000004e-05 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186939+0000", 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4839999999999997e-05 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.487295660000001, 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:40:25.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.778 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2397 3.19 3:9b8be67a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.478107444999999, 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00976898, 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2397 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221382+0000", 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.73e-06 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222800+0000", 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001418802 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222828+0000", 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7790999999999999e-05 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222839+0000", 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0428000000000001e-05 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222926+0000", 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7541999999999996e-05 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223135+0000", 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020900399999999999 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223316+0000", 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018074899999999999 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230660+0000", 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073436259999999998 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231093+0000", 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043387800000000001 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231124+0000", 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939999999999999e-05 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231149+0000", 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4490000000000001e-05 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.329993343, 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2417 3.8 e73/17 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head v 73'4, mlcod=71'2)", 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.257201152, 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099003479999999998, 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:25.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442289+0000", 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4389999999999999e-06 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444260+0000", 2024-04-26T12:40:25.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019712509999999998 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444281+0000", 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1512999999999999e-05 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444294+0000", 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2206e-05 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444378+0000", 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4658000000000002e-05 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444409+0000", 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1086e-05 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451996+0000", 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007586392 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452187+0000", 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000190803 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2418 3.25 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.248384287, 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010790129000000001, 2024-04-26T12:40:25.798 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2418 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451105+0000", 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.351e-06 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453261+0000", 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021551169999999998 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453277+0000", 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6935e-05 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453299+0000", 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1701000000000001e-05 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453368+0000", 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8591999999999997e-05 2024-04-26T12:40:25.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453517+0000", 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014963699999999999 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453638+0000", 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120289 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461242+0000", 2024-04-26T12:40:25.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0076041479999999998 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461821+0000", 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057901100000000004 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461860+0000", 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9498e-05 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461893+0000", 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2849999999999999e-05 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.146589962, 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:40:25.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:40:25.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:25.809 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.116278134, 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:25.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:25.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:25.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:25.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:25.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:25.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:40:25.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:40:25.815 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.815 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.815 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.815 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:25.815 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:25.815 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:25.816 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:25.817 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:25.816+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:25.834 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:40:25.917 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:25.916+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:25.961 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:25.962 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:25.962 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:25.962 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:25.976 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:26.018 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:26.016+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:26.104 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:26.105 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:26.105 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:26.105 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:26.105 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:26.118 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:26.118+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:26.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:26.219 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:26.216+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:26.297 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:26.297 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:26.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:26.297 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:26.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.297 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1544 4.d 4:b0f5eef4:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.305985970999998, 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078556990000000007, 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1544 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989713+0000", 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989720+0000", 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1439999999999997e-06 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989735+0000", 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4318000000000001e-05 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989743+0000", 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3520000000000007e-06 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989816+0000", 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2733999999999999e-05 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989896+0000", 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0635000000000003e-05 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989995+0000", 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8276999999999994e-05 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990617+0000", 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062210300000000004 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997488+0000", 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068714170000000003 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997521+0000", 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3120999999999997e-05 2024-04-26T12:40:26.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997567+0000", 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5259000000000002e-05 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2323 3.3a 3:5f8d6128:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.877456125, 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0089459429999999996, 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.303 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2323 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418243+0000", 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419683+0000", 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014398810000000001 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419708+0000", 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4734000000000001e-05 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419718+0000", 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9450000000000005e-06 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419801+0000", 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3323000000000002e-05 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419969+0000", 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168064 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.420113+0000", 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014409000000000001 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.426671+0000", 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065582080000000003 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427066+0000", 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039501800000000002 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427130+0000", 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3206000000000004e-05 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427187+0000", 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6932999999999999e-05 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.308 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2326 3.0 e72/17 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head v 72'6, mlcod=72'4)", 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.843951513, 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074245839999999997, 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451747+0000", 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.663e-06 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453207+0000", 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014601410000000001 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453232+0000", 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5372e-05 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453244+0000", 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1790999999999999e-05 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453323+0000", 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9140999999999993e-05 2024-04-26T12:40:26.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453347+0000", 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3910999999999999e-05 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459105+0000", 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057577080000000003 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459170+0000", 2024-04-26T12:40:26.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2328 3.3a 3:5e90e1f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.825802770999999, 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0090903670000000002, 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.313 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2328 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469896+0000", 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0229999999999999e-06 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471266+0000", 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001370303 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471294+0000", 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7571000000000001e-05 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471308+0000", 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4267000000000001e-05 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471388+0000", 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9939999999999997e-05 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471525+0000", 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013668400000000001 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471667+0000", 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014186299999999999 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478381+0000", 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067147750000000001 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478838+0000", 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045644799999999998 2024-04-26T12:40:26.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478923+0000", 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4736999999999999e-05 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478984+0000", 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1755999999999996e-05 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.318 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2340 3.3b e72/17 3:dec2f466:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_149:head v 72'4, mlcod=71'2)", 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.692598513, 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010101687, 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603101+0000", 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.548e-06 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608217+0000", 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051159860000000003 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608250+0000", 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3411999999999998e-05 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608266+0000", 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5979000000000001e-05 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608334+0000", 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8120999999999994e-05 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608357+0000", 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2719000000000001e-05 2024-04-26T12:40:26.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613114+0000", 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047573880000000004 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613200+0000", 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5533999999999998e-05 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.322 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2364 3.3a 3:5f88866d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.430826643, 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017066136999999999, 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2364 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864873+0000", 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0989999999999999e-06 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866782+0000", 2024-04-26T12:40:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001908325 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866804+0000", 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2331999999999999e-05 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866817+0000", 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2951e-05 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866910+0000", 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2817000000000003e-05 2024-04-26T12:40:26.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866915+0000", 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0699999999999997e-06 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870125+0000", 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032105279999999998 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870302+0000", 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017691699999999999 2024-04-26T12:40:26.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870475+0000", 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258400000000001 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.877926+0000", 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074516069999999998 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881845+0000", 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039187570000000001 2024-04-26T12:40:26.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881885+0000", 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0234000000000001e-05 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881936+0000", 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0915999999999998e-05 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2366 3.0 e73/17 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:26.328 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.402417911000001, 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007540064, 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9200000000000002e-07 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895376+0000", 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020964460000000001 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895399+0000", 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2886000000000001e-05 2024-04-26T12:40:26.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895411+0000", 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2845e-05 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895487+0000", 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5555000000000004e-05 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895512+0000", 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4751000000000001e-05 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900733+0000", 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052214210000000004 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900819+0000", 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5867999999999998e-05 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2383 3.3a 3:5e222c71:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:26.332 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.232579511000001, 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012876257, 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2383 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063120+0000", 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-06 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065515+0000", 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023946839999999998 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065543+0000", 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8311e-05 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065556+0000", 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442e-05 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065651+0000", 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5266000000000006e-05 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065849+0000", 2024-04-26T12:40:26.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019847699999999999 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.066023+0000", 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173072 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075353+0000", 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093303489999999999 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075875+0000", 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00052190799999999996 2024-04-26T12:40:26.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075936+0000", 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1681999999999997e-05 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075994+0000", 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7092999999999997e-05 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2390 3.3b e73/17 3:de1f29f3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_199:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:26.337 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.149586791999999, 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011629304, 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4900000000000001e-07 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150965+0000", 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048547080000000001 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150993+0000", 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8087999999999999e-05 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151007+0000", 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3653e-05 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151087+0000", 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9856000000000003e-05 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151113+0000", 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6486e-05 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157679+0000", 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065660960000000004 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157739+0000", 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0068000000000002e-05 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2393 3.0 e73/17 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.116870643, 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078009530000000002, 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:26.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178828+0000", 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181282+0000", 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024539710000000001 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181306+0000", 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4080999999999999e-05 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181319+0000", 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.294e-05 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181753+0000", 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043354299999999999 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181777+0000", 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4762000000000001e-05 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186543+0000", 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047658509999999998 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186627+0000", 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3957999999999998e-05 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2395 3.25 e73/41 3:a5fe4c99:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_204:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.094279162999999, 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068691029999999997, 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.346 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201419+0000", 2024-04-26T12:40:26.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3850000000000001e-06 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203007+0000", 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015877650000000001 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203033+0000", 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5981000000000001e-05 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203046+0000", 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3114e-05 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203128+0000", 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2077999999999996e-05 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203153+0000", 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5086999999999999e-05 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208235+0000", 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050818599999999997 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208287+0000", 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1833000000000003e-05 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.350 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.989331092, 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2413 3.2d e73/17 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.896348044, 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097703479999999999, 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399350+0000", 2024-04-26T12:40:26.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.711e-06 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403750+0000", 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043993160000000003 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403772+0000", 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1985999999999999e-05 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403782+0000", 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9340000000000001e-06 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403854+0000", 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2788999999999997e-05 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403881+0000", 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6826999999999999e-05 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409050+0000", 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051684189999999996 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409119+0000", 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9366e-05 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2415 3.0 e73/17 3:007bae19:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_224:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:26.360 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.874076879, 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006983324, 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421622+0000", 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.841e-06 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423279+0000", 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016575139999999999 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423304+0000", 2024-04-26T12:40:26.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5198000000000002e-05 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423318+0000", 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.328e-05 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423400+0000", 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2729e-05 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423428+0000", 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7222000000000001e-05 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428553+0000", 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051254450000000002 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428603+0000", 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0095000000000001e-05 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2418 3.25 e73/41 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.841964637, 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079618780000000004, 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453733+0000", 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3200000000000004e-07 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455472+0000", 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017391749999999999 2024-04-26T12:40:26.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455495+0000", 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2625000000000001e-05 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455509+0000", 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4056999999999999e-05 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455587+0000", 2024-04-26T12:40:26.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8577000000000003e-05 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455619+0000", 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1443999999999999e-05 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461659+0000", 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060406499999999998 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461694+0000", 2024-04-26T12:40:26.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4618e-05 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2419 3.4 e73/17 3:21b3cbd4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_228:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.831355879, 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074141069999999996, 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464342+0000", 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.142e-06 2024-04-26T12:40:26.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466601+0000", 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022590190000000001 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466619+0000", 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8337000000000001e-05 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466628+0000", 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0089999999999996e-06 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466687+0000", 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8368000000000001e-05 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466712+0000", 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4836000000000001e-05 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471699+0000", 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049870019999999999 2024-04-26T12:40:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471755+0000", 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6394000000000003e-05 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2426 3.f 3:f3fcc542:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.762001673, 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017310012999999999, 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2426 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533698+0000", 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8389999999999998e-06 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535314+0000", 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016156949999999999 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535339+0000", 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5117e-05 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535349+0000", 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0569e-05 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535414+0000", 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5080999999999996e-05 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535529+0000", 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114302 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535625+0000", 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6210000000000002e-05 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.542763+0000", 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071382149999999998 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550914+0000", 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081504420000000008 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550953+0000", 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9597000000000001e-05 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.551005+0000", 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1946e-05 2024-04-26T12:40:26.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2429 3.4 e73/17 3:208decb8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_238:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.731403134000001, 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072608780000000001, 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564295+0000", 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566152+0000", 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001856871 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566180+0000", 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7338000000000002e-05 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566195+0000", 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5807999999999998e-05 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566279+0000", 2024-04-26T12:40:26.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3462999999999997e-05 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566307+0000", 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7977999999999999e-05 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571500+0000", 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051927199999999996 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571555+0000", 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4987000000000001e-05 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2432 3.4 e73/17 3:22adec7f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_241:head v 73'4, mlcod=73'2)", 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.699431372999999, 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072901049999999998, 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596267+0000", 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9870000000000002e-06 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597800+0000", 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015329530000000001 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597825+0000", 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4675e-05 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597838+0000", 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3335e-05 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597925+0000", 2024-04-26T12:40:26.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6865000000000003e-05 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597966+0000", 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0417000000000003e-05 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603515+0000", 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055488730000000002 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603556+0000", 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1e-05 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2435 3.2d e73/17 3:b50706f2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_244:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.659428809, 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010411692, 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636271+0000", 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640883+0000", 2024-04-26T12:40:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046121540000000003 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640921+0000", 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8676e-05 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640940+0000", 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8991000000000002e-05 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641044+0000", 2024-04-26T12:40:26.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010401899999999999 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641074+0000", 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0037999999999999e-05 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646616+0000", 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055411619999999997 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646680+0000", 2024-04-26T12:40:26.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4083000000000003e-05 2024-04-26T12:40:26.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.391 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.391 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.391 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.391 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:26.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:26.393 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:26.388+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:26.493 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:26.492+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:26.526 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:26.527 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:26.527 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:26.527 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:26.541 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:26.594 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:26.592+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:26.665 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:26.666 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:26.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:26.729 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:26.730+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:26.796 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:26.792+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1326 3.33 3:cd5db5f2:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.961923963, 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016038528, 2024-04-26T12:40:26.807 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1326 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:26.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842595+0000", 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9420000000000002e-06 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843194+0000", 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059943799999999999 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843214+0000", 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9970999999999999e-05 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843223+0000", 2024-04-26T12:40:26.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0040000000000005e-06 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843310+0000", 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6973999999999998e-05 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843418+0000", 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010787 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843511+0000", 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3305000000000002e-05 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.846677+0000", 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031658749999999999 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858525+0000", 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011848348 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858582+0000", 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6119000000000003e-05 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858631+0000", 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:40:26.813 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2320 3.27 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.415024254, 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020624966000000002, 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.814 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2320 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389495+0000", 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390861+0000", 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013652849999999999 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390898+0000", 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6789000000000003e-05 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390908+0000", 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.065e-05 2024-04-26T12:40:26.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390983+0000", 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391089+0000", 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105752 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391177+0000", 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7596999999999995e-05 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.395646+0000", 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044690889999999999 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410024+0000", 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014378050999999999 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410065+0000", 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1056000000000001e-05 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410117+0000", 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2485000000000003e-05 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.820 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2325 3.2 3:40f43f1f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.365672349, 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013366813, 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.821 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2325 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438847+0000", 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7769999999999998e-06 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440481+0000", 2024-04-26T12:40:26.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001633731 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440511+0000", 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0247999999999999e-05 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440523+0000", 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1861999999999999e-05 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440605+0000", 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2392000000000007e-05 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440774+0000", 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168985 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440934+0000", 2024-04-26T12:40:26.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159908 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.445923+0000", 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049891900000000001 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452114+0000", 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006190887 2024-04-26T12:40:26.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452168+0000", 2024-04-26T12:40:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3749999999999999e-05 2024-04-26T12:40:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452211+0000", 2024-04-26T12:40:26.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3083000000000001e-05 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2329 3.38 3:1f4c78ed:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.325694945, 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015527136, 2024-04-26T12:40:26.828 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2329 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:26.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:26.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478825+0000", 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8959999999999999e-06 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480286+0000", 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001461644 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480319+0000", 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2527000000000002e-05 2024-04-26T12:40:26.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480334+0000", 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.519e-05 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480420+0000", 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5643999999999995e-05 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480572+0000", 2024-04-26T12:40:26.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000152237 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480724+0000", 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015249 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.484967+0000", 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042430879999999999 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494254+0000", 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092865980000000001 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494295+0000", 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0503000000000002e-05 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494349+0000", 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4318999999999999e-05 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.834 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2330 3.27 3:e503c54d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.315848803, 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014172947999999999, 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.835 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2330 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488670+0000", 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.751e-06 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.489978+0000", 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013084850000000001 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490008+0000", 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9967999999999998e-05 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490021+0000", 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2745000000000001e-05 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490094+0000", 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2849999999999995e-05 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490217+0000", 2024-04-26T12:40:26.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012377300000000001 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490323+0000", 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105132 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494969+0000", 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046460959999999997 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502769+0000", 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078001370000000004 2024-04-26T12:40:26.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502810+0000", 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1412000000000003e-05 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502841+0000", 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0599000000000003e-05 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2338 3.2 3:40db620f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:26.840 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.233832901, 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017810332000000002, 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2338 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570686+0000", 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1229999999999998e-06 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572072+0000", 2024-04-26T12:40:26.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001386125 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572105+0000", 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3492999999999999e-05 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572116+0000", 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0627e-05 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572187+0000", 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0531999999999995e-05 2024-04-26T12:40:26.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572308+0000", 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012157700000000001 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572414+0000", 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105889 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576935+0000", 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045206049999999996 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588421+0000", 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011486111 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588462+0000", 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1270000000000003e-05 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588494+0000", 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1980000000000002e-05 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2348 3.29 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.112143851000001, 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019384129999999999, 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2348 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.846 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692376+0000", 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2320000000000001e-06 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.693975+0000", 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001598808 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694006+0000", 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1606000000000002e-05 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694021+0000", 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4783999999999999e-05 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694117+0000", 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5851000000000001e-05 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694259+0000", 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014201099999999999 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694400+0000", 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014122200000000001 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.698538+0000", 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041381170000000002 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711595+0000", 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013056636 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711687+0000", 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1630000000000002e-05 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711757+0000", 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0233000000000003e-05 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2356 3.7 3:e10f5880:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.027148014, 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015864989999999999, 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.851 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2356 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777372+0000", 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8890000000000002e-06 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779070+0000", 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001698764 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779096+0000", 2024-04-26T12:40:26.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5959e-05 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779107+0000", 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779183+0000", 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5788e-05 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779320+0000", 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137269 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779408+0000", 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7560999999999997e-05 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.783717+0000", 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043093230000000003 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793104+0000", 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009387411 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793178+0000", 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3843000000000004e-05 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793234+0000", 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5386000000000001e-05 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2372 3.1e 3:788eb98e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.853592059, 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019326650000000001, 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2372 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950927+0000", 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4310000000000001e-06 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953107+0000", 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021800080000000002 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953135+0000", 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7529999999999999e-05 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953149+0000", 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4171e-05 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953240+0000", 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983999999999995e-05 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953413+0000", 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017362399999999999 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953577+0000", 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000163864 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.959646+0000", 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060690620000000001 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970130+0000", 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010484228999999999 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970199+0000", 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8866000000000001e-05 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970251+0000", 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1881e-05 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2374 3.38 3:1c1a4d28:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.831869853000001, 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020357772999999999, 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.862 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2374 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972649+0000", 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974485+0000", 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018357899999999999 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974516+0000", 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1142000000000001e-05 2024-04-26T12:40:26.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974531+0000", 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.455e-05 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974627+0000", 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6543e-05 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974833+0000", 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020613700000000001 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.975018+0000", 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000184267 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.981099+0000", 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00608093 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011762869 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992942+0000", 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0517000000000002e-05 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.993005+0000", 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2648000000000001e-05 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2376 3.5 e73/17 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:26.867 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.806255744, 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011508294000000001, 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998273+0000", 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1647999999999999e-05 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002533+0000", 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042605840000000004 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002562+0000", 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9343999999999999e-05 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002577+0000", 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4592e-05 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002663+0000", 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6013000000000005e-05 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002694+0000", 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0817e-05 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009691+0000", 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0069972710000000002 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009769+0000", 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8024999999999999e-05 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2382 3.3c e73/17 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:26.871 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.74563369, 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016599513, 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058885+0000", 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.062970+0000", 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040850720000000004 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063005+0000", 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5342999999999997e-05 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063021+0000", 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6019e-05 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063152+0000", 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013094699999999999 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063181+0000", 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8561999999999999e-05 2024-04-26T12:40:26.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075419+0000", 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012238667 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075482+0000", 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3229000000000001e-05 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.875 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2388 3.2 3:404073be:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.687991526999999, 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019415504, 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2388 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116528+0000", 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118771+0000", 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002243091 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118792+0000", 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0990000000000001e-05 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118802+0000", 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0086e-05 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118912+0000", 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109497 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119038+0000", 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126198 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119125+0000", 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7186000000000002e-05 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.123050+0000", 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039251169999999997 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135829+0000", 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012779209 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135892+0000", 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2728e-05 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135941+0000", 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8485000000000001e-05 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2389 3.2 3:427feba5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.676360905999999, 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019131569000000001, 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.881 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2389 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128159+0000", 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.864e-06 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130062+0000", 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019030500000000001 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130088+0000", 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5890000000000001e-05 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130098+0000", 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0263e-05 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130167+0000", 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9643999999999999e-05 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130306+0000", 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013836499999999999 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130397+0000", 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1003999999999998e-05 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135001+0000", 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004604403 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147180+0000", 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012178362 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147227+0000", 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6981000000000003e-05 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147287+0000", 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0742999999999998e-05 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.886 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:26.887 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.554696166999999, 2024-04-26T12:40:26.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:40:26.889 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.889 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2407 3.33 3:ce0fe289:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.487282987, 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018708978000000001, 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2407 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317236+0000", 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7539999999999998e-06 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318627+0000", 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013905600000000001 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318660+0000", 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3042e-05 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318676+0000", 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5775999999999999e-05 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318777+0000", 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101152 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318986+0000", 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000208648 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.319165+0000", 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017941699999999999 2024-04-26T12:40:26.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.324600+0000", 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054352430000000002 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335812+0000", 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011211308999999999 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335886+0000", 2024-04-26T12:40:26.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4263000000000004e-05 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335943+0000", 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6814000000000002e-05 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2409 3.1e 3:7ac1137c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.461256662, 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017629292000000001, 2024-04-26T12:40:26.900 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2409 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343262+0000", 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9549999999999999e-06 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345627+0000", 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023648459999999999 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345658+0000", 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1154e-05 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345675+0000", 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7456e-05 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345800+0000", 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012460300000000001 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346033+0000", 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023336599999999999 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346192+0000", 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015833500000000001 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.352130+0000", 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059381190000000004 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360741+0000", 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0086116479999999995 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360811+0000", 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9342000000000001e-05 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360889+0000", 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8467999999999995e-05 2024-04-26T12:40:26.905 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2417 3.8 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.364643541, 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012677982000000001, 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.906 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2417 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439876+0000", 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441807+0000", 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001931239 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441829+0000", 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1883999999999999e-05 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441839+0000", 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0084999999999999e-05 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441928+0000", 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8608000000000003e-05 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442072+0000", 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144053 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442170+0000", 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7921e-05 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.449581+0000", 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074107469999999996 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452422+0000", 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028413570000000001 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452496+0000", 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3857999999999997e-05 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452551+0000", 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5299e-05 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.911 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.320033375, 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:26.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:40:26.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2423 3.b 3:d15dbab2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.300516039, 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012126067000000001, 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2423 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:26.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504003+0000", 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.452e-06 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506649+0000", 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026461879999999998 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506674+0000", 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4689e-05 2024-04-26T12:40:26.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506686+0000", 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1595e-05 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506759+0000", 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658000000000005e-05 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506933+0000", 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017354100000000001 2024-04-26T12:40:26.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.507051+0000", 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118578 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.513156+0000", 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0061047319999999999 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515986+0000", 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028303199999999999 2024-04-26T12:40:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516064+0000", 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7466999999999995e-05 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516127+0000", 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2847000000000003e-05 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:26.922 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:26.924 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:26.924 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:26.920+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:27.025 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:27.026+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:27.057 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:27.057 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:27.057 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:27.057 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:27.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:27.126 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:27.126+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:27.196 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:27.196 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:27.196 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:27.196 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:27.196 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:27.210 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:27.227 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:27.226+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:27.328 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:27.326+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:27.335 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:27.335 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:27.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:27.335 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:27.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.335 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1601 3.1d e67/17 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:27.335 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.604655801, 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021057349999999999, 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727484+0000", 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733321+0000", 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005836351 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733360+0000", 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9648999999999999e-05 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733383+0000", 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2722999999999999e-05 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733504+0000", 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012115199999999999 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733558+0000", 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3511999999999999e-05 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748395+0000", 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014836937 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748539+0000", 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144356 2024-04-26T12:40:27.339 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2320 3.27 e72/17 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head v 72'3, mlcod=67'1)", 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.941631942000001, 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017587200000000001, 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2799999999999995e-07 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396488+0000", 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059817680000000002 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396509+0000", 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0888999999999999e-05 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396520+0000", 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0708e-05 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396619+0000", 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9263000000000002e-05 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396654+0000", 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5125e-05 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408029+0000", 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011374815 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408093+0000", 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3804000000000001e-05 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2337 3.1b e72/17 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.773349521, 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015714998000000001, 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.344 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558789+0000", 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4780000000000001e-06 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563525+0000", 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047351470000000003 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563558+0000", 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3284999999999997e-05 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563574+0000", 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.573e-05 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563664+0000", 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0006000000000005e-05 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563690+0000", 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6619999999999999e-05 2024-04-26T12:40:27.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574423+0000", 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010732396 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574503+0000", 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0335999999999998e-05 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2347 3.a e72/17 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head v 72'3, mlcod=71'1)", 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.646777724, 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019978432000000001, 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685363+0000", 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:27.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688265+0000", 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029017240000000001 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688336+0000", 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1422999999999997e-05 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688364+0000", 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7234999999999999e-05 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688534+0000", 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017049599999999999 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688604+0000", 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0016000000000002e-05 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705182+0000", 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016577543 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705338+0000", 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156479 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2348 3.29 e72/17 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.639166387, 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016659368000000001, 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692973+0000", 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2199999999999999e-06 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699798+0000", 2024-04-26T12:40:27.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0068248750000000002 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699829+0000", 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699845+0000", 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6132000000000001e-05 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699973+0000", 2024-04-26T12:40:27.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012803099999999999 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700015+0000", 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2052000000000003e-05 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709497+0000", 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094813919999999999 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709631+0000", 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013391299999999999 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2351 3.14 e72/31 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head v 72'4, mlcod=72'2)", 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.599052125, 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018622024000000001, 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733088+0000", 2024-04-26T12:40:27.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.48e-06 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735690+0000", 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026018040000000001 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735724+0000", 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4585999999999997e-05 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735743+0000", 2024-04-26T12:40:27.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8309e-05 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735878+0000", 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013522999999999999 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735919+0000", 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1223000000000002e-05 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751443+0000", 2024-04-26T12:40:27.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015524247999999999 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751707+0000", 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026414400000000001 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2352 3.31 e73/17 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:27.362 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.595808586, 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017289571, 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736330+0000", 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0100000000000001e-06 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740605+0000", 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042746169999999997 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740643+0000", 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8776000000000003e-05 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740669+0000", 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5499000000000001e-05 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740805+0000", 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013579099999999999 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740847+0000", 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2642000000000003e-05 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753498+0000", 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012651172 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753619+0000", 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012006399999999999 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.366 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.364146898, 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:27.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:40:27.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:40:27.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:40:27.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2375 3.1c e73/17 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.345214402, 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018742169999999999, 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986925+0000", 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0439999999999998e-06 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992153+0000", 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005227644 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992186+0000", 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3256000000000001e-05 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992210+0000", 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4249000000000001e-05 2024-04-26T12:40:27.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992375+0000", 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016447 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992438+0000", 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3318999999999995e-05 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005540+0000", 2024-04-26T12:40:27.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013101550999999999 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005665+0000", 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000125637 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2378 3.1d e73/17 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:27.375 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.316414117000001, 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015708637000000001, 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015726+0000", 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4030000000000001e-06 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018549+0000", 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028231969999999999 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018590+0000", 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0995000000000003e-05 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018609+0000", 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8850000000000001e-05 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018752+0000", 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143633 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018793+0000", 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0496e-05 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031304+0000", 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012510795999999999 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031432+0000", 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128267 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.379 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2396 3.31 e73/17 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.119320622, 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015460707000000001, 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:27.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212819+0000", 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.497e-06 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216796+0000", 2024-04-26T12:40:27.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039765190000000004 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216829+0000", 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2712000000000001e-05 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216845+0000", 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6464e-05 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217025+0000", 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000179989 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217090+0000", 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5087999999999998e-05 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228134+0000", 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011044185 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228278+0000", 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014325300000000001 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.087462227, 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.384 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:40:27.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:40:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2400 3.27 e73/17 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.081735246999999, 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020886715, 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.388 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250405+0000", 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254952+0000", 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045466930000000001 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254991+0000", 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9298999999999998e-05 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255014+0000", 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2711999999999999e-05 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255166+0000", 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015193699999999999 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255207+0000", 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1436000000000001e-05 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271130+0000", 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015923262000000001 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271289+0000", 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015862600000000001 2024-04-26T12:40:27.392 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2402 3.11 e73/17 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.059478287999999, 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018233177, 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272662+0000", 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.157e-06 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276695+0000", 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040329739999999999 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276735+0000", 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9338999999999997e-05 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276760+0000", 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4893e-05 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276943+0000", 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000183489 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277008+0000", 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4704999999999998e-05 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290772+0000", 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013764406999999999 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290892+0000", 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120213 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2403 3.3 e73/31 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.053987837999999, 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016271938, 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.397 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278151+0000", 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4e-07 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282860+0000", 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047094179999999999 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282891+0000", 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0562999999999999e-05 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282909+0000", 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7995999999999998e-05 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283056+0000", 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014763299999999999 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283099+0000", 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3139000000000002e-05 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294299+0000", 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011200185 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294422+0000", 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012216399999999999 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2406 3.9 e73/31 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head v 73'3, mlcod=67'1)", 2024-04-26T12:40:27.401 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.025207056999999, 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016385118000000001, 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306931+0000", 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3300000000000001e-07 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312959+0000", 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060277100000000004 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312990+0000", 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0786e-05 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313005+0000", 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5373e-05 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313149+0000", 2024-04-26T12:40:27.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014355999999999999 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313191+0000", 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1928999999999998e-05 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323173+0000", 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099826700000000008 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323316+0000", 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014235699999999999 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2411 3.31 e73/17 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head v 73'10, mlcod=73'8)", 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:27.406 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.961891456, 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015408975, 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370249+0000", 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3869999999999999e-06 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375387+0000", 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051375539999999999 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375425+0000", 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8186000000000003e-05 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375449+0000", 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3620000000000001e-05 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375622+0000", 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017309500000000001 2024-04-26T12:40:27.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375673+0000", 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0849000000000001e-05 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385561+0000", 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098879090000000003 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385655+0000", 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4375000000000004e-05 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2421 3.27 e73/17 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.846974114, 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018694483000000001, 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485166+0000", 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4660000000000002e-06 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490411+0000", 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052454119999999996 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490447+0000", 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6106000000000003e-05 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490466+0000", 2024-04-26T12:40:27.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8329999999999999e-05 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490659+0000", 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019286800000000001 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490703+0000", 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4725999999999998e-05 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503764+0000", 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013060251 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503858+0000", 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4324e-05 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2428 3.1a e73/31 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:27.415 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.779064611999999, 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015568897, 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553076+0000", 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.01e-06 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557315+0000", 2024-04-26T12:40:27.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042394160000000002 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557363+0000", 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7271999999999997e-05 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557388+0000", 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5249000000000002e-05 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557559+0000", 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000171039 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557621+0000", 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1999000000000001e-05 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568551+0000", 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010930415000000001 2024-04-26T12:40:27.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568642+0000", 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0496999999999998e-05 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2431 3.31 e73/17 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head v 73'11, mlcod=73'9)", 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.748358267, 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01575095, 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:27.420 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:27.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583783+0000", 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4960000000000001e-06 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589105+0000", 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053218140000000002 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:27.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589142+0000", 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7149e-05 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589159+0000", 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.774e-05 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589317+0000", 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000157589 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589380+0000", 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2708999999999999e-05 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599423+0000", 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010042882 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599530+0000", 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107571 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.424 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.425 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:27.425 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:27.425 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:27.426 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:27.429 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:27.428+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:27.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:27.530 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:27.528+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:27.550 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:27.550 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:27.550 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:27.550 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:27.564 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:27.615 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:27.632 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:27.632 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:27.648 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:27.648 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:27.657 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:27.656+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:27.666 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:27.666 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:27.685 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:27.686 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:27.705 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:27.705 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:27.727 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:27.727 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:27.732 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:27.734+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:27.738 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:27.738 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:27.748 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:27.748 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:27.753 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:27.845 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:27.844+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:27.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:40:27.921 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:27.921 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:27.935 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:27.935 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:27.932+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:28.036 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:28.034+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:28.100 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:28.100 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:28.114 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:28.161 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:28.160+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:28.237 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:28.236+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:28.241 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:28.241 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:28.255 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:28.415 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:28.338+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:28.417 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:28.417 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:28.431 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:28.477 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:28.476+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:28.540 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:28.536+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:28.556 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:28.557 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:28.571 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:28.657 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:28.656+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:28.736 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:28.736 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:28.743 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:28.740+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:28.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:28.842 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:40:28.843 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:28.840+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:28.916 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:28.916 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:28.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:28.977 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:28.978+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:29.048 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:29.046+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:29.070 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:29.070 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:29.085 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:29.177 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:29.178+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:29.250 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:29.248+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:29.256 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:29.256 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:29.270 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:29.357 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:29.358+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:29.440 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:29.440 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:29.451 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:29.450+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:29.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:29.553 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:29.552+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:29.618 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:29.618 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:29.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:29.678 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:29.678+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:29.754 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:29.754+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:29.755 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:29.755 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:29.767 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:29.769 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:29.855 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:29.852+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:29.910 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:29.911 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:29.928 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:29.928 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 135.49511384900001, 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.938 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:40:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:40:29.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:40:29.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2319 3.1a 3:58f869a1:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.558396482999999, 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013146055, 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2319 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378953+0000", 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.041e-06 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380420+0000", 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001467138 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380454+0000", 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4236999999999998e-05 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380470+0000", 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6578999999999998e-05 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380544+0000", 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3616999999999997e-05 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380697+0000", 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015309199999999999 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380801+0000", 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103513 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.385130+0000", 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00432906 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391960+0000", 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068303560000000001 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392034+0000", 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4119e-05 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392097+0000", 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2303000000000003e-05 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2326 3.0 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.487639360999999, 2024-04-26T12:40:29.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099133869999999992, 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2326 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449708+0000", 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.449711+0000", 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5080000000000001e-06 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451146+0000", 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014349720000000001 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451183+0000", 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6671999999999997e-05 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451199+0000", 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6257999999999999e-05 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451290+0000", 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0728000000000003e-05 2024-04-26T12:40:29.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451468+0000", 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017821300000000001 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451632+0000", 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.458789+0000", 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071576060000000004 2024-04-26T12:40:29.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459479+0000", 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00069001700000000002 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459560+0000", 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0115000000000001e-05 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459621+0000", 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1408000000000006e-05 2024-04-26T12:40:29.953 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2345 3.19 3:99eb3a17:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.277777336, 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010166799000000001, 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.954 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2345 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659570+0000", 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.659573+0000", 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6990000000000001e-06 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661691+0000", 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021175959999999998 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661711+0000", 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0128000000000001e-05 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661724+0000", 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2906e-05 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661800+0000", 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6505e-05 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.661985+0000", 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018474600000000001 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:29.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.662135+0000", 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014955599999999999 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.668376+0000", 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062408280000000003 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669587+0000", 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012110739999999999 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:29.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669672+0000", 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5241999999999995e-05 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.669736+0000", 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4518999999999997e-05 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:29.959 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.201987575, 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:40:29.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:29.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:40:29.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:40:29.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:29.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:29.967 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.125731307999999, 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:40:29.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:40:29.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:29.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.114006939999999, 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.973 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2362 3.19 3:98a41993:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:29.978 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.093148285000002, 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0096554659999999997, 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2362 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:29.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844199+0000", 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.844202+0000", 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0340000000000001e-06 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845840+0000", 2024-04-26T12:40:29.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00163839 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845872+0000", 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1523999999999998e-05 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845888+0000", 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6208000000000001e-05 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.845978+0000", 2024-04-26T12:40:29.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9909999999999998e-05 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846168+0000", 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019002999999999999 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.846343+0000", 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175071 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853321+0000", 2024-04-26T12:40:29.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006978616 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853780+0000", 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045818500000000001 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853821+0000", 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1248999999999998e-05 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.853854+0000", 2024-04-26T12:40:29.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3249e-05 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2366 3.0 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.049364431000001, 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013182772000000001, 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.984 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2366 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:40:29.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887986+0000", 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3469999999999999e-06 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889575+0000", 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00158928 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889602+0000", 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6840999999999999e-05 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889617+0000", 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4667e-05 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889721+0000", 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104255 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889920+0000", 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019873199999999999 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.890088+0000", 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016799 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895734+0000", 2024-04-26T12:40:29.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056464139999999998 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901046+0000", 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053117019999999997 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901114+0000", 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8232999999999995e-05 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901165+0000", 2024-04-26T12:40:29.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1310999999999997e-05 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.853798517000001, 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.990 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:40:29.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.995 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2386 3.19 3:9a588031:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.842579046000001, 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010161018000000001, 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2386 2024-04-26T12:40:29.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094768+0000", 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.094770+0000", 2024-04-26T12:40:29.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3920000000000001e-06 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095718+0000", 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00094744999999999996 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095744+0000", 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6038999999999999e-05 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095757+0000", 2024-04-26T12:40:29.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3451999999999999e-05 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095843+0000", 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5877000000000005e-05 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.095962+0000", 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011846899999999999 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.096054+0000", 2024-04-26T12:40:29.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1963e-05 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104575+0000", 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0085213179999999999 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104801+0000", 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022650599999999999 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104872+0000", 2024-04-26T12:40:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0412000000000003e-05 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.104929+0000", 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7139999999999998e-05 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2391 3.31 3:8f508897:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.784780049999998, 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016948310000000001, 2024-04-26T12:40:30.001 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2391 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152570+0000", 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154503+0000", 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001933234 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154536+0000", 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3321000000000002e-05 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154553+0000", 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6288000000000001e-05 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154639+0000", 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6236000000000006e-05 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154820+0000", 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181306 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154983+0000", 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162929 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.160656+0000", 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056726550000000004 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169397+0000", 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087409170000000008 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169465+0000", 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8730000000000001e-05 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169515+0000", 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9795e-05 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.006 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2393 3.0 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.761267793999998, 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010859486999999999, 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2393 2024-04-26T12:40:30.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176082+0000", 2024-04-26T12:40:30.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3970000000000001e-06 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178323+0000", 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002241818 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178348+0000", 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4335e-05 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178359+0000", 2024-04-26T12:40:30.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1092e-05 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178440+0000", 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0745e-05 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178581+0000", 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014098100000000001 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:30.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178682+0000", 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010178099999999999 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.184116+0000", 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054341090000000003 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186805+0000", 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026890529999999998 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186884+0000", 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8336000000000004e-05 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186939+0000", 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4839999999999997e-05 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.725155276999999, 2024-04-26T12:40:30.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.017 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2397 3.19 3:9b8be67a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.715967062000001, 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00976898, 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.018 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2397 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221380+0000", 2024-04-26T12:40:30.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.221382+0000", 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.73e-06 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222800+0000", 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001418802 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222828+0000", 2024-04-26T12:40:30.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7790999999999999e-05 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222839+0000", 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0428000000000001e-05 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.222926+0000", 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7541999999999996e-05 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223135+0000", 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020900399999999999 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.223316+0000", 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018074899999999999 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230660+0000", 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073436259999999998 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231093+0000", 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043387800000000001 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231124+0000", 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0939999999999999e-05 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.231149+0000", 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4490000000000001e-05 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.023 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.56785296, 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.024 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:40:30.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:40:30.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:40:30.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:40:30.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2417 3.8 e73/17 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head v 73'4, mlcod=71'2)", 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.495060768999998, 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099003479999999998, 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.029 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442286+0000", 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442289+0000", 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4389999999999999e-06 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444260+0000", 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019712509999999998 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444281+0000", 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1512999999999999e-05 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444294+0000", 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2206e-05 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444378+0000", 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4658000000000002e-05 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.444409+0000", 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1086e-05 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451996+0000", 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007586392 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452187+0000", 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000190803 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.033 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2418 3.25 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.486243903999998, 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010790129000000001, 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.034 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2418 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451105+0000", 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.351e-06 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453261+0000", 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021551169999999998 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453277+0000", 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6935e-05 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453299+0000", 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1701000000000001e-05 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453368+0000", 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8591999999999997e-05 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453517+0000", 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014963699999999999 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:30.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453638+0000", 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120289 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461242+0000", 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0076041479999999998 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461821+0000", 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057901100000000004 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461860+0000", 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9498e-05 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461893+0000", 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2849999999999999e-05 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:30.039 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.384449578999998, 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:40:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:40:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:40:30.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:40:30.044 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.354137751, 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.045 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.050 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.051 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.051 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:30.052 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:30.052 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:30.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:30.053 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:30.053 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:30.054 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:30.054 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:30.055 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:30.055 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:30.056 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:30.056 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:30.048+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:30.153 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:30.152+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:30.175 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:30.176 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:30.176 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:30.176 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:30.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:30.254 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:30.252+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:30.306 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:30.306 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:30.307 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:30.319 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:30.355 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:30.352+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:30.441 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:30.441 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:30.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:30.441 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:30.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.441 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1544 4.d 4:b0f5eef4:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:30.441 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:30.441 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 31.451424940999999, 2024-04-26T12:40:30.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078556990000000007, 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1544 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989713+0000", 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989720+0000", 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1439999999999997e-06 2024-04-26T12:40:30.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989735+0000", 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4318000000000001e-05 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989743+0000", 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3520000000000007e-06 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989816+0000", 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2733999999999999e-05 2024-04-26T12:40:30.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989896+0000", 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0635000000000003e-05 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989995+0000", 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8276999999999994e-05 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990617+0000", 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062210300000000004 2024-04-26T12:40:30.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997488+0000", 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068714170000000003 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997521+0000", 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3120999999999997e-05 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997567+0000", 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5259000000000002e-05 2024-04-26T12:40:30.446 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2323 3.3a 3:5f8d6128:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.022895094999999, 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0089459429999999996, 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.447 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2323 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418243+0000", 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419683+0000", 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014398810000000001 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419708+0000", 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4734000000000001e-05 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419718+0000", 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9450000000000005e-06 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419801+0000", 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3323000000000002e-05 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419969+0000", 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168064 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.420113+0000", 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014409000000000001 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.426671+0000", 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065582080000000003 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427066+0000", 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039501800000000002 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427130+0000", 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3206000000000004e-05 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427187+0000", 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6932999999999999e-05 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2326 3.0 e72/17 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head v 72'6, mlcod=72'4)", 2024-04-26T12:40:30.452 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.989390483000001, 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074245839999999997, 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:30.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451747+0000", 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.663e-06 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453207+0000", 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014601410000000001 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453232+0000", 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5372e-05 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453244+0000", 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1790999999999999e-05 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453323+0000", 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9140999999999993e-05 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453347+0000", 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3910999999999999e-05 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459105+0000", 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057577080000000003 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459170+0000", 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2328 3.3a 3:5e90e1f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.971241741, 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0090903670000000002, 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2328 2024-04-26T12:40:30.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469896+0000", 2024-04-26T12:40:30.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0229999999999999e-06 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471266+0000", 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001370303 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471294+0000", 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7571000000000001e-05 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471308+0000", 2024-04-26T12:40:30.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4267000000000001e-05 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471388+0000", 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9939999999999997e-05 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471525+0000", 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013668400000000001 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:30.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471667+0000", 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014186299999999999 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478381+0000", 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067147750000000001 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478838+0000", 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045644799999999998 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478923+0000", 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4736999999999999e-05 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478984+0000", 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1755999999999996e-05 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2340 3.3b e72/17 3:dec2f466:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_149:head v 72'4, mlcod=71'2)", 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.838037483000001, 2024-04-26T12:40:30.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010101687, 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603101+0000", 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.548e-06 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608217+0000", 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051159860000000003 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608250+0000", 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3411999999999998e-05 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608266+0000", 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5979000000000001e-05 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608334+0000", 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8120999999999994e-05 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608357+0000", 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2719000000000001e-05 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613114+0000", 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047573880000000004 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613200+0000", 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5533999999999998e-05 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2364 3.3a 3:5f88866d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.466 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.576265613, 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017066136999999999, 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2364 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864873+0000", 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0989999999999999e-06 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866782+0000", 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001908325 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866804+0000", 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2331999999999999e-05 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866817+0000", 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2951e-05 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866910+0000", 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2817000000000003e-05 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866915+0000", 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0699999999999997e-06 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870125+0000", 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032105279999999998 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870302+0000", 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017691699999999999 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870475+0000", 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258400000000001 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.877926+0000", 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074516069999999998 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881845+0000", 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039187570000000001 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881885+0000", 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0234000000000001e-05 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881936+0000", 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0915999999999998e-05 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2366 3.0 e73/17 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.547856881000001, 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007540064, 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9200000000000002e-07 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895376+0000", 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020964460000000001 2024-04-26T12:40:30.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895399+0000", 2024-04-26T12:40:30.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2886000000000001e-05 2024-04-26T12:40:30.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895411+0000", 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2845e-05 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895487+0000", 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5555000000000004e-05 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895512+0000", 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4751000000000001e-05 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900733+0000", 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052214210000000004 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900819+0000", 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5867999999999998e-05 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2383 3.3a 3:5e222c71:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:30.477 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.378018481000002, 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012876257, 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2383 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:30.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063120+0000", 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-06 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065515+0000", 2024-04-26T12:40:30.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023946839999999998 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065543+0000", 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8311e-05 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065556+0000", 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442e-05 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065651+0000", 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5266000000000006e-05 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065849+0000", 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019847699999999999 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.066023+0000", 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173072 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075353+0000", 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093303489999999999 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075875+0000", 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00052190799999999996 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075936+0000", 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1681999999999997e-05 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075994+0000", 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7092999999999997e-05 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2390 3.3b e73/17 3:de1f29f3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_199:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.295025762000002, 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011629304, 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.483 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:30.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4900000000000001e-07 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150965+0000", 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048547080000000001 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150993+0000", 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8087999999999999e-05 2024-04-26T12:40:30.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151007+0000", 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3653e-05 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151087+0000", 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9856000000000003e-05 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151113+0000", 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6486e-05 2024-04-26T12:40:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157679+0000", 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065660960000000004 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157739+0000", 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0068000000000002e-05 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.487 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2393 3.0 e73/17 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.262309612999999, 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078009530000000002, 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:30.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178828+0000", 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181282+0000", 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024539710000000001 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181306+0000", 2024-04-26T12:40:30.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4080999999999999e-05 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181319+0000", 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.294e-05 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181753+0000", 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043354299999999999 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181777+0000", 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4762000000000001e-05 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186543+0000", 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047658509999999998 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186627+0000", 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3957999999999998e-05 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2395 3.25 e73/41 3:a5fe4c99:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_204:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.239718133, 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068691029999999997, 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201419+0000", 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3850000000000001e-06 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203007+0000", 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015877650000000001 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203033+0000", 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5981000000000001e-05 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203046+0000", 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3114e-05 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203128+0000", 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2077999999999996e-05 2024-04-26T12:40:30.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203153+0000", 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5086999999999999e-05 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208235+0000", 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050818599999999997 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208287+0000", 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1833000000000003e-05 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.134770062000001, 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.496 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:30.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2413 3.2d e73/17 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.041787014000001, 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097703479999999999, 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399350+0000", 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.711e-06 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403750+0000", 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043993160000000003 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403772+0000", 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1985999999999999e-05 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403782+0000", 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9340000000000001e-06 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403854+0000", 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2788999999999997e-05 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403881+0000", 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6826999999999999e-05 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409050+0000", 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051684189999999996 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409119+0000", 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9366e-05 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.505 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.506 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2415 3.0 e73/17 3:007bae19:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_224:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:30.506 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:30.506 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.019515849000001, 2024-04-26T12:40:30.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006983324, 2024-04-26T12:40:30.506 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421622+0000", 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.841e-06 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423279+0000", 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016575139999999999 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423304+0000", 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5198000000000002e-05 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423318+0000", 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.328e-05 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423400+0000", 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2729e-05 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423428+0000", 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7222000000000001e-05 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428553+0000", 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051254450000000002 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428603+0000", 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0095000000000001e-05 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2418 3.25 e73/41 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:30.510 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.987403607000001, 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079618780000000004, 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:30.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453733+0000", 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3200000000000004e-07 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455472+0000", 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017391749999999999 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455495+0000", 2024-04-26T12:40:30.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2625000000000001e-05 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455509+0000", 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4056999999999999e-05 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455587+0000", 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8577000000000003e-05 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455619+0000", 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1443999999999999e-05 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461659+0000", 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060406499999999998 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461694+0000", 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4618e-05 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2419 3.4 e73/17 3:21b3cbd4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_228:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.976794849000001, 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074141069999999996, 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464342+0000", 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.142e-06 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466601+0000", 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022590190000000001 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466619+0000", 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8337000000000001e-05 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466628+0000", 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0089999999999996e-06 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466687+0000", 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8368000000000001e-05 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466712+0000", 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4836000000000001e-05 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471699+0000", 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049870019999999999 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471755+0000", 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6394000000000003e-05 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2426 3.f 3:f3fcc542:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.907440643000001, 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017310012999999999, 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.519 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2426 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:30.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533698+0000", 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8389999999999998e-06 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535314+0000", 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016156949999999999 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535339+0000", 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5117e-05 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535349+0000", 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0569e-05 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535414+0000", 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5080999999999996e-05 2024-04-26T12:40:30.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535529+0000", 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114302 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535625+0000", 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6210000000000002e-05 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.542763+0000", 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071382149999999998 2024-04-26T12:40:30.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550914+0000", 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081504420000000008 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550953+0000", 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9597000000000001e-05 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.551005+0000", 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1946e-05 2024-04-26T12:40:30.524 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2429 3.4 e73/17 3:208decb8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_238:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.876842104000001, 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072608780000000001, 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.525 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564295+0000", 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566152+0000", 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001856871 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566180+0000", 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7338000000000002e-05 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566195+0000", 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5807999999999998e-05 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566279+0000", 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3462999999999997e-05 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566307+0000", 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7977999999999999e-05 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571500+0000", 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051927199999999996 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571555+0000", 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4987000000000001e-05 2024-04-26T12:40:30.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2432 3.4 e73/17 3:22adec7f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_241:head v 73'4, mlcod=73'2)", 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.844870343, 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072901049999999998, 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596267+0000", 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9870000000000002e-06 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597800+0000", 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015329530000000001 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597825+0000", 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4675e-05 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597838+0000", 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3335e-05 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597925+0000", 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6865000000000003e-05 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597966+0000", 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0417000000000003e-05 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603515+0000", 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055488730000000002 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603556+0000", 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1e-05 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2435 3.2d e73/17 3:b50706f2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_244:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.804867778999999, 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010411692, 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:30.534 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:30.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636271+0000", 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640883+0000", 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046121540000000003 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640921+0000", 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8676e-05 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:30.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640940+0000", 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8991000000000002e-05 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641044+0000", 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010401899999999999 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641074+0000", 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0037999999999999e-05 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646616+0000", 2024-04-26T12:40:30.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055411619999999997 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646680+0000", 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4083000000000003e-05 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:30.538 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:30.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:30.540 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:30.538+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:30.641 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:30.642+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:30.704 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:30.704 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:30.704 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:30.705 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:30.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:30.761 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:30.762+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:30.843 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:30.840+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:30.869 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:40:30.885 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:30.885 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:30.886 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:30.886 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:30.886 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:30.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:30.945 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:30.946+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:31.045 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:31.044+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:31.057 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:31.057 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:31.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:31.057 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:31.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.057 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1326 3.33 3:cd5db5f2:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.214149911, 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016038528, 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1326 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842595+0000", 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9420000000000002e-06 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843194+0000", 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059943799999999999 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843214+0000", 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9970999999999999e-05 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843223+0000", 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0040000000000005e-06 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843310+0000", 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6973999999999998e-05 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843418+0000", 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010787 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843511+0000", 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3305000000000002e-05 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.846677+0000", 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031658749999999999 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858525+0000", 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011848348 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858582+0000", 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6119000000000003e-05 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858631+0000", 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2320 3.27 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:31.063 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.667250201999998, 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020624966000000002, 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2320 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:31.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389495+0000", 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390861+0000", 2024-04-26T12:40:31.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013652849999999999 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390898+0000", 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6789000000000003e-05 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390908+0000", 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.065e-05 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390983+0000", 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391089+0000", 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105752 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391177+0000", 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7596999999999995e-05 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.395646+0000", 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044690889999999999 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410024+0000", 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014378050999999999 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410065+0000", 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1056000000000001e-05 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410117+0000", 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2485000000000003e-05 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2325 3.2 3:40f43f1f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.617898297, 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013366813, 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.069 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2325 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438847+0000", 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7769999999999998e-06 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440481+0000", 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001633731 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440511+0000", 2024-04-26T12:40:31.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0247999999999999e-05 2024-04-26T12:40:31.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440523+0000", 2024-04-26T12:40:31.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1861999999999999e-05 2024-04-26T12:40:31.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440605+0000", 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2392000000000007e-05 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440774+0000", 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168985 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440934+0000", 2024-04-26T12:40:31.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159908 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.445923+0000", 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049891900000000001 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452114+0000", 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006190887 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452168+0000", 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3749999999999999e-05 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452211+0000", 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3083000000000001e-05 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2329 3.38 3:1f4c78ed:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.577920893000002, 2024-04-26T12:40:31.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015527136, 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2329 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478825+0000", 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8959999999999999e-06 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480286+0000", 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001461644 2024-04-26T12:40:31.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480319+0000", 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2527000000000002e-05 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480334+0000", 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.519e-05 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480420+0000", 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5643999999999995e-05 2024-04-26T12:40:31.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480572+0000", 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000152237 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480724+0000", 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015249 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.484967+0000", 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042430879999999999 2024-04-26T12:40:31.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494254+0000", 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092865980000000001 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494295+0000", 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0503000000000002e-05 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494349+0000", 2024-04-26T12:40:31.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4318999999999999e-05 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2330 3.27 3:e503c54d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.568074751000001, 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014172947999999999, 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.081 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2330 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488670+0000", 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.751e-06 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.489978+0000", 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013084850000000001 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490008+0000", 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9967999999999998e-05 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490021+0000", 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2745000000000001e-05 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490094+0000", 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2849999999999995e-05 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490217+0000", 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012377300000000001 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490323+0000", 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105132 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494969+0000", 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046460959999999997 2024-04-26T12:40:31.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502769+0000", 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078001370000000004 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502810+0000", 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1412000000000003e-05 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502841+0000", 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0599000000000003e-05 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2338 3.2 3:40db620f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.486058848999999, 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017810332000000002, 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.087 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2338 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570686+0000", 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1229999999999998e-06 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572072+0000", 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001386125 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572105+0000", 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3492999999999999e-05 2024-04-26T12:40:31.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572116+0000", 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0627e-05 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572187+0000", 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0531999999999995e-05 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572308+0000", 2024-04-26T12:40:31.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012157700000000001 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572414+0000", 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105889 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576935+0000", 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045206049999999996 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588421+0000", 2024-04-26T12:40:31.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011486111 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588462+0000", 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1270000000000003e-05 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588494+0000", 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1980000000000002e-05 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2348 3.29 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.364369798999999, 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019384129999999999, 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.093 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2348 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692376+0000", 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2320000000000001e-06 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.693975+0000", 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001598808 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694006+0000", 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1606000000000002e-05 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694021+0000", 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4783999999999999e-05 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694117+0000", 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5851000000000001e-05 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694259+0000", 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014201099999999999 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694400+0000", 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014122200000000001 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.698538+0000", 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041381170000000002 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711595+0000", 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013056636 2024-04-26T12:40:31.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711687+0000", 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1630000000000002e-05 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711757+0000", 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0233000000000003e-05 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.098 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2356 3.7 3:e10f5880:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.279373962000001, 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015864989999999999, 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2356 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777372+0000", 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8890000000000002e-06 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779070+0000", 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001698764 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779096+0000", 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5959e-05 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779107+0000", 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779183+0000", 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5788e-05 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779320+0000", 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137269 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779408+0000", 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7560999999999997e-05 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.783717+0000", 2024-04-26T12:40:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043093230000000003 2024-04-26T12:40:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793104+0000", 2024-04-26T12:40:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009387411 2024-04-26T12:40:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793178+0000", 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3843000000000004e-05 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793234+0000", 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5386000000000001e-05 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.104 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2372 3.1e 3:788eb98e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.105818007, 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019326650000000001, 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2372 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950927+0000", 2024-04-26T12:40:31.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4310000000000001e-06 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953107+0000", 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021800080000000002 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953135+0000", 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7529999999999999e-05 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953149+0000", 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4171e-05 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953240+0000", 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983999999999995e-05 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953413+0000", 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017362399999999999 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:31.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953577+0000", 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000163864 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.959646+0000", 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060690620000000001 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970130+0000", 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010484228999999999 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970199+0000", 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8866000000000001e-05 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970251+0000", 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1881e-05 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2374 3.38 3:1c1a4d28:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.110 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.084095801, 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020357772999999999, 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2374 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972649+0000", 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974485+0000", 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018357899999999999 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974516+0000", 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1142000000000001e-05 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974531+0000", 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.455e-05 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974627+0000", 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6543e-05 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974833+0000", 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020613700000000001 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.975018+0000", 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000184267 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.981099+0000", 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00608093 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011762869 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992942+0000", 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0517000000000002e-05 2024-04-26T12:40:31.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.993005+0000", 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2648000000000001e-05 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2376 3.5 e73/17 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.058481692000001, 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011508294000000001, 2024-04-26T12:40:31.116 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998273+0000", 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1647999999999999e-05 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002533+0000", 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042605840000000004 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002562+0000", 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9343999999999999e-05 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002577+0000", 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4592e-05 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002663+0000", 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6013000000000005e-05 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002694+0000", 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0817e-05 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009691+0000", 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0069972710000000002 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009769+0000", 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8024999999999999e-05 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2382 3.3c e73/17 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.997859638000001, 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016599513, 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058885+0000", 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.062970+0000", 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040850720000000004 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063005+0000", 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5342999999999997e-05 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063021+0000", 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6019e-05 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063152+0000", 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013094699999999999 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063181+0000", 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8561999999999999e-05 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075419+0000", 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012238667 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075482+0000", 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3229000000000001e-05 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2388 3.2 3:404073be:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.940217475000001, 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019415504, 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.125 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2388 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116528+0000", 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118771+0000", 2024-04-26T12:40:31.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002243091 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118792+0000", 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0990000000000001e-05 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118802+0000", 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0086e-05 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118912+0000", 2024-04-26T12:40:31.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109497 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119038+0000", 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126198 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119125+0000", 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7186000000000002e-05 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.123050+0000", 2024-04-26T12:40:31.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039251169999999997 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135829+0000", 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012779209 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135892+0000", 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2728e-05 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135941+0000", 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8485000000000001e-05 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2389 3.2 3:427feba5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.928586853999999, 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019131569000000001, 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2389 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:31.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128159+0000", 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.864e-06 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130062+0000", 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019030500000000001 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130088+0000", 2024-04-26T12:40:31.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5890000000000001e-05 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130098+0000", 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0263e-05 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130167+0000", 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9643999999999999e-05 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130306+0000", 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013836499999999999 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130397+0000", 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1003999999999998e-05 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135001+0000", 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004604403 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147180+0000", 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012178362 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147227+0000", 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6981000000000003e-05 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147287+0000", 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0742999999999998e-05 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.806922114999999, 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:40:31.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:40:31.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2407 3.33 3:ce0fe289:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.142 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.739508935, 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018708978000000001, 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2407 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317236+0000", 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7539999999999998e-06 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318627+0000", 2024-04-26T12:40:31.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013905600000000001 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318660+0000", 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3042e-05 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318676+0000", 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5775999999999999e-05 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318777+0000", 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101152 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318986+0000", 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000208648 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.319165+0000", 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017941699999999999 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.324600+0000", 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054352430000000002 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335812+0000", 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011211308999999999 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335886+0000", 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4263000000000004e-05 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335943+0000", 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6814000000000002e-05 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2409 3.1e 3:7ac1137c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.71348261, 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017629292000000001, 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.148 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2409 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343262+0000", 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9549999999999999e-06 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345627+0000", 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023648459999999999 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345658+0000", 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1154e-05 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345675+0000", 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7456e-05 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345800+0000", 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012460300000000001 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346033+0000", 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023336599999999999 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346192+0000", 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015833500000000001 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.352130+0000", 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059381190000000004 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360741+0000", 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0086116479999999995 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360811+0000", 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9342000000000001e-05 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360889+0000", 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8467999999999995e-05 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.153 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2417 3.8 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.616869488999999, 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012677982000000001, 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.154 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2417 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439876+0000", 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441807+0000", 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001931239 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441829+0000", 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1883999999999999e-05 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441839+0000", 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0084999999999999e-05 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441928+0000", 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8608000000000003e-05 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442072+0000", 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144053 2024-04-26T12:40:31.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442170+0000", 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7921e-05 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.449581+0000", 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074107469999999996 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452422+0000", 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028413570000000001 2024-04-26T12:40:31.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452496+0000", 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3857999999999997e-05 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452551+0000", 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5299e-05 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.572259323000001, 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:40:31.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:31.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2423 3.b 3:d15dbab2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:31.165 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.552741987000001, 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012126067000000001, 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2423 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:31.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504003+0000", 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.452e-06 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506649+0000", 2024-04-26T12:40:31.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026461879999999998 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506674+0000", 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4689e-05 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506686+0000", 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1595e-05 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506759+0000", 2024-04-26T12:40:31.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658000000000005e-05 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506933+0000", 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017354100000000001 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.507051+0000", 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118578 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.513156+0000", 2024-04-26T12:40:31.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0061047319999999999 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515986+0000", 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028303199999999999 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516064+0000", 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7466999999999995e-05 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516127+0000", 2024-04-26T12:40:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2847000000000003e-05 2024-04-26T12:40:31.171 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.171 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.171 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.171 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:31.171 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:31.171 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:31.172 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:31.173 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:31.168+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:31.274 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:31.272+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:31.303 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:31.303 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:31.303 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:31.303 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:31.317 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:31.405 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:31.404+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:31.476 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:31.474+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:31.485 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:31.485 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:31.486 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:31.486 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:31.486 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:31.500 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:31.585 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:31.584+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:31.669 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:31.669 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:31.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:31.669 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:31.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.670 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1601 3.1d e67/17 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:31.670 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:31.670 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 31.938025065000001, 2024-04-26T12:40:31.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021057349999999999, 2024-04-26T12:40:31.670 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.670 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.670 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727484+0000", 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733321+0000", 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005836351 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733360+0000", 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9648999999999999e-05 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733383+0000", 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2722999999999999e-05 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733504+0000", 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012115199999999999 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733558+0000", 2024-04-26T12:40:31.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3511999999999999e-05 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748395+0000", 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014836937 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748539+0000", 2024-04-26T12:40:31.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144356 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2320 3.27 e72/17 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head v 72'3, mlcod=67'1)", 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.275001205999999, 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017587200000000001, 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2799999999999995e-07 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396488+0000", 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059817680000000002 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396509+0000", 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0888999999999999e-05 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396520+0000", 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0708e-05 2024-04-26T12:40:31.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396619+0000", 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9263000000000002e-05 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396654+0000", 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5125e-05 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408029+0000", 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011374815 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408093+0000", 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3804000000000001e-05 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2337 3.1b e72/17 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.106718785000002, 2024-04-26T12:40:31.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015714998000000001, 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558789+0000", 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4780000000000001e-06 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563525+0000", 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047351470000000003 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563558+0000", 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3284999999999997e-05 2024-04-26T12:40:31.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563574+0000", 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.573e-05 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563664+0000", 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0006000000000005e-05 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563690+0000", 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6619999999999999e-05 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574423+0000", 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010732396 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574503+0000", 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0335999999999998e-05 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2347 3.a e72/17 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head v 72'3, mlcod=71'1)", 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.980146988000001, 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019978432000000001, 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685363+0000", 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688265+0000", 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029017240000000001 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688336+0000", 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1422999999999997e-05 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688364+0000", 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7234999999999999e-05 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688534+0000", 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017049599999999999 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688604+0000", 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0016000000000002e-05 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705182+0000", 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016577543 2024-04-26T12:40:31.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705338+0000", 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156479 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2348 3.29 e72/17 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.972535651000001, 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016659368000000001, 2024-04-26T12:40:31.688 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692973+0000", 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2199999999999999e-06 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699798+0000", 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0068248750000000002 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699829+0000", 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:40:31.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699845+0000", 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6132000000000001e-05 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699973+0000", 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012803099999999999 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700015+0000", 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2052000000000003e-05 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709497+0000", 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094813919999999999 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709631+0000", 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013391299999999999 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.692 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2351 3.14 e72/31 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head v 72'4, mlcod=72'2)", 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.932421389000002, 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018622024000000001, 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733088+0000", 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.48e-06 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735690+0000", 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026018040000000001 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735724+0000", 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4585999999999997e-05 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735743+0000", 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8309e-05 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735878+0000", 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013522999999999999 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735919+0000", 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1223000000000002e-05 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751443+0000", 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015524247999999999 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751707+0000", 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026414400000000001 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2352 3.31 e73/17 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.929177849999999, 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017289571, 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736330+0000", 2024-04-26T12:40:31.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0100000000000001e-06 2024-04-26T12:40:31.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740605+0000", 2024-04-26T12:40:31.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042746169999999997 2024-04-26T12:40:31.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740643+0000", 2024-04-26T12:40:31.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8776000000000003e-05 2024-04-26T12:40:31.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740669+0000", 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5499000000000001e-05 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740805+0000", 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013579099999999999 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740847+0000", 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2642000000000003e-05 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753498+0000", 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012651172 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753619+0000", 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012006399999999999 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.702 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.697516161999999, 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:40:31.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:40:31.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:40:31.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:40:31.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.707 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2375 3.1c e73/17 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.678583666000002, 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018742169999999999, 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.708 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986925+0000", 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0439999999999998e-06 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992153+0000", 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005227644 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992186+0000", 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3256000000000001e-05 2024-04-26T12:40:31.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992210+0000", 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4249000000000001e-05 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992375+0000", 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016447 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992438+0000", 2024-04-26T12:40:31.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3318999999999995e-05 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005540+0000", 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013101550999999999 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005665+0000", 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000125637 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.712 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2378 3.1d e73/17 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.649783380999999, 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015708637000000001, 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:31.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:31.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015726+0000", 2024-04-26T12:40:31.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4030000000000001e-06 2024-04-26T12:40:31.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018549+0000", 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028231969999999999 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018590+0000", 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0995000000000003e-05 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018609+0000", 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8850000000000001e-05 2024-04-26T12:40:31.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018752+0000", 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143633 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018793+0000", 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0496e-05 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031304+0000", 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012510795999999999 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031432+0000", 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128267 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.719 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2396 3.31 e73/17 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:31.719 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:31.719 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.452689886000002, 2024-04-26T12:40:31.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015460707000000001, 2024-04-26T12:40:31.719 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.719 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.719 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.719 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212819+0000", 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.497e-06 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216796+0000", 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039765190000000004 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216829+0000", 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2712000000000001e-05 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216845+0000", 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6464e-05 2024-04-26T12:40:31.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217025+0000", 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000179989 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217090+0000", 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5087999999999998e-05 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228134+0000", 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011044185 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228278+0000", 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014325300000000001 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.420831491000001, 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:40:31.728 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2400 3.27 e73/17 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.415104510999999, 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020886715, 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.729 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250405+0000", 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254952+0000", 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045466930000000001 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254991+0000", 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9298999999999998e-05 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255014+0000", 2024-04-26T12:40:31.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2711999999999999e-05 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255166+0000", 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015193699999999999 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255207+0000", 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1436000000000001e-05 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271130+0000", 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015923262000000001 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271289+0000", 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015862600000000001 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2402 3.11 e73/17 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:31.733 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.392847551999999, 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018233177, 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272662+0000", 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.157e-06 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276695+0000", 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040329739999999999 2024-04-26T12:40:31.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276735+0000", 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9338999999999997e-05 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276760+0000", 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4893e-05 2024-04-26T12:40:31.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276943+0000", 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000183489 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277008+0000", 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4704999999999998e-05 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290772+0000", 2024-04-26T12:40:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013764406999999999 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290892+0000", 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120213 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2403 3.3 e73/31 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:31.738 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.387357101999999, 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016271938, 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:31.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278151+0000", 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4e-07 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282860+0000", 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047094179999999999 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282891+0000", 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0562999999999999e-05 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282909+0000", 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7995999999999998e-05 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283056+0000", 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014763299999999999 2024-04-26T12:40:31.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283099+0000", 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3139000000000002e-05 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294299+0000", 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011200185 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294422+0000", 2024-04-26T12:40:31.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012216399999999999 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2406 3.9 e73/31 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head v 73'3, mlcod=67'1)", 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.358576321000001, 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016385118000000001, 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306931+0000", 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3300000000000001e-07 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312959+0000", 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060277100000000004 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312990+0000", 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0786e-05 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313005+0000", 2024-04-26T12:40:31.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5373e-05 2024-04-26T12:40:31.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313149+0000", 2024-04-26T12:40:31.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014355999999999999 2024-04-26T12:40:31.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.747 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313191+0000", 2024-04-26T12:40:31.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1928999999999998e-05 2024-04-26T12:40:31.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323173+0000", 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099826700000000008 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323316+0000", 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014235699999999999 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.748 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2411 3.31 e73/17 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head v 73'10, mlcod=73'8)", 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.295260720000002, 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015408975, 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370249+0000", 2024-04-26T12:40:31.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3869999999999999e-06 2024-04-26T12:40:31.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375387+0000", 2024-04-26T12:40:31.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051375539999999999 2024-04-26T12:40:31.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375425+0000", 2024-04-26T12:40:31.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8186000000000003e-05 2024-04-26T12:40:31.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375449+0000", 2024-04-26T12:40:31.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3620000000000001e-05 2024-04-26T12:40:31.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375622+0000", 2024-04-26T12:40:31.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017309500000000001 2024-04-26T12:40:31.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375673+0000", 2024-04-26T12:40:31.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0849000000000001e-05 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385561+0000", 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098879090000000003 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385655+0000", 2024-04-26T12:40:31.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4375000000000004e-05 2024-04-26T12:40:31.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.756 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.756 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2421 3.27 e73/17 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:31.756 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:31.756 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.180343378, 2024-04-26T12:40:31.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018694483000000001, 2024-04-26T12:40:31.757 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.757 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.757 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.757 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485166+0000", 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4660000000000002e-06 2024-04-26T12:40:31.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490411+0000", 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052454119999999996 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490447+0000", 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6106000000000003e-05 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490466+0000", 2024-04-26T12:40:31.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8329999999999999e-05 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490659+0000", 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019286800000000001 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490703+0000", 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4725999999999998e-05 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503764+0000", 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013060251 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503858+0000", 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4324e-05 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.762 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2428 3.1a e73/31 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:31.762 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:31.762 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.112433876000001, 2024-04-26T12:40:31.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015568897, 2024-04-26T12:40:31.762 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.762 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.762 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.762 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553076+0000", 2024-04-26T12:40:31.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.01e-06 2024-04-26T12:40:31.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557315+0000", 2024-04-26T12:40:31.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042394160000000002 2024-04-26T12:40:31.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557363+0000", 2024-04-26T12:40:31.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7271999999999997e-05 2024-04-26T12:40:31.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557388+0000", 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5249000000000002e-05 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557559+0000", 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000171039 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557621+0000", 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1999000000000001e-05 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568551+0000", 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010930415000000001 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568642+0000", 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0496999999999998e-05 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.767 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2431 3.31 e73/17 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head v 73'11, mlcod=73'9)", 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.081727530999999, 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01575095, 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:31.768 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583783+0000", 2024-04-26T12:40:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4960000000000001e-06 2024-04-26T12:40:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589105+0000", 2024-04-26T12:40:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053218140000000002 2024-04-26T12:40:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589142+0000", 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7149e-05 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589159+0000", 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.774e-05 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:31.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589317+0000", 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000157589 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589380+0000", 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2708999999999999e-05 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599423+0000", 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010042882 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:31.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:31.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599530+0000", 2024-04-26T12:40:31.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107571 2024-04-26T12:40:31.773 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.773 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.773 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.773 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:31.773 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:31.773 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:31.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:31.775 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:31.774+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:31.845 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:40:31.875 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:31.872+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:31.946 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:31.946 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:31.946 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:31.946 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:31.960 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:31.977 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:31.978+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:32.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:32.113 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:32.114+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:32.128 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:32.128 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:32.128 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:32.128 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:32.128 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:32.144 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:32.189 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:32.188+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:32.223 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:32.223 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:32.239 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:32.258 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:32.258 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:32.269 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1328 3.1f e67/17 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 34.4012733, 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019374358000000001, 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.270 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:32.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.28e-07 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867669+0000", 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004831915 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867686+0000", 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6895999999999999e-05 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867695+0000", 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867801+0000", 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010592200000000001 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867837+0000", 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6032000000000003e-05 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882087+0000", 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014249265000000001 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882212+0000", 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012479900000000001 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.274 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1457 3.22 3:46753612:::d749f084-3851-4e95-9492-490675b43f90.4382.3__shadow_.89eL0OTfRIkm8jjkAhjXzYFORkpc2AZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.662895734000003, 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021050049000000001, 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1457 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601217+0000", 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.509e-06 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607652+0000", 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064351900000000004 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607693+0000", 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0868999999999998e-05 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607712+0000", 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8702000000000002e-05 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607889+0000", 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000177061 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608263+0000", 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037431500000000001 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608646+0000", 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038215100000000001 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.620501+0000", 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011855625 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622083+0000", 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001581556 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622195+0000", 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112667 2024-04-26T12:40:32.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622265+0000", 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9404000000000002e-05 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1601 3.1d 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.543392863999998, 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028382847999999999, 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.280 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1601 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720720+0000", 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3300000000000001e-06 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726577+0000", 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005857307 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726616+0000", 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9224999999999998e-05 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726640+0000", 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3873e-05 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726810+0000", 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016950799999999999 2024-04-26T12:40:32.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727033+0000", 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022316600000000001 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727242+0000", 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020876 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748847+0000", 2024-04-26T12:40:32.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021605347 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748917+0000", 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9413999999999996e-05 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749020+0000", 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103383 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749100+0000", 2024-04-26T12:40:32.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0535000000000001e-05 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1602 3.28 3:15f7ca78:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.537417648000002, 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021360100999999999, 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.286 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1602 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726695+0000", 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1900000000000002e-06 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729949+0000", 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032543730000000001 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729991+0000", 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1403000000000003e-05 2024-04-26T12:40:32.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730016+0000", 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5709000000000001e-05 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730228+0000", 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021134999999999999 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730651+0000", 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042305000000000001 2024-04-26T12:40:32.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.731097+0000", 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044566700000000001 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.740379+0000", 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092821050000000006 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747886+0000", 2024-04-26T12:40:32.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007507555 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747980+0000", 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3727000000000006e-05 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748053+0000", 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2972000000000005e-05 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2322 3.1c 3:3aeebad8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.857268654999999, 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017554513000000001, 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2322 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406844+0000", 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2050000000000001e-06 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412062+0000", 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052182130000000002 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412097+0000", 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5086000000000003e-05 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412118+0000", 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0299999999999999e-05 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412207+0000", 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9482999999999997e-05 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412358+0000", 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000150483 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412463+0000", 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000104956 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.423146+0000", 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01068347 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424315+0000", 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011691799999999999 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424359+0000", 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4212000000000003e-05 2024-04-26T12:40:32.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424396+0000", 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6925000000000003e-05 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2357 3.2a 3:5615e7fe:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.477786605999999, 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019796023999999999, 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.297 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2357 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786327+0000", 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.49e-06 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790818+0000", 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044903690000000001 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790860+0000", 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1851999999999998e-05 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790879+0000", 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9551999999999998e-05 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791003+0000", 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012405399999999999 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791242+0000", 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238495 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791453+0000", 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000211005 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.801975+0000", 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010522658000000001 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.805976+0000", 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040003449999999998 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806054+0000", 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8757999999999994e-05 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806120+0000", 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5445999999999996e-05 2024-04-26T12:40:32.302 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2358 3.c 3:30528342:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.465896449999999, 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017961708999999999, 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.303 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2358 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798217+0000", 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4120000000000001e-06 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802700+0000", 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044824900000000004 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802739+0000", 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9181999999999999e-05 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802766+0000", 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6682e-05 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802894+0000", 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128102 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.803151+0000", 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025679700000000001 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.803409+0000", 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025825099999999998 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.812254+0000", 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0088452759999999991 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.815918+0000", 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0036635259999999998 2024-04-26T12:40:32.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.816068+0000", 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000150777 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.816176+0000", 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010721399999999999 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2367 3.2a 3:55ec8106:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.366164888, 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020327305, 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2367 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.309 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897949+0000", 2024-04-26T12:40:32.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4489999999999999e-06 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902370+0000", 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044209369999999998 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902408+0000", 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8541999999999998e-05 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902428+0000", 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9040000000000001e-05 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902607+0000", 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017954599999999999 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903016+0000", 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040908999999999997 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903422+0000", 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040581100000000001 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.917186+0000", 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013763861 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918102+0000", 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091656300000000001 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918200+0000", 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7906999999999996e-05 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918273+0000", 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2558999999999994e-05 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2375 3.1c 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.284431198, 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026708701000000001, 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2375 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.315 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979683+0000", 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8759999999999998e-06 2024-04-26T12:40:32.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985829+0000", 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061460810000000003 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985877+0000", 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7812000000000002e-05 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985907+0000", 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9713000000000002e-05 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986054+0000", 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014770300000000001 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986363+0000", 2024-04-26T12:40:32.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030863899999999998 2024-04-26T12:40:32.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:32.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986696+0000", 2024-04-26T12:40:32.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033299000000000002 2024-04-26T12:40:32.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.997022+0000", 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010325732000000001 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006148+0000", 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091265240000000004 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006280+0000", 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013179399999999999 2024-04-26T12:40:32.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006388+0000", 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107837 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2376 3.5 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.275124829999999, 2024-04-26T12:40:32.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020175694000000001, 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2376 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988989+0000", 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5769999999999998e-06 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995521+0000", 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006531635 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995571+0000", 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9738999999999999e-05 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995601+0000", 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995729+0000", 2024-04-26T12:40:32.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012808399999999999 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996014+0000", 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028456400000000001 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996264+0000", 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025048699999999998 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006170+0000", 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099054369999999996 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009021+0000", 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028506730000000002 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009103+0000", 2024-04-26T12:40:32.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2908e-05 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009161+0000", 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7855000000000001e-05 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.328 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2378 3.1d 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.329 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:32.329 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.253663036999999, 2024-04-26T12:40:32.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023192784000000001, 2024-04-26T12:40:32.329 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.329 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.329 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.329 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.329 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.329 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2378 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010450+0000", 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5239999999999999e-06 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014852+0000", 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044019619999999997 2024-04-26T12:40:32.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014884+0000", 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2323000000000002e-05 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014900+0000", 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5651999999999999e-05 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015044+0000", 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014389700000000001 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015292+0000", 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024860399999999998 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015521+0000", 2024-04-26T12:40:32.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022877100000000001 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031237+0000", 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015715600999999999 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033338+0000", 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021008699999999999 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033518+0000", 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180089 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033640+0000", 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012249099999999999 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.335 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2380 3.c 3:32d641af:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.232763316, 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019849939, 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2380 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031352+0000", 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5399999999999997e-06 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039154+0000", 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007802135 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039191+0000", 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7240000000000003e-05 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039210+0000", 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9236e-05 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039358+0000", 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147866 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039611+0000", 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000253298 2024-04-26T12:40:32.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039846+0000", 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023419399999999999 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.049633+0000", 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097878089999999997 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.050899+0000", 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001265455 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051067+0000", 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016852600000000001 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051197+0000", 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012964000000000001 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2382 3.3c 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.212558766000001, 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023553801999999999, 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.342 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2382 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051554+0000", 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.706e-06 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.055983+0000", 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044283889999999996 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056027+0000", 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4518999999999998e-05 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056052+0000", 2024-04-26T12:40:32.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4675999999999999e-05 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056206+0000", 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015424199999999999 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056594+0000", 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038824299999999998 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056974+0000", 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000379751 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068770+0000", 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011795386999999999 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074792+0000", 2024-04-26T12:40:32.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060226439999999997 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074974+0000", 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000181282 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.075105+0000", 2024-04-26T12:40:32.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131963 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2387 3.28 3:1657e0bf:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.161294634000001, 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018313085, 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.349 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2387 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102819+0000", 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107254+0000", 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044347290000000001 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107287+0000", 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2753000000000003e-05 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107302+0000", 2024-04-26T12:40:32.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5302999999999999e-05 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107463+0000", 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161531 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107863+0000", 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039991799999999997 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.108294+0000", 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043064600000000002 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.118549+0000", 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010255083 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.120957+0000", 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024081990000000002 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121053+0000", 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6070999999999995e-05 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121129+0000", 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5574999999999994e-05 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2392 3.30 3:0e664f76:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.101824871000002, 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020233060000000001, 2024-04-26T12:40:32.356 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2392 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:32.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162289+0000", 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:32.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166843+0000", 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045541959999999999 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166886+0000", 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2908999999999999e-05 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166917+0000", 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0741999999999998e-05 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167061+0000", 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143771 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167317+0000", 2024-04-26T12:40:32.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000256493 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167549+0000", 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023142099999999999 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.176299+0000", 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0087508729999999993 2024-04-26T12:40:32.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182351+0000", 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060514330000000002 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182446+0000", 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5531000000000004e-05 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182519+0000", 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2175000000000006e-05 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2399 3.1d 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.024922878000002, 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029752193999999999, 2024-04-26T12:40:32.363 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2399 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239192+0000", 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1829999999999996e-06 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243681+0000", 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044893629999999997 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243722+0000", 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0639000000000002e-05 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243743+0000", 2024-04-26T12:40:32.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0760000000000001e-05 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243882+0000", 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013962600000000001 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244142+0000", 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025946699999999999 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244378+0000", 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000236839 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254731+0000", 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010353004000000001 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268598+0000", 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013866431 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268779+0000", 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018066499999999999 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268940+0000", 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016121700000000001 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.369 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2401 3.2a 3:54e389fa:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.005772959000002, 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018846505999999999, 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.370 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2401 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258341+0000", 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1559999999999999e-06 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262849+0000", 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045083329999999998 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262889+0000", 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9903000000000001e-05 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262907+0000", 2024-04-26T12:40:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8179e-05 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263036+0000", 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012896000000000001 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263291+0000", 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025503100000000002 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263523+0000", 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023191100000000001 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.275751+0000", 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012228517 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276977+0000", 2024-04-26T12:40:32.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012251580000000001 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277070+0000", 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3718e-05 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277184+0000", 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011364 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.376 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2405 3.22 3:45892c0a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.969420424999999, 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017862690000000001, 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2405 2024-04-26T12:40:32.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294694+0000", 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9929999999999997e-06 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299557+0000", 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048627050000000002 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299594+0000", 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6996000000000003e-05 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299612+0000", 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8695999999999999e-05 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299745+0000", 2024-04-26T12:40:32.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013255 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299991+0000", 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000246481 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.300210+0000", 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218588 2024-04-26T12:40:32.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.309919+0000", 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097093330000000005 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312225+0000", 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002306125 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312421+0000", 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019588599999999999 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312553+0000", 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013133700000000001 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2410 3.16 3:697fa4a2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.906489084, 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019793999999999999, 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.384 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2410 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357625+0000", 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8630000000000001e-06 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362361+0000", 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004736011 2024-04-26T12:40:32.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362400+0000", 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8719e-05 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362418+0000", 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8366e-05 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362541+0000", 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012312400000000001 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362785+0000", 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000243837 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.363004+0000", 2024-04-26T12:40:32.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218629 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.376177+0000", 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173239999999999 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377237+0000", 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001059862 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377335+0000", 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8171000000000006e-05 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377415+0000", 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0178000000000004e-05 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2425 3.5 3:a11dc694:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.740989906999999, 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018795115000000001, 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2425 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.391 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:32.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523123+0000", 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528942+0000", 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058186920000000003 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528985+0000", 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2951999999999998e-05 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529011+0000", 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6190000000000002e-05 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529142+0000", 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013053000000000001 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:32.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529415+0000", 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027316299999999999 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529659+0000", 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024458800000000001 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.538947+0000", 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092877199999999993 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541743+0000", 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002795723 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541840+0000", 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7261000000000003e-05 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541916+0000", 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5562000000000006e-05 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.396 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:32.397 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:32.397 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:32.398 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:32.398 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:32.399 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:32.399 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:32.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:32.400 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:32.396+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:32.400 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:32.401 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:32.401 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:32.401 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:32.402 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:32.499 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:32.498+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:32.570 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:32.571 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:32.584 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:32.633 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:32.632+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:32.701 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:32.700+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:32.708 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:32.709 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:32.723 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:32.809 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:32.808+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:32.891 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:32.891 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:32.903 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:32.900+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:32.905 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:33.004 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:33.002+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:33.074 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:33.074 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:33.088 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:33.104 INFO:tasks.workunit.client.0.smithi016.stderr:200+0 records in 2024-04-26T12:40:33.104 INFO:tasks.workunit.client.0.smithi016.stderr:200+0 records out 2024-04-26T12:40:33.104 INFO:tasks.workunit.client.0.smithi016.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 19.8198 s, 106 MB/s 2024-04-26T12:40:33.104 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:33.102+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:33.205 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:33.206+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:33.211 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:33.212 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:33.228 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:33.272 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_40_33 2024-04-26T12:40:33.305 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:33.304+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:33.352 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:33.352 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:33.369 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:33.413 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:33.414+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:33.486 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:33.487 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:33.502 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:33.545 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:33.546+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:33.568 INFO:tasks.workunit.client.0.smithi016.stdout:bucket quota max size set for the given user: buck_2024_03_26_12_40_33 2024-04-26T12:40:33.645 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:33.646+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:33.664 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:33.664 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:33.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:33.747 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:33.744+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:33.833 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:33.834 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:33.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:33.848 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:33.844+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:33.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:40:33.948 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:33.948+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:33.968 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:33.968 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:33.982 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:34.049 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:34.050+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:34.099 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:34.099 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:34.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:34.157 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:34.158+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:34.237 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:40:34.251 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:34.248+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:34.273 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:34.273 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:34.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:34.373 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:34.374+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:34.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:34.442 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:34.442 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:34.452 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:34.450+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:34.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:34.549 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:34.549 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:34.553 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:34.552+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:34.566 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:34.566 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:34.583 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:34.583 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:34.599 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:34.599 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:34.620 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:34.620 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:34.633 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:34.634 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:34.634 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:34.634 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:34.634 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:34.641 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:34.641 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:34.648 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:34.654 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:34.652+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:34.662 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:34.663 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:34.683 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:34.683 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:34.755 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:34.754+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:34.764 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:34.764 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:34.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:34.764 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:34.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.764 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1544 4.d 4:b0f5eef4:::.dir.d749f084-3851-4e95-9492-490675b43f90.4382.3.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:34.765 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:34.765 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 35.773384352999997, 2024-04-26T12:40:34.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078556990000000007, 2024-04-26T12:40:34.765 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.765 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.765 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.765 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:34.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:34.766 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:34.766 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1544 2024-04-26T12:40:34.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.766 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:34.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.767 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.767 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989711+0000", 2024-04-26T12:40:34.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989713+0000", 2024-04-26T12:40:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:40:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989720+0000", 2024-04-26T12:40:34.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1439999999999997e-06 2024-04-26T12:40:34.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989735+0000", 2024-04-26T12:40:34.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4318000000000001e-05 2024-04-26T12:40:34.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989743+0000", 2024-04-26T12:40:34.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3520000000000007e-06 2024-04-26T12:40:34.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989816+0000", 2024-04-26T12:40:34.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2733999999999999e-05 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989896+0000", 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0635000000000003e-05 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.989995+0000", 2024-04-26T12:40:34.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8276999999999994e-05 2024-04-26T12:40:34.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:34.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.990617+0000", 2024-04-26T12:40:34.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00062210300000000004 2024-04-26T12:40:34.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:34.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997488+0000", 2024-04-26T12:40:34.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068714170000000003 2024-04-26T12:40:34.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997521+0000", 2024-04-26T12:40:34.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3120999999999997e-05 2024-04-26T12:40:34.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:58.997567+0000", 2024-04-26T12:40:34.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5259000000000002e-05 2024-04-26T12:40:34.775 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.776 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.776 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.776 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2323 3.3a 3:5f8d6128:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:34.776 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:34.777 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.344854507000001, 2024-04-26T12:40:34.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0089459429999999996, 2024-04-26T12:40:34.777 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.777 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.777 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.777 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:34.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:34.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:34.778 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2323 2024-04-26T12:40:34.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.778 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:34.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418241+0000", 2024-04-26T12:40:34.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.418243+0000", 2024-04-26T12:40:34.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:40:34.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419683+0000", 2024-04-26T12:40:34.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014398810000000001 2024-04-26T12:40:34.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419708+0000", 2024-04-26T12:40:34.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4734000000000001e-05 2024-04-26T12:40:34.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419718+0000", 2024-04-26T12:40:34.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9450000000000005e-06 2024-04-26T12:40:34.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419801+0000", 2024-04-26T12:40:34.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3323000000000002e-05 2024-04-26T12:40:34.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.419969+0000", 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168064 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.420113+0000", 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014409000000000001 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.426671+0000", 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065582080000000003 2024-04-26T12:40:34.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427066+0000", 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00039501800000000002 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427130+0000", 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3206000000000004e-05 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.427187+0000", 2024-04-26T12:40:34.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6932999999999999e-05 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2326 3.0 e72/17 3:039da517:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_135:head v 72'6, mlcod=72'4)", 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.311349894999999, 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074245839999999997, 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451745+0000", 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.451747+0000", 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.663e-06 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453207+0000", 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014601410000000001 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453232+0000", 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5372e-05 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453244+0000", 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1790999999999999e-05 2024-04-26T12:40:34.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453323+0000", 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9140999999999993e-05 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.453347+0000", 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3910999999999999e-05 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459105+0000", 2024-04-26T12:40:34.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057577080000000003 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.459170+0000", 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2328 3.3a 3:5e90e1f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.293201152999998, 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0090903670000000002, 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:34.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2328 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469894+0000", 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.469896+0000", 2024-04-26T12:40:34.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0229999999999999e-06 2024-04-26T12:40:34.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471266+0000", 2024-04-26T12:40:34.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001370303 2024-04-26T12:40:34.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471294+0000", 2024-04-26T12:40:34.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7571000000000001e-05 2024-04-26T12:40:34.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471308+0000", 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4267000000000001e-05 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471388+0000", 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9939999999999997e-05 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471525+0000", 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013668400000000001 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.471667+0000", 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014186299999999999 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478381+0000", 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067147750000000001 2024-04-26T12:40:34.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478838+0000", 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045644799999999998 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478923+0000", 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4736999999999999e-05 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478984+0000", 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1755999999999996e-05 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2340 3.3b e72/17 3:dec2f466:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_149:head v 72'4, mlcod=71'2)", 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.159996894999999, 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010101687, 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.799 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603098+0000", 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.603101+0000", 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.548e-06 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608217+0000", 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051159860000000003 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608250+0000", 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3411999999999998e-05 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608266+0000", 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5979000000000001e-05 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608334+0000", 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8120999999999994e-05 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.608357+0000", 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2719000000000001e-05 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613114+0000", 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047573880000000004 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.613200+0000", 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5533999999999998e-05 2024-04-26T12:40:34.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.804 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2364 3.3a 3:5f88866d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:34.805 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:34.805 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.898225024999999, 2024-04-26T12:40:34.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017066136999999999, 2024-04-26T12:40:34.805 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.805 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.805 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2364 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864873+0000", 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0989999999999999e-06 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866782+0000", 2024-04-26T12:40:34.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001908325 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866804+0000", 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2331999999999999e-05 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866817+0000", 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2951e-05 2024-04-26T12:40:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866910+0000", 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2817000000000003e-05 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866915+0000", 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0699999999999997e-06 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870125+0000", 2024-04-26T12:40:34.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032105279999999998 2024-04-26T12:40:34.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870302+0000", 2024-04-26T12:40:34.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017691699999999999 2024-04-26T12:40:34.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870475+0000", 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258400000000001 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.877926+0000", 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074516069999999998 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881845+0000", 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039187570000000001 2024-04-26T12:40:34.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881885+0000", 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0234000000000001e-05 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881936+0000", 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0915999999999998e-05 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.812 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2366 3.0 e73/17 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.869816293, 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007540064, 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.893279+0000", 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9200000000000002e-07 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895376+0000", 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020964460000000001 2024-04-26T12:40:34.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895399+0000", 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2886000000000001e-05 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895411+0000", 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2845e-05 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895487+0000", 2024-04-26T12:40:34.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5555000000000004e-05 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895512+0000", 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4751000000000001e-05 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900733+0000", 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052214210000000004 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.900819+0000", 2024-04-26T12:40:34.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5867999999999998e-05 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2383 3.3a 3:5e222c71:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.699977893, 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012876257, 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.817 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2383 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063117+0000", 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063120+0000", 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-06 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065515+0000", 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023946839999999998 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065543+0000", 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8311e-05 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065556+0000", 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2442e-05 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065651+0000", 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5266000000000006e-05 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.065849+0000", 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019847699999999999 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:34.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.066023+0000", 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173072 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075353+0000", 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093303489999999999 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:34.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075875+0000", 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00052190799999999996 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075936+0000", 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1681999999999997e-05 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075994+0000", 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7092999999999997e-05 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.823 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2390 3.3b e73/17 3:de1f29f3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_199:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.616985174, 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011629304, 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.824 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.146110+0000", 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4900000000000001e-07 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150965+0000", 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048547080000000001 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.150993+0000", 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8087999999999999e-05 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151007+0000", 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3653e-05 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151087+0000", 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9856000000000003e-05 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.151113+0000", 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6486e-05 2024-04-26T12:40:34.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157679+0000", 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065660960000000004 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.157739+0000", 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0068000000000002e-05 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2393 3.0 e73/17 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.584269025000001, 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078009530000000002, 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178826+0000", 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178828+0000", 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8470000000000001e-06 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181282+0000", 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024539710000000001 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181306+0000", 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4080999999999999e-05 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181319+0000", 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.294e-05 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181753+0000", 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00043354299999999999 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.181777+0000", 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4762000000000001e-05 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186543+0000", 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047658509999999998 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186627+0000", 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3957999999999998e-05 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2395 3.25 e73/41 3:a5fe4c99:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_204:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.561677544999998, 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068691029999999997, 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.833 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201418+0000", 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.201419+0000", 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3850000000000001e-06 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203007+0000", 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015877650000000001 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203033+0000", 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5981000000000001e-05 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203046+0000", 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3114e-05 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203128+0000", 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2077999999999996e-05 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.203153+0000", 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5086999999999999e-05 2024-04-26T12:40:34.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208235+0000", 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050818599999999997 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.208287+0000", 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1833000000000003e-05 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.837 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.456729473999999, 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:40:34.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:40:34.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2413 3.2d e73/17 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.363746425999999, 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097703479999999999, 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399349+0000", 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.399350+0000", 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.711e-06 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403750+0000", 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043993160000000003 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403772+0000", 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1985999999999999e-05 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403782+0000", 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9340000000000001e-06 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403854+0000", 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2788999999999997e-05 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.403881+0000", 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6826999999999999e-05 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409050+0000", 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051684189999999996 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.409119+0000", 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9366e-05 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2415 3.0 e73/17 3:007bae19:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_224:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:34.848 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.341475260999999, 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006983324, 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421620+0000", 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.421622+0000", 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.841e-06 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423279+0000", 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016575139999999999 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423304+0000", 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5198000000000002e-05 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423318+0000", 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.328e-05 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423400+0000", 2024-04-26T12:40:34.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2729e-05 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.423428+0000", 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7222000000000001e-05 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428553+0000", 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051254450000000002 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.428603+0000", 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0095000000000001e-05 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2418 3.25 e73/41 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.309363018999999, 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079618780000000004, 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453732+0000", 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453733+0000", 2024-04-26T12:40:34.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3200000000000004e-07 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455472+0000", 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017391749999999999 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455495+0000", 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2625000000000001e-05 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.855 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455509+0000", 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4056999999999999e-05 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455587+0000", 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8577000000000003e-05 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.455619+0000", 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1443999999999999e-05 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461659+0000", 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060406499999999998 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461694+0000", 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4618e-05 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.857 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2419 3.4 e73/17 3:21b3cbd4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_228:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.298754260999999, 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074141069999999996, 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:34.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464341+0000", 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.464342+0000", 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.142e-06 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466601+0000", 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022590190000000001 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466619+0000", 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8337000000000001e-05 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466628+0000", 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0089999999999996e-06 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466687+0000", 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8368000000000001e-05 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.466712+0000", 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4836000000000001e-05 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471699+0000", 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049870019999999999 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.861 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.471755+0000", 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6394000000000003e-05 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2426 3.f 3:f3fcc542:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.229400054999999, 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017310012999999999, 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.862 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2426 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533698+0000", 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8389999999999998e-06 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535314+0000", 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016156949999999999 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535339+0000", 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5117e-05 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535349+0000", 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0569e-05 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535414+0000", 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5080999999999996e-05 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535529+0000", 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114302 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535625+0000", 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6210000000000002e-05 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.542763+0000", 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071382149999999998 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550914+0000", 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081504420000000008 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550953+0000", 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9597000000000001e-05 2024-04-26T12:40:34.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.551005+0000", 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1946e-05 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2429 3.4 e73/17 3:208decb8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_238:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.198801516, 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072608780000000001, 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.868 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564294+0000", 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.564295+0000", 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7129999999999999e-06 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566152+0000", 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001856871 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566180+0000", 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7338000000000002e-05 2024-04-26T12:40:34.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566195+0000", 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5807999999999998e-05 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566279+0000", 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3462999999999997e-05 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.566307+0000", 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7977999999999999e-05 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571500+0000", 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051927199999999996 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.571555+0000", 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4987000000000001e-05 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.872 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2432 3.4 e73/17 3:22adec7f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_241:head v 73'4, mlcod=73'2)", 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.166829754999998, 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072901049999999998, 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:34.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596265+0000", 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.596267+0000", 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9870000000000002e-06 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597800+0000", 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015329530000000001 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597825+0000", 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4675e-05 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597838+0000", 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3335e-05 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597925+0000", 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6865000000000003e-05 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.597966+0000", 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0417000000000003e-05 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603515+0000", 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055488730000000002 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.603556+0000", 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1e-05 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2435 3.2d e73/17 3:b50706f2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_244:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.126827191, 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010411692, 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:34.877 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636268+0000", 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.878 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.636271+0000", 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640883+0000", 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046121540000000003 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640921+0000", 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8676e-05 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.640940+0000", 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8991000000000002e-05 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641044+0000", 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010401899999999999 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.641074+0000", 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0037999999999999e-05 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646616+0000", 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055411619999999997 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.646680+0000", 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4083000000000003e-05 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:34.881 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:34.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:34.883 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:34.882+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:34.984 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:34.980+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:35.041 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:35.042 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:35.042 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:35.042 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:35.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:35.085 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:35.084+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:35.185 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:35.185 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:35.186 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:35.186 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:35.186 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:35.186+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:35.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:35.287 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:35.286+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:35.359 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:35.359 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1326 3.33 3:cd5db5f2:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.514036472999997, 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016038528, 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.360 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1326 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842595+0000", 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9420000000000002e-06 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843194+0000", 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059943799999999999 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843214+0000", 2024-04-26T12:40:35.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9970999999999999e-05 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843223+0000", 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0040000000000005e-06 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843310+0000", 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6973999999999998e-05 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843418+0000", 2024-04-26T12:40:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010787 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843511+0000", 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3305000000000002e-05 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.846677+0000", 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031658749999999999 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858525+0000", 2024-04-26T12:40:35.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011848348 2024-04-26T12:40:35.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858582+0000", 2024-04-26T12:40:35.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6119000000000003e-05 2024-04-26T12:40:35.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858631+0000", 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2320 3.27 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.967136763999999, 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020624966000000002, 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.366 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2320 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389495+0000", 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390861+0000", 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013652849999999999 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390898+0000", 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6789000000000003e-05 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390908+0000", 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.065e-05 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390983+0000", 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391089+0000", 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105752 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391177+0000", 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7596999999999995e-05 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.395646+0000", 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044690889999999999 2024-04-26T12:40:35.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410024+0000", 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014378050999999999 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410065+0000", 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1056000000000001e-05 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410117+0000", 2024-04-26T12:40:35.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2485000000000003e-05 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2325 3.2 3:40f43f1f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.917784859000001, 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013366813, 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.372 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2325 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:35.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438847+0000", 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7769999999999998e-06 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440481+0000", 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001633731 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440511+0000", 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0247999999999999e-05 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440523+0000", 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1861999999999999e-05 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440605+0000", 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2392000000000007e-05 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440774+0000", 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168985 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440934+0000", 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159908 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.445923+0000", 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049891900000000001 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452114+0000", 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006190887 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452168+0000", 2024-04-26T12:40:35.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3749999999999999e-05 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452211+0000", 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3083000000000001e-05 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2329 3.38 3:1f4c78ed:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.877807454999999, 2024-04-26T12:40:35.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015527136, 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2329 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478825+0000", 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8959999999999999e-06 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480286+0000", 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001461644 2024-04-26T12:40:35.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480319+0000", 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2527000000000002e-05 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480334+0000", 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.519e-05 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480420+0000", 2024-04-26T12:40:35.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5643999999999995e-05 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480572+0000", 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000152237 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480724+0000", 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015249 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.484967+0000", 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042430879999999999 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494254+0000", 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092865980000000001 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494295+0000", 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0503000000000002e-05 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494349+0000", 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4318999999999999e-05 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2330 3.27 3:e503c54d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.867961312999999, 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014172947999999999, 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2330 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488670+0000", 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.751e-06 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.489978+0000", 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013084850000000001 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490008+0000", 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9967999999999998e-05 2024-04-26T12:40:35.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490021+0000", 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2745000000000001e-05 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490094+0000", 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2849999999999995e-05 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490217+0000", 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012377300000000001 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490323+0000", 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105132 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494969+0000", 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046460959999999997 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502769+0000", 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078001370000000004 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502810+0000", 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1412000000000003e-05 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502841+0000", 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0599000000000003e-05 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2338 3.2 3:40db620f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.785945411, 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017810332000000002, 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2338 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.390 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570686+0000", 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1229999999999998e-06 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572072+0000", 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001386125 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572105+0000", 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3492999999999999e-05 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572116+0000", 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0627e-05 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572187+0000", 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0531999999999995e-05 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572308+0000", 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012157700000000001 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572414+0000", 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105889 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576935+0000", 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045206049999999996 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588421+0000", 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011486111 2024-04-26T12:40:35.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588462+0000", 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1270000000000003e-05 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588494+0000", 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1980000000000002e-05 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.395 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2348 3.29 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.664256361, 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019384129999999999, 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2348 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692376+0000", 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2320000000000001e-06 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.693975+0000", 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001598808 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694006+0000", 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1606000000000002e-05 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694021+0000", 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4783999999999999e-05 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694117+0000", 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5851000000000001e-05 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694259+0000", 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014201099999999999 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694400+0000", 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014122200000000001 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.698538+0000", 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041381170000000002 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711595+0000", 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013056636 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711687+0000", 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1630000000000002e-05 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711757+0000", 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0233000000000003e-05 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2356 3.7 3:e10f5880:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.579260523999999, 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015864989999999999, 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2356 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777372+0000", 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8890000000000002e-06 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779070+0000", 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001698764 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779096+0000", 2024-04-26T12:40:35.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5959e-05 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779107+0000", 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779183+0000", 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5788e-05 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779320+0000", 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137269 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779408+0000", 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7560999999999997e-05 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.783717+0000", 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043093230000000003 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793104+0000", 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009387411 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793178+0000", 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3843000000000004e-05 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793234+0000", 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5386000000000001e-05 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.406 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2372 3.1e 3:788eb98e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.405704569000001, 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019326650000000001, 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.407 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2372 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950927+0000", 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4310000000000001e-06 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953107+0000", 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021800080000000002 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953135+0000", 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7529999999999999e-05 2024-04-26T12:40:35.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953149+0000", 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4171e-05 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953240+0000", 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983999999999995e-05 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953413+0000", 2024-04-26T12:40:35.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017362399999999999 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953577+0000", 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000163864 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.959646+0000", 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060690620000000001 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970130+0000", 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010484228999999999 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970199+0000", 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8866000000000001e-05 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970251+0000", 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1881e-05 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2374 3.38 3:1c1a4d28:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.383982363000001, 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020357772999999999, 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2374 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972649+0000", 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974485+0000", 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018357899999999999 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974516+0000", 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1142000000000001e-05 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974531+0000", 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.455e-05 2024-04-26T12:40:35.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974627+0000", 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6543e-05 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974833+0000", 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020613700000000001 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:35.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.975018+0000", 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000184267 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.981099+0000", 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00608093 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011762869 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992942+0000", 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0517000000000002e-05 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.993005+0000", 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2648000000000001e-05 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2376 3.5 e73/17 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:35.418 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.358368253999998, 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011508294000000001, 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998273+0000", 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1647999999999999e-05 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002533+0000", 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042605840000000004 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002562+0000", 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9343999999999999e-05 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002577+0000", 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4592e-05 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002663+0000", 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6013000000000005e-05 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002694+0000", 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0817e-05 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009691+0000", 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0069972710000000002 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009769+0000", 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8024999999999999e-05 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.422 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2382 3.3c e73/17 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.297746199999999, 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016599513, 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:35.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058885+0000", 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.062970+0000", 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040850720000000004 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063005+0000", 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5342999999999997e-05 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063021+0000", 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6019e-05 2024-04-26T12:40:35.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063152+0000", 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013094699999999999 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063181+0000", 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8561999999999999e-05 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075419+0000", 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012238667 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075482+0000", 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3229000000000001e-05 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2388 3.2 3:404073be:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.427 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.240104036999998, 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019415504, 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2388 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116528+0000", 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118771+0000", 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002243091 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118792+0000", 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0990000000000001e-05 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118802+0000", 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0086e-05 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118912+0000", 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109497 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119038+0000", 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126198 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119125+0000", 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7186000000000002e-05 2024-04-26T12:40:35.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.123050+0000", 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039251169999999997 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135829+0000", 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012779209 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135892+0000", 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2728e-05 2024-04-26T12:40:35.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135941+0000", 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8485000000000001e-05 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2389 3.2 3:427feba5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.228473416, 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019131569000000001, 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.433 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2389 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128159+0000", 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.864e-06 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130062+0000", 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019030500000000001 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130088+0000", 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5890000000000001e-05 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130098+0000", 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0263e-05 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130167+0000", 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9643999999999999e-05 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130306+0000", 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013836499999999999 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130397+0000", 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1003999999999998e-05 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135001+0000", 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004604403 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147180+0000", 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012178362 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147227+0000", 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6981000000000003e-05 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147287+0000", 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0742999999999998e-05 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.106808677, 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:40:35.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:40:35.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:40:35.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:40:35.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2407 3.33 3:ce0fe289:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.039395497000001, 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018708978000000001, 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.444 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2407 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317236+0000", 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7539999999999998e-06 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318627+0000", 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013905600000000001 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318660+0000", 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3042e-05 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318676+0000", 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5775999999999999e-05 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318777+0000", 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101152 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318986+0000", 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000208648 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.319165+0000", 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017941699999999999 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.324600+0000", 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054352430000000002 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335812+0000", 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011211308999999999 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335886+0000", 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4263000000000004e-05 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335943+0000", 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6814000000000002e-05 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2409 3.1e 3:7ac1137c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:35.449 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.013369172000001, 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017629292000000001, 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2409 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:35.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343262+0000", 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9549999999999999e-06 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345627+0000", 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023648459999999999 2024-04-26T12:40:35.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345658+0000", 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1154e-05 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345675+0000", 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7456e-05 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345800+0000", 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012460300000000001 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346033+0000", 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023336599999999999 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346192+0000", 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015833500000000001 2024-04-26T12:40:35.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.352130+0000", 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059381190000000004 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360741+0000", 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0086116479999999995 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360811+0000", 2024-04-26T12:40:35.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9342000000000001e-05 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360889+0000", 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8467999999999995e-05 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2417 3.8 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.916756051, 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012677982000000001, 2024-04-26T12:40:35.455 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2417 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439876+0000", 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441807+0000", 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001931239 2024-04-26T12:40:35.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441829+0000", 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1883999999999999e-05 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441839+0000", 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0084999999999999e-05 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441928+0000", 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8608000000000003e-05 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442072+0000", 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144053 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442170+0000", 2024-04-26T12:40:35.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7921e-05 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.449581+0000", 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074107469999999996 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452422+0000", 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028413570000000001 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452496+0000", 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3857999999999997e-05 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452551+0000", 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5299e-05 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.872145884999998, 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:40:35.461 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:40:35.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2423 3.b 3:d15dbab2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.852628548999999, 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012126067000000001, 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:35.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2423 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504003+0000", 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.452e-06 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506649+0000", 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026461879999999998 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506674+0000", 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4689e-05 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506686+0000", 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1595e-05 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506759+0000", 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658000000000005e-05 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506933+0000", 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017354100000000001 2024-04-26T12:40:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.507051+0000", 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118578 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.513156+0000", 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0061047319999999999 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515986+0000", 2024-04-26T12:40:35.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028303199999999999 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516064+0000", 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7466999999999995e-05 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516127+0000", 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2847000000000003e-05 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:35.472 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:35.473 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:35.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:35.475 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:35.472+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:35.575 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:35.572+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:35.607 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:35.607 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:35.607 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:35.607 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:35.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:35.709 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:35.708+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:35.778 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:35.776+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:35.787 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:35.787 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:35.787 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:35.788 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:35.788 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:35.801 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:35.878 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:35.878+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:35.970 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:35.970 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:35.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:35.970 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:35.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.970 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1601 3.1d e67/17 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:35.970 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.240813187000001, 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021057349999999999, 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727484+0000", 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733321+0000", 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005836351 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733360+0000", 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9648999999999999e-05 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733383+0000", 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2722999999999999e-05 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733504+0000", 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012115199999999999 2024-04-26T12:40:35.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733558+0000", 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3511999999999999e-05 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748395+0000", 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014836937 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748539+0000", 2024-04-26T12:40:35.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144356 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2320 3.27 e72/17 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head v 72'3, mlcod=67'1)", 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.577789328000001, 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017587200000000001, 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2799999999999995e-07 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396488+0000", 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059817680000000002 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396509+0000", 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0888999999999999e-05 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396520+0000", 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0708e-05 2024-04-26T12:40:35.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396619+0000", 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9263000000000002e-05 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396654+0000", 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5125e-05 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408029+0000", 2024-04-26T12:40:35.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011374815 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408093+0000", 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3804000000000001e-05 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2337 3.1b e72/17 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.409506907000001, 2024-04-26T12:40:35.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015714998000000001, 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558789+0000", 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4780000000000001e-06 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563525+0000", 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047351470000000003 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:35.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563558+0000", 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3284999999999997e-05 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563574+0000", 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.573e-05 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563664+0000", 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0006000000000005e-05 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563690+0000", 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6619999999999999e-05 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574423+0000", 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010732396 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574503+0000", 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0335999999999998e-05 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:35.983 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2347 3.a e72/17 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head v 72'3, mlcod=71'1)", 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.28293511, 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019978432000000001, 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685363+0000", 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688265+0000", 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029017240000000001 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688336+0000", 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1422999999999997e-05 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688364+0000", 2024-04-26T12:40:35.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7234999999999999e-05 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688534+0000", 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017049599999999999 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688604+0000", 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0016000000000002e-05 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705182+0000", 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016577543 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705338+0000", 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156479 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.988 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2348 3.29 e72/17 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.275323773, 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016659368000000001, 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692973+0000", 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2199999999999999e-06 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699798+0000", 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0068248750000000002 2024-04-26T12:40:35.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699829+0000", 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699845+0000", 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6132000000000001e-05 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699973+0000", 2024-04-26T12:40:35.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012803099999999999 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700015+0000", 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2052000000000003e-05 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709497+0000", 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094813919999999999 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709631+0000", 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013391299999999999 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2351 3.14 e72/31 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head v 72'4, mlcod=72'2)", 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.235209511000001, 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018622024000000001, 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:35.993 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733088+0000", 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.48e-06 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735690+0000", 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026018040000000001 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735724+0000", 2024-04-26T12:40:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4585999999999997e-05 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735743+0000", 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8309e-05 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735878+0000", 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013522999999999999 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:35.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735919+0000", 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1223000000000002e-05 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751443+0000", 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015524247999999999 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751707+0000", 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026414400000000001 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:35.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2352 3.31 e73/17 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.231965972000001, 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017289571, 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:35.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736330+0000", 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0100000000000001e-06 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:35.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740605+0000", 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042746169999999997 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740643+0000", 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8776000000000003e-05 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740669+0000", 2024-04-26T12:40:36.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5499000000000001e-05 2024-04-26T12:40:36.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740805+0000", 2024-04-26T12:40:36.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013579099999999999 2024-04-26T12:40:36.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740847+0000", 2024-04-26T12:40:36.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2642000000000003e-05 2024-04-26T12:40:36.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753498+0000", 2024-04-26T12:40:36.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012651172 2024-04-26T12:40:36.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753619+0000", 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012006399999999999 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.000304283999998, 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.003 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:40:36.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.007 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2375 3.1c e73/17 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.981371788000001, 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018742169999999999, 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986925+0000", 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0439999999999998e-06 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992153+0000", 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005227644 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992186+0000", 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3256000000000001e-05 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992210+0000", 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4249000000000001e-05 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992375+0000", 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016447 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992438+0000", 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3318999999999995e-05 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005540+0000", 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013101550999999999 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005665+0000", 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000125637 2024-04-26T12:40:36.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2378 3.1d e73/17 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.952571503000001, 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015708637000000001, 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015726+0000", 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4030000000000001e-06 2024-04-26T12:40:36.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018549+0000", 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028231969999999999 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018590+0000", 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0995000000000003e-05 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018609+0000", 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8850000000000001e-05 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018752+0000", 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143633 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018793+0000", 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0496e-05 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031304+0000", 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012510795999999999 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031432+0000", 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128267 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.016 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2396 3.31 e73/17 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.755478008000001, 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015460707000000001, 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212819+0000", 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.497e-06 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216796+0000", 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039765190000000004 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216829+0000", 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2712000000000001e-05 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216845+0000", 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6464e-05 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217025+0000", 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000179989 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217090+0000", 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5087999999999998e-05 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228134+0000", 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011044185 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228278+0000", 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014325300000000001 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.020 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.723619613, 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:40:36.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2400 3.27 e73/17 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.717892632999998, 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020886715, 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250405+0000", 2024-04-26T12:40:36.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254952+0000", 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045466930000000001 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254991+0000", 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9298999999999998e-05 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255014+0000", 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2711999999999999e-05 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255166+0000", 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015193699999999999 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255207+0000", 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1436000000000001e-05 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271130+0000", 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015923262000000001 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271289+0000", 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015862600000000001 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2402 3.11 e73/17 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.695635674000002, 2024-04-26T12:40:36.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018233177, 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:36.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272662+0000", 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.157e-06 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276695+0000", 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040329739999999999 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276735+0000", 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9338999999999997e-05 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276760+0000", 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4893e-05 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276943+0000", 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000183489 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277008+0000", 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4704999999999998e-05 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290772+0000", 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013764406999999999 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290892+0000", 2024-04-26T12:40:36.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120213 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2403 3.3 e73/31 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.690145223999998, 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016271938, 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278151+0000", 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4e-07 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282860+0000", 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047094179999999999 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282891+0000", 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0562999999999999e-05 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282909+0000", 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7995999999999998e-05 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283056+0000", 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014763299999999999 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283099+0000", 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3139000000000002e-05 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294299+0000", 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011200185 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294422+0000", 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012216399999999999 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2406 3.9 e73/31 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head v 73'3, mlcod=67'1)", 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.661364443, 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016385118000000001, 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.038 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306931+0000", 2024-04-26T12:40:36.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3300000000000001e-07 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312959+0000", 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060277100000000004 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312990+0000", 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0786e-05 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313005+0000", 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5373e-05 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313149+0000", 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014355999999999999 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313191+0000", 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1928999999999998e-05 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323173+0000", 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099826700000000008 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323316+0000", 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014235699999999999 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2411 3.31 e73/17 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head v 73'10, mlcod=73'8)", 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:36.042 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.598048842000001, 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015408975, 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370249+0000", 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3869999999999999e-06 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375387+0000", 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051375539999999999 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375425+0000", 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8186000000000003e-05 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375449+0000", 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3620000000000001e-05 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375622+0000", 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017309500000000001 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375673+0000", 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0849000000000001e-05 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385561+0000", 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098879090000000003 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385655+0000", 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4375000000000004e-05 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.046 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2421 3.27 e73/17 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.483131499999999, 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018694483000000001, 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:36.047 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485166+0000", 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4660000000000002e-06 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490411+0000", 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052454119999999996 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490447+0000", 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6106000000000003e-05 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490466+0000", 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8329999999999999e-05 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490659+0000", 2024-04-26T12:40:36.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019286800000000001 2024-04-26T12:40:36.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490703+0000", 2024-04-26T12:40:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4725999999999998e-05 2024-04-26T12:40:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503764+0000", 2024-04-26T12:40:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013060251 2024-04-26T12:40:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503858+0000", 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4324e-05 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2428 3.1a e73/31 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.415221998, 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015568897, 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.052 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553076+0000", 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.01e-06 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557315+0000", 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042394160000000002 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557363+0000", 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7271999999999997e-05 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557388+0000", 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5249000000000002e-05 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557559+0000", 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000171039 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557621+0000", 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1999000000000001e-05 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568551+0000", 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010930415000000001 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568642+0000", 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0496999999999998e-05 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2431 3.31 e73/17 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head v 73'11, mlcod=73'9)", 2024-04-26T12:40:36.056 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.384515653000001, 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01575095, 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.057 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583783+0000", 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4960000000000001e-06 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589105+0000", 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053218140000000002 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589142+0000", 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7149e-05 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589159+0000", 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.774e-05 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589317+0000", 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000157589 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589380+0000", 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2708999999999999e-05 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599423+0000", 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010042882 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599530+0000", 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107571 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.060 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.061 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.061 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.061 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:36.062 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:36.062 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:36.060+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:36.163 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:36.162+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:36.231 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:36.231 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:36.231 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:36.231 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:36.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:36.267 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:40:36.293 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:36.292+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:36.365 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:36.365 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:36.365 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:36.365 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:36.365 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:36.366 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:36.366+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:36.379 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:36.466 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:36.466+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:36.555 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:36.556 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:36.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:36.556 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:36.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.556 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1328 3.1f e67/17 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:36.557 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:36.557 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.687865414999997, 2024-04-26T12:40:36.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019374358000000001, 2024-04-26T12:40:36.557 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.557 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.557 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.557 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:36.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:36.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:36.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.28e-07 2024-04-26T12:40:36.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867669+0000", 2024-04-26T12:40:36.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004831915 2024-04-26T12:40:36.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867686+0000", 2024-04-26T12:40:36.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6895999999999999e-05 2024-04-26T12:40:36.562 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.562 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.562 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867695+0000", 2024-04-26T12:40:36.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:40:36.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867801+0000", 2024-04-26T12:40:36.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010592200000000001 2024-04-26T12:40:36.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867837+0000", 2024-04-26T12:40:36.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6032000000000003e-05 2024-04-26T12:40:36.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882087+0000", 2024-04-26T12:40:36.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014249265000000001 2024-04-26T12:40:36.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882212+0000", 2024-04-26T12:40:36.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012479900000000001 2024-04-26T12:40:36.566 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.566 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.566 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.567 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1457 3.22 3:46753612:::d749f084-3851-4e95-9492-490675b43f90.4382.3__shadow_.89eL0OTfRIkm8jjkAhjXzYFORkpc2AZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:36.567 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:36.567 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.949487849, 2024-04-26T12:40:36.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021050049000000001, 2024-04-26T12:40:36.567 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.567 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.568 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.568 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.568 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.568 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.568 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1457 2024-04-26T12:40:36.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.569 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.569 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.569 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:36.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:36.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601217+0000", 2024-04-26T12:40:36.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.509e-06 2024-04-26T12:40:36.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607652+0000", 2024-04-26T12:40:36.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064351900000000004 2024-04-26T12:40:36.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607693+0000", 2024-04-26T12:40:36.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0868999999999998e-05 2024-04-26T12:40:36.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607712+0000", 2024-04-26T12:40:36.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8702000000000002e-05 2024-04-26T12:40:36.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607889+0000", 2024-04-26T12:40:36.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000177061 2024-04-26T12:40:36.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608263+0000", 2024-04-26T12:40:36.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037431500000000001 2024-04-26T12:40:36.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:36.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608646+0000", 2024-04-26T12:40:36.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038215100000000001 2024-04-26T12:40:36.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.620501+0000", 2024-04-26T12:40:36.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011855625 2024-04-26T12:40:36.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622083+0000", 2024-04-26T12:40:36.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001581556 2024-04-26T12:40:36.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622195+0000", 2024-04-26T12:40:36.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112667 2024-04-26T12:40:36.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622265+0000", 2024-04-26T12:40:36.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9404000000000002e-05 2024-04-26T12:40:36.579 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.579 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.579 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.580 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1601 3.1d 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:36.580 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:36.580 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.829984979000002, 2024-04-26T12:40:36.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028382847999999999, 2024-04-26T12:40:36.580 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.581 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.581 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.581 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.581 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.581 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.581 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1601 2024-04-26T12:40:36.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.582 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:36.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:36.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720720+0000", 2024-04-26T12:40:36.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3300000000000001e-06 2024-04-26T12:40:36.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726577+0000", 2024-04-26T12:40:36.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005857307 2024-04-26T12:40:36.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726616+0000", 2024-04-26T12:40:36.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9224999999999998e-05 2024-04-26T12:40:36.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726640+0000", 2024-04-26T12:40:36.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3873e-05 2024-04-26T12:40:36.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726810+0000", 2024-04-26T12:40:36.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016950799999999999 2024-04-26T12:40:36.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727033+0000", 2024-04-26T12:40:36.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022316600000000001 2024-04-26T12:40:36.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:36.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727242+0000", 2024-04-26T12:40:36.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020876 2024-04-26T12:40:36.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748847+0000", 2024-04-26T12:40:36.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021605347 2024-04-26T12:40:36.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748917+0000", 2024-04-26T12:40:36.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9413999999999996e-05 2024-04-26T12:40:36.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749020+0000", 2024-04-26T12:40:36.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103383 2024-04-26T12:40:36.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749100+0000", 2024-04-26T12:40:36.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0535000000000001e-05 2024-04-26T12:40:36.593 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.593 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.593 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.593 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1602 3.28 3:15f7ca78:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:36.594 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:36.594 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.824009762999999, 2024-04-26T12:40:36.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021360100999999999, 2024-04-26T12:40:36.594 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.594 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.594 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.595 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.595 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.595 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.595 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1602 2024-04-26T12:40:36.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.595 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:36.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:36.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726695+0000", 2024-04-26T12:40:36.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1900000000000002e-06 2024-04-26T12:40:36.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729949+0000", 2024-04-26T12:40:36.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032543730000000001 2024-04-26T12:40:36.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729991+0000", 2024-04-26T12:40:36.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1403000000000003e-05 2024-04-26T12:40:36.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730016+0000", 2024-04-26T12:40:36.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5709000000000001e-05 2024-04-26T12:40:36.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730228+0000", 2024-04-26T12:40:36.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021134999999999999 2024-04-26T12:40:36.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730651+0000", 2024-04-26T12:40:36.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042305000000000001 2024-04-26T12:40:36.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:36.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.731097+0000", 2024-04-26T12:40:36.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044566700000000001 2024-04-26T12:40:36.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.740379+0000", 2024-04-26T12:40:36.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092821050000000006 2024-04-26T12:40:36.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747886+0000", 2024-04-26T12:40:36.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007507555 2024-04-26T12:40:36.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747980+0000", 2024-04-26T12:40:36.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3727000000000006e-05 2024-04-26T12:40:36.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748053+0000", 2024-04-26T12:40:36.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2972000000000005e-05 2024-04-26T12:40:36.606 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.606 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.606 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.606 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2322 3.1c 3:3aeebad8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:36.607 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:36.607 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.14386077, 2024-04-26T12:40:36.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017554513000000001, 2024-04-26T12:40:36.607 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.607 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.607 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.608 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.608 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.608 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.608 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2322 2024-04-26T12:40:36.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.608 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:36.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:36.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406844+0000", 2024-04-26T12:40:36.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2050000000000001e-06 2024-04-26T12:40:36.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412062+0000", 2024-04-26T12:40:36.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052182130000000002 2024-04-26T12:40:36.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412097+0000", 2024-04-26T12:40:36.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5086000000000003e-05 2024-04-26T12:40:36.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412118+0000", 2024-04-26T12:40:36.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0299999999999999e-05 2024-04-26T12:40:36.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412207+0000", 2024-04-26T12:40:36.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9482999999999997e-05 2024-04-26T12:40:36.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412358+0000", 2024-04-26T12:40:36.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000150483 2024-04-26T12:40:36.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:36.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412463+0000", 2024-04-26T12:40:36.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000104956 2024-04-26T12:40:36.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.423146+0000", 2024-04-26T12:40:36.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01068347 2024-04-26T12:40:36.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424315+0000", 2024-04-26T12:40:36.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011691799999999999 2024-04-26T12:40:36.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424359+0000", 2024-04-26T12:40:36.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4212000000000003e-05 2024-04-26T12:40:36.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424396+0000", 2024-04-26T12:40:36.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6925000000000003e-05 2024-04-26T12:40:36.620 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.620 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.620 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.621 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2357 3.2a 3:5615e7fe:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.621 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:36.621 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.764378721, 2024-04-26T12:40:36.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019796023999999999, 2024-04-26T12:40:36.622 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.622 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.622 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.622 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.622 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.622 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.623 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2357 2024-04-26T12:40:36.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.623 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:36.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:36.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786327+0000", 2024-04-26T12:40:36.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.49e-06 2024-04-26T12:40:36.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790818+0000", 2024-04-26T12:40:36.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044903690000000001 2024-04-26T12:40:36.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790860+0000", 2024-04-26T12:40:36.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1851999999999998e-05 2024-04-26T12:40:36.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790879+0000", 2024-04-26T12:40:36.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9551999999999998e-05 2024-04-26T12:40:36.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791003+0000", 2024-04-26T12:40:36.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012405399999999999 2024-04-26T12:40:36.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791242+0000", 2024-04-26T12:40:36.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238495 2024-04-26T12:40:36.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:36.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791453+0000", 2024-04-26T12:40:36.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000211005 2024-04-26T12:40:36.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.801975+0000", 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010522658000000001 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.805976+0000", 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040003449999999998 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806054+0000", 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8757999999999994e-05 2024-04-26T12:40:36.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806120+0000", 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5445999999999996e-05 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2358 3.c 3:30528342:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:36.632 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.752488565, 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017961708999999999, 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2358 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798217+0000", 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4120000000000001e-06 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802700+0000", 2024-04-26T12:40:36.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044824900000000004 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802739+0000", 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9181999999999999e-05 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802766+0000", 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6682e-05 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802894+0000", 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128102 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.803151+0000", 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025679700000000001 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.803409+0000", 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025825099999999998 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.812254+0000", 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0088452759999999991 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.815918+0000", 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0036635259999999998 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.816068+0000", 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000150777 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.816176+0000", 2024-04-26T12:40:36.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010721399999999999 2024-04-26T12:40:36.638 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.638 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.638 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.638 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2367 3.2a 3:55ec8106:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.638 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.652757003000001, 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020327305, 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2367 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897949+0000", 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4489999999999999e-06 2024-04-26T12:40:36.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902370+0000", 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044209369999999998 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902408+0000", 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8541999999999998e-05 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902428+0000", 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9040000000000001e-05 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902607+0000", 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017954599999999999 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903016+0000", 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040908999999999997 2024-04-26T12:40:36.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903422+0000", 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040581100000000001 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.917186+0000", 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013763861 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918102+0000", 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091656300000000001 2024-04-26T12:40:36.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918200+0000", 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7906999999999996e-05 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918273+0000", 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2558999999999994e-05 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2375 3.1c 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.571023313000001, 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026708701000000001, 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2375 2024-04-26T12:40:36.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979683+0000", 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8759999999999998e-06 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985829+0000", 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061460810000000003 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985877+0000", 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7812000000000002e-05 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985907+0000", 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9713000000000002e-05 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986054+0000", 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014770300000000001 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986363+0000", 2024-04-26T12:40:36.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030863899999999998 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986696+0000", 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033299000000000002 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.997022+0000", 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010325732000000001 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006148+0000", 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091265240000000004 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006280+0000", 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013179399999999999 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006388+0000", 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107837 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.650 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2376 3.5 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.561716945000001, 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020175694000000001, 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2376 2024-04-26T12:40:36.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988989+0000", 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5769999999999998e-06 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995521+0000", 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006531635 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995571+0000", 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9738999999999999e-05 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995601+0000", 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995729+0000", 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012808399999999999 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996014+0000", 2024-04-26T12:40:36.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028456400000000001 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996264+0000", 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025048699999999998 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006170+0000", 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099054369999999996 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009021+0000", 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028506730000000002 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009103+0000", 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2908e-05 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009161+0000", 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7855000000000001e-05 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.656 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2378 3.1d 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.540255152, 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023192784000000001, 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.657 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2378 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010450+0000", 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5239999999999999e-06 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014852+0000", 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044019619999999997 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014884+0000", 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2323000000000002e-05 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014900+0000", 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5651999999999999e-05 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015044+0000", 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014389700000000001 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015292+0000", 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024860399999999998 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015521+0000", 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022877100000000001 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031237+0000", 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015715600999999999 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033338+0000", 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021008699999999999 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033518+0000", 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180089 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033640+0000", 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012249099999999999 2024-04-26T12:40:36.662 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2380 3.c 3:32d641af:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.519355431000001, 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019849939, 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.663 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2380 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031352+0000", 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5399999999999997e-06 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039154+0000", 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007802135 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039191+0000", 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7240000000000003e-05 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039210+0000", 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9236e-05 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039358+0000", 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147866 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039611+0000", 2024-04-26T12:40:36.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000253298 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039846+0000", 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023419399999999999 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.049633+0000", 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097878089999999997 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.050899+0000", 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001265455 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051067+0000", 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016852600000000001 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051197+0000", 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012964000000000001 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.668 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2382 3.3c 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.499150880999998, 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023553801999999999, 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.669 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2382 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051554+0000", 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.706e-06 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.055983+0000", 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044283889999999996 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056027+0000", 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4518999999999998e-05 2024-04-26T12:40:36.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056052+0000", 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4675999999999999e-05 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056206+0000", 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015424199999999999 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056594+0000", 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038824299999999998 2024-04-26T12:40:36.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056974+0000", 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000379751 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068770+0000", 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011795386999999999 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074792+0000", 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060226439999999997 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074974+0000", 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000181282 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.075105+0000", 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131963 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.674 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2387 3.28 3:1657e0bf:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.447886748999998, 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018313085, 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.675 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2387 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102819+0000", 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107254+0000", 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044347290000000001 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107287+0000", 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2753000000000003e-05 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107302+0000", 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5302999999999999e-05 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107463+0000", 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161531 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107863+0000", 2024-04-26T12:40:36.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039991799999999997 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.108294+0000", 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043064600000000002 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.118549+0000", 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010255083 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.120957+0000", 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024081990000000002 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121053+0000", 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6070999999999995e-05 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121129+0000", 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5574999999999994e-05 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.680 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2392 3.30 3:0e664f76:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.388416985999999, 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020233060000000001, 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.681 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2392 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162289+0000", 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166843+0000", 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045541959999999999 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166886+0000", 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2908999999999999e-05 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166917+0000", 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0741999999999998e-05 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167061+0000", 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143771 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167317+0000", 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000256493 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167549+0000", 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023142099999999999 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.176299+0000", 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0087508729999999993 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182351+0000", 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060514330000000002 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182446+0000", 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5531000000000004e-05 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182519+0000", 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2175000000000006e-05 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.686 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2399 3.1d 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.311514992999999, 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029752193999999999, 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2399 2024-04-26T12:40:36.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239192+0000", 2024-04-26T12:40:36.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1829999999999996e-06 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243681+0000", 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044893629999999997 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243722+0000", 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0639000000000002e-05 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243743+0000", 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0760000000000001e-05 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243882+0000", 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013962600000000001 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244142+0000", 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025946699999999999 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244378+0000", 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000236839 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254731+0000", 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010353004000000001 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268598+0000", 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013866431 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268779+0000", 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018066499999999999 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268940+0000", 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016121700000000001 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.692 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2401 3.2a 3:54e389fa:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.292365073999999, 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018846505999999999, 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2401 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258341+0000", 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1559999999999999e-06 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262849+0000", 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045083329999999998 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262889+0000", 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9903000000000001e-05 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262907+0000", 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8179e-05 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263036+0000", 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012896000000000001 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263291+0000", 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025503100000000002 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:36.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263523+0000", 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023191100000000001 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.275751+0000", 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012228517 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276977+0000", 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012251580000000001 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277070+0000", 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3718e-05 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277184+0000", 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011364 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2405 3.22 3:45892c0a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.698 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.25601254, 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017862690000000001, 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2405 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:36.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294694+0000", 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9929999999999997e-06 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299557+0000", 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048627050000000002 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299594+0000", 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6996000000000003e-05 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299612+0000", 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8695999999999999e-05 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299745+0000", 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013255 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299991+0000", 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000246481 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.300210+0000", 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218588 2024-04-26T12:40:36.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.309919+0000", 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097093330000000005 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312225+0000", 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002306125 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312421+0000", 2024-04-26T12:40:36.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019588599999999999 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312553+0000", 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013133700000000001 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2410 3.16 3:697fa4a2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.193081199000002, 2024-04-26T12:40:36.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019793999999999999, 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2410 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357625+0000", 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8630000000000001e-06 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362361+0000", 2024-04-26T12:40:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004736011 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362400+0000", 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8719e-05 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362418+0000", 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8366e-05 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362541+0000", 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012312400000000001 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362785+0000", 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000243837 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.363004+0000", 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218629 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.376177+0000", 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173239999999999 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377237+0000", 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001059862 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377335+0000", 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8171000000000006e-05 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377415+0000", 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0178000000000004e-05 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2425 3.5 3:a11dc694:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.027582022000001, 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018795115000000001, 2024-04-26T12:40:36.710 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2425 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523123+0000", 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528942+0000", 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058186920000000003 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528985+0000", 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2951999999999998e-05 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529011+0000", 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6190000000000002e-05 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529142+0000", 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013053000000000001 2024-04-26T12:40:36.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529415+0000", 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027316299999999999 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529659+0000", 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024458800000000001 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.538947+0000", 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092877199999999993 2024-04-26T12:40:36.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541743+0000", 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002795723 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541840+0000", 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7261000000000003e-05 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541916+0000", 2024-04-26T12:40:36.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5562000000000006e-05 2024-04-26T12:40:36.716 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.716 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.716 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.716 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:36.716 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:36.716 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:36.716 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:36.718 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:40:36.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:36.719 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:36.718+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:36.818 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:36.818+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:36.847 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:36.847 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:36.847 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:36.847 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:36.861 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:36.894 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:36.894 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:36.910 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:36.910 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:36.918 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:36.918+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:36.926 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:36.926 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:36.942 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:36.943 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:36.969 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:36.981 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:36.981 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:36.981 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:36.981 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:36.981 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:36.986 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:36.996 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:37.005 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:37.020 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:37.018+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:37.024 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:37.024 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:37.112 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:37.113 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:37.121 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:37.122+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:37.128 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:37.223 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:37.220+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:37.250 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:37.250 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:37.265 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:37.324 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:37.322+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:37.425 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:37.426+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:37.432 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:37.432 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:37.446 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:37.525 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:37.524+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:37.571 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:37.571 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:37.585 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:37.633 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:37.634+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:37.642 INFO:tasks.workunit.client.0.smithi016.stdout:quota enabled for the bucket: buck_2024_03_26_12_40_33 2024-04-26T12:40:37.642 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 2Gb. 2024-04-26T12:40:37.642 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:37.642 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - set max size for a given user and ensure that objects upload beyond max size is not entertained 2024-04-26T12:40:37.642 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:37.642 INFO:tasks.workunit.client.0.smithi016.stdout:delete objects successful 2024-04-26T12:40:37.705 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:37.705 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:37.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:37.727 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:37.724+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:37.827 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:37.826+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:37.890 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:37.890 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:37.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:37.949 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:37.950+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:38.029 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:38.028+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:38.066 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:38.067 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:38.084 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:38.130 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:38.130+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:38.203 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:38.203 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:38.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:38.265 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:38.266+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:38.332 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:38.330+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:38.383 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:38.383 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:38.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:38.433 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:38.432+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:38.534 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:38.534+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:38.552 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:38.553 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:38.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:38.653 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:38.654+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:38.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:40:38.735 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:38.732+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:38.736 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:38.736 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:38.750 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:38.837 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:38.836+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:38.909 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:38.909 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:38.921 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:38.973 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:38.974+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:39.038 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:39.036+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:39.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:39.042 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:39.042 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:39.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:39.145 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:39.146+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:39.176 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:39.176 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:39.193 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:39.193 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:39.209 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:39.210 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:39.222 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:39.222 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:39.225 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:39.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:39.246 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:39.246 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:39.246 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:39.246+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:39.267 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:39.267 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:39.287 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:39.288 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:39.308 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:39.308 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:39.355 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:39.355 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:39.356 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:39.356 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:39.354+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:39.368 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:39.443 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:39.440+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:39.527 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:39.527 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:39.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:39.527 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:39.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.527 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1326 3.33 3:cd5db5f2:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:39.527 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:39.527 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 41.684041884999999, 2024-04-26T12:40:39.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016038528, 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1326 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842593+0000", 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.842595+0000", 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9420000000000002e-06 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843194+0000", 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00059943799999999999 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843214+0000", 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9970999999999999e-05 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843223+0000", 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0040000000000005e-06 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843310+0000", 2024-04-26T12:40:39.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6973999999999998e-05 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843418+0000", 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010787 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.843511+0000", 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3305000000000002e-05 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.846677+0000", 2024-04-26T12:40:39.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0031658749999999999 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858525+0000", 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011848348 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858582+0000", 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6119000000000003e-05 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.858631+0000", 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9682000000000003e-05 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2320 3.27 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.137142176000001, 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020624966000000002, 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.533 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2320 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389495+0000", 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390861+0000", 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013652849999999999 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390898+0000", 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6789000000000003e-05 2024-04-26T12:40:39.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390908+0000", 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.065e-05 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390983+0000", 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391089+0000", 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105752 2024-04-26T12:40:39.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391177+0000", 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7596999999999995e-05 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.395646+0000", 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044690889999999999 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410024+0000", 2024-04-26T12:40:39.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014378050999999999 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410065+0000", 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1056000000000001e-05 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410117+0000", 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2485000000000003e-05 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.538 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2325 3.2 3:40f43f1f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.087790270999999, 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013366813, 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2325 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.539 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438844+0000", 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.438847+0000", 2024-04-26T12:40:39.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7769999999999998e-06 2024-04-26T12:40:39.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440481+0000", 2024-04-26T12:40:39.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001633731 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440511+0000", 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0247999999999999e-05 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440523+0000", 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1861999999999999e-05 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440605+0000", 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2392000000000007e-05 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440774+0000", 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168985 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.440934+0000", 2024-04-26T12:40:39.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159908 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.445923+0000", 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049891900000000001 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452114+0000", 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006190887 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452168+0000", 2024-04-26T12:40:39.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3749999999999999e-05 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.452211+0000", 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3083000000000001e-05 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2329 3.38 3:1f4c78ed:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.047812867000001, 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015527136, 2024-04-26T12:40:39.545 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2329 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478822+0000", 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.478825+0000", 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8959999999999999e-06 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480286+0000", 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001461644 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480319+0000", 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2527000000000002e-05 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480334+0000", 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.519e-05 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480420+0000", 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5643999999999995e-05 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480572+0000", 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000152237 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.480724+0000", 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015249 2024-04-26T12:40:39.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.484967+0000", 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042430879999999999 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494254+0000", 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092865980000000001 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494295+0000", 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0503000000000002e-05 2024-04-26T12:40:39.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494349+0000", 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4318999999999999e-05 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2330 3.27 3:e503c54d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.037966725, 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014172947999999999, 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.551 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2330 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488668+0000", 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.488670+0000", 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.751e-06 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.489978+0000", 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013084850000000001 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.553 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490008+0000", 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9967999999999998e-05 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490021+0000", 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2745000000000001e-05 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490094+0000", 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2849999999999995e-05 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490217+0000", 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012377300000000001 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.490323+0000", 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105132 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.494969+0000", 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046460959999999997 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502769+0000", 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078001370000000004 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502810+0000", 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1412000000000003e-05 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.502841+0000", 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0599000000000003e-05 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.556 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2338 3.2 3:40db620f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.955950822999998, 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017810332000000002, 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2338 2024-04-26T12:40:39.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570684+0000", 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.570686+0000", 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1229999999999998e-06 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572072+0000", 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001386125 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572105+0000", 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3492999999999999e-05 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572116+0000", 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0627e-05 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572187+0000", 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0531999999999995e-05 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572308+0000", 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012157700000000001 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:39.560 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.572414+0000", 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105889 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576935+0000", 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045206049999999996 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588421+0000", 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011486111 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588462+0000", 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1270000000000003e-05 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.588494+0000", 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1980000000000002e-05 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2348 3.29 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:39.562 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.834261773000001, 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019384129999999999, 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2348 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692373+0000", 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.692376+0000", 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2320000000000001e-06 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.693975+0000", 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001598808 2024-04-26T12:40:39.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694006+0000", 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1606000000000002e-05 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694021+0000", 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4783999999999999e-05 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694117+0000", 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5851000000000001e-05 2024-04-26T12:40:39.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694259+0000", 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014201099999999999 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.694400+0000", 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014122200000000001 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.698538+0000", 2024-04-26T12:40:39.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041381170000000002 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711595+0000", 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013056636 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711687+0000", 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1630000000000002e-05 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.711757+0000", 2024-04-26T12:40:39.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0233000000000003e-05 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2356 3.7 3:e10f5880:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_165:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.749265936, 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015864989999999999, 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.568 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2356 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777369+0000", 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.777372+0000", 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8890000000000002e-06 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779070+0000", 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001698764 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779096+0000", 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5959e-05 2024-04-26T12:40:39.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779107+0000", 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0797e-05 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779183+0000", 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5788e-05 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779320+0000", 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000137269 2024-04-26T12:40:39.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.779408+0000", 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7560999999999997e-05 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.783717+0000", 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043093230000000003 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793104+0000", 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009387411 2024-04-26T12:40:39.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793178+0000", 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3843000000000004e-05 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.793234+0000", 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5386000000000001e-05 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.573 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2372 3.1e 3:788eb98e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.575709980999999, 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019326650000000001, 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2372 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950925+0000", 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.950927+0000", 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4310000000000001e-06 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953107+0000", 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021800080000000002 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953135+0000", 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7529999999999999e-05 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953149+0000", 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4171e-05 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953240+0000", 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0983999999999995e-05 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953413+0000", 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017362399999999999 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.953577+0000", 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000163864 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.959646+0000", 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060690620000000001 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970130+0000", 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010484228999999999 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970199+0000", 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8866000000000001e-05 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.970251+0000", 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1881e-05 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2374 3.38 3:1c1a4d28:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.553987775, 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020357772999999999, 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2374 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:40:39.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972649+0000", 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974485+0000", 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018357899999999999 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974516+0000", 2024-04-26T12:40:39.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1142000000000001e-05 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974531+0000", 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.455e-05 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974627+0000", 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6543e-05 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974833+0000", 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020613700000000001 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.975018+0000", 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000184267 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.981099+0000", 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00608093 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011762869 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992942+0000", 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0517000000000002e-05 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.993005+0000", 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2648000000000001e-05 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.584 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2376 3.5 e73/17 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.528373666, 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011508294000000001, 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998261+0000", 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.998273+0000", 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1647999999999999e-05 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002533+0000", 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042605840000000004 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002562+0000", 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9343999999999999e-05 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002577+0000", 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4592e-05 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002663+0000", 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6013000000000005e-05 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.002694+0000", 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0817e-05 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009691+0000", 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0069972710000000002 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.009769+0000", 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8024999999999999e-05 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2382 3.3c e73/17 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head v 73'7, mlcod=72'5)", 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.467751612000001, 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016599513, 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.589 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058883+0000", 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.058885+0000", 2024-04-26T12:40:39.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.062970+0000", 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0040850720000000004 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063005+0000", 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5342999999999997e-05 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063021+0000", 2024-04-26T12:40:39.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6019e-05 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063152+0000", 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013094699999999999 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.063181+0000", 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8561999999999999e-05 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075419+0000", 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012238667 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.075482+0000", 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3229000000000001e-05 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2388 3.2 3:404073be:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.410109449, 2024-04-26T12:40:39.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019415504, 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2388 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116525+0000", 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.116528+0000", 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9170000000000002e-06 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118771+0000", 2024-04-26T12:40:39.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002243091 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118792+0000", 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0990000000000001e-05 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118802+0000", 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0086e-05 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.118912+0000", 2024-04-26T12:40:39.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109497 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119038+0000", 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126198 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.119125+0000", 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7186000000000002e-05 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.123050+0000", 2024-04-26T12:40:39.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039251169999999997 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135829+0000", 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012779209 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135892+0000", 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2728e-05 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135941+0000", 2024-04-26T12:40:39.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8485000000000001e-05 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2389 3.2 3:427feba5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.398478828000002, 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019131569000000001, 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.599 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2389 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128156+0000", 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.128159+0000", 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.864e-06 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130062+0000", 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019030500000000001 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130088+0000", 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5890000000000001e-05 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130098+0000", 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0263e-05 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130167+0000", 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9643999999999999e-05 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130306+0000", 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013836499999999999 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:39.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.130397+0000", 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1003999999999998e-05 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.135001+0000", 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004604403 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147180+0000", 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012178362 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147227+0000", 2024-04-26T12:40:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6981000000000003e-05 2024-04-26T12:40:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.147287+0000", 2024-04-26T12:40:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0742999999999998e-05 2024-04-26T12:40:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.604 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.276814088999998, 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:40:39.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:40:39.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2407 3.33 3:ce0fe289:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_216:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.209400908999999, 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018708978000000001, 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.611 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2407 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317234+0000", 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.317236+0000", 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7539999999999998e-06 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318627+0000", 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013905600000000001 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318660+0000", 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3042e-05 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318676+0000", 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5775999999999999e-05 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318777+0000", 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101152 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.318986+0000", 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000208648 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.319165+0000", 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017941699999999999 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.324600+0000", 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054352430000000002 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335812+0000", 2024-04-26T12:40:39.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011211308999999999 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335886+0000", 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4263000000000004e-05 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.335943+0000", 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6814000000000002e-05 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2409 3.1e 3:7ac1137c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.183374583999999, 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017629292000000001, 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2409 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343260+0000", 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.343262+0000", 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9549999999999999e-06 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345627+0000", 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023648459999999999 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345658+0000", 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1154e-05 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345675+0000", 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7456e-05 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.345800+0000", 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012460300000000001 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346033+0000", 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023336599999999999 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.346192+0000", 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015833500000000001 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.352130+0000", 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059381190000000004 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360741+0000", 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0086116479999999995 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360811+0000", 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9342000000000001e-05 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.360889+0000", 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8467999999999995e-05 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2417 3.8 3:10729fe4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.086761462999998, 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012677982000000001, 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.622 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2417 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439873+0000", 2024-04-26T12:40:39.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.439876+0000", 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441807+0000", 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001931239 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441829+0000", 2024-04-26T12:40:39.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1883999999999999e-05 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441839+0000", 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0084999999999999e-05 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.441928+0000", 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8608000000000003e-05 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442072+0000", 2024-04-26T12:40:39.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144053 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.442170+0000", 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7921e-05 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.449581+0000", 2024-04-26T12:40:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074107469999999996 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452422+0000", 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028413570000000001 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452496+0000", 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3857999999999997e-05 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.452551+0000", 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5299e-05 2024-04-26T12:40:39.627 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.042151297, 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.628 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:39.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2423 3.b 3:d15dbab2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.022633961, 2024-04-26T12:40:39.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012126067000000001, 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2423 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504001+0000", 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.504003+0000", 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.452e-06 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506649+0000", 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026461879999999998 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506674+0000", 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4689e-05 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506686+0000", 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1595e-05 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506759+0000", 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658000000000005e-05 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506933+0000", 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017354100000000001 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.507051+0000", 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118578 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.513156+0000", 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0061047319999999999 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515986+0000", 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028303199999999999 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516064+0000", 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7466999999999995e-05 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516127+0000", 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2847000000000003e-05 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.638 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:39.639 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:39.639 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:39.640 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:39.641 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:39.638+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:39.741 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:39.740+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:39.774 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:39.774 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:39.774 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:39.774 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:39.790 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:40:39.790 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:39.842 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:39.842+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:39.943 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:39.942+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:39.959 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:39.959 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:39.960 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:39.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:40.044 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:40.044+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:40.098 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:40.098 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:40.098 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:40.098 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:40.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.098 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1601 3.1d e67/17 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:40.098 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:40.098 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.369036792000003, 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021057349999999999, 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:40.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727484+0000", 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733321+0000", 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005836351 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733360+0000", 2024-04-26T12:40:40.100 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9648999999999999e-05 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733383+0000", 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2722999999999999e-05 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733504+0000", 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012115199999999999 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.101 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733558+0000", 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3511999999999999e-05 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748395+0000", 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014836937 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748539+0000", 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144356 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.102 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2320 3.27 e72/17 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head v 72'3, mlcod=67'1)", 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.706012933, 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017587200000000001, 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2799999999999995e-07 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396488+0000", 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059817680000000002 2024-04-26T12:40:40.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396509+0000", 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0888999999999999e-05 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396520+0000", 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0708e-05 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396619+0000", 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9263000000000002e-05 2024-04-26T12:40:40.105 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396654+0000", 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5125e-05 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408029+0000", 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011374815 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408093+0000", 2024-04-26T12:40:40.106 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3804000000000001e-05 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2337 3.1b e72/17 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.537730512, 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015714998000000001, 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.107 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558789+0000", 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4780000000000001e-06 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.108 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563525+0000", 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047351470000000003 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563558+0000", 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3284999999999997e-05 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563574+0000", 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.573e-05 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.109 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563664+0000", 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0006000000000005e-05 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563690+0000", 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6619999999999999e-05 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574423+0000", 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010732396 2024-04-26T12:40:40.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574503+0000", 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0335999999999998e-05 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2347 3.a e72/17 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head v 72'3, mlcod=71'1)", 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.411158714999999, 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019978432000000001, 2024-04-26T12:40:40.111 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685363+0000", 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688265+0000", 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029017240000000001 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688336+0000", 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1422999999999997e-05 2024-04-26T12:40:40.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688364+0000", 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7234999999999999e-05 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688534+0000", 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017049599999999999 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688604+0000", 2024-04-26T12:40:40.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0016000000000002e-05 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705182+0000", 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016577543 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705338+0000", 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156479 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2348 3.29 e72/17 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.403547377999999, 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016659368000000001, 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692973+0000", 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2199999999999999e-06 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699798+0000", 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0068248750000000002 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699829+0000", 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699845+0000", 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6132000000000001e-05 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699973+0000", 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012803099999999999 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700015+0000", 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2052000000000003e-05 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709497+0000", 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094813919999999999 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709631+0000", 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013391299999999999 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.119 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2351 3.14 e72/31 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head v 72'4, mlcod=72'2)", 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.363433116, 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018622024000000001, 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:40.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733088+0000", 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.48e-06 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735690+0000", 2024-04-26T12:40:40.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026018040000000001 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735724+0000", 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4585999999999997e-05 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735743+0000", 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8309e-05 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735878+0000", 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013522999999999999 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735919+0000", 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1223000000000002e-05 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751443+0000", 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015524247999999999 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751707+0000", 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026414400000000001 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2352 3.31 e73/17 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.360189577, 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017289571, 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736330+0000", 2024-04-26T12:40:40.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0100000000000001e-06 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740605+0000", 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042746169999999997 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740643+0000", 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8776000000000003e-05 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740669+0000", 2024-04-26T12:40:40.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5499000000000001e-05 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740805+0000", 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013579099999999999 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740847+0000", 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2642000000000003e-05 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753498+0000", 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012651172 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753619+0000", 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012006399999999999 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.128527889000001, 2024-04-26T12:40:40.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:40:40.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:40:40.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2375 3.1c e73/17 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.109595392999999, 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018742169999999999, 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986925+0000", 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0439999999999998e-06 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992153+0000", 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005227644 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992186+0000", 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3256000000000001e-05 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992210+0000", 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4249000000000001e-05 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992375+0000", 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016447 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992438+0000", 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3318999999999995e-05 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005540+0000", 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013101550999999999 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005665+0000", 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000125637 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.136 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2378 3.1d e73/17 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.080795108, 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015708637000000001, 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:40.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015726+0000", 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4030000000000001e-06 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018549+0000", 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028231969999999999 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018590+0000", 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0995000000000003e-05 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018609+0000", 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8850000000000001e-05 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018752+0000", 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143633 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018793+0000", 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0496e-05 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031304+0000", 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012510795999999999 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031432+0000", 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128267 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2396 3.31 e73/17 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.883701612999999, 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015460707000000001, 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.141 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212819+0000", 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.497e-06 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216796+0000", 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039765190000000004 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216829+0000", 2024-04-26T12:40:40.143 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2712000000000001e-05 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216845+0000", 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6464e-05 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217025+0000", 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000179989 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217090+0000", 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5087999999999998e-05 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228134+0000", 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011044185 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228278+0000", 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014325300000000001 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.851843217999999, 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.146 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:40:40.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:40:40.149 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2400 3.27 e73/17 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.846116238, 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020886715, 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.150 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250405+0000", 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254952+0000", 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045466930000000001 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254991+0000", 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9298999999999998e-05 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255014+0000", 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2711999999999999e-05 2024-04-26T12:40:40.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255166+0000", 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015193699999999999 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255207+0000", 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1436000000000001e-05 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271130+0000", 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015923262000000001 2024-04-26T12:40:40.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271289+0000", 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015862600000000001 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2402 3.11 e73/17 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.823859279000001, 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018233177, 2024-04-26T12:40:40.154 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272662+0000", 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.157e-06 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276695+0000", 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040329739999999999 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276735+0000", 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9338999999999997e-05 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276760+0000", 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4893e-05 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276943+0000", 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000183489 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277008+0000", 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4704999999999998e-05 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.157 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290772+0000", 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013764406999999999 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290892+0000", 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120213 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2403 3.3 e73/31 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:40.158 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.818368829000001, 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016271938, 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:40.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278151+0000", 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4e-07 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282860+0000", 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047094179999999999 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282891+0000", 2024-04-26T12:40:40.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0562999999999999e-05 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282909+0000", 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7995999999999998e-05 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283056+0000", 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014763299999999999 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283099+0000", 2024-04-26T12:40:40.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3139000000000002e-05 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294299+0000", 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011200185 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294422+0000", 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012216399999999999 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2406 3.9 e73/31 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head v 73'3, mlcod=67'1)", 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.789588047999999, 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016385118000000001, 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306931+0000", 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3300000000000001e-07 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312959+0000", 2024-04-26T12:40:40.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060277100000000004 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312990+0000", 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0786e-05 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313005+0000", 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5373e-05 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313149+0000", 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014355999999999999 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313191+0000", 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1928999999999998e-05 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323173+0000", 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099826700000000008 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323316+0000", 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014235699999999999 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2411 3.31 e73/17 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head v 73'10, mlcod=73'8)", 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.726272446999999, 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015408975, 2024-04-26T12:40:40.168 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370249+0000", 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3869999999999999e-06 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375387+0000", 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051375539999999999 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375425+0000", 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8186000000000003e-05 2024-04-26T12:40:40.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375449+0000", 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3620000000000001e-05 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375622+0000", 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017309500000000001 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375673+0000", 2024-04-26T12:40:40.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0849000000000001e-05 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385561+0000", 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098879090000000003 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385655+0000", 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4375000000000004e-05 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2421 3.27 e73/17 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.611355105000001, 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018694483000000001, 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485166+0000", 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4660000000000002e-06 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490411+0000", 2024-04-26T12:40:40.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052454119999999996 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490447+0000", 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6106000000000003e-05 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490466+0000", 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8329999999999999e-05 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490659+0000", 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019286800000000001 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490703+0000", 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4725999999999998e-05 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503764+0000", 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013060251 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503858+0000", 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4324e-05 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2428 3.1a e73/31 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.543445602999999, 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015568897, 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.177 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553076+0000", 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.01e-06 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557315+0000", 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042394160000000002 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557363+0000", 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7271999999999997e-05 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557388+0000", 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5249000000000002e-05 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557559+0000", 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000171039 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557621+0000", 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1999000000000001e-05 2024-04-26T12:40:40.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568551+0000", 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010930415000000001 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568642+0000", 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0496999999999998e-05 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2431 3.31 e73/17 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head v 73'11, mlcod=73'9)", 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.512739258, 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01575095, 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583783+0000", 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4960000000000001e-06 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589105+0000", 2024-04-26T12:40:40.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053218140000000002 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589142+0000", 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7149e-05 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589159+0000", 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.774e-05 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589317+0000", 2024-04-26T12:40:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000157589 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589380+0000", 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2708999999999999e-05 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599423+0000", 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010042882 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599530+0000", 2024-04-26T12:40:40.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107571 2024-04-26T12:40:40.186 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.186 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.186 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.186 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.186 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.186 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:40.188 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:40.188 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:40.186+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:40.289 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:40.288+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:40.357 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:40.358 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:40.358 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:40.358 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:40.371 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:40.413 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:40.412+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:40.490 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:40.490+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:40.538 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:40.538 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:40.539 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:40.539 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:40.539 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:40.553 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:40.591 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:40.590+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1328 3.1f e67/17 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.813719261000003, 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019374358000000001, 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.679 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.28e-07 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867669+0000", 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004831915 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867686+0000", 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6895999999999999e-05 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867695+0000", 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867801+0000", 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010592200000000001 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867837+0000", 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6032000000000003e-05 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882087+0000", 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014249265000000001 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882212+0000", 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012479900000000001 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1457 3.22 3:46753612:::d749f084-3851-4e95-9492-490675b43f90.4382.3__shadow_.89eL0OTfRIkm8jjkAhjXzYFORkpc2AZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:40.683 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.075341694999999, 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021050049000000001, 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1457 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601217+0000", 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.509e-06 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607652+0000", 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064351900000000004 2024-04-26T12:40:40.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607693+0000", 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0868999999999998e-05 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607712+0000", 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8702000000000002e-05 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607889+0000", 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000177061 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608263+0000", 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037431500000000001 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608646+0000", 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038215100000000001 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.620501+0000", 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011855625 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622083+0000", 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001581556 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622195+0000", 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112667 2024-04-26T12:40:40.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622265+0000", 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9404000000000002e-05 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1601 3.1d 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.955838825000001, 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028382847999999999, 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.689 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1601 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720720+0000", 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3300000000000001e-06 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726577+0000", 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005857307 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726616+0000", 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9224999999999998e-05 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726640+0000", 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3873e-05 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726810+0000", 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016950799999999999 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727033+0000", 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022316600000000001 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727242+0000", 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020876 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748847+0000", 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021605347 2024-04-26T12:40:40.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748917+0000", 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9413999999999996e-05 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749020+0000", 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103383 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749100+0000", 2024-04-26T12:40:40.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0535000000000001e-05 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1602 3.28 3:15f7ca78:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 40.949863608999998, 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021360100999999999, 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.695 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1602 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726695+0000", 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1900000000000002e-06 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729949+0000", 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032543730000000001 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729991+0000", 2024-04-26T12:40:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1403000000000003e-05 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730016+0000", 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5709000000000001e-05 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730228+0000", 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021134999999999999 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730651+0000", 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042305000000000001 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.731097+0000", 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044566700000000001 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.740379+0000", 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092821050000000006 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747886+0000", 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007507555 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747980+0000", 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3727000000000006e-05 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748053+0000", 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2972000000000005e-05 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.700 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2322 3.1c 3:3aeebad8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.269714616000002, 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017554513000000001, 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2322 2024-04-26T12:40:40.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406844+0000", 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2050000000000001e-06 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412062+0000", 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052182130000000002 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412097+0000", 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5086000000000003e-05 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412118+0000", 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0299999999999999e-05 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412207+0000", 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9482999999999997e-05 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412358+0000", 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000150483 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:40.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412463+0000", 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000104956 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.423146+0000", 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01068347 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424315+0000", 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011691799999999999 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424359+0000", 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4212000000000003e-05 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424396+0000", 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6925000000000003e-05 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2357 3.2a 3:5615e7fe:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.706 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.890232566999998, 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019796023999999999, 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2357 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786327+0000", 2024-04-26T12:40:40.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.49e-06 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790818+0000", 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044903690000000001 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790860+0000", 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1851999999999998e-05 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790879+0000", 2024-04-26T12:40:40.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9551999999999998e-05 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791003+0000", 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012405399999999999 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791242+0000", 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238495 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:40.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791453+0000", 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000211005 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.801975+0000", 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010522658000000001 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.805976+0000", 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040003449999999998 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806054+0000", 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8757999999999994e-05 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806120+0000", 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5445999999999996e-05 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2358 3.c 3:30528342:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:40.712 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.878342410999998, 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017961708999999999, 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2358 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:40.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:40.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.714 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.714 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798217+0000", 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4120000000000001e-06 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802700+0000", 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044824900000000004 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802739+0000", 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9181999999999999e-05 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802766+0000", 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6682e-05 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802894+0000", 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128102 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.803151+0000", 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025679700000000001 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.803409+0000", 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025825099999999998 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.812254+0000", 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0088452759999999991 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.815918+0000", 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0036635259999999998 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.816068+0000", 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000150777 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.816176+0000", 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010721399999999999 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.718 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2367 3.2a 3:55ec8106:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.778610849, 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020327305, 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2367 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.719 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897949+0000", 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4489999999999999e-06 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902370+0000", 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044209369999999998 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902408+0000", 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8541999999999998e-05 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902428+0000", 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9040000000000001e-05 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902607+0000", 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017954599999999999 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903016+0000", 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040908999999999997 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903422+0000", 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040581100000000001 2024-04-26T12:40:40.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.917186+0000", 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013763861 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918102+0000", 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091656300000000001 2024-04-26T12:40:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918200+0000", 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7906999999999996e-05 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918273+0000", 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2558999999999994e-05 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2375 3.1c 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.696877159, 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026708701000000001, 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2375 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979683+0000", 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8759999999999998e-06 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985829+0000", 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061460810000000003 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985877+0000", 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7812000000000002e-05 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985907+0000", 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9713000000000002e-05 2024-04-26T12:40:40.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986054+0000", 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014770300000000001 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986363+0000", 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030863899999999998 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986696+0000", 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033299000000000002 2024-04-26T12:40:40.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.997022+0000", 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010325732000000001 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006148+0000", 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091265240000000004 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006280+0000", 2024-04-26T12:40:40.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013179399999999999 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006388+0000", 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107837 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2376 3.5 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.687570790999999, 2024-04-26T12:40:40.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020175694000000001, 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2376 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988989+0000", 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5769999999999998e-06 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995521+0000", 2024-04-26T12:40:40.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006531635 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995571+0000", 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9738999999999999e-05 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995601+0000", 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995729+0000", 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012808399999999999 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996014+0000", 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028456400000000001 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996264+0000", 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025048699999999998 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006170+0000", 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099054369999999996 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009021+0000", 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028506730000000002 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009103+0000", 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2908e-05 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009161+0000", 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7855000000000001e-05 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2378 3.1d 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.666108997999999, 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023192784000000001, 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.736 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2378 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.737 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010450+0000", 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5239999999999999e-06 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014852+0000", 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044019619999999997 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014884+0000", 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2323000000000002e-05 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014900+0000", 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5651999999999999e-05 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015044+0000", 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014389700000000001 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015292+0000", 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024860399999999998 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015521+0000", 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022877100000000001 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031237+0000", 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015715600999999999 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033338+0000", 2024-04-26T12:40:40.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021008699999999999 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033518+0000", 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180089 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033640+0000", 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012249099999999999 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.741 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2380 3.c 3:32d641af:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.645209276999999, 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019849939, 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2380 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031352+0000", 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5399999999999997e-06 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.743 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039154+0000", 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007802135 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039191+0000", 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7240000000000003e-05 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039210+0000", 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9236e-05 2024-04-26T12:40:40.744 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039358+0000", 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147866 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039611+0000", 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000253298 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039846+0000", 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023419399999999999 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.745 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.049633+0000", 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097878089999999997 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.050899+0000", 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001265455 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051067+0000", 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016852600000000001 2024-04-26T12:40:40.746 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051197+0000", 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012964000000000001 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2382 3.3c 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.625004727, 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023553801999999999, 2024-04-26T12:40:40.747 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2382 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051554+0000", 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.706e-06 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.055983+0000", 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044283889999999996 2024-04-26T12:40:40.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056027+0000", 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4518999999999998e-05 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056052+0000", 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4675999999999999e-05 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056206+0000", 2024-04-26T12:40:40.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015424199999999999 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056594+0000", 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038824299999999998 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056974+0000", 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000379751 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068770+0000", 2024-04-26T12:40:40.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011795386999999999 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074792+0000", 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060226439999999997 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074974+0000", 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000181282 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.075105+0000", 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131963 2024-04-26T12:40:40.752 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2387 3.28 3:1657e0bf:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.573740595, 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018313085, 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.753 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2387 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102819+0000", 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107254+0000", 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044347290000000001 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107287+0000", 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2753000000000003e-05 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107302+0000", 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5302999999999999e-05 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107463+0000", 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161531 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107863+0000", 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039991799999999997 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.108294+0000", 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043064600000000002 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.118549+0000", 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010255083 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.120957+0000", 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024081990000000002 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121053+0000", 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6070999999999995e-05 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121129+0000", 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5574999999999994e-05 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2392 3.30 3:0e664f76:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.514270832000001, 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020233060000000001, 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2392 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162289+0000", 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:40.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166843+0000", 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045541959999999999 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166886+0000", 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2908999999999999e-05 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166917+0000", 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0741999999999998e-05 2024-04-26T12:40:40.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167061+0000", 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143771 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167317+0000", 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000256493 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167549+0000", 2024-04-26T12:40:40.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023142099999999999 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.176299+0000", 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0087508729999999993 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182351+0000", 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060514330000000002 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182446+0000", 2024-04-26T12:40:40.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5531000000000004e-05 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182519+0000", 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2175000000000006e-05 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2399 3.1d 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.437368839000001, 2024-04-26T12:40:40.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029752193999999999, 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2399 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239192+0000", 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1829999999999996e-06 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243681+0000", 2024-04-26T12:40:40.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044893629999999997 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243722+0000", 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0639000000000002e-05 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243743+0000", 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0760000000000001e-05 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243882+0000", 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013962600000000001 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244142+0000", 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025946699999999999 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244378+0000", 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000236839 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254731+0000", 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010353004000000001 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268598+0000", 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013866431 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268779+0000", 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018066499999999999 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268940+0000", 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016121700000000001 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2401 3.2a 3:54e389fa:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.418218920000001, 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018846505999999999, 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.770 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2401 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258341+0000", 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1559999999999999e-06 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262849+0000", 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045083329999999998 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262889+0000", 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9903000000000001e-05 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262907+0000", 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8179e-05 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263036+0000", 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012896000000000001 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263291+0000", 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025503100000000002 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263523+0000", 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023191100000000001 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.275751+0000", 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012228517 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276977+0000", 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012251580000000001 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277070+0000", 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3718e-05 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277184+0000", 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011364 2024-04-26T12:40:40.775 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2405 3.22 3:45892c0a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.381866385999999, 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017862690000000001, 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.776 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2405 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294694+0000", 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9929999999999997e-06 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299557+0000", 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048627050000000002 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299594+0000", 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6996000000000003e-05 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299612+0000", 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8695999999999999e-05 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299745+0000", 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013255 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299991+0000", 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000246481 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.300210+0000", 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218588 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.309919+0000", 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097093330000000005 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312225+0000", 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002306125 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312421+0000", 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019588599999999999 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312553+0000", 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013133700000000001 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.781 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2410 3.16 3:697fa4a2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.318935045, 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019793999999999999, 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2410 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357625+0000", 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8630000000000001e-06 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362361+0000", 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004736011 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362400+0000", 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8719e-05 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362418+0000", 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8366e-05 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362541+0000", 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012312400000000001 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362785+0000", 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000243837 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.363004+0000", 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218629 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.376177+0000", 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173239999999999 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377237+0000", 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001059862 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377335+0000", 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8171000000000006e-05 2024-04-26T12:40:40.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377415+0000", 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0178000000000004e-05 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2425 3.5 3:a11dc694:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.153435867999999, 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018795115000000001, 2024-04-26T12:40:40.787 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2425 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523123+0000", 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528942+0000", 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058186920000000003 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528985+0000", 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2951999999999998e-05 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529011+0000", 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6190000000000002e-05 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529142+0000", 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013053000000000001 2024-04-26T12:40:40.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529415+0000", 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027316299999999999 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529659+0000", 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024458800000000001 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.538947+0000", 2024-04-26T12:40:40.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092877199999999993 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541743+0000", 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002795723 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541840+0000", 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7261000000000003e-05 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:40.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541916+0000", 2024-04-26T12:40:40.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5562000000000006e-05 2024-04-26T12:40:40.793 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.793 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.793 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.793 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:40.793 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:40.793 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:40.794 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:40.795 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:40.794+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:40.896 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:40.892+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:40.921 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:40.921 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:40.921 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:40.921 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:40.935 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:40.997 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:40.998+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:41.098 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:41.096+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:41.100 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:41.101 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:41.101 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:41.101 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:41.101 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:41.115 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:41.201 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:41.200+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:41.286 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:41.286 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:41.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:41.286 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:41.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.286 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1325 3.34 3:2cf99e10:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:41.286 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:41.286 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 43.444282248999997, 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020543797999999999, 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1325 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:41.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837059+0000", 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2140000000000001e-06 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843506+0000", 2024-04-26T12:40:41.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064467209999999999 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843561+0000", 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.5291999999999998e-05 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843589+0000", 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8354999999999999e-05 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843720+0000", 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013083999999999999 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843945+0000", 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000224782 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.844155+0000", 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000209743 2024-04-26T12:40:41.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857491+0000", 2024-04-26T12:40:41.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013336249 2024-04-26T12:40:41.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857520+0000", 2024-04-26T12:40:41.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8941e-05 2024-04-26T12:40:41.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857557+0000", 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7115e-05 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857600+0000", 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2546000000000002e-05 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.293 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1460 3.36 3:6e35934d:::d749f084-3851-4e95-9492-490675b43f90.4382.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.655966450000001, 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025121213, 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1460 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625375+0000", 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631320+0000", 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059444809999999997 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631360+0000", 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0398999999999997e-05 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631378+0000", 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8050000000000002e-05 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631551+0000", 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017255800000000001 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631822+0000", 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027131799999999999 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.632685+0000", 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00086248900000000003 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.649790+0000", 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017105170999999999 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650179+0000", 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000389284 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650359+0000", 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180061 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650493+0000", 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133876 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2331 3.26 3:660a096e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:41.299 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.783711357000001, 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018877251000000001, 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2331 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:41.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497630+0000", 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4400000000000001e-06 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501943+0000", 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004312715 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501979+0000", 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6365999999999997e-05 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501997+0000", 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7793000000000001e-05 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502089+0000", 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1958000000000003e-05 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502288+0000", 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019909800000000001 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502477+0000", 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018923200000000001 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.509874+0000", 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073965639999999996 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516336+0000", 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006461629 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516433+0000", 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7807999999999996e-05 2024-04-26T12:40:41.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516504+0000", 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0648000000000005e-05 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2341 3.35 3:ad2a0070:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.675257433999999, 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020122823000000001, 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.305 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2341 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606084+0000", 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5030000000000002e-06 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610523+0000", 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004439035 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610563+0000", 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9305999999999999e-05 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610582+0000", 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9083e-05 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610736+0000", 2024-04-26T12:40:41.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015433999999999999 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611020+0000", 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028411000000000002 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611253+0000", 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023267200000000001 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.625380+0000", 2024-04-26T12:40:41.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014127366000000001 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626034+0000", 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00065407499999999995 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626133+0000", 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9141000000000005e-05 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626204+0000", 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2346 3.10 3:093f8fa5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.669959+0000", 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.611379399, 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016731467, 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.311 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2346 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.669959+0000", 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.669959+0000", 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.669962+0000", 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0699999999999998e-06 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.674529+0000", 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004567176 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.674567+0000", 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:40:41.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.674586+0000", 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8609000000000001e-05 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.674764+0000", 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017794299999999999 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.675041+0000", 2024-04-26T12:40:41.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027680700000000001 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.675278+0000", 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023771799999999999 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684276+0000", 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0089975750000000007 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.686515+0000", 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022386099999999998 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.686614+0000", 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9020999999999999e-05 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.686690+0000", 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6644999999999995e-05 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.316 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2347 3.a 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.601272415, 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025995128999999999, 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2347 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.317 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680068+0000", 2024-04-26T12:40:41.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2699999999999999e-06 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684436+0000", 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043681800000000002 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684474+0000", 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7696e-05 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684498+0000", 2024-04-26T12:40:41.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3736000000000001e-05 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684647+0000", 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014935999999999999 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684905+0000", 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000257767 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:41.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685154+0000", 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024906499999999997 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.694110+0000", 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0089561629999999996 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011663118 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705931+0000", 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015790699999999999 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706061+0000", 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012986700000000001 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2354 3.3f e73/17 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:41.322 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.517729545000002, 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023388658, 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3699999999999999e-07 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767456+0000", 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038463529999999998 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767493+0000", 2024-04-26T12:40:41.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7058999999999999e-05 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767512+0000", 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426e-05 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767810+0000", 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029746500000000001 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767864+0000", 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3974999999999997e-05 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786741+0000", 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018876885999999999 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786997+0000", 2024-04-26T12:40:41.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025665699999999998 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2361 3.26 3:6509be61:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.448212166000001, 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020183629000000002, 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.327 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2361 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:41.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833130+0000", 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7330000000000001e-06 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837748+0000", 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046180049999999997 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837801+0000", 2024-04-26T12:40:41.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3458999999999998e-05 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837829+0000", 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8299000000000001e-05 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837988+0000", 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015878100000000001 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838269+0000", 2024-04-26T12:40:41.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028097000000000002 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838507+0000", 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238118 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.852548+0000", 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014040777000000001 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853137+0000", 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00058917099999999999 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853233+0000", 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5338000000000001e-05 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853310+0000", 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6977999999999994e-05 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2372 3.1e e73/17 3:788eb98e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_181:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.952239+0000", 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.329099598999999, 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015929385000000001, 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.952239+0000", 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.952239+0000", 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.952239+0000", 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956216+0000", 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039770600000000001 2024-04-26T12:40:41.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956244+0000", 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7406000000000002e-05 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956260+0000", 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6152999999999999e-05 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956386+0000", 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012595999999999999 2024-04-26T12:40:41.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956428+0000", 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2252999999999997e-05 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.968028+0000", 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01160011 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.968168+0000", 2024-04-26T12:40:41.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013973600000000001 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2377 3.10 3:0bb0443e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.999174+0000", 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.282163771, 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015559542000000001, 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.337 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2377 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.999174+0000", 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.999174+0000", 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.999178+0000", 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3129999999999999e-06 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.003758+0000", 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045806989999999997 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.003795+0000", 2024-04-26T12:40:41.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6752000000000003e-05 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.003814+0000", 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.003945+0000", 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013163000000000001 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.004197+0000", 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000251201 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.004431+0000", 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023426499999999999 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.013480+0000", 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.009048759 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014565+0000", 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001084911 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014664+0000", 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9117999999999995e-05 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014734+0000", 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0290999999999995e-05 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.342 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2379 3.2c 3:3590e7ea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.260263719000001, 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022546869000000001, 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2379 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021078+0000", 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026404+0000", 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053251669999999996 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026452+0000", 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8304999999999999e-05 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026472+0000", 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.959e-05 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026612+0000", 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014085700000000001 2024-04-26T12:40:41.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027080+0000", 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00046714499999999997 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027701+0000", 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00062184600000000001 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041035+0000", 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013333617000000001 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043446+0000", 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024114359999999999 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043546+0000", 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100041 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043621+0000", 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4808000000000006e-05 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2381 3.26 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.239793993999999, 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.027555486000000001, 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.349 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2381 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041549+0000", 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5539999999999999e-06 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046113+0000", 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045646840000000003 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046153+0000", 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046178+0000", 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4743e-05 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046298+0000", 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120087 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046514+0000", 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021600800000000001 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046746+0000", 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000232241 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056160+0000", 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094137170000000003 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068838+0000", 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012678149999999999 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069011+0000", 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173129 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069100+0000", 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8694000000000002e-05 2024-04-26T12:40:41.354 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2394 3.26 3:649f95b9:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.094924840000001, 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023463999999999999, 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.355 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2394 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186417+0000", 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2030000000000001e-06 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191437+0000", 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005020488 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191475+0000", 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7879000000000001e-05 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191493+0000", 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7703e-05 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191654+0000", 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016161600000000001 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191908+0000", 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025423399999999999 2024-04-26T12:40:41.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.192139+0000", 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230184 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.207939+0000", 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015800715999999999 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209724+0000", 2024-04-26T12:40:41.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001784461 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209809+0000", 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5014999999999998e-05 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209877+0000", 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8501e-05 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2404 3.20 3:079a3e14:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.995726908999998, 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017213770999999999, 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2404 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.361 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285615+0000", 2024-04-26T12:40:41.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5729999999999999e-06 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290079+0000", 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044646399999999998 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290120+0000", 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290140+0000", 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290273+0000", 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013316000000000001 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290551+0000", 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027847599999999999 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:41.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290916+0000", 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000364306 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.301035+0000", 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010119360000000001 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302519+0000", 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001484031 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302691+0000", 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017180599999999999 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302825+0000", 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013415000000000001 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.366 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2407 3.33 e73/17 3:ce0fe289:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_216:head v 73'5, mlcod=71'3)", 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.317687+0000", 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.963651284000001, 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016228299000000002, 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.317687+0000", 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.317687+0000", 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.317690+0000", 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321727+0000", 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040370670000000001 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321758+0000", 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1349000000000001e-05 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321780+0000", 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2036999999999999e-05 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321917+0000", 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000137319 2024-04-26T12:40:41.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321955+0000", 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7410000000000003e-05 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.333829+0000", 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011874325 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.333915+0000", 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6057999999999995e-05 2024-04-26T12:40:41.370 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2408 3.20 3:07238821:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.949966432, 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017149066000000001, 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.371 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2408 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331375+0000", 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4630000000000001e-06 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336575+0000", 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052001240000000004 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336603+0000", 2024-04-26T12:40:41.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7526e-05 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336622+0000", 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9613e-05 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336759+0000", 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013698399999999999 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337044+0000", 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028474300000000001 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337284+0000", 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023956699999999999 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.345871+0000", 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0085868230000000004 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348358+0000", 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024872269999999998 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348449+0000", 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0795000000000001e-05 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348521+0000", 2024-04-26T12:40:41.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2200999999999995e-05 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2433 3.2c 3:352e35ac:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.678204604000001, 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019506391000000001, 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.377 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2433 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603138+0000", 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.386e-06 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607459+0000", 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043213210000000004 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607499+0000", 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0228999999999997e-05 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607517+0000", 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7895999999999999e-05 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607651+0000", 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133487 2024-04-26T12:40:41.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607918+0000", 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026730100000000001 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.608152+0000", 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023403399999999999 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621350+0000", 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013197416999999999 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622407+0000", 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001057805 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622498+0000", 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0390999999999996e-05 2024-04-26T12:40:41.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622640+0000", 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014212400000000001 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2434 3.35 3:ac41eaea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.665275353999998, 2024-04-26T12:40:41.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022970694999999999, 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2434 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616067+0000", 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.907e-06 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620671+0000", 2024-04-26T12:40:41.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046047070000000004 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620709+0000", 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7392999999999999e-05 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620728+0000", 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9199e-05 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620876+0000", 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014752299999999999 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621360+0000", 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048465200000000002 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621810+0000", 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044939600000000002 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638455+0000", 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016645172 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638848+0000", 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000393137 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638951+0000", 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102771 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.639033+0000", 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2837999999999995e-05 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.389 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2437 3.26 3:65b96022:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.632139949999999, 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020654793000000001, 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2437 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649201+0000", 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.247e-06 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654391+0000", 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051896090000000004 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654430+0000", 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8906000000000003e-05 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654449+0000", 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8960000000000001e-05 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654577+0000", 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012784299999999999 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654838+0000", 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026151100000000002 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.655052+0000", 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021390800000000001 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.668862+0000", 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013810206 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669649+0000", 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00078632500000000004 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669747+0000", 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8478000000000001e-05 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669853+0000", 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001058 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2438 3.36 3:6cea662e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.623075792000002, 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021295308999999998, 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:41.395 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2438 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:41.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658266+0000", 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9870000000000001e-06 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662764+0000", 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044975229999999998 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662804+0000", 2024-04-26T12:40:41.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0575999999999999e-05 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662832+0000", 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8019000000000001e-05 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663009+0000", 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017632600000000001 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:41.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663314+0000", 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030489299999999998 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663544+0000", 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230564 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.678407+0000", 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014862254 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679337+0000", 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00093039800000000003 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679443+0000", 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105908 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679558+0000", 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114861 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.400 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:41.401 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:41.401 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:41.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:41.403 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:41.404 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:41.400+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:41.503 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:41.502+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:41.560 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:41.560 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:41.573 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:41.573 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:41.573 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:41.573 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:41.578 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:41.578 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:41.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:41.595 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:41.595 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:41.612 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:41.612 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:41.632 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:41.632 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:41.633 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:41.632+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:41.651 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:41.652 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:41.670 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:41.670 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:41.691 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:41.691 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:41.705 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:41.704+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:41.706 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:41.706 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:41.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:41.809 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:41.808+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:41.813 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:40:41.891 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:41.891 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:41.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:41.953 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:41.952+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:42.009 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:42.010+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:42.046 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:42.046 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:42.061 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:42.149 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:42.150+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:42.211 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:42.210+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:42.237 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:42.237 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:42.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:42.312 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:42.308+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:42.413 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:42.412+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:42.420 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:42.420 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:42.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:42.514 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:42.512+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:42.566 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:42.566 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:42.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:42.615 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:42.612+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:42.706 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:42.706 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:42.717 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:42.716+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:42.720 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:42.814 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:40:42.817 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:42.816+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:42.851 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:42.851 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:42.865 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:42.918 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:42.916+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:43.019 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:43.016+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:43.036 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:43.036 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:43.052 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:43.120 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:43.118+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:43.179 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:43.179 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:43.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:43.220 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:43.216+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:43.321 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:43.320+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:43.364 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:43.364 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:43.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:43.429 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:43.430+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:43.505 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:43.505 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:43.520 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:43.522 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:43.520+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:43.624 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:43.620+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:43.689 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:43.690 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:43.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:43.714 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:43.749 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:43.750+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:43.826 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:43.824+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:43.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:43.890 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:43.907 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:43.907 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:43.923 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:43.924 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:43.927 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:43.924+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:43.941 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:43.960 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:43.961 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:43.979 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:43.979 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:43.987 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:43.988 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:43.988 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:43.988 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:43.998 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:43.998 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:44.003 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:44.017 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:44.045 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:44.044+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:44.127 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:44.124+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:44.161 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:44.161 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:44.162 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:44.162 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:44.162 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:44.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:44.265 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:44.264+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:44.330 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:44.330+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:44.344 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1601 3.1d e67/17 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.614770718999999, 2024-04-26T12:40:44.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021057349999999999, 2024-04-26T12:40:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:44.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727484+0000", 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:40:44.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733321+0000", 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005836351 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733360+0000", 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9648999999999999e-05 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733383+0000", 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2722999999999999e-05 2024-04-26T12:40:44.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733504+0000", 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012115199999999999 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733558+0000", 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3511999999999999e-05 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748395+0000", 2024-04-26T12:40:44.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014836937 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748539+0000", 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144356 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2320 3.27 e72/17 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head v 72'3, mlcod=67'1)", 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.95174686, 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017587200000000001, 2024-04-26T12:40:44.349 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:44.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2799999999999995e-07 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396488+0000", 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059817680000000002 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396509+0000", 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0888999999999999e-05 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396520+0000", 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0708e-05 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396619+0000", 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9263000000000002e-05 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396654+0000", 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5125e-05 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408029+0000", 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011374815 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408093+0000", 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3804000000000001e-05 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.353 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2337 3.1b e72/17 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.783464438999999, 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015714998000000001, 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558789+0000", 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4780000000000001e-06 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563525+0000", 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047351470000000003 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563558+0000", 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3284999999999997e-05 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563574+0000", 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.573e-05 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563664+0000", 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0006000000000005e-05 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563690+0000", 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6619999999999999e-05 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574423+0000", 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010732396 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574503+0000", 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0335999999999998e-05 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2347 3.a e72/17 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head v 72'3, mlcod=71'1)", 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.656892642000003, 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019978432000000001, 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.358 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685363+0000", 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688265+0000", 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029017240000000001 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688336+0000", 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1422999999999997e-05 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688364+0000", 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7234999999999999e-05 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688534+0000", 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017049599999999999 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688604+0000", 2024-04-26T12:40:44.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0016000000000002e-05 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705182+0000", 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016577543 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705338+0000", 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156479 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2348 3.29 e72/17 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.649281305000002, 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016659368000000001, 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692973+0000", 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2199999999999999e-06 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699798+0000", 2024-04-26T12:40:44.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0068248750000000002 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699829+0000", 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699845+0000", 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6132000000000001e-05 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699973+0000", 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012803099999999999 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700015+0000", 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2052000000000003e-05 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709497+0000", 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094813919999999999 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709631+0000", 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013391299999999999 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2351 3.14 e72/31 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head v 72'4, mlcod=72'2)", 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.609167042999999, 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018622024000000001, 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.367 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733088+0000", 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.48e-06 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735690+0000", 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026018040000000001 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735724+0000", 2024-04-26T12:40:44.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4585999999999997e-05 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735743+0000", 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8309e-05 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735878+0000", 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013522999999999999 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735919+0000", 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1223000000000002e-05 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751443+0000", 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015524247999999999 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751707+0000", 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026414400000000001 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2352 3.31 e73/17 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.605923504000003, 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017289571, 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736330+0000", 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0100000000000001e-06 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740605+0000", 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042746169999999997 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740643+0000", 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8776000000000003e-05 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740669+0000", 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5499000000000001e-05 2024-04-26T12:40:44.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740805+0000", 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013579099999999999 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740847+0000", 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2642000000000003e-05 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753498+0000", 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012651172 2024-04-26T12:40:44.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753619+0000", 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012006399999999999 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.374261816000001, 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:40:44.376 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:40:44.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2375 3.1c e73/17 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.355329320000003, 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018742169999999999, 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986925+0000", 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0439999999999998e-06 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992153+0000", 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005227644 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992186+0000", 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3256000000000001e-05 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992210+0000", 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4249000000000001e-05 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992375+0000", 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016447 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992438+0000", 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3318999999999995e-05 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005540+0000", 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013101550999999999 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005665+0000", 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000125637 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2378 3.1d e73/17 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.326529035, 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015708637000000001, 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.385 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015726+0000", 2024-04-26T12:40:44.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4030000000000001e-06 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018549+0000", 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028231969999999999 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018590+0000", 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0995000000000003e-05 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018609+0000", 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8850000000000001e-05 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018752+0000", 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143633 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018793+0000", 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0496e-05 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031304+0000", 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012510795999999999 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031432+0000", 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128267 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2396 3.31 e73/17 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.129435540000003, 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015460707000000001, 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212819+0000", 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.497e-06 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216796+0000", 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039765190000000004 2024-04-26T12:40:44.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216829+0000", 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2712000000000001e-05 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216845+0000", 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6464e-05 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217025+0000", 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000179989 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217090+0000", 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5087999999999998e-05 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228134+0000", 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011044185 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228278+0000", 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014325300000000001 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.097577145000002, 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.397 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2400 3.27 e73/17 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.091850164999997, 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020886715, 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250405+0000", 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254952+0000", 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045466930000000001 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254991+0000", 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9298999999999998e-05 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255014+0000", 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2711999999999999e-05 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255166+0000", 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015193699999999999 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255207+0000", 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1436000000000001e-05 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271130+0000", 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015923262000000001 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271289+0000", 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015862600000000001 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2402 3.11 e73/17 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.069593206, 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018233177, 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272662+0000", 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.157e-06 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276695+0000", 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040329739999999999 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276735+0000", 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9338999999999997e-05 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276760+0000", 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4893e-05 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276943+0000", 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000183489 2024-04-26T12:40:44.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277008+0000", 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4704999999999998e-05 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290772+0000", 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013764406999999999 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290892+0000", 2024-04-26T12:40:44.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120213 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2403 3.3 e73/31 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.064102755999997, 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016271938, 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278151+0000", 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4e-07 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282860+0000", 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047094179999999999 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282891+0000", 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0562999999999999e-05 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282909+0000", 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7995999999999998e-05 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283056+0000", 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014763299999999999 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283099+0000", 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3139000000000002e-05 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294299+0000", 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011200185 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294422+0000", 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012216399999999999 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2406 3.9 e73/31 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head v 73'3, mlcod=67'1)", 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.035321975000002, 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016385118000000001, 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.410 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306931+0000", 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3300000000000001e-07 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312959+0000", 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060277100000000004 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312990+0000", 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0786e-05 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313005+0000", 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5373e-05 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313149+0000", 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014355999999999999 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313191+0000", 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1928999999999998e-05 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323173+0000", 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099826700000000008 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323316+0000", 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014235699999999999 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.414 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2411 3.31 e73/17 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head v 73'10, mlcod=73'8)", 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 31.972006373999999, 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015408975, 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:44.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370249+0000", 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3869999999999999e-06 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375387+0000", 2024-04-26T12:40:44.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051375539999999999 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375425+0000", 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8186000000000003e-05 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375449+0000", 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3620000000000001e-05 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375622+0000", 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017309500000000001 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375673+0000", 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0849000000000001e-05 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385561+0000", 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098879090000000003 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385655+0000", 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4375000000000004e-05 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2421 3.27 e73/17 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 31.857089032000001, 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018694483000000001, 2024-04-26T12:40:44.419 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485166+0000", 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4660000000000002e-06 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490411+0000", 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052454119999999996 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490447+0000", 2024-04-26T12:40:44.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6106000000000003e-05 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490466+0000", 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8329999999999999e-05 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490659+0000", 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019286800000000001 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490703+0000", 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4725999999999998e-05 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503764+0000", 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013060251 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503858+0000", 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4324e-05 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2428 3.1a e73/31 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 31.789179529999998, 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015568897, 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:44.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553076+0000", 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.01e-06 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557315+0000", 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042394160000000002 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557363+0000", 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7271999999999997e-05 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557388+0000", 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5249000000000002e-05 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557559+0000", 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000171039 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557621+0000", 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1999000000000001e-05 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568551+0000", 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010930415000000001 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568642+0000", 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0496999999999998e-05 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2431 3.31 e73/17 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head v 73'11, mlcod=73'9)", 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 31.758473185, 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01575095, 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.428 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583783+0000", 2024-04-26T12:40:44.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4960000000000001e-06 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589105+0000", 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053218140000000002 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589142+0000", 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7149e-05 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589159+0000", 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.774e-05 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589317+0000", 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000157589 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589380+0000", 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2708999999999999e-05 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599423+0000", 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010042882 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599530+0000", 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107571 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.432 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:44.434 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:44.434 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:44.434+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:44.497 INFO:tasks.workunit.client.0.smithi016.stderr:100+0 records in 2024-04-26T12:40:44.497 INFO:tasks.workunit.client.0.smithi016.stderr:100+0 records out 2024-04-26T12:40:44.497 INFO:tasks.workunit.client.0.smithi016.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 6.75095 s, 155 MB/s 2024-04-26T12:40:44.535 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:44.534+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:44.605 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:44.605 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:44.605 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:44.605 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:44.619 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:44.665 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:44.664+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:44.739 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:44.739 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:44.739 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:44.739 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:44.739 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:44.739 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:44.736+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:44.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:44.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:40:44.840 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:44.838+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:44.916 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.916 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1328 3.1f e67/17 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 47.049220597000001, 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019374358000000001, 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.917 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.28e-07 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867669+0000", 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004831915 2024-04-26T12:40:44.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867686+0000", 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6895999999999999e-05 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867695+0000", 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867801+0000", 2024-04-26T12:40:44.919 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010592200000000001 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867837+0000", 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6032000000000003e-05 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882087+0000", 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014249265000000001 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882212+0000", 2024-04-26T12:40:44.920 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012479900000000001 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1457 3.22 3:46753612:::d749f084-3851-4e95-9492-490675b43f90.4382.3__shadow_.89eL0OTfRIkm8jjkAhjXzYFORkpc2AZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.310843030999997, 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021050049000000001, 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.921 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1457 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601217+0000", 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.509e-06 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607652+0000", 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064351900000000004 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607693+0000", 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0868999999999998e-05 2024-04-26T12:40:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607712+0000", 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8702000000000002e-05 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607889+0000", 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000177061 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608263+0000", 2024-04-26T12:40:44.924 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037431500000000001 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608646+0000", 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038215100000000001 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.620501+0000", 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011855625 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622083+0000", 2024-04-26T12:40:44.925 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001581556 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622195+0000", 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112667 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622265+0000", 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9404000000000002e-05 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.926 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1601 3.1d 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.191340160999999, 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028382847999999999, 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1601 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.927 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720720+0000", 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3300000000000001e-06 2024-04-26T12:40:44.928 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726577+0000", 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005857307 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726616+0000", 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9224999999999998e-05 2024-04-26T12:40:44.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726640+0000", 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3873e-05 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726810+0000", 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016950799999999999 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.930 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727033+0000", 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022316600000000001 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727242+0000", 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020876 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.931 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748847+0000", 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021605347 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748917+0000", 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9413999999999996e-05 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749020+0000", 2024-04-26T12:40:44.932 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103383 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749100+0000", 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0535000000000001e-05 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1602 3.28 3:15f7ca78:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.185364945000003, 2024-04-26T12:40:44.933 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021360100999999999, 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1602 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.934 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726695+0000", 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1900000000000002e-06 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729949+0000", 2024-04-26T12:40:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032543730000000001 2024-04-26T12:40:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729991+0000", 2024-04-26T12:40:44.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1403000000000003e-05 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730016+0000", 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5709000000000001e-05 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730228+0000", 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021134999999999999 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730651+0000", 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042305000000000001 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.731097+0000", 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044566700000000001 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.740379+0000", 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092821050000000006 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747886+0000", 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007507555 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747980+0000", 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3727000000000006e-05 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748053+0000", 2024-04-26T12:40:44.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2972000000000005e-05 2024-04-26T12:40:44.941 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2322 3.1c 3:3aeebad8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.505215952, 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017554513000000001, 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.942 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2322 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406842+0000", 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.406844+0000", 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2050000000000001e-06 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412062+0000", 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052182130000000002 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412097+0000", 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5086000000000003e-05 2024-04-26T12:40:44.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412118+0000", 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0299999999999999e-05 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412207+0000", 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9482999999999997e-05 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412358+0000", 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000150483 2024-04-26T12:40:44.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.412463+0000", 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000104956 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.423146+0000", 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01068347 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424315+0000", 2024-04-26T12:40:44.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011691799999999999 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424359+0000", 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4212000000000003e-05 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.424396+0000", 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6925000000000003e-05 2024-04-26T12:40:44.947 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2357 3.2a 3:5615e7fe:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.125733902999997, 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019796023999999999, 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.948 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2357 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786327+0000", 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.49e-06 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790818+0000", 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044903690000000001 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790860+0000", 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1851999999999998e-05 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790879+0000", 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9551999999999998e-05 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791003+0000", 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012405399999999999 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791242+0000", 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238495 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791453+0000", 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000211005 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.801975+0000", 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010522658000000001 2024-04-26T12:40:44.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.805976+0000", 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040003449999999998 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806054+0000", 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8757999999999994e-05 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806120+0000", 2024-04-26T12:40:44.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5445999999999996e-05 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2358 3.c 3:30528342:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.113843746999997, 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017961708999999999, 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2358 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798214+0000", 2024-04-26T12:40:44.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.798217+0000", 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4120000000000001e-06 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802700+0000", 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044824900000000004 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802739+0000", 2024-04-26T12:40:44.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9181999999999999e-05 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802766+0000", 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6682e-05 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.802894+0000", 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128102 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.803151+0000", 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025679700000000001 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.803409+0000", 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025825099999999998 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.812254+0000", 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0088452759999999991 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.815918+0000", 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0036635259999999998 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.816068+0000", 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000150777 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.816176+0000", 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010721399999999999 2024-04-26T12:40:44.959 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2367 3.2a 3:55ec8106:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.014112185000002, 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020327305, 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.960 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2367 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897949+0000", 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4489999999999999e-06 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902370+0000", 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044209369999999998 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902408+0000", 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8541999999999998e-05 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902428+0000", 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9040000000000001e-05 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902607+0000", 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017954599999999999 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903016+0000", 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040908999999999997 2024-04-26T12:40:44.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903422+0000", 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040581100000000001 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.917186+0000", 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013763861 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918102+0000", 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091656300000000001 2024-04-26T12:40:44.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918200+0000", 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7906999999999996e-05 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918273+0000", 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2558999999999994e-05 2024-04-26T12:40:44.965 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2375 3.1c 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.932378495000002, 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026708701000000001, 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.966 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2375 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979683+0000", 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8759999999999998e-06 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985829+0000", 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061460810000000003 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985877+0000", 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7812000000000002e-05 2024-04-26T12:40:44.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985907+0000", 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9713000000000002e-05 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986054+0000", 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014770300000000001 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986363+0000", 2024-04-26T12:40:44.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030863899999999998 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986696+0000", 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033299000000000002 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.997022+0000", 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010325732000000001 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006148+0000", 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091265240000000004 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006280+0000", 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013179399999999999 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006388+0000", 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107837 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.971 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2376 3.5 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.923072126999998, 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020175694000000001, 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2376 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.972 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988989+0000", 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5769999999999998e-06 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995521+0000", 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006531635 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995571+0000", 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9738999999999999e-05 2024-04-26T12:40:44.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995601+0000", 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995729+0000", 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012808399999999999 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996014+0000", 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028456400000000001 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996264+0000", 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025048699999999998 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006170+0000", 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099054369999999996 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009021+0000", 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028506730000000002 2024-04-26T12:40:44.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009103+0000", 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2908e-05 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009161+0000", 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7855000000000001e-05 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.977 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2378 3.1d 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.901610333999997, 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023192784000000001, 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2378 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010450+0000", 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5239999999999999e-06 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014852+0000", 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044019619999999997 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014884+0000", 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2323000000000002e-05 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014900+0000", 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5651999999999999e-05 2024-04-26T12:40:44.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015044+0000", 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014389700000000001 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015292+0000", 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024860399999999998 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015521+0000", 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022877100000000001 2024-04-26T12:40:44.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031237+0000", 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015715600999999999 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033338+0000", 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021008699999999999 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033518+0000", 2024-04-26T12:40:44.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180089 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033640+0000", 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012249099999999999 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2380 3.c 3:32d641af:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.880710612999998, 2024-04-26T12:40:44.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019849939, 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2380 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031352+0000", 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5399999999999997e-06 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039154+0000", 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007802135 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039191+0000", 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7240000000000003e-05 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039210+0000", 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9236e-05 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039358+0000", 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147866 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039611+0000", 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000253298 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039846+0000", 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023419399999999999 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.049633+0000", 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097878089999999997 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.050899+0000", 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001265455 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051067+0000", 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016852600000000001 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051197+0000", 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012964000000000001 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.988 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2382 3.3c 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.860506063000003, 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023553801999999999, 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.989 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2382 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051554+0000", 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.706e-06 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.055983+0000", 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044283889999999996 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056027+0000", 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4518999999999998e-05 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056052+0000", 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4675999999999999e-05 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056206+0000", 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015424199999999999 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056594+0000", 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038824299999999998 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056974+0000", 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000379751 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068770+0000", 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011795386999999999 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074792+0000", 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060226439999999997 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074974+0000", 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000181282 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.075105+0000", 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131963 2024-04-26T12:40:44.994 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2387 3.28 3:1657e0bf:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.809241931000003, 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018313085, 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:44.995 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2387 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:44.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102819+0000", 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107254+0000", 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044347290000000001 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107287+0000", 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2753000000000003e-05 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:44.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107302+0000", 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5302999999999999e-05 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107463+0000", 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161531 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107863+0000", 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039991799999999997 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.108294+0000", 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043064600000000002 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.118549+0000", 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010255083 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.120957+0000", 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024081990000000002 2024-04-26T12:40:44.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121053+0000", 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6070999999999995e-05 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121129+0000", 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5574999999999994e-05 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2392 3.30 3:0e664f76:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.749772168, 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020233060000000001, 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2392 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162289+0000", 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:45.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166843+0000", 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045541959999999999 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166886+0000", 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2908999999999999e-05 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166917+0000", 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0741999999999998e-05 2024-04-26T12:40:45.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167061+0000", 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143771 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167317+0000", 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000256493 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167549+0000", 2024-04-26T12:40:45.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023142099999999999 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.176299+0000", 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0087508729999999993 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182351+0000", 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060514330000000002 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182446+0000", 2024-04-26T12:40:45.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5531000000000004e-05 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182519+0000", 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2175000000000006e-05 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2399 3.1d 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.672870175, 2024-04-26T12:40:45.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029752193999999999, 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2399 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239192+0000", 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1829999999999996e-06 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243681+0000", 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044893629999999997 2024-04-26T12:40:45.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243722+0000", 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0639000000000002e-05 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243743+0000", 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0760000000000001e-05 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243882+0000", 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013962600000000001 2024-04-26T12:40:45.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244142+0000", 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025946699999999999 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244378+0000", 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000236839 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254731+0000", 2024-04-26T12:40:45.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010353004000000001 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268598+0000", 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013866431 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268779+0000", 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018066499999999999 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268940+0000", 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016121700000000001 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2401 3.2a 3:54e389fa:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.653720256, 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018846505999999999, 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.012 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2401 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258341+0000", 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1559999999999999e-06 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262849+0000", 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045083329999999998 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262889+0000", 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9903000000000001e-05 2024-04-26T12:40:45.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262907+0000", 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8179e-05 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263036+0000", 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012896000000000001 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263291+0000", 2024-04-26T12:40:45.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025503100000000002 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263523+0000", 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023191100000000001 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.275751+0000", 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012228517 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276977+0000", 2024-04-26T12:40:45.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012251580000000001 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277070+0000", 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3718e-05 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277184+0000", 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011364 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2405 3.22 3:45892c0a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.617367721999997, 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017862690000000001, 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2405 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294690+0000", 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294694+0000", 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9929999999999997e-06 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299557+0000", 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048627050000000002 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299594+0000", 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6996000000000003e-05 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299612+0000", 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8695999999999999e-05 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299745+0000", 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013255 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.299991+0000", 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000246481 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.300210+0000", 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218588 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.309919+0000", 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097093330000000005 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312225+0000", 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002306125 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312421+0000", 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019588599999999999 2024-04-26T12:40:45.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312553+0000", 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013133700000000001 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2410 3.16 3:697fa4a2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.554436381000002, 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019793999999999999, 2024-04-26T12:40:45.023 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2410 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357625+0000", 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8630000000000001e-06 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362361+0000", 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004736011 2024-04-26T12:40:45.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362400+0000", 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8719e-05 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362418+0000", 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8366e-05 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362541+0000", 2024-04-26T12:40:45.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012312400000000001 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362785+0000", 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000243837 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.363004+0000", 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218629 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.376177+0000", 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173239999999999 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377237+0000", 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001059862 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377335+0000", 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8171000000000006e-05 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377415+0000", 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0178000000000004e-05 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2425 3.5 3:a11dc694:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.388937204000001, 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018795115000000001, 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2425 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523123+0000", 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528942+0000", 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058186920000000003 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528985+0000", 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2951999999999998e-05 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529011+0000", 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6190000000000002e-05 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529142+0000", 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013053000000000001 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529415+0000", 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027316299999999999 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529659+0000", 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024458800000000001 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.538947+0000", 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092877199999999993 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541743+0000", 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002795723 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541840+0000", 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7261000000000003e-05 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541916+0000", 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5562000000000006e-05 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.034 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:45.036 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:45.036 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:45.034+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:45.137 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:45.136+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:45.163 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:45.163 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:45.163 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:45.163 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:45.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:45.238 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:45.238+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:45.339 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:45.338+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:45.341 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:45.341 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:45.341 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:45.341 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:45.341 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:45.356 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:45.440 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:45.436+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:45.482 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1325 3.34 3:2cf99e10:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 47.640985092000001, 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020543797999999999, 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.483 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1325 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.484 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837059+0000", 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2140000000000001e-06 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843506+0000", 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064467209999999999 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843561+0000", 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.5291999999999998e-05 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843589+0000", 2024-04-26T12:40:45.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8354999999999999e-05 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843720+0000", 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013083999999999999 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843945+0000", 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000224782 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:45.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.844155+0000", 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000209743 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857491+0000", 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013336249 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857520+0000", 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8941e-05 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857557+0000", 2024-04-26T12:40:45.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7115e-05 2024-04-26T12:40:45.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857600+0000", 2024-04-26T12:40:45.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2546000000000002e-05 2024-04-26T12:40:45.489 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.489 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.489 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1460 3.36 3:6e35934d:::d749f084-3851-4e95-9492-490675b43f90.4382.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.852669292999998, 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025121213, 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.490 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.491 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.491 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.491 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1460 2024-04-26T12:40:45.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.491 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625375+0000", 2024-04-26T12:40:45.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:45.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631320+0000", 2024-04-26T12:40:45.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059444809999999997 2024-04-26T12:40:45.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631360+0000", 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0398999999999997e-05 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631378+0000", 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8050000000000002e-05 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631551+0000", 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017255800000000001 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631822+0000", 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027131799999999999 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:45.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.632685+0000", 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00086248900000000003 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.649790+0000", 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017105170999999999 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650179+0000", 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000389284 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650359+0000", 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180061 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650493+0000", 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133876 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2331 3.26 3:660a096e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.980414199999998, 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018877251000000001, 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.498 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2331 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497630+0000", 2024-04-26T12:40:45.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4400000000000001e-06 2024-04-26T12:40:45.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501943+0000", 2024-04-26T12:40:45.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004312715 2024-04-26T12:40:45.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501979+0000", 2024-04-26T12:40:45.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6365999999999997e-05 2024-04-26T12:40:45.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501997+0000", 2024-04-26T12:40:45.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7793000000000001e-05 2024-04-26T12:40:45.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502089+0000", 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1958000000000003e-05 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502288+0000", 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019909800000000001 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502477+0000", 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018923200000000001 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.509874+0000", 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073965639999999996 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516336+0000", 2024-04-26T12:40:45.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006461629 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516433+0000", 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7807999999999996e-05 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516504+0000", 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0648000000000005e-05 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.504 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2341 3.35 3:ad2a0070:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.871960276999999, 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020122823000000001, 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.505 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2341 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606084+0000", 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5030000000000002e-06 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610523+0000", 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004439035 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610563+0000", 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9305999999999999e-05 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610582+0000", 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9083e-05 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610736+0000", 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015433999999999999 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611020+0000", 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028411000000000002 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611253+0000", 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023267200000000001 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.625380+0000", 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014127366000000001 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626034+0000", 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00065407499999999995 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626133+0000", 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9141000000000005e-05 2024-04-26T12:40:45.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626204+0000", 2024-04-26T12:40:45.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:40:45.511 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.511 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.511 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2346 3.10 3:093f8fa5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.669959+0000", 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.808082241999998, 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016731467, 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2346 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.669959+0000", 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.669959+0000", 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.669962+0000", 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0699999999999998e-06 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.674529+0000", 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004567176 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.674567+0000", 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8293000000000001e-05 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.674586+0000", 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8609000000000001e-05 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.674764+0000", 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017794299999999999 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.675041+0000", 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027680700000000001 2024-04-26T12:40:45.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.675278+0000", 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023771799999999999 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684276+0000", 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0089975750000000007 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.686515+0000", 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0022386099999999998 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.686614+0000", 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9020999999999999e-05 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.686690+0000", 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6644999999999995e-05 2024-04-26T12:40:45.517 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2347 3.a 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.797975258000001, 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025995128999999999, 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.518 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2347 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680068+0000", 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2699999999999999e-06 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684436+0000", 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043681800000000002 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684474+0000", 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7696e-05 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684498+0000", 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3736000000000001e-05 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684647+0000", 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014935999999999999 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684905+0000", 2024-04-26T12:40:45.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000257767 2024-04-26T12:40:45.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:45.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685154+0000", 2024-04-26T12:40:45.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024906499999999997 2024-04-26T12:40:45.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.694110+0000", 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0089561629999999996 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011663118 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705931+0000", 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015790699999999999 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706061+0000", 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012986700000000001 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2354 3.3f e73/17 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:45.524 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.714432387999999, 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023388658, 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:45.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:45.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3699999999999999e-07 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767456+0000", 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038463529999999998 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767493+0000", 2024-04-26T12:40:45.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7058999999999999e-05 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767512+0000", 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426e-05 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767810+0000", 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029746500000000001 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.528 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767864+0000", 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3974999999999997e-05 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786741+0000", 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018876885999999999 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786997+0000", 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025665699999999998 2024-04-26T12:40:45.529 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2361 3.26 3:6509be61:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.644915009000002, 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020183629000000002, 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.530 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2361 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833130+0000", 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7330000000000001e-06 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837748+0000", 2024-04-26T12:40:45.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046180049999999997 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837801+0000", 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3458999999999998e-05 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837829+0000", 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8299000000000001e-05 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837988+0000", 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015878100000000001 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838269+0000", 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028097000000000002 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838507+0000", 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238118 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.852548+0000", 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014040777000000001 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853137+0000", 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00058917099999999999 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853233+0000", 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5338000000000001e-05 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853310+0000", 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6977999999999994e-05 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2372 3.1e e73/17 3:788eb98e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_181:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.952239+0000", 2024-04-26T12:40:45.536 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.525802442, 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015929385000000001, 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.952239+0000", 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.952239+0000", 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.952239+0000", 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0699999999999996e-07 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956216+0000", 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039770600000000001 2024-04-26T12:40:45.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956244+0000", 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7406000000000002e-05 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956260+0000", 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6152999999999999e-05 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956386+0000", 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012595999999999999 2024-04-26T12:40:45.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.956428+0000", 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2252999999999997e-05 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.968028+0000", 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01160011 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.968168+0000", 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013973600000000001 2024-04-26T12:40:45.540 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2377 3.10 3:0bb0443e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.999174+0000", 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.478866613999998, 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015559542000000001, 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.541 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2377 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.999174+0000", 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.999174+0000", 2024-04-26T12:40:45.542 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.999178+0000", 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3129999999999999e-06 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.003758+0000", 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045806989999999997 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.543 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.003795+0000", 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6752000000000003e-05 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.003814+0000", 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8603000000000001e-05 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.003945+0000", 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013163000000000001 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.544 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.004197+0000", 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000251201 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.004431+0000", 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023426499999999999 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.545 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.013480+0000", 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.009048759 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014565+0000", 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001084911 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014664+0000", 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9117999999999995e-05 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.546 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014734+0000", 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0290999999999995e-05 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2379 3.2c 3:3590e7ea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:45.547 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.456966561999998, 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022546869000000001, 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2379 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.548 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021078+0000", 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026404+0000", 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053251669999999996 2024-04-26T12:40:45.549 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026452+0000", 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8304999999999999e-05 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026472+0000", 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.959e-05 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.550 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026612+0000", 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014085700000000001 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027080+0000", 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00046714499999999997 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027701+0000", 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00062184600000000001 2024-04-26T12:40:45.551 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041035+0000", 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013333617000000001 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043446+0000", 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024114359999999999 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043546+0000", 2024-04-26T12:40:45.552 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100041 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043621+0000", 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4808000000000006e-05 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.553 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2381 3.26 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.436496837, 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.027555486000000001, 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.554 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2381 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.555 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041549+0000", 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5539999999999999e-06 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046113+0000", 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045646840000000003 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.556 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046153+0000", 2024-04-26T12:40:45.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:40:45.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.557 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.557 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.557 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046178+0000", 2024-04-26T12:40:45.557 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4743e-05 2024-04-26T12:40:45.557 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.558 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046298+0000", 2024-04-26T12:40:45.558 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120087 2024-04-26T12:40:45.558 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.558 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.558 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046514+0000", 2024-04-26T12:40:45.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021600800000000001 2024-04-26T12:40:45.559 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.559 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.559 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:45.559 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046746+0000", 2024-04-26T12:40:45.559 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000232241 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056160+0000", 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094137170000000003 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068838+0000", 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012678149999999999 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.560 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069011+0000", 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173129 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069100+0000", 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8694000000000002e-05 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.561 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2394 3.26 3:649f95b9:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.291627683000002, 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023463999999999999, 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.562 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2394 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.563 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186417+0000", 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2030000000000001e-06 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191437+0000", 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005020488 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.564 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191475+0000", 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7879000000000001e-05 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191493+0000", 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7703e-05 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191654+0000", 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016161600000000001 2024-04-26T12:40:45.565 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191908+0000", 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025423399999999999 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.192139+0000", 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230184 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.566 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.207939+0000", 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015800715999999999 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209724+0000", 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001784461 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209809+0000", 2024-04-26T12:40:45.567 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5014999999999998e-05 2024-04-26T12:40:45.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.568 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.568 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.568 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209877+0000", 2024-04-26T12:40:45.568 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8501e-05 2024-04-26T12:40:45.568 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.568 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.568 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.568 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2404 3.20 3:079a3e14:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.192429752000002, 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017213770999999999, 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2404 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.569 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285615+0000", 2024-04-26T12:40:45.570 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5729999999999999e-06 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290079+0000", 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044646399999999998 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290120+0000", 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290140+0000", 2024-04-26T12:40:45.571 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290273+0000", 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013316000000000001 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290551+0000", 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027847599999999999 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:45.572 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290916+0000", 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000364306 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.301035+0000", 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010119360000000001 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302519+0000", 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001484031 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.573 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302691+0000", 2024-04-26T12:40:45.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017180599999999999 2024-04-26T12:40:45.574 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.574 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.574 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.574 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302825+0000", 2024-04-26T12:40:45.574 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013415000000000001 2024-04-26T12:40:45.574 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.574 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.574 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2407 3.33 e73/17 3:ce0fe289:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_216:head v 73'5, mlcod=71'3)", 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.317687+0000", 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.160354126999998, 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016228299000000002, 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.317687+0000", 2024-04-26T12:40:45.575 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.317687+0000", 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.317690+0000", 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:40:45.576 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321727+0000", 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040370670000000001 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321758+0000", 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1349000000000001e-05 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321780+0000", 2024-04-26T12:40:45.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2036999999999999e-05 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321917+0000", 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000137319 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.321955+0000", 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7410000000000003e-05 2024-04-26T12:40:45.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.333829+0000", 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011874325 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.333915+0000", 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6057999999999995e-05 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2408 3.20 3:07238821:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.146669275000001, 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017149066000000001, 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2408 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.580 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331375+0000", 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4630000000000001e-06 2024-04-26T12:40:45.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336575+0000", 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052001240000000004 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336603+0000", 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7526e-05 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336622+0000", 2024-04-26T12:40:45.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9613e-05 2024-04-26T12:40:45.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336759+0000", 2024-04-26T12:40:45.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013698399999999999 2024-04-26T12:40:45.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337044+0000", 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028474300000000001 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337284+0000", 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023956699999999999 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.345871+0000", 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0085868230000000004 2024-04-26T12:40:45.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348358+0000", 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024872269999999998 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348449+0000", 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0795000000000001e-05 2024-04-26T12:40:45.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348521+0000", 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2200999999999995e-05 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2433 3.2c 3:352e35ac:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.874907446999998, 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019506391000000001, 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2433 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603138+0000", 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.386e-06 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607459+0000", 2024-04-26T12:40:45.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043213210000000004 2024-04-26T12:40:45.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607499+0000", 2024-04-26T12:40:45.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0228999999999997e-05 2024-04-26T12:40:45.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607517+0000", 2024-04-26T12:40:45.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7895999999999999e-05 2024-04-26T12:40:45.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607651+0000", 2024-04-26T12:40:45.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133487 2024-04-26T12:40:45.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607918+0000", 2024-04-26T12:40:45.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026730100000000001 2024-04-26T12:40:45.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:45.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.608152+0000", 2024-04-26T12:40:45.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023403399999999999 2024-04-26T12:40:45.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621350+0000", 2024-04-26T12:40:45.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013197416999999999 2024-04-26T12:40:45.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622407+0000", 2024-04-26T12:40:45.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001057805 2024-04-26T12:40:45.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622498+0000", 2024-04-26T12:40:45.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0390999999999996e-05 2024-04-26T12:40:45.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622640+0000", 2024-04-26T12:40:45.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014212400000000001 2024-04-26T12:40:45.596 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.596 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.596 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.597 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2434 3.35 3:ac41eaea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.597 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:45.597 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.861978196999999, 2024-04-26T12:40:45.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022970694999999999, 2024-04-26T12:40:45.597 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.597 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.598 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.598 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.598 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.598 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.598 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2434 2024-04-26T12:40:45.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.599 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:45.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:45.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616067+0000", 2024-04-26T12:40:45.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.907e-06 2024-04-26T12:40:45.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620671+0000", 2024-04-26T12:40:45.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046047070000000004 2024-04-26T12:40:45.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620709+0000", 2024-04-26T12:40:45.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7392999999999999e-05 2024-04-26T12:40:45.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620728+0000", 2024-04-26T12:40:45.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9199e-05 2024-04-26T12:40:45.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620876+0000", 2024-04-26T12:40:45.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014752299999999999 2024-04-26T12:40:45.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621360+0000", 2024-04-26T12:40:45.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048465200000000002 2024-04-26T12:40:45.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:45.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621810+0000", 2024-04-26T12:40:45.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044939600000000002 2024-04-26T12:40:45.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638455+0000", 2024-04-26T12:40:45.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016645172 2024-04-26T12:40:45.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638848+0000", 2024-04-26T12:40:45.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000393137 2024-04-26T12:40:45.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638951+0000", 2024-04-26T12:40:45.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102771 2024-04-26T12:40:45.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.639033+0000", 2024-04-26T12:40:45.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2837999999999995e-05 2024-04-26T12:40:45.608 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.608 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.608 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.609 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2437 3.26 3:65b96022:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.609 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:45.609 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.828842793, 2024-04-26T12:40:45.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020654793000000001, 2024-04-26T12:40:45.610 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.610 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.610 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.610 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.610 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.610 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.610 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2437 2024-04-26T12:40:45.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.611 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:45.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649201+0000", 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.247e-06 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654391+0000", 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051896090000000004 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654430+0000", 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8906000000000003e-05 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654449+0000", 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8960000000000001e-05 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654577+0000", 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012784299999999999 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654838+0000", 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026151100000000002 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.655052+0000", 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021390800000000001 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.668862+0000", 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013810206 2024-04-26T12:40:45.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669649+0000", 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00078632500000000004 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669747+0000", 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8478000000000001e-05 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669853+0000", 2024-04-26T12:40:45.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001058 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2438 3.36 3:6cea662e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 32.819778634999999, 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021295308999999998, 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:45.616 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2438 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658266+0000", 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9870000000000001e-06 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662764+0000", 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044975229999999998 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662804+0000", 2024-04-26T12:40:45.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0575999999999999e-05 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662832+0000", 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8019000000000001e-05 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663009+0000", 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017632600000000001 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663314+0000", 2024-04-26T12:40:45.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030489299999999998 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663544+0000", 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230564 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.678407+0000", 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014862254 2024-04-26T12:40:45.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:45.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679337+0000", 2024-04-26T12:40:45.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00093039800000000003 2024-04-26T12:40:45.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:45.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679443+0000", 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105908 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679558+0000", 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114861 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:45.622 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:45.623 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:45.624 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:45.624 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:45.620+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:45.725 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:45.724+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:45.798 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:45.799 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:45.799 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:45.799 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:45.812 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:45.829 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:40:45.857 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:45.856+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:45.927 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:45.926+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:45.977 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:45.977 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:45.977 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:45.978 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:45.978 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:45.991 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:46.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:46.037 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:46.036+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:46.119 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:46.119 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:46.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:46.119 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:46.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.119 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 161.72631005400001, 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:40:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:40:46.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 161.42228290599999, 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.126 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:46.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:40:46.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:40:46.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.131 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 161.42224283900001, 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:40:46.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:40:46.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:46.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 161.42204762099999, 2024-04-26T12:40:46.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:40:46.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:40:46.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:40:46.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:40:46.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 161.42201054399999, 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:46.143 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.145 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:40:46.146 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:40:46.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.148 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2349 3.37 3:ec3a3f83:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 34.413717599999998, 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023512585999999999, 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2349 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.149 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.701002+0000", 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.150 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047707940000000001 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705810+0000", 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7543000000000003e-05 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705828+0000", 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.151 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705952+0000", 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123967 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706240+0000", 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028815399999999999 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706474+0000", 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233878 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.716974+0000", 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010500061999999999 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724253+0000", 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0072788139999999998 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724383+0000", 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013002000000000001 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724511+0000", 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128164 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2351 3.14 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 34.391605128999998, 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029175587999999999, 2024-04-26T12:40:46.154 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2351 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723115+0000", 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8500000000000004e-06 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727939+0000", 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048243670000000004 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727979+0000", 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0326e-05 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728003+0000", 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4193e-05 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728157+0000", 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015328 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728534+0000", 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037701500000000002 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728958+0000", 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042402 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.742778+0000", 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013820426 2024-04-26T12:40:46.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752106+0000", 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0093279780000000007 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752210+0000", 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103854 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752286+0000", 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6279000000000006e-05 2024-04-26T12:40:46.159 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2353 3.2b e73/17 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 34.362329527, 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022414480000000001, 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752388+0000", 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9530000000000002e-06 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760303+0000", 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079148240000000009 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760339+0000", 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5615999999999999e-05 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760363+0000", 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4272000000000001e-05 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760530+0000", 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167047 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760593+0000", 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3214999999999997e-05 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774684+0000", 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01409087 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774801+0000", 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011668299999999999 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2354 3.3f 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 34.355508090000001, 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028337384, 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.164 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2354 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759211+0000", 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762648+0000", 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003436854 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762685+0000", 2024-04-26T12:40:46.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7004e-05 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762709+0000", 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3482999999999999e-05 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762871+0000", 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016273399999999999 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763073+0000", 2024-04-26T12:40:46.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020189599999999999 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763271+0000", 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000197412 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.775210+0000", 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011939171 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787276+0000", 2024-04-26T12:40:46.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012066464000000001 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787428+0000", 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000151383 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787545+0000", 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000117457 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2355 3.37 3:eff17c6c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 34.348301835999997, 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02156363, 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2355 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.170 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766417+0000", 2024-04-26T12:40:46.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3440000000000001e-06 2024-04-26T12:40:46.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.770991+0000", 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004573756 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771029+0000", 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7821999999999998e-05 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771053+0000", 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.387e-05 2024-04-26T12:40:46.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771215+0000", 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016220300000000001 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771568+0000", 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000352472 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771951+0000", 2024-04-26T12:40:46.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038302699999999998 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787714+0000", 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015763065999999999 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787794+0000", 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0259999999999994e-05 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787886+0000", 2024-04-26T12:40:46.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2472000000000005e-05 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787978+0000", 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1337999999999999e-05 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2373 3.13 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 34.152520854000002, 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030808384000000001, 2024-04-26T12:40:46.177 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2373 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962198+0000", 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1200000000000002e-06 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966728+0000", 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045301170000000002 2024-04-26T12:40:46.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966768+0000", 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9619000000000001e-05 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966787+0000", 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8933999999999999e-05 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966954+0000", 2024-04-26T12:40:46.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016689600000000001 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967341+0000", 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038776099999999998 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967720+0000", 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037867100000000002 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.980012+0000", 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012291717000000001 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992693+0000", 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012681192000000001 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016807000000000001 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.993003+0000", 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142287 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2381 3.26 e73/17 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 34.067746792000001, 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021426161999999999, 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.183 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046971+0000", 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051948+0000", 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049762549999999997 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051984+0000", 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.625e-05 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052007+0000", 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2572e-05 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052200+0000", 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193372 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052261+0000", 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1471999999999997e-05 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068271+0000", 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016010027999999999 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068395+0000", 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012382300000000001 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2384 3.37 3:eff1e373:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 34.042486738000001, 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022518564000000001, 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2384 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072232+0000", 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2569999999999999e-06 2024-04-26T12:40:46.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076853+0000", 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046206870000000001 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076884+0000", 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1049e-05 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076902+0000", 2024-04-26T12:40:46.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8070000000000001e-05 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077053+0000", 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015034 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077312+0000", 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025907300000000002 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:46.191 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077559+0000", 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024693099999999998 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.087260+0000", 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097015409999999993 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094578+0000", 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073179739999999997 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094666+0000", 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8160999999999998e-05 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094748+0000", 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1481000000000001e-05 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2402 3.11 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.193 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.847438441000001, 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026287990000000001, 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2402 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267281+0000", 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.557e-06 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271739+0000", 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004457524 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271771+0000", 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2852999999999999e-05 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271790+0000", 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8889000000000002e-05 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271949+0000", 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015870000000000001 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272198+0000", 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024856800000000001 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272455+0000", 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025784700000000001 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.291321+0000", 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018865189000000001 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293294+0000", 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001973196 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293449+0000", 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001552 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293565+0000", 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011646699999999999 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2413 3.2d 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.722809949999998, 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020394760000000001, 2024-04-26T12:40:46.199 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2413 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391909+0000", 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0429999999999999e-06 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396691+0000", 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047820140000000002 2024-04-26T12:40:46.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396734+0000", 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396751+0000", 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7011999999999999e-05 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396899+0000", 2024-04-26T12:40:46.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014740399999999999 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397244+0000", 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034543200000000001 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397484+0000", 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024016099999999999 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.405191+0000", 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0077069340000000004 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412133+0000", 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006941465 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412231+0000", 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7770999999999996e-05 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412301+0000", 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2414 3.37 3:efe9b32a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.708636198999997, 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019629488, 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.205 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2414 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:46.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406083+0000", 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2729999999999998e-06 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411790+0000", 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0057067749999999999 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411830+0000", 2024-04-26T12:40:46.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0525000000000002e-05 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411856+0000", 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5695999999999999e-05 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411994+0000", 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013798400000000001 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412226+0000", 2024-04-26T12:40:46.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023230399999999999 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412447+0000", 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022097499999999999 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.423387+0000", 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010939574000000001 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425535+0000", 2024-04-26T12:40:46.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002148109 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425634+0000", 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8851000000000006e-05 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425709+0000", 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5421999999999997e-05 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.210 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2422 3.39 3:9d730a95:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.493245+0000", 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.621471286999999, 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019038202000000001, 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2422 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.211 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.493245+0000", 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.493245+0000", 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.493249+0000", 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.357e-06 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.498026+0000", 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047766759999999997 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.498067+0000", 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1276000000000003e-05 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.498088+0000", 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0752999999999999e-05 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.498265+0000", 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017761900000000001 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.498612+0000", 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034656500000000001 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.499000+0000", 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038802699999999999 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.507520+0000", 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0085203620000000001 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.512112+0000", 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045914479999999997 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.512210+0000", 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8004000000000006e-05 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.512283+0000", 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3114999999999994e-05 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2427 3.d 3:b1e8d312:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.216 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.572289863999998, 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021368552999999998, 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2427 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542430+0000", 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547450+0000", 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050205040000000003 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547487+0000", 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6866000000000002e-05 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547506+0000", 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9343000000000001e-05 2024-04-26T12:40:46.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547680+0000", 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017347599999999999 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548089+0000", 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040960699999999998 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548515+0000", 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042551999999999998 2024-04-26T12:40:46.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.558096+0000", 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0095806929999999995 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563571+0000", 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054753329999999998 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563674+0000", 2024-04-26T12:40:46.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010266400000000001 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563795+0000", 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012098 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2430 3.37 3:eff5ab0a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.543020034000001, 2024-04-26T12:40:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020751628000000001, 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2430 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571699+0000", 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5360000000000001e-06 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576275+0000", 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045753479999999999 2024-04-26T12:40:46.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576311+0000", 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5865999999999998e-05 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576328+0000", 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576501+0000", 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000172659 2024-04-26T12:40:46.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576910+0000", 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040915 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.577329+0000", 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041870699999999999 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.591164+0000", 2024-04-26T12:40:46.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013835896 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592117+0000", 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00095214699999999998 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592309+0000", 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019207600000000001 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592447+0000", 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013884999999999999 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2440 3.d 3:b0894f88:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 33.394569871999998, 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020963463000000002, 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:46.228 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2440 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:46.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720150+0000", 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5200000000000002e-06 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724635+0000", 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004485447 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724675+0000", 2024-04-26T12:40:46.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9938999999999998e-05 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724694+0000", 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724859+0000", 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016413899999999999 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725146+0000", 2024-04-26T12:40:46.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000287387 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725469+0000", 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032321900000000002 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.739743+0000", 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014273485000000001 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:46.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.740904+0000", 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011612790000000001 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741034+0000", 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130314 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741109+0000", 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5221000000000004e-05 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.233 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:46.234 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:46.234 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:46.235 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:46.235 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:46.236 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:46.236 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:46.236 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:46.237 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:46.237 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:46.237 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:46.238 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:46.238 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:46.234+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:46.246 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:46.246 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:46.267 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:46.267 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:46.287 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:46.287 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:46.309 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:46.309 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:46.339 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:46.336+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:46.354 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:46.354 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:46.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:46.439 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:46.436+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:46.532 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:46.540 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:46.538+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:46.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:46.641 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:46.640+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:46.742 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:46.742+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:46.759 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:46.760 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:46.777 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:46.865 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:46.865+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:46.944 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:46.940+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:46.971 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:46.971 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:46.992 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:47.081 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:47.081+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:47.146 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:47.145+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:47.179 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:47.180 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:47.209 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:47.246 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:47.244+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:47.347 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:47.344+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:47.393 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:47.394 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:47.415 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:47.465 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:47.465+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:47.550 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:47.549+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:47.561 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:47.561 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:47.580 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:47.651 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:47.648+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:47.752 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:47.749+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:47.766 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:47.766 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:47.788 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:47.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:40:47.873 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:47.873+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:47.954 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:47.953+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:47.974 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:47.974 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:47.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:48.056 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:48.052+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:48.157 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:48.156+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:48.194 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:48.195 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:48.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:48.258 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:48.256+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:48.327 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:48.343 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:40:48.360 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:48.356+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:48.366 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:48.366 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:48.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:48.489 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:48.489+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:48.561 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:48.560+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:48.565 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:48.565 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:48.587 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:48.587 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:48.601 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:48.602 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:48.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:48.636 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:48.636 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:48.657 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:48.658 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:48.662 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:48.660+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:48.681 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:48.681 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:48.704 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:48.705 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:48.727 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:48.728 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:48.746 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2852 3.14 e91/31 3:2aef5010:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_207:head v 91'5, mlcod=72'3)", 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:48.735457+0000", 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.011102786, 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011148385, 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "started", 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.747 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.735457+0000", 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.735457+0000", 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.735459+0000", 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.835e-06 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.748 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.736994+0000", 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0015350889999999999 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.737015+0000", 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1103000000000001e-05 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.737026+0000", 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0985000000000001e-05 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.749 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.737092+0000", 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6011000000000002e-05 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.737116+0000", 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3884999999999999e-05 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:48.750 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2853 3.9 e91/31 3:91cf5c60:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_208:head v 91'8, mlcod=90'6)", 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:48.740515+0000", 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.0060442869999999998, 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062015580000000002, 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "started", 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.740515+0000", 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.740515+0000", 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.740521+0000", 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.4029999999999998e-06 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.745930+0000", 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00540867 2024-04-26T12:40:48.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:48.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.745962+0000", 2024-04-26T12:40:48.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2095999999999999e-05 2024-04-26T12:40:48.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:48.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.745984+0000", 2024-04-26T12:40:48.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2515999999999999e-05 2024-04-26T12:40:48.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:48.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.746066+0000", 2024-04-26T12:40:48.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1699000000000005e-05 2024-04-26T12:40:48.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:48.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:48.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:48.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.746083+0000", 2024-04-26T12:40:48.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7285000000000001e-05 2024-04-26T12:40:48.755 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:48.756 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:48.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:48.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:48.756 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2024-04-26T12:40:48.756 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 2 2024-04-26T12:40:48.756 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:48.757 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:48.757 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:48.762 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:48.761+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:48.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:48.863 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:48.861+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:48.945 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:48.946 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:48.946 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:48.964 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:48.961+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:48.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:49.066 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:49.065+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:49.100 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:49.101 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:49.101 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:49.101 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:49.101 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.101 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1601 3.1d e67/17 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:49.101 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:49.102 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.368873030000003, 2024-04-26T12:40:49.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021057349999999999, 2024-04-26T12:40:49.102 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.102 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.102 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.102 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:49.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:40:49.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727484+0000", 2024-04-26T12:40:49.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:40:49.105 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.105 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.105 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733321+0000", 2024-04-26T12:40:49.105 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005836351 2024-04-26T12:40:49.105 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.105 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.106 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.106 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733360+0000", 2024-04-26T12:40:49.106 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9648999999999999e-05 2024-04-26T12:40:49.106 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.106 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.106 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.106 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733383+0000", 2024-04-26T12:40:49.106 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2722999999999999e-05 2024-04-26T12:40:49.107 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.107 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.107 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.107 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733504+0000", 2024-04-26T12:40:49.107 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012115199999999999 2024-04-26T12:40:49.107 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.107 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.107 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733558+0000", 2024-04-26T12:40:49.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3511999999999999e-05 2024-04-26T12:40:49.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.108 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.108 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.108 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748395+0000", 2024-04-26T12:40:49.108 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014836937 2024-04-26T12:40:49.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.109 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.109 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.109 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748539+0000", 2024-04-26T12:40:49.109 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144356 2024-04-26T12:40:49.109 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.109 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.109 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2320 3.27 e72/17 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head v 72'3, mlcod=67'1)", 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.705849170999997, 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017587200000000001, 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.110 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.390506+0000", 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2799999999999995e-07 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.111 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396488+0000", 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059817680000000002 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396509+0000", 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0888999999999999e-05 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396520+0000", 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0708e-05 2024-04-26T12:40:49.112 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396619+0000", 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9263000000000002e-05 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.396654+0000", 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5125e-05 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408029+0000", 2024-04-26T12:40:49.113 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011374815 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.408093+0000", 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3804000000000001e-05 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2337 3.1b e72/17 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.537566750000003, 2024-04-26T12:40:49.114 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015714998000000001, 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.115 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558788+0000", 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.558789+0000", 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4780000000000001e-06 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563525+0000", 2024-04-26T12:40:49.116 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047351470000000003 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563558+0000", 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3284999999999997e-05 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563574+0000", 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.573e-05 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.117 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563664+0000", 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0006000000000005e-05 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.563690+0000", 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6619999999999999e-05 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.118 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574423+0000", 2024-04-26T12:40:49.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010732396 2024-04-26T12:40:49.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.119 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.119 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.119 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.574503+0000", 2024-04-26T12:40:49.119 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0335999999999998e-05 2024-04-26T12:40:49.119 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.119 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2347 3.a e72/17 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head v 72'3, mlcod=71'1)", 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.410994952999999, 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019978432000000001, 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.120 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685360+0000", 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685363+0000", 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.121 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.122 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688265+0000", 2024-04-26T12:40:49.122 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029017240000000001 2024-04-26T12:40:49.122 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.122 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.122 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688336+0000", 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1422999999999997e-05 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688364+0000", 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7234999999999999e-05 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.123 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688534+0000", 2024-04-26T12:40:49.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017049599999999999 2024-04-26T12:40:49.124 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.124 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.124 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.124 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.688604+0000", 2024-04-26T12:40:49.124 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0016000000000002e-05 2024-04-26T12:40:49.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.125 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.125 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.125 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705182+0000", 2024-04-26T12:40:49.125 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016577543 2024-04-26T12:40:49.125 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.126 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.126 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.126 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705338+0000", 2024-04-26T12:40:49.126 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000156479 2024-04-26T12:40:49.126 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.126 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.126 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.127 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.127 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.127 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2348 3.29 e72/17 3:94659418:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_157:head v 72'2, mlcod=0'0)", 2024-04-26T12:40:49.127 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:49.127 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.403383615999999, 2024-04-26T12:40:49.127 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016659368000000001, 2024-04-26T12:40:49.127 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692971+0000", 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.128 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.692973+0000", 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2199999999999999e-06 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699798+0000", 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0068248750000000002 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.129 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699829+0000", 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0753000000000002e-05 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699845+0000", 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6132000000000001e-05 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.130 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.699973+0000", 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012803099999999999 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700015+0000", 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2052000000000003e-05 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709497+0000", 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094813919999999999 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.131 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.709631+0000", 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013391299999999999 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2351 3.14 e72/31 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head v 72'4, mlcod=72'2)", 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.363269354000003, 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018622024000000001, 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.132 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733085+0000", 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.133 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.733088+0000", 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.48e-06 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735690+0000", 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026018040000000001 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735724+0000", 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4585999999999997e-05 2024-04-26T12:40:49.134 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735743+0000", 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8309e-05 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735878+0000", 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013522999999999999 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.735919+0000", 2024-04-26T12:40:49.135 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1223000000000002e-05 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751443+0000", 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015524247999999999 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.751707+0000", 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026414400000000001 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.136 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2352 3.31 e73/17 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.360025815, 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017289571, 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:49.137 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736329+0000", 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.736330+0000", 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0100000000000001e-06 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.138 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740605+0000", 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042746169999999997 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740643+0000", 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8776000000000003e-05 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740669+0000", 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5499000000000001e-05 2024-04-26T12:40:49.139 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740805+0000", 2024-04-26T12:40:49.140 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013579099999999999 2024-04-26T12:40:49.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.140 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.140 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.140 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.740847+0000", 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2642000000000003e-05 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753498+0000", 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012651172 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.141 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.753619+0000", 2024-04-26T12:40:49.142 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012006399999999999 2024-04-26T12:40:49.142 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.142 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.142 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.142 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.142 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.142 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:49.142 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:49.143 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.128364126999998, 2024-04-26T12:40:49.143 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:40:49.143 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.143 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.143 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.143 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.143 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.143 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.143 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:49.144 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.144 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.144 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:40:49.144 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.144 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.145 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.145 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:40:49.145 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:40:49.145 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.145 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.145 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.145 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:40:49.146 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:40:49.146 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.146 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.146 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.146 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:40:49.146 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:40:49.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.147 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.147 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:40:49.147 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:40:49.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.147 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.147 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:40:49.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:40:49.148 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.148 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.148 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.148 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:40:49.148 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:40:49.149 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.149 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.149 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.149 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:40:49.149 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:40:49.149 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.149 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.149 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.149 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:40:49.150 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:40:49.150 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.150 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.150 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.150 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.151 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2375 3.1c e73/17 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head v 73'8, mlcod=72'6)", 2024-04-26T12:40:49.151 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:49.151 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.109431631, 2024-04-26T12:40:49.151 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018742169999999999, 2024-04-26T12:40:49.151 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.151 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.152 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.152 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.152 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.152 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.152 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:49.152 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986923+0000", 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986925+0000", 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0439999999999998e-06 2024-04-26T12:40:49.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992153+0000", 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005227644 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992186+0000", 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3256000000000001e-05 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992210+0000", 2024-04-26T12:40:49.154 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4249000000000001e-05 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992375+0000", 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016447 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992438+0000", 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3318999999999995e-05 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.155 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005540+0000", 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013101550999999999 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.005665+0000", 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000125637 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2378 3.1d e73/17 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:49.156 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.080631345999997, 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015708637000000001, 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.157 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015723+0000", 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015726+0000", 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4030000000000001e-06 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018549+0000", 2024-04-26T12:40:49.158 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028231969999999999 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018590+0000", 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0995000000000003e-05 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018609+0000", 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8850000000000001e-05 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.159 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018752+0000", 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143633 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.018793+0000", 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0496e-05 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031304+0000", 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012510795999999999 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.160 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031432+0000", 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128267 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2396 3.31 e73/17 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head v 73'9, mlcod=73'7)", 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:49.161 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.883537851, 2024-04-26T12:40:49.162 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015460707000000001, 2024-04-26T12:40:49.162 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.162 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.162 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.162 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.162 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.162 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212817+0000", 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.212819+0000", 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.497e-06 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.163 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216796+0000", 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0039765190000000004 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216829+0000", 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2712000000000001e-05 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.216845+0000", 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6464e-05 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217025+0000", 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000179989 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.217090+0000", 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5087999999999998e-05 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228134+0000", 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011044185 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.228278+0000", 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014325300000000001 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.851679455999999, 2024-04-26T12:40:49.166 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.168 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:40:49.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.170 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2400 3.27 e73/17 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head v 73'5, mlcod=72'3)", 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.845952476000001, 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020886715, 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.171 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.172 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250405+0000", 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254952+0000", 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045466930000000001 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.173 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254991+0000", 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9298999999999998e-05 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255014+0000", 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2711999999999999e-05 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255166+0000", 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015193699999999999 2024-04-26T12:40:49.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255207+0000", 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1436000000000001e-05 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271130+0000", 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015923262000000001 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271289+0000", 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015862600000000001 2024-04-26T12:40:49.175 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2402 3.11 e73/17 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.823695516999997, 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018233177, 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.176 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272659+0000", 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272662+0000", 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.157e-06 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.177 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276695+0000", 2024-04-26T12:40:49.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040329739999999999 2024-04-26T12:40:49.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.178 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.178 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276735+0000", 2024-04-26T12:40:49.178 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9338999999999997e-05 2024-04-26T12:40:49.178 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.178 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276760+0000", 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4893e-05 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276943+0000", 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000183489 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.179 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277008+0000", 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4704999999999998e-05 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290772+0000", 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013764406999999999 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.180 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290892+0000", 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120213 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2403 3.3 e73/31 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head v 73'3, mlcod=72'1)", 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.818205067000001, 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016271938, 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.181 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.182 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:49.182 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.182 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.182 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.182 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.182 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278150+0000", 2024-04-26T12:40:49.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.183 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.183 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.183 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.183 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.278151+0000", 2024-04-26T12:40:49.183 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.4e-07 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282860+0000", 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047094179999999999 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282891+0000", 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0562999999999999e-05 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.184 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.282909+0000", 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7995999999999998e-05 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283056+0000", 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014763299999999999 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.283099+0000", 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3139000000000002e-05 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.185 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294299+0000", 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011200185 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.294422+0000", 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012216399999999999 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.186 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2406 3.9 e73/31 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head v 73'3, mlcod=67'1)", 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.789424285999999, 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016385118000000001, 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.187 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306930+0000", 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.306931+0000", 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.3300000000000001e-07 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312959+0000", 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060277100000000004 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.188 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.312990+0000", 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0786e-05 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313005+0000", 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5373e-05 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313149+0000", 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014355999999999999 2024-04-26T12:40:49.189 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.313191+0000", 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1928999999999998e-05 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323173+0000", 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099826700000000008 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.190 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.323316+0000", 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014235699999999999 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2411 3.31 e73/17 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head v 73'10, mlcod=73'8)", 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.726108685, 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015408975, 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.191 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370246+0000", 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.370249+0000", 2024-04-26T12:40:49.192 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3869999999999999e-06 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375387+0000", 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051375539999999999 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375425+0000", 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8186000000000003e-05 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.193 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375449+0000", 2024-04-26T12:40:49.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3620000000000001e-05 2024-04-26T12:40:49.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.194 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375622+0000", 2024-04-26T12:40:49.194 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017309500000000001 2024-04-26T12:40:49.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.194 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.194 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.375673+0000", 2024-04-26T12:40:49.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.0849000000000001e-05 2024-04-26T12:40:49.195 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.195 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.195 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.195 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385561+0000", 2024-04-26T12:40:49.195 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0098879090000000003 2024-04-26T12:40:49.196 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.196 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.196 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.196 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.385655+0000", 2024-04-26T12:40:49.196 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4375000000000004e-05 2024-04-26T12:40:49.196 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2421 3.27 e73/17 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head v 73'6, mlcod=72'4)", 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.611191343000002, 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018694483000000001, 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.197 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485163+0000", 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.485166+0000", 2024-04-26T12:40:49.198 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4660000000000002e-06 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490411+0000", 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052454119999999996 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490447+0000", 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6106000000000003e-05 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.199 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490466+0000", 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8329999999999999e-05 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490659+0000", 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019286800000000001 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.490703+0000", 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4725999999999998e-05 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.200 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503764+0000", 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013060251 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.503858+0000", 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.4324e-05 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2428 3.1a e73/31 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head v 73'3, mlcod=71'1)", 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.543281841000002, 2024-04-26T12:40:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015568897, 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553073+0000", 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.202 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.553076+0000", 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.01e-06 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557315+0000", 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042394160000000002 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557363+0000", 2024-04-26T12:40:49.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7271999999999997e-05 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557388+0000", 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5249000000000002e-05 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557559+0000", 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000171039 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.557621+0000", 2024-04-26T12:40:49.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1999000000000001e-05 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568551+0000", 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010930415000000001 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.568642+0000", 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0496999999999998e-05 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2431 3.31 e73/17 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head v 73'11, mlcod=73'9)", 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 36.512575495999997, 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01575095, 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583779+0000", 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.583783+0000", 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4960000000000001e-06 2024-04-26T12:40:49.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589105+0000", 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053218140000000002 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589142+0000", 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7149e-05 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589159+0000", 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.774e-05 2024-04-26T12:40:49.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589317+0000", 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000157589 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.589380+0000", 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2708999999999999e-05 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599423+0000", 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010042882 2024-04-26T12:40:49.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.599530+0000", 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107571 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.210 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:49.212 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:49.212 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:49.209+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:49.275 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 1Gb. 2024-04-26T12:40:49.275 INFO:tasks.workunit.client.0.smithi016.stdout:upload file successful 2024-04-26T12:40:49.275 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:49.275 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - set max size for a given user and ensure that the max size is in effect 2024-04-26T12:40:49.276 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:40:49.312 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:49.309+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:49.342 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:49.342 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:49.342 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:49.342 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:49.358 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:49.413 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:49.413+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:49.488 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:49.488 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:49.488 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:49.492 INFO:tasks.workunit.client.0.smithi016.stdout:user qa_user deleted 2024-04-26T12:40:49.492 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:40:49.503 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:49.549 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:49.548+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:49.615 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:49.613+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:49.627 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:49.627 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:49.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:49.627 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1328 3.1f e67/17 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.760371059000001, 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019374358000000001, 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:49.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.28e-07 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867669+0000", 2024-04-26T12:40:49.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004831915 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867686+0000", 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6895999999999999e-05 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867695+0000", 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867801+0000", 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010592200000000001 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867837+0000", 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6032000000000003e-05 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882087+0000", 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014249265000000001 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882212+0000", 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012479900000000001 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1457 3.22 3:46753612:::d749f084-3851-4e95-9492-490675b43f90.4382.3__shadow_.89eL0OTfRIkm8jjkAhjXzYFORkpc2AZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.021993492999997, 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021050049000000001, 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.632 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1457 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601217+0000", 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.509e-06 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607652+0000", 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064351900000000004 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607693+0000", 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0868999999999998e-05 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607712+0000", 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8702000000000002e-05 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607889+0000", 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000177061 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608263+0000", 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037431500000000001 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608646+0000", 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038215100000000001 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.620501+0000", 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011855625 2024-04-26T12:40:49.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622083+0000", 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001581556 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622195+0000", 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112667 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622265+0000", 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9404000000000002e-05 2024-04-26T12:40:49.637 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1601 3.1d 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.902490622999998, 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028382847999999999, 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.638 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1601 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720720+0000", 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3300000000000001e-06 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726577+0000", 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005857307 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726616+0000", 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9224999999999998e-05 2024-04-26T12:40:49.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726640+0000", 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3873e-05 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726810+0000", 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016950799999999999 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727033+0000", 2024-04-26T12:40:49.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022316600000000001 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727242+0000", 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020876 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748847+0000", 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021605347 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748917+0000", 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9413999999999996e-05 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749020+0000", 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103383 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749100+0000", 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0535000000000001e-05 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.643 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1602 3.28 3:15f7ca78:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 49.896515407000003, 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021360100999999999, 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1602 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.644 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726695+0000", 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1900000000000002e-06 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729949+0000", 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032543730000000001 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729991+0000", 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1403000000000003e-05 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730016+0000", 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5709000000000001e-05 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730228+0000", 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021134999999999999 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730651+0000", 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042305000000000001 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.731097+0000", 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044566700000000001 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.740379+0000", 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092821050000000006 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747886+0000", 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007507555 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747980+0000", 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3727000000000006e-05 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748053+0000", 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2972000000000005e-05 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.649 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2357 3.2a 3:5615e7fe:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.836884365000003, 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019796023999999999, 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2357 2024-04-26T12:40:49.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786327+0000", 2024-04-26T12:40:49.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.49e-06 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790818+0000", 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044903690000000001 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790860+0000", 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1851999999999998e-05 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790879+0000", 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9551999999999998e-05 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791003+0000", 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012405399999999999 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791242+0000", 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238495 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:49.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791453+0000", 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000211005 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.801975+0000", 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010522658000000001 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.805976+0000", 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040003449999999998 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806054+0000", 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8757999999999994e-05 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806120+0000", 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5445999999999996e-05 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2367 3.2a 3:55ec8106:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.655 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.725262647000001, 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020327305, 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2367 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:49.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897949+0000", 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4489999999999999e-06 2024-04-26T12:40:49.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902370+0000", 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044209369999999998 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902408+0000", 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8541999999999998e-05 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902428+0000", 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9040000000000001e-05 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902607+0000", 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017954599999999999 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903016+0000", 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040908999999999997 2024-04-26T12:40:49.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:49.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903422+0000", 2024-04-26T12:40:49.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040581100000000001 2024-04-26T12:40:49.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.917186+0000", 2024-04-26T12:40:49.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013763861 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918102+0000", 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091656300000000001 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918200+0000", 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7906999999999996e-05 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918273+0000", 2024-04-26T12:40:49.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2558999999999994e-05 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2375 3.1c 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.643528957000001, 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026708701000000001, 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.662 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2375 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979683+0000", 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8759999999999998e-06 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985829+0000", 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061460810000000003 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985877+0000", 2024-04-26T12:40:49.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7812000000000002e-05 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985907+0000", 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9713000000000002e-05 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986054+0000", 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014770300000000001 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.665 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986363+0000", 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030863899999999998 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986696+0000", 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033299000000000002 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.997022+0000", 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010325732000000001 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006148+0000", 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091265240000000004 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006280+0000", 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013179399999999999 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006388+0000", 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107837 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.667 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2376 3.5 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.634222588999997, 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020175694000000001, 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.668 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2376 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988989+0000", 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5769999999999998e-06 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995521+0000", 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006531635 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995571+0000", 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9738999999999999e-05 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995601+0000", 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995729+0000", 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012808399999999999 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996014+0000", 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028456400000000001 2024-04-26T12:40:49.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996264+0000", 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025048699999999998 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006170+0000", 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099054369999999996 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009021+0000", 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028506730000000002 2024-04-26T12:40:49.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009103+0000", 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2908e-05 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009161+0000", 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7855000000000001e-05 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2378 3.1d 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.612760796000003, 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023192784000000001, 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2378 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010450+0000", 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5239999999999999e-06 2024-04-26T12:40:49.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014852+0000", 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044019619999999997 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014884+0000", 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2323000000000002e-05 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014900+0000", 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5651999999999999e-05 2024-04-26T12:40:49.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015044+0000", 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014389700000000001 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015292+0000", 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024860399999999998 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015521+0000", 2024-04-26T12:40:49.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022877100000000001 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031237+0000", 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015715600999999999 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033338+0000", 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021008699999999999 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033518+0000", 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180089 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033640+0000", 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012249099999999999 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2380 3.c 3:32d641af:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.591861074999997, 2024-04-26T12:40:49.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019849939, 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2380 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031352+0000", 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5399999999999997e-06 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039154+0000", 2024-04-26T12:40:49.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007802135 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039191+0000", 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7240000000000003e-05 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039210+0000", 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9236e-05 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039358+0000", 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147866 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039611+0000", 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000253298 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039846+0000", 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023419399999999999 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.049633+0000", 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097878089999999997 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.050899+0000", 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001265455 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051067+0000", 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016852600000000001 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051197+0000", 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012964000000000001 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2382 3.3c 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.571656525000002, 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023553801999999999, 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.685 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2382 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051554+0000", 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.706e-06 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.055983+0000", 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044283889999999996 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056027+0000", 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4518999999999998e-05 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056052+0000", 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4675999999999999e-05 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056206+0000", 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015424199999999999 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056594+0000", 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038824299999999998 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056974+0000", 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000379751 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068770+0000", 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011795386999999999 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074792+0000", 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060226439999999997 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074974+0000", 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000181282 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.075105+0000", 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131963 2024-04-26T12:40:49.690 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2387 3.28 3:1657e0bf:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.520392393000002, 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018313085, 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.691 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2387 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102819+0000", 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107254+0000", 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044347290000000001 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107287+0000", 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2753000000000003e-05 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107302+0000", 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5302999999999999e-05 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107463+0000", 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161531 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107863+0000", 2024-04-26T12:40:49.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039991799999999997 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.108294+0000", 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043064600000000002 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.118549+0000", 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010255083 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.120957+0000", 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024081990000000002 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121053+0000", 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6070999999999995e-05 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121129+0000", 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5574999999999994e-05 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.696 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2392 3.30 3:0e664f76:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.460922629999999, 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020233060000000001, 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2392 2024-04-26T12:40:49.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162289+0000", 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166843+0000", 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045541959999999999 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166886+0000", 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2908999999999999e-05 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166917+0000", 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0741999999999998e-05 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167061+0000", 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143771 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167317+0000", 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000256493 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167549+0000", 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023142099999999999 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.176299+0000", 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0087508729999999993 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182351+0000", 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060514330000000002 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182446+0000", 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5531000000000004e-05 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182519+0000", 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2175000000000006e-05 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.702 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2399 3.1d 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.384020636999999, 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029752193999999999, 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2399 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239192+0000", 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1829999999999996e-06 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243681+0000", 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044893629999999997 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243722+0000", 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0639000000000002e-05 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243743+0000", 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0760000000000001e-05 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243882+0000", 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013962600000000001 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244142+0000", 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025946699999999999 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244378+0000", 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000236839 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.706 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254731+0000", 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010353004000000001 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268598+0000", 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013866431 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268779+0000", 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018066499999999999 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.707 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268940+0000", 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016121700000000001 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2401 3.2a 3:54e389fa:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.364870717999999, 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018846505999999999, 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.708 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2401 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:49.709 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258341+0000", 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1559999999999999e-06 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262849+0000", 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045083329999999998 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.710 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262889+0000", 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9903000000000001e-05 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262907+0000", 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8179e-05 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263036+0000", 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012896000000000001 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.711 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263291+0000", 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025503100000000002 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263523+0000", 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023191100000000001 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.275751+0000", 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012228517 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.712 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276977+0000", 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012251580000000001 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277070+0000", 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3718e-05 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277184+0000", 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011364 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.713 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2410 3.16 3:697fa4a2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.265586843000001, 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019793999999999999, 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.714 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2410 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.715 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357625+0000", 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8630000000000001e-06 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362361+0000", 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004736011 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362400+0000", 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8719e-05 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.716 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362418+0000", 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8366e-05 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362541+0000", 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012312400000000001 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362785+0000", 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000243837 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.717 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.363004+0000", 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218629 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.376177+0000", 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173239999999999 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377237+0000", 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001059862 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.718 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377335+0000", 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8171000000000006e-05 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377415+0000", 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0178000000000004e-05 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2425 3.5 3:a11dc694:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:49.719 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.100087666, 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018795115000000001, 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2425 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.720 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523123+0000", 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.721 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528942+0000", 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058186920000000003 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528985+0000", 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2951999999999998e-05 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529011+0000", 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6190000000000002e-05 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529142+0000", 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013053000000000001 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529415+0000", 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027316299999999999 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529659+0000", 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024458800000000001 2024-04-26T12:40:49.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.538947+0000", 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092877199999999993 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541743+0000", 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002795723 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.724 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541840+0000", 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7261000000000003e-05 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541916+0000", 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5562000000000006e-05 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2884 3.2f 3:f6197e28:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.096676+0000", 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.52653238800000002, 2024-04-26T12:40:49.725 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028209858000000001, 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2884 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.096676+0000", 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.726 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.096676+0000", 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.096693+0000", 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.73e-05 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101223+0000", 2024-04-26T12:40:49.727 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045303599999999998 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101266+0000", 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2973999999999999e-05 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101286+0000", 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9266000000000002e-05 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101452+0000", 2024-04-26T12:40:49.728 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016583799999999999 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101701+0000", 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024983200000000002 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101924+0000", 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000222487 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.114371+0000", 2024-04-26T12:40:49.729 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012447389999999999 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124747+0000", 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010375654999999999 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124829+0000", 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2124000000000002e-05 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.730 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124886+0000", 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6632000000000003e-05 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2885 3.16 3:68cd90f5:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.106688+0000", 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.51651986900000002, 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024775195, 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.731 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2885 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.106688+0000", 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.106688+0000", 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.732 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.106692+0000", 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7000000000000002e-06 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111163+0000", 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044714220000000001 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111201+0000", 2024-04-26T12:40:49.733 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7605999999999999e-05 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111226+0000", 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5207000000000001e-05 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111408+0000", 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000181705 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.734 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111717+0000", 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030930999999999998 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111976+0000", 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025830100000000001 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124511+0000", 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012535559 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.735 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.131382+0000", 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006870569 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.131429+0000", 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7148999999999999e-05 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.131464+0000", 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.736 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2887 3.5 3:a14a2cb3:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.137881+0000", 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.485327538, 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020910497, 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2887 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.737 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.137881+0000", 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.137881+0000", 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.137883+0000", 2024-04-26T12:40:49.738 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.593e-06 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.142905+0000", 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00502164 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.142940+0000", 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5366e-05 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.142956+0000", 2024-04-26T12:40:49.739 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6223e-05 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.143081+0000", 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124552 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.143339+0000", 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000258311 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.143564+0000", 2024-04-26T12:40:49.740 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225085 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.156217+0000", 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012652541 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.158629+0000", 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002412277 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:49.741 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.158721+0000", 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1952000000000003e-05 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.158791+0000", 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9956999999999994e-05 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:49.742 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:49.744 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:49.744 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:49.740+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:49.845 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:49.844+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:49.855 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T12:40:49.855 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:40:49.913 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:49.913 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:49.913 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:49.913 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:49.927 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:49.945 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:49.945+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:50.046 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:50.045+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:50.086 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:50.086 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:50.086 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:50.086 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:50.086 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:50.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:50.148 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:50.145+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:50.227 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:50.227 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:50.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:50.227 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:50.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.227 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1325 3.34 3:2cf99e10:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:50.227 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 52.385857987000001, 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020543797999999999, 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1325 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837059+0000", 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2140000000000001e-06 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843506+0000", 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064467209999999999 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843561+0000", 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.5291999999999998e-05 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843589+0000", 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8354999999999999e-05 2024-04-26T12:40:50.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843720+0000", 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013083999999999999 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843945+0000", 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000224782 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.844155+0000", 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000209743 2024-04-26T12:40:50.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857491+0000", 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013336249 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857520+0000", 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8941e-05 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857557+0000", 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7115e-05 2024-04-26T12:40:50.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857600+0000", 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2546000000000002e-05 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1460 3.36 3:6e35934d:::d749f084-3851-4e95-9492-490675b43f90.4382.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.597542187999998, 2024-04-26T12:40:50.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025121213, 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1460 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625375+0000", 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631320+0000", 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059444809999999997 2024-04-26T12:40:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631360+0000", 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0398999999999997e-05 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631378+0000", 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8050000000000002e-05 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631551+0000", 2024-04-26T12:40:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017255800000000001 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631822+0000", 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027131799999999999 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.632685+0000", 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00086248900000000003 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.649790+0000", 2024-04-26T12:40:50.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017105170999999999 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650179+0000", 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000389284 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650359+0000", 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180061 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650493+0000", 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133876 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2331 3.26 3:660a096e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.725287094999999, 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018877251000000001, 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.239 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2331 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:50.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497630+0000", 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4400000000000001e-06 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501943+0000", 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004312715 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501979+0000", 2024-04-26T12:40:50.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6365999999999997e-05 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501997+0000", 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7793000000000001e-05 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502089+0000", 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1958000000000003e-05 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502288+0000", 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019909800000000001 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502477+0000", 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018923200000000001 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.509874+0000", 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073965639999999996 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516336+0000", 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006461629 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516433+0000", 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7807999999999996e-05 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516504+0000", 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0648000000000005e-05 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.244 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2341 3.35 3:ad2a0070:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.616833172, 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020122823000000001, 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2341 2024-04-26T12:40:50.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606084+0000", 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5030000000000002e-06 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610523+0000", 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004439035 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610563+0000", 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9305999999999999e-05 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610582+0000", 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9083e-05 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610736+0000", 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015433999999999999 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611020+0000", 2024-04-26T12:40:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028411000000000002 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611253+0000", 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023267200000000001 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.625380+0000", 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014127366000000001 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626034+0000", 2024-04-26T12:40:50.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00065407499999999995 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626133+0000", 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9141000000000005e-05 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626204+0000", 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.250 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2347 3.a 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.542848153000001, 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025995128999999999, 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2347 2024-04-26T12:40:50.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680068+0000", 2024-04-26T12:40:50.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2699999999999999e-06 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684436+0000", 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043681800000000002 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684474+0000", 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7696e-05 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684498+0000", 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3736000000000001e-05 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684647+0000", 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014935999999999999 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684905+0000", 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000257767 2024-04-26T12:40:50.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685154+0000", 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024906499999999997 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.694110+0000", 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0089561629999999996 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:40:50.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011663118 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705931+0000", 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015790699999999999 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706061+0000", 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012986700000000001 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2354 3.3f e73/17 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.459305282999999, 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023388658, 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3699999999999999e-07 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767456+0000", 2024-04-26T12:40:50.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038463529999999998 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767493+0000", 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7058999999999999e-05 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767512+0000", 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426e-05 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767810+0000", 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029746500000000001 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767864+0000", 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3974999999999997e-05 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786741+0000", 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018876885999999999 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786997+0000", 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025665699999999998 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2361 3.26 3:6509be61:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.389787904000002, 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020183629000000002, 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.261 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2361 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833130+0000", 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7330000000000001e-06 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837748+0000", 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046180049999999997 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837801+0000", 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3458999999999998e-05 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837829+0000", 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8299000000000001e-05 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837988+0000", 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015878100000000001 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838269+0000", 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028097000000000002 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838507+0000", 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238118 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.852548+0000", 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014040777000000001 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853137+0000", 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00058917099999999999 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853233+0000", 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5338000000000001e-05 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853310+0000", 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6977999999999994e-05 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2379 3.2c 3:3590e7ea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.201839456999998, 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022546869000000001, 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.267 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2379 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:50.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021078+0000", 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026404+0000", 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053251669999999996 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026452+0000", 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8304999999999999e-05 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026472+0000", 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.959e-05 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026612+0000", 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014085700000000001 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027080+0000", 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00046714499999999997 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027701+0000", 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00062184600000000001 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041035+0000", 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013333617000000001 2024-04-26T12:40:50.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043446+0000", 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024114359999999999 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043546+0000", 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100041 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043621+0000", 2024-04-26T12:40:50.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4808000000000006e-05 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2381 3.26 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.181369732, 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.027555486000000001, 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.273 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2381 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041549+0000", 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5539999999999999e-06 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046113+0000", 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045646840000000003 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046153+0000", 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:40:50.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046178+0000", 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4743e-05 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046298+0000", 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120087 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046514+0000", 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021600800000000001 2024-04-26T12:40:50.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046746+0000", 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000232241 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056160+0000", 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094137170000000003 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068838+0000", 2024-04-26T12:40:50.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012678149999999999 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069011+0000", 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173129 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069100+0000", 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8694000000000002e-05 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2394 3.26 3:649f95b9:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.036500578000002, 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023463999999999999, 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2394 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186417+0000", 2024-04-26T12:40:50.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2030000000000001e-06 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191437+0000", 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005020488 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191475+0000", 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7879000000000001e-05 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191493+0000", 2024-04-26T12:40:50.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7703e-05 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191654+0000", 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016161600000000001 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191908+0000", 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025423399999999999 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:50.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.192139+0000", 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230184 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.207939+0000", 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015800715999999999 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209724+0000", 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001784461 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209809+0000", 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5014999999999998e-05 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209877+0000", 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8501e-05 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2404 3.20 3:079a3e14:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.284 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.937302647000003, 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017213770999999999, 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2404 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:50.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285615+0000", 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5729999999999999e-06 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290079+0000", 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044646399999999998 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290120+0000", 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290140+0000", 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290273+0000", 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013316000000000001 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290551+0000", 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027847599999999999 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290916+0000", 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000364306 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.301035+0000", 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010119360000000001 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302519+0000", 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001484031 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302691+0000", 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017180599999999999 2024-04-26T12:40:50.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302825+0000", 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013415000000000001 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2408 3.20 3:07238821:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.891542170000001, 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017149066000000001, 2024-04-26T12:40:50.290 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2408 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331375+0000", 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4630000000000001e-06 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336575+0000", 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052001240000000004 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336603+0000", 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7526e-05 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336622+0000", 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9613e-05 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336759+0000", 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013698399999999999 2024-04-26T12:40:50.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337044+0000", 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028474300000000001 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337284+0000", 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023956699999999999 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.345871+0000", 2024-04-26T12:40:50.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0085868230000000004 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348358+0000", 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024872269999999998 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348449+0000", 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0795000000000001e-05 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348521+0000", 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2200999999999995e-05 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2433 3.2c 3:352e35ac:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.619780341999999, 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019506391000000001, 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.296 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2433 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603138+0000", 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.386e-06 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607459+0000", 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043213210000000004 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607499+0000", 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0228999999999997e-05 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607517+0000", 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7895999999999999e-05 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607651+0000", 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133487 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607918+0000", 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026730100000000001 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.608152+0000", 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023403399999999999 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621350+0000", 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013197416999999999 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622407+0000", 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001057805 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622498+0000", 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0390999999999996e-05 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622640+0000", 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014212400000000001 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2434 3.35 3:ac41eaea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.606851091999999, 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022970694999999999, 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2434 2024-04-26T12:40:50.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616067+0000", 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.907e-06 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620671+0000", 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046047070000000004 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620709+0000", 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7392999999999999e-05 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620728+0000", 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9199e-05 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620876+0000", 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014752299999999999 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621360+0000", 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048465200000000002 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621810+0000", 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044939600000000002 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638455+0000", 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016645172 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638848+0000", 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000393137 2024-04-26T12:40:50.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638951+0000", 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102771 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.639033+0000", 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2837999999999995e-05 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2437 3.26 3:65b96022:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.573715688, 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020654793000000001, 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2437 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649201+0000", 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.247e-06 2024-04-26T12:40:50.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654391+0000", 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051896090000000004 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654430+0000", 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8906000000000003e-05 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654449+0000", 2024-04-26T12:40:50.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8960000000000001e-05 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654577+0000", 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012784299999999999 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654838+0000", 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026151100000000002 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:50.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.655052+0000", 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021390800000000001 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.668862+0000", 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013810206 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669649+0000", 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00078632500000000004 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669747+0000", 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8478000000000001e-05 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669853+0000", 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001058 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2438 3.36 3:6cea662e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.313 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 37.564651529999999, 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021295308999999998, 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2438 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658266+0000", 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9870000000000001e-06 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662764+0000", 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044975229999999998 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662804+0000", 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0575999999999999e-05 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662832+0000", 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8019000000000001e-05 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663009+0000", 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017632600000000001 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663314+0000", 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030489299999999998 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663544+0000", 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230564 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.678407+0000", 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014862254 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679337+0000", 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00093039800000000003 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679443+0000", 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105908 2024-04-26T12:40:50.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679558+0000", 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114861 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2871 3.26 3:6787126b:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.3032474000000001, 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019856490000000001, 2024-04-26T12:40:50.319 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2871 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919669+0000", 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923715+0000", 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040457449999999999 2024-04-26T12:40:50.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923745+0000", 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9442999999999999e-05 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923760+0000", 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5899000000000001e-05 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923881+0000", 2024-04-26T12:40:50.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120099 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.924116+0000", 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023545799999999999 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.924459+0000", 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034342999999999998 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.938038+0000", 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013578392999999999 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939226+0000", 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011884549999999999 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939398+0000", 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017150600000000001 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939523+0000", 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012520200000000001 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2882 3.a 3:52be8611:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.148671923, 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021456744999999999, 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.325 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2882 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074247+0000", 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3959999999999997e-06 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078878+0000", 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046305039999999997 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078917+0000", 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9125999999999998e-05 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078936+0000", 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8787000000000002e-05 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079079+0000", 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143318 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079309+0000", 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000229865 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079533+0000", 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022415400000000001 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.092322+0000", 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012788620000000001 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095522+0000", 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032001170000000002 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095620+0000", 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8312000000000003e-05 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095699+0000", 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8546000000000003e-05 2024-04-26T12:40:50.330 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2892 3.20 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.022530078, 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028217702000000001, 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.331 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2892 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200388+0000", 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9600000000000002e-06 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206310+0000", 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059217280000000002 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206354+0000", 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206374+0000", 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0163e-05 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206504+0000", 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013038899999999999 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206764+0000", 2024-04-26T12:40:50.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026011200000000001 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206980+0000", 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021612199999999999 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.216070+0000", 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0090894280000000001 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228367+0000", 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01229715 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228481+0000", 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114491 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228602+0000", 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120079 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2896 3.35 3:ad957356:::d749f084-3851-4e95-9492-490675b43f90.4382.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.96849724599999998, 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018487367000000001, 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2896 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.337 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254420+0000", 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:40:50.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258671+0000", 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004250813 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258698+0000", 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7746000000000002e-05 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258710+0000", 2024-04-26T12:40:50.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1904e-05 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258792+0000", 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1879000000000007e-05 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258957+0000", 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016524899999999999 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.259486+0000", 2024-04-26T12:40:50.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052866199999999995 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272598+0000", 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013112047 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272802+0000", 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020374100000000001 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272860+0000", 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8451e-05 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272904+0000", 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3671000000000003e-05 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.342 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:50.344 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:50.344 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:50.341+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:50.364 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:40:50.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:40:50.389 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:40:50.473 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:50.473 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:50.473 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:50.473 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:50.477 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:50.477+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:50.489 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:50.544 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:50.545+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:50.610 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:50.610 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:50.611 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:50.611 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:50.611 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:50.624 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:50.669 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:50.668+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:50.747 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:50.744+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 166.359858637, 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:40:50.750 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.751 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:40:50.752 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:40:50.753 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.754 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.755 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.756 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 166.05583148900001, 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:50.757 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.758 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:40:50.760 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:40:50.761 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.762 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 166.055791422, 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:40:50.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:40:50.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:40:50.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 166.05559620400001, 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:40:50.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:40:50.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:40:50.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 166.05555912700001, 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:40:50.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:40:50.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.780 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2349 3.37 3:ec3a3f83:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 39.047266182999998, 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023512585999999999, 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.781 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2349 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.701002+0000", 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047707940000000001 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705810+0000", 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7543000000000003e-05 2024-04-26T12:40:50.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705828+0000", 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705952+0000", 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123967 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706240+0000", 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028815399999999999 2024-04-26T12:40:50.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706474+0000", 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233878 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.716974+0000", 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010500061999999999 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724253+0000", 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0072788139999999998 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724383+0000", 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013002000000000001 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724511+0000", 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128164 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.786 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2351 3.14 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 39.025153711999998, 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029175587999999999, 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.787 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2351 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723115+0000", 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8500000000000004e-06 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727939+0000", 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048243670000000004 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727979+0000", 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0326e-05 2024-04-26T12:40:50.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728003+0000", 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4193e-05 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728157+0000", 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015328 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728534+0000", 2024-04-26T12:40:50.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037701500000000002 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728958+0000", 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042402 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.742778+0000", 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013820426 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752106+0000", 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0093279780000000007 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752210+0000", 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103854 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752286+0000", 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6279000000000006e-05 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.792 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2353 3.2b e73/17 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.99587811, 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022414480000000001, 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752388+0000", 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9530000000000002e-06 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760303+0000", 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079148240000000009 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760339+0000", 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5615999999999999e-05 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760363+0000", 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4272000000000001e-05 2024-04-26T12:40:50.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760530+0000", 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167047 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760593+0000", 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3214999999999997e-05 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774684+0000", 2024-04-26T12:40:50.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01409087 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774801+0000", 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011668299999999999 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2354 3.3f 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.989056673, 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028337384, 2024-04-26T12:40:50.797 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2354 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759211+0000", 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762648+0000", 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003436854 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762685+0000", 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7004e-05 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762709+0000", 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3482999999999999e-05 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762871+0000", 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016273399999999999 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763073+0000", 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020189599999999999 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763271+0000", 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000197412 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.775210+0000", 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011939171 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787276+0000", 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012066464000000001 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787428+0000", 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000151383 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787545+0000", 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000117457 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2355 3.37 3:eff17c6c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.981850418999997, 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02156363, 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.803 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2355 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766417+0000", 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3440000000000001e-06 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.770991+0000", 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004573756 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771029+0000", 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7821999999999998e-05 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771053+0000", 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.387e-05 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771215+0000", 2024-04-26T12:40:50.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016220300000000001 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771568+0000", 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000352472 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771951+0000", 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038302699999999998 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787714+0000", 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015763065999999999 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787794+0000", 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0259999999999994e-05 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787886+0000", 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2472000000000005e-05 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787978+0000", 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1337999999999999e-05 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2373 3.13 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.786069437000002, 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030808384000000001, 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.809 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2373 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962198+0000", 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1200000000000002e-06 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966728+0000", 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045301170000000002 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966768+0000", 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9619000000000001e-05 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966787+0000", 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8933999999999999e-05 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966954+0000", 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016689600000000001 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967341+0000", 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038776099999999998 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967720+0000", 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037867100000000002 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.980012+0000", 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012291717000000001 2024-04-26T12:40:50.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992693+0000", 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012681192000000001 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016807000000000001 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.993003+0000", 2024-04-26T12:40:50.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142287 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2381 3.26 e73/17 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.701295375000001, 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021426161999999999, 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046971+0000", 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051948+0000", 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049762549999999997 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051984+0000", 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.625e-05 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052007+0000", 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2572e-05 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052200+0000", 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193372 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052261+0000", 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1471999999999997e-05 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068271+0000", 2024-04-26T12:40:50.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016010027999999999 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068395+0000", 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012382300000000001 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2384 3.37 3:eff1e373:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.676035321000001, 2024-04-26T12:40:50.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022518564000000001, 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2384 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072232+0000", 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2569999999999999e-06 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076853+0000", 2024-04-26T12:40:50.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046206870000000001 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076884+0000", 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1049e-05 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076902+0000", 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8070000000000001e-05 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077053+0000", 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015034 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077312+0000", 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025907300000000002 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077559+0000", 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024693099999999998 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.087260+0000", 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097015409999999993 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094578+0000", 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073179739999999997 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094666+0000", 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8160999999999998e-05 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094748+0000", 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1481000000000001e-05 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2402 3.11 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.480987024000001, 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026287990000000001, 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.825 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2402 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267281+0000", 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.557e-06 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271739+0000", 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004457524 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271771+0000", 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2852999999999999e-05 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271790+0000", 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8889000000000002e-05 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271949+0000", 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015870000000000001 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272198+0000", 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024856800000000001 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272455+0000", 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025784700000000001 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.291321+0000", 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018865189000000001 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293294+0000", 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001973196 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293449+0000", 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001552 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293565+0000", 2024-04-26T12:40:50.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011646699999999999 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2413 3.2d 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.356358532999998, 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020394760000000001, 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.831 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2413 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391909+0000", 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0429999999999999e-06 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396691+0000", 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047820140000000002 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396734+0000", 2024-04-26T12:40:50.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396751+0000", 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7011999999999999e-05 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396899+0000", 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014740399999999999 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397244+0000", 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034543200000000001 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397484+0000", 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024016099999999999 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.405191+0000", 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0077069340000000004 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412133+0000", 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006941465 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412231+0000", 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7770999999999996e-05 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412301+0000", 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.836 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2414 3.37 3:efe9b32a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.342184781999997, 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019629488, 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2414 2024-04-26T12:40:50.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406083+0000", 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2729999999999998e-06 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411790+0000", 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0057067749999999999 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411830+0000", 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0525000000000002e-05 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411856+0000", 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5695999999999999e-05 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411994+0000", 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013798400000000001 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412226+0000", 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023230399999999999 2024-04-26T12:40:50.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412447+0000", 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022097499999999999 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.423387+0000", 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010939574000000001 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425535+0000", 2024-04-26T12:40:50.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002148109 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425634+0000", 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8851000000000006e-05 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425709+0000", 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5421999999999997e-05 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2427 3.d 3:b1e8d312:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.205838446999998, 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021368552999999998, 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2427 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542430+0000", 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:40:50.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547450+0000", 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050205040000000003 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547487+0000", 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6866000000000002e-05 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547506+0000", 2024-04-26T12:40:50.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9343000000000001e-05 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547680+0000", 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017347599999999999 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548089+0000", 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040960699999999998 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548515+0000", 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042551999999999998 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.558096+0000", 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0095806929999999995 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563571+0000", 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054753329999999998 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563674+0000", 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010266400000000001 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563795+0000", 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012098 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2430 3.37 3:eff5ab0a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.848 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.176568617000001, 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020751628000000001, 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2430 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:50.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571699+0000", 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5360000000000001e-06 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576275+0000", 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045753479999999999 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576311+0000", 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5865999999999998e-05 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576328+0000", 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576501+0000", 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000172659 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576910+0000", 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040915 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.577329+0000", 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041870699999999999 2024-04-26T12:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.591164+0000", 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013835896 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592117+0000", 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00095214699999999998 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592309+0000", 2024-04-26T12:40:50.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019207600000000001 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592447+0000", 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013884999999999999 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2440 3.d 3:b0894f88:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 38.028118454999998, 2024-04-26T12:40:50.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020963463000000002, 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2440 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720150+0000", 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5200000000000002e-06 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724635+0000", 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004485447 2024-04-26T12:40:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724675+0000", 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9938999999999998e-05 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724694+0000", 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724859+0000", 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016413899999999999 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725146+0000", 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000287387 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725469+0000", 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032321900000000002 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.739743+0000", 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014273485000000001 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.740904+0000", 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011612790000000001 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741034+0000", 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130314 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741109+0000", 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5221000000000004e-05 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2884 3.2f e91/17 3:f6197e28:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_239:head v 91'6, mlcod=90'4)", 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.6460964059999998, 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022275581999999999, 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:50.860 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102172+0000", 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.76e-06 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104815+0000", 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002643088 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104864+0000", 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9450000000000003e-05 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104891+0000", 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6990000000000001e-05 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.105091+0000", 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019925499999999999 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.105154+0000", 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2954999999999996e-05 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124376+0000", 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019222123000000001 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124444+0000", 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7960999999999995e-05 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:50.864 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:50.865 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:50.867 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:50.864+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:50.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:50.968 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:50.965+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:50.986 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:50.986 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:50.986 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:50.986 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:51.011 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:51.015 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:51.015 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:51.031 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:51.031 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:51.048 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:51.048 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:51.065 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:51.065 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:51.069 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:51.068+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:51.086 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:51.086 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:51.105 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:51.106 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:51.126 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:51.126 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:51.126 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:51.126 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:51.139 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:51.147 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:51.148 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:51.212 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:51.213+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:51.255 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:51.255 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:51.269 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:51.313 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:51.313+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:51.371 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:51.368+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:51.384 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:40:51.385 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:40:51.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:40:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:51.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:51.472 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:51.468+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:51.573 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:51.572+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:51.620 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:51.621 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:51.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:51.681 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:51.681+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:51.754 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:51.754 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:51.767 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:51.774 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:51.772+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:51.875 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:51.872+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:51.927 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:51.927 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:51.940 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:51.976 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:51.972+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:52.049 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:52.049 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:52.062 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:52.077 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:52.076+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:52.177 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:52.177 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:52.178 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:52.176+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:52.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:52.278 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:52.276+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:52.317 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:52.318 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:52.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:52.380 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:52.376+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:52.382 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:40:52.408 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-26T12:40:52.455 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:52.456 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:52.471 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:52.513 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:52.513+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:52.581 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:52.581+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:52.626 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:52.626 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:52.639 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:52.685 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:52.684+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:52.770 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:52.770 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:52.782 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:52.781+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:52.784 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:52.882 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:52.880+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:52.950 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:52.950 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:52.964 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:52.983 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:52.981+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:53.084 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:53.084+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:53.130 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:53.131 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:53.145 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:53.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:53.189 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:53.188+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:53.286 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:53.285+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:53.311 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:53.311 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:53.320 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:53.325 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:53.337 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:53.337 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:53.354 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:53.354 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:53.372 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:53.372 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:53.386 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:53.385+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:53.390 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:53.390 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:53.403 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.3 to 1 (10000) 2024-04-26T12:40:53.411 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:53.411 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:53.415 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:40:53.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-26T12:40:53.430 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:53.431 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:53.446 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:53.446 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:53.446 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:53.446 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:53.447 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:53.450 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:53.450 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:53.461 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:53.505 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:53.504+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:53.588 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1328 3.1f e67/17 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head v 67'1, mlcod=0'0)", 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 55.721739397, 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019374358000000001, 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.862837+0000", 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.28e-07 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867669+0000", 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004831915 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867686+0000", 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6895999999999999e-05 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867695+0000", 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3009999999999995e-06 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867801+0000", 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010592200000000001 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.867837+0000", 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6032000000000003e-05 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882087+0000", 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014249265000000001 2024-04-26T12:40:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.882212+0000", 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012479900000000001 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1457 3.22 3:46753612:::d749f084-3851-4e95-9492-490675b43f90.4382.3__shadow_.89eL0OTfRIkm8jjkAhjXzYFORkpc2AZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 54.983361831000003, 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021050049000000001, 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1457 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601215+0000", 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.601217+0000", 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.509e-06 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607652+0000", 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064351900000000004 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607693+0000", 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0868999999999998e-05 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607712+0000", 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8702000000000002e-05 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.607889+0000", 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000177061 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608263+0000", 2024-04-26T12:40:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037431500000000001 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.608646+0000", 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038215100000000001 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.620501+0000", 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011855625 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622083+0000", 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001581556 2024-04-26T12:40:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622195+0000", 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000112667 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.622265+0000", 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9404000000000002e-05 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1601 3.1d 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.863858960999998, 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028382847999999999, 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1601 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720720+0000", 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3300000000000001e-06 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726577+0000", 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005857307 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726616+0000", 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9224999999999998e-05 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726640+0000", 2024-04-26T12:40:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3873e-05 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726810+0000", 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016950799999999999 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727033+0000", 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022316600000000001 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727242+0000", 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020876 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748847+0000", 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021605347 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748917+0000", 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9413999999999996e-05 2024-04-26T12:40:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749020+0000", 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103383 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749100+0000", 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0535000000000001e-05 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1602 3.28 3:15f7ca78:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 53.857883745000002, 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021360100999999999, 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1602 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726693+0000", 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726695+0000", 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1900000000000002e-06 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729949+0000", 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032543730000000001 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.729991+0000", 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1403000000000003e-05 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730016+0000", 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5709000000000001e-05 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730228+0000", 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021134999999999999 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.730651+0000", 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042305000000000001 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.731097+0000", 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044566700000000001 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.740379+0000", 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092821050000000006 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747886+0000", 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007507555 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.747980+0000", 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3727000000000006e-05 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748053+0000", 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2972000000000005e-05 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2357 3.2a 3:5615e7fe:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.798252703000003, 2024-04-26T12:40:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019796023999999999, 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2357 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786324+0000", 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786327+0000", 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.49e-06 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790818+0000", 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044903690000000001 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790860+0000", 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1851999999999998e-05 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.790879+0000", 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9551999999999998e-05 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791003+0000", 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012405399999999999 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791242+0000", 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238495 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.791453+0000", 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000211005 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.801975+0000", 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010522658000000001 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.805976+0000", 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040003449999999998 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806054+0000", 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8757999999999994e-05 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.806120+0000", 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5445999999999996e-05 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2367 3.2a 3:55ec8106:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.686630985000001, 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020327305, 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2367 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897946+0000", 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.897949+0000", 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4489999999999999e-06 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902370+0000", 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044209369999999998 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902408+0000", 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8541999999999998e-05 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902428+0000", 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9040000000000001e-05 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.902607+0000", 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017954599999999999 2024-04-26T12:40:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903016+0000", 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040908999999999997 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.903422+0000", 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040581100000000001 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.917186+0000", 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013763861 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918102+0000", 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091656300000000001 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918200+0000", 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7906999999999996e-05 2024-04-26T12:40:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.918273+0000", 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2558999999999994e-05 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2375 3.1c 3:3a59d76b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.604897295000001, 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026708701000000001, 2024-04-26T12:40:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2375 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979679+0000", 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.979683+0000", 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8759999999999998e-06 2024-04-26T12:40:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985829+0000", 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061460810000000003 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985877+0000", 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7812000000000002e-05 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.985907+0000", 2024-04-26T12:40:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9713000000000002e-05 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986054+0000", 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014770300000000001 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986363+0000", 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030863899999999998 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.986696+0000", 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00033299000000000002 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.997022+0000", 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010325732000000001 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006148+0000", 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091265240000000004 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006280+0000", 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013179399999999999 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006388+0000", 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107837 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2376 3.5 3:a1825eda:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.595590927000003, 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020175694000000001, 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2376 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988986+0000", 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.988989+0000", 2024-04-26T12:40:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5769999999999998e-06 2024-04-26T12:40:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995521+0000", 2024-04-26T12:40:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006531635 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995571+0000", 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9738999999999999e-05 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995601+0000", 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0735000000000003e-05 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.995729+0000", 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012808399999999999 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996014+0000", 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028456400000000001 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.996264+0000", 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025048699999999998 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.006170+0000", 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0099054369999999996 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009021+0000", 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0028506730000000002 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009103+0000", 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2908e-05 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.009161+0000", 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7855000000000001e-05 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2378 3.1d 3:ba925228:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.574129134000003, 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023192784000000001, 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2378 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010447+0000", 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.010450+0000", 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5239999999999999e-06 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014852+0000", 2024-04-26T12:40:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044019619999999997 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014884+0000", 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2323000000000002e-05 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.014900+0000", 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5651999999999999e-05 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015044+0000", 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014389700000000001 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015292+0000", 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024860399999999998 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.015521+0000", 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022877100000000001 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031237+0000", 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015715600999999999 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033338+0000", 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0021008699999999999 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033518+0000", 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180089 2024-04-26T12:40:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.033640+0000", 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012249099999999999 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2380 3.c 3:32d641af:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.553229412999997, 2024-04-26T12:40:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019849939, 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2380 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031347+0000", 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.031352+0000", 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5399999999999997e-06 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039154+0000", 2024-04-26T12:40:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.007802135 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039191+0000", 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7240000000000003e-05 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039210+0000", 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9236e-05 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039358+0000", 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000147866 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039611+0000", 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000253298 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.039846+0000", 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023419399999999999 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.049633+0000", 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097878089999999997 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.050899+0000", 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001265455 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051067+0000", 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016852600000000001 2024-04-26T12:40:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051197+0000", 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012964000000000001 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2382 3.3c 3:3fca812b:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.533024863000001, 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023553801999999999, 2024-04-26T12:40:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2382 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051552+0000", 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051554+0000", 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.706e-06 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.055983+0000", 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044283889999999996 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056027+0000", 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4518999999999998e-05 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056052+0000", 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4675999999999999e-05 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056206+0000", 2024-04-26T12:40:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015424199999999999 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056594+0000", 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038824299999999998 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056974+0000", 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000379751 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068770+0000", 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011795386999999999 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074792+0000", 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060226439999999997 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.074974+0000", 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000181282 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.075105+0000", 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000131963 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2387 3.28 3:1657e0bf:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_196:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.481760731000001, 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018313085, 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2387 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102816+0000", 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.102819+0000", 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2770000000000001e-06 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107254+0000", 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044347290000000001 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107287+0000", 2024-04-26T12:40:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2753000000000003e-05 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107302+0000", 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5302999999999999e-05 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107463+0000", 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161531 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.107863+0000", 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039991799999999997 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.108294+0000", 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043064600000000002 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.118549+0000", 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010255083 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.120957+0000", 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024081990000000002 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121053+0000", 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6070999999999995e-05 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.121129+0000", 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5574999999999994e-05 2024-04-26T12:40:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2392 3.30 3:0e664f76:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.422290967999999, 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020233060000000001, 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2392 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162286+0000", 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.162289+0000", 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5159999999999999e-06 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166843+0000", 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045541959999999999 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166886+0000", 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2908999999999999e-05 2024-04-26T12:40:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.166917+0000", 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0741999999999998e-05 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167061+0000", 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143771 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167317+0000", 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000256493 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.167549+0000", 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023142099999999999 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.176299+0000", 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0087508729999999993 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182351+0000", 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060514330000000002 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182446+0000", 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5531000000000004e-05 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.182519+0000", 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2175000000000006e-05 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2399 3.1d 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.345388974999999, 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029752193999999999, 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2399 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239192+0000", 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1829999999999996e-06 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243681+0000", 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044893629999999997 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243722+0000", 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0639000000000002e-05 2024-04-26T12:40:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243743+0000", 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0760000000000001e-05 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243882+0000", 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013962600000000001 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244142+0000", 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025946699999999999 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244378+0000", 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000236839 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254731+0000", 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010353004000000001 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268598+0000", 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013866431 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268779+0000", 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018066499999999999 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268940+0000", 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016121700000000001 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2401 3.2a 3:54e389fa:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.326239055999999, 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018846505999999999, 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2401 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258337+0000", 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.258341+0000", 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1559999999999999e-06 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262849+0000", 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045083329999999998 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262889+0000", 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9903000000000001e-05 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.262907+0000", 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8179e-05 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263036+0000", 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012896000000000001 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263291+0000", 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025503100000000002 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.263523+0000", 2024-04-26T12:40:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023191100000000001 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.275751+0000", 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012228517 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.276977+0000", 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0012251580000000001 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277070+0000", 2024-04-26T12:40:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3718e-05 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.277184+0000", 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011364 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2410 3.16 3:697fa4a2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:53.676 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.226955181000001, 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019793999999999999, 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2410 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357621+0000", 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.357625+0000", 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8630000000000001e-06 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362361+0000", 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004736011 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362400+0000", 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8719e-05 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362418+0000", 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8366e-05 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362541+0000", 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012312400000000001 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.362785+0000", 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000243837 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.363004+0000", 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000218629 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.376177+0000", 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013173239999999999 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377237+0000", 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001059862 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377335+0000", 2024-04-26T12:40:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8171000000000006e-05 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.377415+0000", 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0178000000000004e-05 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2425 3.5 3:a11dc694:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.061456004, 2024-04-26T12:40:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018795115000000001, 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2425 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523121+0000", 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.523123+0000", 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528942+0000", 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058186920000000003 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.528985+0000", 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2951999999999998e-05 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529011+0000", 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6190000000000002e-05 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529142+0000", 2024-04-26T12:40:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013053000000000001 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529415+0000", 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027316299999999999 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.529659+0000", 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024458800000000001 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.538947+0000", 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0092877199999999993 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541743+0000", 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002795723 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541840+0000", 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7261000000000003e-05 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.541916+0000", 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5562000000000006e-05 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2884 3.2f 3:f6197e28:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.096676+0000", 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 4.4879007260000003, 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028209858000000001, 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2884 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.096676+0000", 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.096676+0000", 2024-04-26T12:40:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.096693+0000", 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.73e-05 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101223+0000", 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045303599999999998 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101266+0000", 2024-04-26T12:40:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2973999999999999e-05 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101286+0000", 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9266000000000002e-05 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101452+0000", 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016583799999999999 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101701+0000", 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024983200000000002 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101924+0000", 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000222487 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.114371+0000", 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012447389999999999 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124747+0000", 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010375654999999999 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124829+0000", 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2124000000000002e-05 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124886+0000", 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6632000000000003e-05 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2885 3.16 3:68cd90f5:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.106688+0000", 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 4.4778882070000003, 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024775195, 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2885 2024-04-26T12:40:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.106688+0000", 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.106688+0000", 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.106692+0000", 2024-04-26T12:40:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7000000000000002e-06 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111163+0000", 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044714220000000001 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111201+0000", 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7605999999999999e-05 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111226+0000", 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5207000000000001e-05 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111408+0000", 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000181705 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111717+0000", 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030930999999999998 2024-04-26T12:40:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.111976+0000", 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025830100000000001 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124511+0000", 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012535559 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.131382+0000", 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006870569 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.131429+0000", 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7148999999999999e-05 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.131464+0000", 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4666999999999999e-05 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2887 3.5 3:a14a2cb3:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.137881+0000", 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 4.4466958759999997, 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020910497, 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2887 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.137881+0000", 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.137881+0000", 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.137883+0000", 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.593e-06 2024-04-26T12:40:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.142905+0000", 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00502164 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.142940+0000", 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5366e-05 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.142956+0000", 2024-04-26T12:40:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6223e-05 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.143081+0000", 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000124552 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.143339+0000", 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000258311 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.143564+0000", 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000225085 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.156217+0000", 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012652541 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.158629+0000", 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002412277 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.158721+0000", 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1952000000000003e-05 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.158791+0000", 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9956999999999994e-05 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:53.705 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:53.706 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:53.588+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:53.707 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:53.708 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:53.705+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:53.809 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:53.808+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:53.878 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:53.878 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:53.878 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:53.878 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:53.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:53.910 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:53.909+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:54.010 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:54.009+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:54.061 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:54.062 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:54.075 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:54.111 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:54.109+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:54.202 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1325 3.34 3:2cf99e10:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 56.361151909999997, 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020543797999999999, 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1325 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837059+0000", 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2140000000000001e-06 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843506+0000", 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064467209999999999 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843561+0000", 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.5291999999999998e-05 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843589+0000", 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8354999999999999e-05 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843720+0000", 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013083999999999999 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843945+0000", 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000224782 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.844155+0000", 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000209743 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857491+0000", 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013336249 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857520+0000", 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8941e-05 2024-04-26T12:40:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857557+0000", 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7115e-05 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857600+0000", 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2546000000000002e-05 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1460 3.36 3:6e35934d:::d749f084-3851-4e95-9492-490675b43f90.4382.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 55.572836111000001, 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025121213, 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1460 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625375+0000", 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631320+0000", 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059444809999999997 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631360+0000", 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0398999999999997e-05 2024-04-26T12:40:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631378+0000", 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8050000000000002e-05 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631551+0000", 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017255800000000001 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631822+0000", 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027131799999999999 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.632685+0000", 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00086248900000000003 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.649790+0000", 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017105170999999999 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650179+0000", 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000389284 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650359+0000", 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180061 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650493+0000", 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133876 2024-04-26T12:40:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2331 3.26 3:660a096e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.700581018000001, 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018877251000000001, 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2331 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497630+0000", 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4400000000000001e-06 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501943+0000", 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004312715 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501979+0000", 2024-04-26T12:40:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6365999999999997e-05 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501997+0000", 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7793000000000001e-05 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502089+0000", 2024-04-26T12:40:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1958000000000003e-05 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502288+0000", 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019909800000000001 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502477+0000", 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018923200000000001 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.509874+0000", 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073965639999999996 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516336+0000", 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006461629 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516433+0000", 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7807999999999996e-05 2024-04-26T12:40:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516504+0000", 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0648000000000005e-05 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2341 3.35 3:ad2a0070:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.592127095000002, 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020122823000000001, 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2341 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606084+0000", 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5030000000000002e-06 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610523+0000", 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004439035 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610563+0000", 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9305999999999999e-05 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610582+0000", 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9083e-05 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610736+0000", 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015433999999999999 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611020+0000", 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028411000000000002 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611253+0000", 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023267200000000001 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.625380+0000", 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014127366000000001 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626034+0000", 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00065407499999999995 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626133+0000", 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9141000000000005e-05 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626204+0000", 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2347 3.a 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.518142075999997, 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025995128999999999, 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2347 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680068+0000", 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2699999999999999e-06 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684436+0000", 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043681800000000002 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684474+0000", 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7696e-05 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684498+0000", 2024-04-26T12:40:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3736000000000001e-05 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684647+0000", 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014935999999999999 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684905+0000", 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000257767 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685154+0000", 2024-04-26T12:40:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024906499999999997 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.694110+0000", 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0089561629999999996 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011663118 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705931+0000", 2024-04-26T12:40:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015790699999999999 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706061+0000", 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012986700000000001 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2354 3.3f e73/17 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.434599206000001, 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023388658, 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3699999999999999e-07 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767456+0000", 2024-04-26T12:40:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038463529999999998 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767493+0000", 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7058999999999999e-05 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767512+0000", 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426e-05 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767810+0000", 2024-04-26T12:40:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029746500000000001 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767864+0000", 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3974999999999997e-05 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786741+0000", 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018876885999999999 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786997+0000", 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025665699999999998 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2361 3.26 3:6509be61:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.365081826999997, 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020183629000000002, 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2361 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833130+0000", 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7330000000000001e-06 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837748+0000", 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046180049999999997 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837801+0000", 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3458999999999998e-05 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837829+0000", 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8299000000000001e-05 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837988+0000", 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015878100000000001 2024-04-26T12:40:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838269+0000", 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028097000000000002 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838507+0000", 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238118 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.852548+0000", 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014040777000000001 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853137+0000", 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00058917099999999999 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853233+0000", 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5338000000000001e-05 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853310+0000", 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6977999999999994e-05 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2379 3.2c 3:3590e7ea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.177133380000001, 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022546869000000001, 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2379 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021078+0000", 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026404+0000", 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053251669999999996 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026452+0000", 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8304999999999999e-05 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026472+0000", 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.959e-05 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026612+0000", 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014085700000000001 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027080+0000", 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00046714499999999997 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027701+0000", 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00062184600000000001 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041035+0000", 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013333617000000001 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043446+0000", 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024114359999999999 2024-04-26T12:40:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043546+0000", 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100041 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043621+0000", 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4808000000000006e-05 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2381 3.26 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.156663655000003, 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.027555486000000001, 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2381 2024-04-26T12:40:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041549+0000", 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5539999999999999e-06 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046113+0000", 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045646840000000003 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046153+0000", 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046178+0000", 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4743e-05 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046298+0000", 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120087 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046514+0000", 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021600800000000001 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046746+0000", 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000232241 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056160+0000", 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094137170000000003 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068838+0000", 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012678149999999999 2024-04-26T12:40:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069011+0000", 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173129 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069100+0000", 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8694000000000002e-05 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2394 3.26 3:649f95b9:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.011794500999997, 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023463999999999999, 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2394 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186417+0000", 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2030000000000001e-06 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191437+0000", 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005020488 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191475+0000", 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7879000000000001e-05 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191493+0000", 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7703e-05 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191654+0000", 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016161600000000001 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191908+0000", 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025423399999999999 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.192139+0000", 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230184 2024-04-26T12:40:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.207939+0000", 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015800715999999999 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209724+0000", 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001784461 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209809+0000", 2024-04-26T12:40:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5014999999999998e-05 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209877+0000", 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8501e-05 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2404 3.20 3:079a3e14:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.912596569999998, 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017213770999999999, 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2404 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285615+0000", 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5729999999999999e-06 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290079+0000", 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044646399999999998 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290120+0000", 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290140+0000", 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:40:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290273+0000", 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013316000000000001 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290551+0000", 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027847599999999999 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290916+0000", 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000364306 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.301035+0000", 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010119360000000001 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302519+0000", 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001484031 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302691+0000", 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017180599999999999 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302825+0000", 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013415000000000001 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2408 3.20 3:07238821:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.866836093000003, 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017149066000000001, 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2408 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331375+0000", 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4630000000000001e-06 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336575+0000", 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052001240000000004 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336603+0000", 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7526e-05 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336622+0000", 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9613e-05 2024-04-26T12:40:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336759+0000", 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013698399999999999 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337044+0000", 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028474300000000001 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337284+0000", 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023956699999999999 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.345871+0000", 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0085868230000000004 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348358+0000", 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024872269999999998 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348449+0000", 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0795000000000001e-05 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348521+0000", 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2200999999999995e-05 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2433 3.2c 3:352e35ac:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.595074265000001, 2024-04-26T12:40:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019506391000000001, 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2433 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603138+0000", 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.386e-06 2024-04-26T12:40:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607459+0000", 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043213210000000004 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607499+0000", 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0228999999999997e-05 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607517+0000", 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7895999999999999e-05 2024-04-26T12:40:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607651+0000", 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133487 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607918+0000", 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026730100000000001 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.608152+0000", 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023403399999999999 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621350+0000", 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013197416999999999 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622407+0000", 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001057805 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622498+0000", 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0390999999999996e-05 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622640+0000", 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014212400000000001 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2434 3.35 3:ac41eaea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.582145015000002, 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022970694999999999, 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2434 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616067+0000", 2024-04-26T12:40:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.907e-06 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620671+0000", 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046047070000000004 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620709+0000", 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7392999999999999e-05 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620728+0000", 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9199e-05 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620876+0000", 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014752299999999999 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621360+0000", 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048465200000000002 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621810+0000", 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044939600000000002 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638455+0000", 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016645172 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638848+0000", 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000393137 2024-04-26T12:40:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638951+0000", 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102771 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.639033+0000", 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2837999999999995e-05 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2437 3.26 3:65b96022:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.549009611000002, 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020654793000000001, 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2437 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649201+0000", 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.247e-06 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654391+0000", 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051896090000000004 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654430+0000", 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8906000000000003e-05 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654449+0000", 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8960000000000001e-05 2024-04-26T12:40:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654577+0000", 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012784299999999999 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654838+0000", 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026151100000000002 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.655052+0000", 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021390800000000001 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.668862+0000", 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013810206 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669649+0000", 2024-04-26T12:40:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00078632500000000004 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669747+0000", 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8478000000000001e-05 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669853+0000", 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001058 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.292 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2438 3.36 3:6cea662e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 41.539945453000001, 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021295308999999998, 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2438 2024-04-26T12:40:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658266+0000", 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9870000000000001e-06 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662764+0000", 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044975229999999998 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662804+0000", 2024-04-26T12:40:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0575999999999999e-05 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662832+0000", 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8019000000000001e-05 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663009+0000", 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017632600000000001 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663314+0000", 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030489299999999998 2024-04-26T12:40:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663544+0000", 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230564 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.678407+0000", 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014862254 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679337+0000", 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00093039800000000003 2024-04-26T12:40:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679443+0000", 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105908 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679558+0000", 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114861 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2871 3.26 3:6787126b:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 5.2785413229999998, 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019856490000000001, 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2871 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919669+0000", 2024-04-26T12:40:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923715+0000", 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040457449999999999 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923745+0000", 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9442999999999999e-05 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923760+0000", 2024-04-26T12:40:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5899000000000001e-05 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923881+0000", 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120099 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.924116+0000", 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023545799999999999 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.924459+0000", 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034342999999999998 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.938038+0000", 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013578392999999999 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939226+0000", 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011884549999999999 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939398+0000", 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017150600000000001 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939523+0000", 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012520200000000001 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2882 3.a 3:52be8611:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 5.1239658459999999, 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021456744999999999, 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2882 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:40:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074247+0000", 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3959999999999997e-06 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078878+0000", 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046305039999999997 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078917+0000", 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9125999999999998e-05 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078936+0000", 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8787000000000002e-05 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079079+0000", 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143318 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079309+0000", 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000229865 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079533+0000", 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022415400000000001 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.092322+0000", 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012788620000000001 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095522+0000", 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032001170000000002 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095620+0000", 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8312000000000003e-05 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095699+0000", 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8546000000000003e-05 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2892 3.20 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 4.9978240009999997, 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028217702000000001, 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2892 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200388+0000", 2024-04-26T12:40:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9600000000000002e-06 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206310+0000", 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059217280000000002 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206354+0000", 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206374+0000", 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0163e-05 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206504+0000", 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013038899999999999 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206764+0000", 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026011200000000001 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206980+0000", 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021612199999999999 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.216070+0000", 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0090894280000000001 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228367+0000", 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01229715 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228481+0000", 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114491 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228602+0000", 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120079 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2896 3.35 3:ad957356:::d749f084-3851-4e95-9492-490675b43f90.4382.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 4.9437911689999998, 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018487367000000001, 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2896 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254420+0000", 2024-04-26T12:40:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258671+0000", 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004250813 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258698+0000", 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7746000000000002e-05 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258710+0000", 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1904e-05 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258792+0000", 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1879000000000007e-05 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258957+0000", 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016524899999999999 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.259486+0000", 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052866199999999995 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272598+0000", 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013112047 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272802+0000", 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020374100000000001 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272860+0000", 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8451e-05 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272904+0000", 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3671000000000003e-05 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.323 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:54.324 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:54.325 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:54.321+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:54.424 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.4 to 1 (10000) 2024-04-26T12:40:54.425 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:40:54.425 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:54.424+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:54.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-26T12:40:54.456 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:54.456 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:54.470 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:54.537 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:54.537+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:54.626 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:54.625+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:54.630 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:54.631 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:54.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:54.727 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:54.724+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:54.768 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 170.37551575500001, 2024-04-26T12:40:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:40:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:40:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:40:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 170.07148860699999, 2024-04-26T12:40:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:40:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:40:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:40:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 170.07144854000001, 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 170.07125332199999, 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:40:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 170.07121624499999, 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:40:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2349 3.37 3:ec3a3f83:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 43.062923300999998, 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023512585999999999, 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2349 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.701002+0000", 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047707940000000001 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705810+0000", 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7543000000000003e-05 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705828+0000", 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705952+0000", 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123967 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706240+0000", 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028815399999999999 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706474+0000", 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233878 2024-04-26T12:40:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.716974+0000", 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010500061999999999 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724253+0000", 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0072788139999999998 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724383+0000", 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013002000000000001 2024-04-26T12:40:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724511+0000", 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128164 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2351 3.14 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 43.040810829999998, 2024-04-26T12:40:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029175587999999999, 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2351 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723115+0000", 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8500000000000004e-06 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727939+0000", 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048243670000000004 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727979+0000", 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0326e-05 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728003+0000", 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4193e-05 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728157+0000", 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015328 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728534+0000", 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037701500000000002 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728958+0000", 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042402 2024-04-26T12:40:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.742778+0000", 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013820426 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752106+0000", 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0093279780000000007 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752210+0000", 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103854 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752286+0000", 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6279000000000006e-05 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2353 3.2b e73/17 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 43.011535228, 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022414480000000001, 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752388+0000", 2024-04-26T12:40:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9530000000000002e-06 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760303+0000", 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079148240000000009 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760339+0000", 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5615999999999999e-05 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760363+0000", 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4272000000000001e-05 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760530+0000", 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167047 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760593+0000", 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3214999999999997e-05 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774684+0000", 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01409087 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774801+0000", 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011668299999999999 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2354 3.3f 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 43.004713791, 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028337384, 2024-04-26T12:40:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2354 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759211+0000", 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762648+0000", 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003436854 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762685+0000", 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7004e-05 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762709+0000", 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3482999999999999e-05 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762871+0000", 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016273399999999999 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763073+0000", 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020189599999999999 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763271+0000", 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000197412 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.775210+0000", 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011939171 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787276+0000", 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012066464000000001 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787428+0000", 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000151383 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787545+0000", 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000117457 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2355 3.37 3:eff17c6c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.997507536999997, 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02156363, 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2355 2024-04-26T12:40:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766417+0000", 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3440000000000001e-06 2024-04-26T12:40:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.770991+0000", 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004573756 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771029+0000", 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7821999999999998e-05 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771053+0000", 2024-04-26T12:40:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.387e-05 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771215+0000", 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016220300000000001 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771568+0000", 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000352472 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771951+0000", 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038302699999999998 2024-04-26T12:40:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787714+0000", 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015763065999999999 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787794+0000", 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0259999999999994e-05 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787886+0000", 2024-04-26T12:40:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2472000000000005e-05 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787978+0000", 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1337999999999999e-05 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2373 3.13 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.801726555000002, 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030808384000000001, 2024-04-26T12:40:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2373 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962198+0000", 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1200000000000002e-06 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966728+0000", 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045301170000000002 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966768+0000", 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9619000000000001e-05 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966787+0000", 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8933999999999999e-05 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966954+0000", 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016689600000000001 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967341+0000", 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038776099999999998 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967720+0000", 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037867100000000002 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.980012+0000", 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012291717000000001 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992693+0000", 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012681192000000001 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016807000000000001 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.993003+0000", 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142287 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2381 3.26 e73/17 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.716952493000001, 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021426161999999999, 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046971+0000", 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051948+0000", 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049762549999999997 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051984+0000", 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.625e-05 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052007+0000", 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2572e-05 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052200+0000", 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193372 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052261+0000", 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1471999999999997e-05 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068271+0000", 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016010027999999999 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068395+0000", 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012382300000000001 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2384 3.37 3:eff1e373:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.691692439000001, 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022518564000000001, 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2384 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072232+0000", 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2569999999999999e-06 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076853+0000", 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046206870000000001 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076884+0000", 2024-04-26T12:40:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1049e-05 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076902+0000", 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8070000000000001e-05 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077053+0000", 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015034 2024-04-26T12:40:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077312+0000", 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025907300000000002 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077559+0000", 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024693099999999998 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.087260+0000", 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097015409999999993 2024-04-26T12:40:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094578+0000", 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073179739999999997 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094666+0000", 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8160999999999998e-05 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094748+0000", 2024-04-26T12:40:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1481000000000001e-05 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2402 3.11 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.496644142000001, 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026287990000000001, 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2402 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267281+0000", 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.557e-06 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271739+0000", 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004457524 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271771+0000", 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2852999999999999e-05 2024-04-26T12:40:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271790+0000", 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8889000000000002e-05 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271949+0000", 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015870000000000001 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272198+0000", 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024856800000000001 2024-04-26T12:40:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272455+0000", 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025784700000000001 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.291321+0000", 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018865189000000001 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293294+0000", 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001973196 2024-04-26T12:40:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293449+0000", 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001552 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293565+0000", 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011646699999999999 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2413 3.2d 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.372015650999998, 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020394760000000001, 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2413 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391909+0000", 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0429999999999999e-06 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396691+0000", 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047820140000000002 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396734+0000", 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396751+0000", 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7011999999999999e-05 2024-04-26T12:40:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396899+0000", 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014740399999999999 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397244+0000", 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034543200000000001 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397484+0000", 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024016099999999999 2024-04-26T12:40:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.405191+0000", 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0077069340000000004 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412133+0000", 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006941465 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412231+0000", 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7770999999999996e-05 2024-04-26T12:40:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412301+0000", 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2414 3.37 3:efe9b32a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.357841899999997, 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019629488, 2024-04-26T12:40:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2414 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406083+0000", 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2729999999999998e-06 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411790+0000", 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0057067749999999999 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411830+0000", 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0525000000000002e-05 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411856+0000", 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5695999999999999e-05 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411994+0000", 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013798400000000001 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412226+0000", 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023230399999999999 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412447+0000", 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022097499999999999 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.423387+0000", 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010939574000000001 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425535+0000", 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002148109 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425634+0000", 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8851000000000006e-05 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425709+0000", 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5421999999999997e-05 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2427 3.d 3:b1e8d312:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.221495564999998, 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021368552999999998, 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2427 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542430+0000", 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547450+0000", 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050205040000000003 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547487+0000", 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6866000000000002e-05 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547506+0000", 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9343000000000001e-05 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547680+0000", 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017347599999999999 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548089+0000", 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040960699999999998 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548515+0000", 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042551999999999998 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.558096+0000", 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0095806929999999995 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563571+0000", 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054753329999999998 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563674+0000", 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010266400000000001 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563795+0000", 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012098 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2430 3.37 3:eff5ab0a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.192225735000001, 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020751628000000001, 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2430 2024-04-26T12:40:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571699+0000", 2024-04-26T12:40:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5360000000000001e-06 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576275+0000", 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045753479999999999 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576311+0000", 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5865999999999998e-05 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576328+0000", 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576501+0000", 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000172659 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576910+0000", 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040915 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.577329+0000", 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041870699999999999 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.591164+0000", 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013835896 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592117+0000", 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00095214699999999998 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592309+0000", 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019207600000000001 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592447+0000", 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013884999999999999 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2440 3.d 3:b0894f88:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 42.043775572999998, 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020963463000000002, 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2440 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720150+0000", 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5200000000000002e-06 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724635+0000", 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004485447 2024-04-26T12:40:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724675+0000", 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9938999999999998e-05 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724694+0000", 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724859+0000", 2024-04-26T12:40:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016413899999999999 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725146+0000", 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000287387 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725469+0000", 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032321900000000002 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.739743+0000", 2024-04-26T12:40:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014273485000000001 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.740904+0000", 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011612790000000001 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741034+0000", 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130314 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741109+0000", 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5221000000000004e-05 2024-04-26T12:40:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2884 3.2f e91/17 3:f6197e28:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_239:head v 91'6, mlcod=90'4)", 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 5.6617535239999999, 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022275581999999999, 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102172+0000", 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.76e-06 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104815+0000", 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002643088 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104864+0000", 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9450000000000003e-05 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104891+0000", 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6990000000000001e-05 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.105091+0000", 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019925499999999999 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.105154+0000", 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2954999999999996e-05 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124376+0000", 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019222123000000001 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124444+0000", 2024-04-26T12:40:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7960999999999995e-05 2024-04-26T12:40:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:54.881 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:54.883 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:54.880+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:54.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:54.983 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:54.980+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:55.016 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:55.017 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:55.017 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:55.017 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:55.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:55.084 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:55.084+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:55.158 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:55.158 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:55.158 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:55.158 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:55.158 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:55.172 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:55.217 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:55.217+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:55.286 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:55.284+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.433962317999999, 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.298 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:55.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:40:55.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:40:55.303 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2333 3.12 3:49fff330:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.776235561, 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014903046, 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2333 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519355+0000", 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1739999999999999e-06 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520939+0000", 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015836960000000001 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520971+0000", 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1930000000000001e-05 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520986+0000", 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5420000000000001e-05 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521057+0000", 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0825e-05 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521178+0000", 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120316 2024-04-26T12:40:55.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521332+0000", 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015460800000000001 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.526796+0000", 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054637089999999998 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534174+0000", 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073778660000000003 2024-04-26T12:40:55.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534216+0000", 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1869000000000002e-05 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534256+0000", 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0633000000000002e-05 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.309 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2337 3.1b 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.737154760999999, 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018047987000000001, 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2337 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558438+0000", 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6239999999999999e-06 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559867+0000", 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014292490000000001 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559886+0000", 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8697000000000001e-05 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559898+0000", 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2542e-05 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559976+0000", 2024-04-26T12:40:55.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7610999999999999e-05 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560136+0000", 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160443 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560298+0000", 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016194899999999999 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.566613+0000", 2024-04-26T12:40:55.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063145279999999998 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576388+0000", 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097756340000000001 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576434+0000", 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6020000000000003e-05 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576482+0000", 2024-04-26T12:40:55.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7689999999999999e-05 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2342 3.12 3:4a564d9a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.674982301, 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020986402000000001, 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.315 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2342 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620609+0000", 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622196+0000", 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587045 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622224+0000", 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8028e-05 2024-04-26T12:40:55.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622234+0000", 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0577999999999999e-05 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622319+0000", 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4296999999999996e-05 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622520+0000", 2024-04-26T12:40:55.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201571 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622753+0000", 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000232501 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.629187+0000", 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064345679999999999 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641429+0000", 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012241573 2024-04-26T12:40:55.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641522+0000", 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3239999999999995e-05 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641593+0000", 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0683000000000001e-05 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.320 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2344 3.3 3:c3214891:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.647376915999999, 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017793122000000001, 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2344 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648214+0000", 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649908+0000", 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693069 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649940+0000", 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1974999999999998e-05 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649956+0000", 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6429000000000001e-05 2024-04-26T12:40:55.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650027+0000", 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1346000000000004e-05 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650146+0000", 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118581 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650277+0000", 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013136300000000001 2024-04-26T12:40:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.654910+0000", 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046332300000000003 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665861+0000", 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01095054 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665942+0000", 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0782e-05 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.666005+0000", 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3146999999999997e-05 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.326 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2350 3.12 3:494cd927:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.581809389, 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019319528999999998, 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2350 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713782+0000", 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0759999999999999e-06 2024-04-26T12:40:55.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714797+0000", 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010147159999999999 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714824+0000", 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.658e-05 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714838+0000", 2024-04-26T12:40:55.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4609e-05 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714950+0000", 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112185 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715172+0000", 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022140199999999999 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715311+0000", 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000138639 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.721604+0000", 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062931289999999997 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.732954+0000", 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011350314 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733038+0000", 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4445999999999998e-05 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733099+0000", 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0433000000000002e-05 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2353 3.2b 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:55.332 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.548507925999999, 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029788120000000001, 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2353 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:55.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747083+0000", 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748701+0000", 2024-04-26T12:40:55.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016182550000000001 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748730+0000", 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8809000000000001e-05 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748741+0000", 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0949e-05 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748822+0000", 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0777000000000003e-05 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748827+0000", 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752276+0000", 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034484350000000001 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752425+0000", 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014880699999999999 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752572+0000", 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014723899999999999 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.757807+0000", 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052354319999999999 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776737+0000", 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018929437 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776811+0000", 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4651000000000001e-05 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776869+0000", 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7541999999999999e-05 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.338 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2369 3.12 3:4bcc53b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.376023908000001, 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014928745, 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2369 2024-04-26T12:40:55.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919568+0000", 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0110000000000001e-06 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921453+0000", 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018855079999999999 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921476+0000", 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2705e-05 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921490+0000", 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4049999999999999e-05 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921560+0000", 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9580999999999997e-05 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921710+0000", 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150261 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921810+0000", 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100351 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.926466+0000", 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046561160000000001 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934371+0000", 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079049830000000008 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934442+0000", 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0607999999999999e-05 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934494+0000", 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1570999999999998e-05 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2371 3.12 3:4aa38e60:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:55.344 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.355410634999998, 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016346532, 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2371 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940181+0000", 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941785+0000", 2024-04-26T12:40:55.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016038700000000001 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941813+0000", 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827e-05 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941828+0000", 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5545000000000001e-05 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941914+0000", 2024-04-26T12:40:55.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5353999999999996e-05 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942093+0000", 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000179004 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942264+0000", 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017166999999999999 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.946973+0000", 2024-04-26T12:40:55.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047087179999999998 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956399+0000", 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094257760000000003 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956471+0000", 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1740000000000001e-05 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956525+0000", 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4097000000000001e-05 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2403 3.3 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 43.017903670999999, 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019288092999999999, 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2403 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277689+0000", 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.941e-06 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279232+0000", 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015426719999999999 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279255+0000", 2024-04-26T12:40:55.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3059000000000001e-05 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279265+0000", 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9599999999999995e-06 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279330+0000", 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5282000000000003e-05 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279465+0000", 2024-04-26T12:40:55.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135413 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279583+0000", 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011731900000000001 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.284332+0000", 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047490700000000002 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296834+0000", 2024-04-26T12:40:55.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012501864 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296908+0000", 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3994999999999999e-05 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296973+0000", 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5518000000000005e-05 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2420 3.1f 3:f85890ec:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.820274240000003, 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016319348000000001, 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2420 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475317+0000", 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5170000000000002e-06 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476909+0000", 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015916389999999999 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476934+0000", 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5602999999999999e-05 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476944+0000", 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5980000000000003e-06 2024-04-26T12:40:55.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477024+0000", 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9969999999999995e-05 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477203+0000", 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017948000000000001 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477363+0000", 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160008 2024-04-26T12:40:55.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.482189+0000", 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048257430000000004 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491558+0000", 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093691820000000002 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491601+0000", 2024-04-26T12:40:55.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3099000000000002e-05 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491634+0000", 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2509000000000003e-05 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2424 3.3 3:c1866c22:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.780272142000001, 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016771441000000002, 2024-04-26T12:40:55.361 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2424 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515318+0000", 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516904+0000", 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015852570000000001 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516913+0000", 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1679999999999993e-06 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516921+0000", 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6319999999999997e-06 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516980+0000", 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9151999999999999e-05 2024-04-26T12:40:55.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517101+0000", 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012034199999999999 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517259+0000", 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015827300000000001 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.522184+0000", 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004925296 2024-04-26T12:40:55.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.531965+0000", 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009780647 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532033+0000", 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7546999999999996e-05 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532088+0000", 2024-04-26T12:40:55.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5452999999999999e-05 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2842 3.1b 3:da1355e5:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.6638968119999999, 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017378536999999999, 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2842 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631695+0000", 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0240000000000002e-06 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633298+0000", 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016033810000000001 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633326+0000", 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8192e-05 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633338+0000", 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1268e-05 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633418+0000", 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9847999999999999e-05 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633585+0000", 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000167496 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633743+0000", 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015822399999999999 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.638928+0000", 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051849690000000002 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.648991+0000", 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010062877 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.649033+0000", 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2197999999999998e-05 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.649070+0000", 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7060000000000001e-05 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.372 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2867 3.12 3:4ae9c7d5:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.880794+0000", 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.4147944729999997, 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014702395, 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2867 2024-04-26T12:40:55.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.880794+0000", 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.880794+0000", 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.880798+0000", 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3170000000000002e-06 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882172+0000", 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001374756 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882202+0000", 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9484000000000001e-05 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882217+0000", 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5332000000000002e-05 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882296+0000", 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8888999999999996e-05 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882434+0000", 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013823000000000001 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882581+0000", 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146592 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.887388+0000", 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048066660000000002 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.895308+0000", 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079201889999999994 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.895425+0000", 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117094 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.895497+0000", 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1846000000000003e-05 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2870 3.17 3:e8fb4e0e:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:55.378 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.3847071480000004, 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017263286999999999, 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2870 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:40:55.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910884+0000", 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912208+0000", 2024-04-26T12:40:55.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013243 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912239+0000", 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0713999999999998e-05 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912254+0000", 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5048000000000001e-05 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912333+0000", 2024-04-26T12:40:55.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8886000000000003e-05 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912480+0000", 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014738199999999999 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912570+0000", 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9837000000000001e-05 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.917171+0000", 2024-04-26T12:40:55.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046010629999999999 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928063+0000", 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010892341 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928104+0000", 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0222999999999998e-05 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928145+0000", 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1260000000000001e-05 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2878 3.2b 3:d6ec64be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.2721421900000003, 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016634683000000001, 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2878 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023451+0000", 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025269+0000", 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001818465 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025313+0000", 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4443000000000001e-05 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025340+0000", 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6454000000000001e-05 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025467+0000", 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012757799999999999 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025786+0000", 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031818999999999999 2024-04-26T12:40:55.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.026118+0000", 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000332696 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.034247+0000", 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081283770000000009 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.039934+0000", 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056876699999999997 2024-04-26T12:40:55.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.040018+0000", 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3194000000000003e-05 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.040081+0000", 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3578999999999996e-05 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2879 3.2b 3:d5c534be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.043786+0000", 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.2518027079999996, 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016000855000000001, 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2879 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.043786+0000", 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.043786+0000", 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.043789+0000", 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045340+0000", 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015508270000000001 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045375+0000", 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5104000000000001e-05 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045391+0000", 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045468+0000", 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7262999999999995e-05 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045582+0000", 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113347 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045712+0000", 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013066299999999999 2024-04-26T12:40:55.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.050614+0000", 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049019320000000003 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.059501+0000", 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0088870809999999998 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.059670+0000", 2024-04-26T12:40:55.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168319 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.059787+0000", 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117359 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2889 3.12 3:4a48a540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.1345772460000001, 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01761325, 2024-04-26T12:40:55.395 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2889 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161014+0000", 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.249e-06 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164387+0000", 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003373479 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164426+0000", 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8733999999999999e-05 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164445+0000", 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9483e-05 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164533+0000", 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7980999999999997e-05 2024-04-26T12:40:55.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164700+0000", 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016626400000000001 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164856+0000", 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015638499999999999 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.170310+0000", 2024-04-26T12:40:55.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054534889999999997 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178389+0000", 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080794509999999996 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178500+0000", 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111399 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178625+0000", 2024-04-26T12:40:55.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012433600000000001 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2891 3.2b 3:d7deca59:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.1028563719999998, 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020816259, 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:55.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2891 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192735+0000", 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9399999999999998e-06 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197005+0000", 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042695859999999997 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197044+0000", 2024-04-26T12:40:55.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9345999999999999e-05 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197068+0000", 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3788e-05 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197172+0000", 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104063 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197364+0000", 2024-04-26T12:40:55.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192239 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197561+0000", 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019647600000000001 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.206860+0000", 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092991719999999996 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:55.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213224+0000", 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063636949999999999 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213413+0000", 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018908799999999999 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213549+0000", 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135866 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2892 3.20 e91/17 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head v 91'8, mlcod=90'6)", 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.0865715820000004, 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020804692999999999, 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209019+0000", 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214490+0000", 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054710219999999999 2024-04-26T12:40:55.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214515+0000", 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4539999999999999e-05 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214528+0000", 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2914999999999999e-05 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214672+0000", 2024-04-26T12:40:55.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143957 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214738+0000", 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6452999999999995e-05 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229776+0000", 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015037897 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229822+0000", 2024-04-26T12:40:55.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5583e-05 2024-04-26T12:40:55.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.411 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.411 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:55.411 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:55.411 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:55.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:55.413 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:55.412+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:55.418 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.5 to 1 (10000) 2024-04-26T12:40:55.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-26T12:40:55.469 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:40:55.513 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:55.512+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:55.544 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:55.544 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:55.544 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:55.561 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:55.613 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:55.612+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:55.644 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:55.645 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:55.670 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:55.670 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:55.688 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:55.706 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:55.706 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:55.714 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:55.712+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:55.739 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:55.739 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:55.741 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:55.741 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:55.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:40:55.776 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:55.776 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:55.797 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:55.815 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:55.812+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:55.817 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:55.818 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:55.900 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:55.900 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:55.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:40:55.916 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:55.912+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:56.017 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:56.016+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:56.039 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:56.039 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:56.052 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:40:56.118 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:56.117+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:56.163 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:56.163 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:56.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:40:56.219 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:56.217+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:56.319 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:56.317+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:56.341 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:56.341 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:56.355 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:40:56.420 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:56.420+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:56.436 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.6 to 1 (10000) 2024-04-26T12:40:56.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:40:56.458 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-26T12:40:56.522 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:56.520+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:56.532 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:56.532 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:56.548 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:40:56.636 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:56.637+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:56.703 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:56.703 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:56.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:40:56.762 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:56.761+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:56.824 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:56.824+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:56.874 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:56.874 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:56.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:40:56.925 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:56.925+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:57.020 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:57.021 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:57.026 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:57.024+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:57.035 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:40:57.126 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:57.124+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:57.200 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:57.200 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:57.213 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:40:57.227 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:57.225+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:57.328 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:40:57.325+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:40:57.377 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:57.377 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:57.391 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:40:57.429 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:57.429+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:57.441 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.7 to 1 (10000) 2024-04-26T12:40:57.451 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:40:57.479 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:40:57.480 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:40:57.509 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:57.509 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:57.523 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:40:57.568 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:57.568+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:57.630 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:57.628+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:57.646 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:57.647 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:57.661 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:40:57.731 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:57.729+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:57.826 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:57.826 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:57.832 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:57.828+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:57.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:40:57.841 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:40:57.855 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:40:57.861 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:40:57.881 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-04-26T12:40:57.444631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2114663260,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":2848,"num_read_kb":2548,"num_write":1700,"num_write_kb":2091651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2510,"ondisk_log_size":2510,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4405204,"kb_used_data":4139112,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":750569516,"statfs":{"total":773094113280,"available":768583184384,"internally_reserved":0,"allocated":4238450688,"data_stored":4234413452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038514"},"pg_stats":[{"pgid":"3.3f","version":"91'6","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396811+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:40:52.396811+0000","last_peered":"2024-04-26T12:40:52.396811+0000","last_clean":"2024-04-26T12:40:52.396811+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:40:52.396811+0000","last_undegraded":"2024-04-26T12:40:52.396811+0000","last_fullsized":"2024-04-26T12:40:52.396811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"68'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390147+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:40:52.390147+0000","last_peered":"2024-04-26T12:40:52.390147+0000","last_clean":"2024-04-26T12:40:52.390147+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:40:52.390147+0000","last_undegraded":"2024-04-26T12:40:52.390147+0000","last_fullsized":"2024-04-26T12:40:52.390147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"71'1","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384463+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:40:52.384463+0000","last_peered":"2024-04-26T12:40:52.384463+0000","last_clean":"2024-04-26T12:40:52.384463+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:40:52.384463+0000","last_undegraded":"2024-04-26T12:40:52.384463+0000","last_fullsized":"2024-04-26T12:40:52.384463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395174+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:40:52.395174+0000","last_peered":"2024-04-26T12:40:52.395174+0000","last_clean":"2024-04-26T12:40:52.395174+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:40:52.395174+0000","last_undegraded":"2024-04-26T12:40:52.395174+0000","last_fullsized":"2024-04-26T12:40:52.395174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"90'4","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383841+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:40:52.383841+0000","last_peered":"2024-04-26T12:40:52.383841+0000","last_clean":"2024-04-26T12:40:52.383841+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:40:52.383841+0000","last_undegraded":"2024-04-26T12:40:52.383841+0000","last_fullsized":"2024-04-26T12:40:52.383841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382212+0000","last_change":"2024-04-26T12:38:32.099160+0000","last_active":"2024-04-26T12:40:52.382212+0000","last_peered":"2024-04-26T12:40:52.382212+0000","last_clean":"2024-04-26T12:40:52.382212+0000","last_became_active":"2024-04-26T12:38:32.093033+0000","last_became_peered":"2024-04-26T12:38:32.093033+0000","last_unstale":"2024-04-26T12:40:52.382212+0000","last_undegraded":"2024-04-26T12:40:52.382212+0000","last_fullsized":"2024-04-26T12:40:52.382212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:22.221188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'15","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391885+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:40:52.391885+0000","last_peered":"2024-04-26T12:40:52.391885+0000","last_clean":"2024-04-26T12:40:52.391885+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:40:52.391885+0000","last_undegraded":"2024-04-26T12:40:52.391885+0000","last_fullsized":"2024-04-26T12:40:52.391885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382785+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:40:52.382785+0000","last_peered":"2024-04-26T12:40:52.382785+0000","last_clean":"2024-04-26T12:40:52.382785+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:40:52.382785+0000","last_undegraded":"2024-04-26T12:40:52.382785+0000","last_fullsized":"2024-04-26T12:40:52.382785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"91'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398931+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:40:52.398931+0000","last_peered":"2024-04-26T12:40:52.398931+0000","last_clean":"2024-04-26T12:40:52.398931+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:40:52.398931+0000","last_undegraded":"2024-04-26T12:40:52.398931+0000","last_fullsized":"2024-04-26T12:40:52.398931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"68'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399093+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:40:52.399093+0000","last_peered":"2024-04-26T12:40:52.399093+0000","last_clean":"2024-04-26T12:40:52.399093+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:40:52.399093+0000","last_undegraded":"2024-04-26T12:40:52.399093+0000","last_fullsized":"2024-04-26T12:40:52.399093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"91'11","reported_seq":124,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393658+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:40:52.393658+0000","last_peered":"2024-04-26T12:40:52.393658+0000","last_clean":"2024-04-26T12:40:52.393658+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:40:52.393658+0000","last_undegraded":"2024-04-26T12:40:52.393658+0000","last_fullsized":"2024-04-26T12:40:52.393658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383815+0000","last_change":"2024-04-26T12:38:32.092960+0000","last_active":"2024-04-26T12:40:52.383815+0000","last_peered":"2024-04-26T12:40:52.383815+0000","last_clean":"2024-04-26T12:40:52.383815+0000","last_became_active":"2024-04-26T12:38:32.092562+0000","last_became_peered":"2024-04-26T12:38:32.092562+0000","last_unstale":"2024-04-26T12:40:52.383815+0000","last_undegraded":"2024-04-26T12:40:52.383815+0000","last_fullsized":"2024-04-26T12:40:52.383815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:43.474569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"91'7","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395918+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:40:52.395918+0000","last_peered":"2024-04-26T12:40:52.395918+0000","last_clean":"2024-04-26T12:40:52.395918+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:40:52.395918+0000","last_undegraded":"2024-04-26T12:40:52.395918+0000","last_fullsized":"2024-04-26T12:40:52.395918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396553+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:40:52.396553+0000","last_peered":"2024-04-26T12:40:52.396553+0000","last_clean":"2024-04-26T12:40:52.396553+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:40:52.396553+0000","last_undegraded":"2024-04-26T12:40:52.396553+0000","last_fullsized":"2024-04-26T12:40:52.396553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"90'5","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391907+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:40:52.391907+0000","last_peered":"2024-04-26T12:40:52.391907+0000","last_clean":"2024-04-26T12:40:52.391907+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:40:52.391907+0000","last_undegraded":"2024-04-26T12:40:52.391907+0000","last_fullsized":"2024-04-26T12:40:52.391907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391110+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:40:52.391110+0000","last_peered":"2024-04-26T12:40:52.391110+0000","last_clean":"2024-04-26T12:40:52.391110+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:40:52.391110+0000","last_undegraded":"2024-04-26T12:40:52.391110+0000","last_fullsized":"2024-04-26T12:40:52.391110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381156+0000","last_change":"2024-04-26T12:38:32.098437+0000","last_active":"2024-04-26T12:40:52.381156+0000","last_peered":"2024-04-26T12:40:52.381156+0000","last_clean":"2024-04-26T12:40:52.381156+0000","last_became_active":"2024-04-26T12:38:32.093038+0000","last_became_peered":"2024-04-26T12:38:32.093038+0000","last_unstale":"2024-04-26T12:40:52.381156+0000","last_undegraded":"2024-04-26T12:40:52.381156+0000","last_fullsized":"2024-04-26T12:40:52.381156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:11.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397606+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:40:52.397606+0000","last_peered":"2024-04-26T12:40:52.397606+0000","last_clean":"2024-04-26T12:40:52.397606+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:40:52.397606+0000","last_undegraded":"2024-04-26T12:40:52.397606+0000","last_fullsized":"2024-04-26T12:40:52.397606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"68'2","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395532+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:40:52.395532+0000","last_peered":"2024-04-26T12:40:52.395532+0000","last_clean":"2024-04-26T12:40:52.395532+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:40:52.395532+0000","last_undegraded":"2024-04-26T12:40:52.395532+0000","last_fullsized":"2024-04-26T12:40:52.395532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'12","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401403+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:40:52.401403+0000","last_peered":"2024-04-26T12:40:52.401403+0000","last_clean":"2024-04-26T12:40:52.401403+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:40:52.401403+0000","last_undegraded":"2024-04-26T12:40:52.401403+0000","last_fullsized":"2024-04-26T12:40:52.401403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390910+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:40:52.390910+0000","last_peered":"2024-04-26T12:40:52.390910+0000","last_clean":"2024-04-26T12:40:52.390910+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:40:52.390910+0000","last_undegraded":"2024-04-26T12:40:52.390910+0000","last_fullsized":"2024-04-26T12:40:52.390910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"91'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400466+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:40:52.400466+0000","last_peered":"2024-04-26T12:40:52.400466+0000","last_clean":"2024-04-26T12:40:52.400466+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:40:52.400466+0000","last_undegraded":"2024-04-26T12:40:52.400466+0000","last_fullsized":"2024-04-26T12:40:52.400466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"68'6","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390972+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:40:52.390972+0000","last_peered":"2024-04-26T12:40:52.390972+0000","last_clean":"2024-04-26T12:40:52.390972+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:40:52.390972+0000","last_undegraded":"2024-04-26T12:40:52.390972+0000","last_fullsized":"2024-04-26T12:40:52.390972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"90'6","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399265+0000","last_change":"2024-04-26T12:38:32.097333+0000","last_active":"2024-04-26T12:40:52.399265+0000","last_peered":"2024-04-26T12:40:52.399265+0000","last_clean":"2024-04-26T12:40:52.399265+0000","last_became_active":"2024-04-26T12:38:32.097076+0000","last_became_peered":"2024-04-26T12:38:32.097076+0000","last_unstale":"2024-04-26T12:40:52.399265+0000","last_undegraded":"2024-04-26T12:40:52.399265+0000","last_fullsized":"2024-04-26T12:40:52.399265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:52.365241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392098+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:40:52.392098+0000","last_peered":"2024-04-26T12:40:52.392098+0000","last_clean":"2024-04-26T12:40:52.392098+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:40:52.392098+0000","last_undegraded":"2024-04-26T12:40:52.392098+0000","last_fullsized":"2024-04-26T12:40:52.392098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394667+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:40:52.394667+0000","last_peered":"2024-04-26T12:40:52.394667+0000","last_clean":"2024-04-26T12:40:52.394667+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:40:52.394667+0000","last_undegraded":"2024-04-26T12:40:52.394667+0000","last_fullsized":"2024-04-26T12:40:52.394667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383681+0000","last_change":"2024-04-26T12:38:32.098711+0000","last_active":"2024-04-26T12:40:52.383681+0000","last_peered":"2024-04-26T12:40:52.383681+0000","last_clean":"2024-04-26T12:40:52.383681+0000","last_became_active":"2024-04-26T12:38:32.097887+0000","last_became_peered":"2024-04-26T12:38:32.097887+0000","last_unstale":"2024-04-26T12:40:52.383681+0000","last_undegraded":"2024-04-26T12:40:52.383681+0000","last_fullsized":"2024-04-26T12:40:52.383681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:43.980582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"91'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382350+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:40:52.382350+0000","last_peered":"2024-04-26T12:40:52.382350+0000","last_clean":"2024-04-26T12:40:52.382350+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:40:52.382350+0000","last_undegraded":"2024-04-26T12:40:52.382350+0000","last_fullsized":"2024-04-26T12:40:52.382350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390074+0000","last_change":"2024-04-26T12:38:32.091108+0000","last_active":"2024-04-26T12:40:52.390074+0000","last_peered":"2024-04-26T12:40:52.390074+0000","last_clean":"2024-04-26T12:40:52.390074+0000","last_became_active":"2024-04-26T12:38:32.090800+0000","last_became_peered":"2024-04-26T12:38:32.090800+0000","last_unstale":"2024-04-26T12:40:52.390074+0000","last_undegraded":"2024-04-26T12:40:52.390074+0000","last_fullsized":"2024-04-26T12:40:52.390074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:54.159328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390893+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:40:52.390893+0000","last_peered":"2024-04-26T12:40:52.390893+0000","last_clean":"2024-04-26T12:40:52.390893+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:40:52.390893+0000","last_undegraded":"2024-04-26T12:40:52.390893+0000","last_fullsized":"2024-04-26T12:40:52.390893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"91'3","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396111+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:40:52.396111+0000","last_peered":"2024-04-26T12:40:52.396111+0000","last_clean":"2024-04-26T12:40:52.396111+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:40:52.396111+0000","last_undegraded":"2024-04-26T12:40:52.396111+0000","last_fullsized":"2024-04-26T12:40:52.396111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393089+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:40:52.393089+0000","last_peered":"2024-04-26T12:40:52.393089+0000","last_clean":"2024-04-26T12:40:52.393089+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:40:52.393089+0000","last_undegraded":"2024-04-26T12:40:52.393089+0000","last_fullsized":"2024-04-26T12:40:52.393089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"91'16","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382655+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:40:52.382655+0000","last_peered":"2024-04-26T12:40:52.382655+0000","last_clean":"2024-04-26T12:40:52.382655+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:40:52.382655+0000","last_undegraded":"2024-04-26T12:40:52.382655+0000","last_fullsized":"2024-04-26T12:40:52.382655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395971+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:40:52.395971+0000","last_peered":"2024-04-26T12:40:52.395971+0000","last_clean":"2024-04-26T12:40:52.395971+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:40:52.395971+0000","last_undegraded":"2024-04-26T12:40:52.395971+0000","last_fullsized":"2024-04-26T12:40:52.395971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"91'40","reported_seq":198,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390237+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:40:52.390237+0000","last_peered":"2024-04-26T12:40:52.390237+0000","last_clean":"2024-04-26T12:40:52.390237+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:40:52.390237+0000","last_undegraded":"2024-04-26T12:40:52.390237+0000","last_fullsized":"2024-04-26T12:40:52.390237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396025+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:40:52.396025+0000","last_peered":"2024-04-26T12:40:52.396025+0000","last_clean":"2024-04-26T12:40:52.396025+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:40:52.396025+0000","last_undegraded":"2024-04-26T12:40:52.396025+0000","last_fullsized":"2024-04-26T12:40:52.396025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"91'11","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382485+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:40:52.382485+0000","last_peered":"2024-04-26T12:40:52.382485+0000","last_clean":"2024-04-26T12:40:52.382485+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:40:52.382485+0000","last_undegraded":"2024-04-26T12:40:52.382485+0000","last_fullsized":"2024-04-26T12:40:52.382485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390628+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:40:52.390628+0000","last_peered":"2024-04-26T12:40:52.390628+0000","last_clean":"2024-04-26T12:40:52.390628+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:40:52.390628+0000","last_undegraded":"2024-04-26T12:40:52.390628+0000","last_fullsized":"2024-04-26T12:40:52.390628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390681+0000","last_change":"2024-04-26T12:38:32.099862+0000","last_active":"2024-04-26T12:40:52.390681+0000","last_peered":"2024-04-26T12:40:52.390681+0000","last_clean":"2024-04-26T12:40:52.390681+0000","last_became_active":"2024-04-26T12:38:32.098951+0000","last_became_peered":"2024-04-26T12:38:32.098951+0000","last_unstale":"2024-04-26T12:40:52.390681+0000","last_undegraded":"2024-04-26T12:40:52.390681+0000","last_fullsized":"2024-04-26T12:40:52.390681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:37.401523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382564+0000","last_change":"2024-04-26T12:38:32.100120+0000","last_active":"2024-04-26T12:40:52.382564+0000","last_peered":"2024-04-26T12:40:52.382564+0000","last_clean":"2024-04-26T12:40:52.382564+0000","last_became_active":"2024-04-26T12:38:32.099583+0000","last_became_peered":"2024-04-26T12:38:32.099583+0000","last_unstale":"2024-04-26T12:40:52.382564+0000","last_undegraded":"2024-04-26T12:40:52.382564+0000","last_fullsized":"2024-04-26T12:40:52.382564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:16.598403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381902+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:40:52.381902+0000","last_peered":"2024-04-26T12:40:52.381902+0000","last_clean":"2024-04-26T12:40:52.381902+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:40:52.381902+0000","last_undegraded":"2024-04-26T12:40:52.381902+0000","last_fullsized":"2024-04-26T12:40:52.381902+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383442+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:40:52.383442+0000","last_peered":"2024-04-26T12:40:52.383442+0000","last_clean":"2024-04-26T12:40:52.383442+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:40:52.383442+0000","last_undegraded":"2024-04-26T12:40:52.383442+0000","last_fullsized":"2024-04-26T12:40:52.383442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"91'5","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396321+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:40:52.396321+0000","last_peered":"2024-04-26T12:40:52.396321+0000","last_clean":"2024-04-26T12:40:52.396321+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:40:52.396321+0000","last_undegraded":"2024-04-26T12:40:52.396321+0000","last_fullsized":"2024-04-26T12:40:52.396321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396004+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:40:52.396004+0000","last_peered":"2024-04-26T12:40:52.396004+0000","last_clean":"2024-04-26T12:40:52.396004+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:40:52.396004+0000","last_undegraded":"2024-04-26T12:40:52.396004+0000","last_fullsized":"2024-04-26T12:40:52.396004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391913+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:40:52.391913+0000","last_peered":"2024-04-26T12:40:52.391913+0000","last_clean":"2024-04-26T12:40:52.391913+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:40:52.391913+0000","last_undegraded":"2024-04-26T12:40:52.391913+0000","last_fullsized":"2024-04-26T12:40:52.391913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"91'107","reported_seq":361,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395952+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:40:52.395952+0000","last_peered":"2024-04-26T12:40:52.395952+0000","last_clean":"2024-04-26T12:40:52.395952+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:40:52.395952+0000","last_undegraded":"2024-04-26T12:40:52.395952+0000","last_fullsized":"2024-04-26T12:40:52.395952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390649+0000","last_change":"2024-04-26T12:38:32.097189+0000","last_active":"2024-04-26T12:40:52.390649+0000","last_peered":"2024-04-26T12:40:52.390649+0000","last_clean":"2024-04-26T12:40:52.390649+0000","last_became_active":"2024-04-26T12:38:32.096313+0000","last_became_peered":"2024-04-26T12:38:32.096313+0000","last_unstale":"2024-04-26T12:40:52.390649+0000","last_undegraded":"2024-04-26T12:40:52.390649+0000","last_fullsized":"2024-04-26T12:40:52.390649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:26.879794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395449+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:40:52.395449+0000","last_peered":"2024-04-26T12:40:52.395449+0000","last_clean":"2024-04-26T12:40:52.395449+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:40:52.395449+0000","last_undegraded":"2024-04-26T12:40:52.395449+0000","last_fullsized":"2024-04-26T12:40:52.395449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"91'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394740+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:40:52.394740+0000","last_peered":"2024-04-26T12:40:52.394740+0000","last_clean":"2024-04-26T12:40:52.394740+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:40:52.394740+0000","last_undegraded":"2024-04-26T12:40:52.394740+0000","last_fullsized":"2024-04-26T12:40:52.394740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396254+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:40:52.396254+0000","last_peered":"2024-04-26T12:40:52.396254+0000","last_clean":"2024-04-26T12:40:52.396254+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:40:52.396254+0000","last_undegraded":"2024-04-26T12:40:52.396254+0000","last_fullsized":"2024-04-26T12:40:52.396254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"91'15","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396650+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:40:52.396650+0000","last_peered":"2024-04-26T12:40:52.396650+0000","last_clean":"2024-04-26T12:40:52.396650+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:40:52.396650+0000","last_undegraded":"2024-04-26T12:40:52.396650+0000","last_fullsized":"2024-04-26T12:40:52.396650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"91'107","reported_seq":284,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390166+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:40:52.390166+0000","last_peered":"2024-04-26T12:40:52.390166+0000","last_clean":"2024-04-26T12:40:52.390166+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:40:52.390166+0000","last_undegraded":"2024-04-26T12:40:52.390166+0000","last_fullsized":"2024-04-26T12:40:52.390166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398190+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:40:52.398190+0000","last_peered":"2024-04-26T12:40:52.398190+0000","last_clean":"2024-04-26T12:40:52.398190+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:40:52.398190+0000","last_undegraded":"2024-04-26T12:40:52.398190+0000","last_fullsized":"2024-04-26T12:40:52.398190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"91'6","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390559+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:40:52.390559+0000","last_peered":"2024-04-26T12:40:52.390559+0000","last_clean":"2024-04-26T12:40:52.390559+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:40:52.390559+0000","last_undegraded":"2024-04-26T12:40:52.390559+0000","last_fullsized":"2024-04-26T12:40:52.390559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394238+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:40:52.394238+0000","last_peered":"2024-04-26T12:40:52.394238+0000","last_clean":"2024-04-26T12:40:52.394238+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:40:52.394238+0000","last_undegraded":"2024-04-26T12:40:52.394238+0000","last_fullsized":"2024-04-26T12:40:52.394238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"91'25","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390095+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:40:52.390095+0000","last_peered":"2024-04-26T12:40:52.390095+0000","last_clean":"2024-04-26T12:40:52.390095+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:40:52.390095+0000","last_undegraded":"2024-04-26T12:40:52.390095+0000","last_fullsized":"2024-04-26T12:40:52.390095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382507+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:40:52.382507+0000","last_peered":"2024-04-26T12:40:52.382507+0000","last_clean":"2024-04-26T12:40:52.382507+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:40:52.382507+0000","last_undegraded":"2024-04-26T12:40:52.382507+0000","last_fullsized":"2024-04-26T12:40:52.382507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391517+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:40:52.391517+0000","last_peered":"2024-04-26T12:40:52.391517+0000","last_clean":"2024-04-26T12:40:52.391517+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:40:52.391517+0000","last_undegraded":"2024-04-26T12:40:52.391517+0000","last_fullsized":"2024-04-26T12:40:52.391517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"68'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384415+0000","last_change":"2024-04-26T12:38:32.097378+0000","last_active":"2024-04-26T12:40:52.384415+0000","last_peered":"2024-04-26T12:40:52.384415+0000","last_clean":"2024-04-26T12:40:52.384415+0000","last_became_active":"2024-04-26T12:38:32.096994+0000","last_became_peered":"2024-04-26T12:38:32.096994+0000","last_unstale":"2024-04-26T12:40:52.384415+0000","last_undegraded":"2024-04-26T12:40:52.384415+0000","last_fullsized":"2024-04-26T12:40:52.384415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:26.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"90'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399421+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:40:52.399421+0000","last_peered":"2024-04-26T12:40:52.399421+0000","last_clean":"2024-04-26T12:40:52.399421+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:40:52.399421+0000","last_undegraded":"2024-04-26T12:40:52.399421+0000","last_fullsized":"2024-04-26T12:40:52.399421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389645+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:40:52.389645+0000","last_peered":"2024-04-26T12:40:52.389645+0000","last_clean":"2024-04-26T12:40:52.389645+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:40:52.389645+0000","last_undegraded":"2024-04-26T12:40:52.389645+0000","last_fullsized":"2024-04-26T12:40:52.389645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"91'17","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395201+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:40:52.395201+0000","last_peered":"2024-04-26T12:40:52.395201+0000","last_clean":"2024-04-26T12:40:52.395201+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:40:52.395201+0000","last_undegraded":"2024-04-26T12:40:52.395201+0000","last_fullsized":"2024-04-26T12:40:52.395201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393472+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:40:52.393472+0000","last_peered":"2024-04-26T12:40:52.393472+0000","last_clean":"2024-04-26T12:40:52.393472+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:40:52.393472+0000","last_undegraded":"2024-04-26T12:40:52.393472+0000","last_fullsized":"2024-04-26T12:40:52.393472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"68'3","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397619+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:40:52.397619+0000","last_peered":"2024-04-26T12:40:52.397619+0000","last_clean":"2024-04-26T12:40:52.397619+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:40:52.397619+0000","last_undegraded":"2024-04-26T12:40:52.397619+0000","last_fullsized":"2024-04-26T12:40:52.397619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398350+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:40:52.398350+0000","last_peered":"2024-04-26T12:40:52.398350+0000","last_clean":"2024-04-26T12:40:52.398350+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:40:52.398350+0000","last_undegraded":"2024-04-26T12:40:52.398350+0000","last_fullsized":"2024-04-26T12:40:52.398350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"90'9","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399998+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:40:52.399998+0000","last_peered":"2024-04-26T12:40:52.399998+0000","last_clean":"2024-04-26T12:40:52.399998+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:40:52.399998+0000","last_undegraded":"2024-04-26T12:40:52.399998+0000","last_fullsized":"2024-04-26T12:40:52.399998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391544+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:40:52.391544+0000","last_peered":"2024-04-26T12:40:52.391544+0000","last_clean":"2024-04-26T12:40:52.391544+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:40:52.391544+0000","last_undegraded":"2024-04-26T12:40:52.391544+0000","last_fullsized":"2024-04-26T12:40:52.391544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"91'22","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399801+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:40:52.399801+0000","last_peered":"2024-04-26T12:40:52.399801+0000","last_clean":"2024-04-26T12:40:52.399801+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:40:52.399801+0000","last_undegraded":"2024-04-26T12:40:52.399801+0000","last_fullsized":"2024-04-26T12:40:52.399801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"91'107","reported_seq":293,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381824+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:40:52.381824+0000","last_peered":"2024-04-26T12:40:52.381824+0000","last_clean":"2024-04-26T12:40:52.381824+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:40:52.381824+0000","last_undegraded":"2024-04-26T12:40:52.381824+0000","last_fullsized":"2024-04-26T12:40:52.381824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382757+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:40:52.382757+0000","last_peered":"2024-04-26T12:40:52.382757+0000","last_clean":"2024-04-26T12:40:52.382757+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:40:52.382757+0000","last_undegraded":"2024-04-26T12:40:52.382757+0000","last_fullsized":"2024-04-26T12:40:52.382757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383628+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:40:52.383628+0000","last_peered":"2024-04-26T12:40:52.383628+0000","last_clean":"2024-04-26T12:40:52.383628+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:40:52.383628+0000","last_undegraded":"2024-04-26T12:40:52.383628+0000","last_fullsized":"2024-04-26T12:40:52.383628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"91'8","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392220+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:40:52.392220+0000","last_peered":"2024-04-26T12:40:52.392220+0000","last_clean":"2024-04-26T12:40:52.392220+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:40:52.392220+0000","last_undegraded":"2024-04-26T12:40:52.392220+0000","last_fullsized":"2024-04-26T12:40:52.392220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391547+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:40:52.391547+0000","last_peered":"2024-04-26T12:40:52.391547+0000","last_clean":"2024-04-26T12:40:52.391547+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:40:52.391547+0000","last_undegraded":"2024-04-26T12:40:52.391547+0000","last_fullsized":"2024-04-26T12:40:52.391547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"91'25","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382103+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:40:52.382103+0000","last_peered":"2024-04-26T12:40:52.382103+0000","last_clean":"2024-04-26T12:40:52.382103+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:40:52.382103+0000","last_undegraded":"2024-04-26T12:40:52.382103+0000","last_fullsized":"2024-04-26T12:40:52.382103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389505+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:40:52.389505+0000","last_peered":"2024-04-26T12:40:52.389505+0000","last_clean":"2024-04-26T12:40:52.389505+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:40:52.389505+0000","last_undegraded":"2024-04-26T12:40:52.389505+0000","last_fullsized":"2024-04-26T12:40:52.389505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"85'6","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384620+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:40:52.384620+0000","last_peered":"2024-04-26T12:40:52.384620+0000","last_clean":"2024-04-26T12:40:52.384620+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:40:52.384620+0000","last_undegraded":"2024-04-26T12:40:52.384620+0000","last_fullsized":"2024-04-26T12:40:52.384620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"68'2","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390751+0000","last_change":"2024-04-26T12:38:32.098058+0000","last_active":"2024-04-26T12:40:52.390751+0000","last_peered":"2024-04-26T12:40:52.390751+0000","last_clean":"2024-04-26T12:40:52.390751+0000","last_became_active":"2024-04-26T12:38:32.095643+0000","last_became_peered":"2024-04-26T12:38:32.095643+0000","last_unstale":"2024-04-26T12:40:52.390751+0000","last_undegraded":"2024-04-26T12:40:52.390751+0000","last_fullsized":"2024-04-26T12:40:52.390751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:56.628368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"91'11","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394374+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:40:52.394374+0000","last_peered":"2024-04-26T12:40:52.394374+0000","last_clean":"2024-04-26T12:40:52.394374+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:40:52.394374+0000","last_undegraded":"2024-04-26T12:40:52.394374+0000","last_fullsized":"2024-04-26T12:40:52.394374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390393+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:40:52.390393+0000","last_peered":"2024-04-26T12:40:52.390393+0000","last_clean":"2024-04-26T12:40:52.390393+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:40:52.390393+0000","last_undegraded":"2024-04-26T12:40:52.390393+0000","last_fullsized":"2024-04-26T12:40:52.390393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"91'17","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384202+0000","last_change":"2024-04-26T12:38:32.096426+0000","last_active":"2024-04-26T12:40:52.384202+0000","last_peered":"2024-04-26T12:40:52.384202+0000","last_clean":"2024-04-26T12:40:52.384202+0000","last_became_active":"2024-04-26T12:38:32.095992+0000","last_became_peered":"2024-04-26T12:38:32.095992+0000","last_unstale":"2024-04-26T12:40:52.384202+0000","last_undegraded":"2024-04-26T12:40:52.384202+0000","last_fullsized":"2024-04-26T12:40:52.384202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:27.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383584+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:40:52.383584+0000","last_peered":"2024-04-26T12:40:52.383584+0000","last_clean":"2024-04-26T12:40:52.383584+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:40:52.383584+0000","last_undegraded":"2024-04-26T12:40:52.383584+0000","last_fullsized":"2024-04-26T12:40:52.383584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391095+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:40:52.391095+0000","last_peered":"2024-04-26T12:40:52.391095+0000","last_clean":"2024-04-26T12:40:52.391095+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:40:52.391095+0000","last_undegraded":"2024-04-26T12:40:52.391095+0000","last_fullsized":"2024-04-26T12:40:52.391095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390541+0000","last_change":"2024-04-26T12:38:32.097968+0000","last_active":"2024-04-26T12:40:52.390541+0000","last_peered":"2024-04-26T12:40:52.390541+0000","last_clean":"2024-04-26T12:40:52.390541+0000","last_became_active":"2024-04-26T12:38:32.095619+0000","last_became_peered":"2024-04-26T12:38:32.095619+0000","last_unstale":"2024-04-26T12:40:52.390541+0000","last_undegraded":"2024-04-26T12:40:52.390541+0000","last_fullsized":"2024-04-26T12:40:52.390541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398724+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:40:52.398724+0000","last_peered":"2024-04-26T12:40:52.398724+0000","last_clean":"2024-04-26T12:40:52.398724+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:40:52.398724+0000","last_undegraded":"2024-04-26T12:40:52.398724+0000","last_fullsized":"2024-04-26T12:40:52.398724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382823+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:40:52.382823+0000","last_peered":"2024-04-26T12:40:52.382823+0000","last_clean":"2024-04-26T12:40:52.382823+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:40:52.382823+0000","last_undegraded":"2024-04-26T12:40:52.382823+0000","last_fullsized":"2024-04-26T12:40:52.382823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"91'21","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390882+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:40:52.390882+0000","last_peered":"2024-04-26T12:40:52.390882+0000","last_clean":"2024-04-26T12:40:52.390882+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:40:52.390882+0000","last_undegraded":"2024-04-26T12:40:52.390882+0000","last_fullsized":"2024-04-26T12:40:52.390882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"91'107","reported_seq":296,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390399+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:40:52.390399+0000","last_peered":"2024-04-26T12:40:52.390399+0000","last_clean":"2024-04-26T12:40:52.390399+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:40:52.390399+0000","last_undegraded":"2024-04-26T12:40:52.390399+0000","last_fullsized":"2024-04-26T12:40:52.390399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381473+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:40:52.381473+0000","last_peered":"2024-04-26T12:40:52.381473+0000","last_clean":"2024-04-26T12:40:52.381473+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:40:52.381473+0000","last_undegraded":"2024-04-26T12:40:52.381473+0000","last_fullsized":"2024-04-26T12:40:52.381473+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400915+0000","last_change":"2024-04-26T12:38:32.098436+0000","last_active":"2024-04-26T12:40:52.400915+0000","last_peered":"2024-04-26T12:40:52.400915+0000","last_clean":"2024-04-26T12:40:52.400915+0000","last_became_active":"2024-04-26T12:38:32.097675+0000","last_became_peered":"2024-04-26T12:38:32.097675+0000","last_unstale":"2024-04-26T12:40:52.400915+0000","last_undegraded":"2024-04-26T12:40:52.400915+0000","last_fullsized":"2024-04-26T12:40:52.400915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:10.967994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"91'8","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389751+0000","last_change":"2024-04-26T12:38:32.091912+0000","last_active":"2024-04-26T12:40:52.389751+0000","last_peered":"2024-04-26T12:40:52.389751+0000","last_clean":"2024-04-26T12:40:52.389751+0000","last_became_active":"2024-04-26T12:38:32.091595+0000","last_became_peered":"2024-04-26T12:38:32.091595+0000","last_unstale":"2024-04-26T12:40:52.389751+0000","last_undegraded":"2024-04-26T12:40:52.389751+0000","last_fullsized":"2024-04-26T12:40:52.389751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:30.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":299,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397922+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:40:52.397922+0000","last_peered":"2024-04-26T12:40:52.397922+0000","last_clean":"2024-04-26T12:40:52.397922+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:40:52.397922+0000","last_undegraded":"2024-04-26T12:40:52.397922+0000","last_fullsized":"2024-04-26T12:40:52.397922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390312+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:40:52.390312+0000","last_peered":"2024-04-26T12:40:52.390312+0000","last_clean":"2024-04-26T12:40:52.390312+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:40:52.390312+0000","last_undegraded":"2024-04-26T12:40:52.390312+0000","last_fullsized":"2024-04-26T12:40:52.390312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"91'107","reported_seq":324,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399885+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:40:52.399885+0000","last_peered":"2024-04-26T12:40:52.399885+0000","last_clean":"2024-04-26T12:40:52.399885+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:40:52.399885+0000","last_undegraded":"2024-04-26T12:40:52.399885+0000","last_fullsized":"2024-04-26T12:40:52.399885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382068+0000","last_change":"2024-04-26T12:38:32.092303+0000","last_active":"2024-04-26T12:40:52.382068+0000","last_peered":"2024-04-26T12:40:52.382068+0000","last_clean":"2024-04-26T12:40:52.382068+0000","last_became_active":"2024-04-26T12:38:32.091872+0000","last_became_peered":"2024-04-26T12:38:32.091872+0000","last_unstale":"2024-04-26T12:40:52.382068+0000","last_undegraded":"2024-04-26T12:40:52.382068+0000","last_fullsized":"2024-04-26T12:40:52.382068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384843+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:40:52.384843+0000","last_peered":"2024-04-26T12:40:52.384843+0000","last_clean":"2024-04-26T12:40:52.384843+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:40:52.384843+0000","last_undegraded":"2024-04-26T12:40:52.384843+0000","last_fullsized":"2024-04-26T12:40:52.384843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392147+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:40:52.392147+0000","last_peered":"2024-04-26T12:40:52.392147+0000","last_clean":"2024-04-26T12:40:52.392147+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:40:52.392147+0000","last_undegraded":"2024-04-26T12:40:52.392147+0000","last_fullsized":"2024-04-26T12:40:52.392147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397019+0000","last_change":"2024-04-26T12:38:32.094763+0000","last_active":"2024-04-26T12:40:52.397019+0000","last_peered":"2024-04-26T12:40:52.397019+0000","last_clean":"2024-04-26T12:40:52.397019+0000","last_became_active":"2024-04-26T12:38:32.094384+0000","last_became_peered":"2024-04-26T12:38:32.094384+0000","last_unstale":"2024-04-26T12:40:52.397019+0000","last_undegraded":"2024-04-26T12:40:52.397019+0000","last_fullsized":"2024-04-26T12:40:52.397019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"91'24","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392811+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:40:52.392811+0000","last_peered":"2024-04-26T12:40:52.392811+0000","last_clean":"2024-04-26T12:40:52.392811+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:40:52.392811+0000","last_undegraded":"2024-04-26T12:40:52.392811+0000","last_fullsized":"2024-04-26T12:40:52.392811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398347+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:40:52.398347+0000","last_peered":"2024-04-26T12:40:52.398347+0000","last_clean":"2024-04-26T12:40:52.398347+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:40:52.398347+0000","last_undegraded":"2024-04-26T12:40:52.398347+0000","last_fullsized":"2024-04-26T12:40:52.398347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382363+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:40:52.382363+0000","last_peered":"2024-04-26T12:40:52.382363+0000","last_clean":"2024-04-26T12:40:52.382363+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:40:52.382363+0000","last_undegraded":"2024-04-26T12:40:52.382363+0000","last_fullsized":"2024-04-26T12:40:52.382363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400328+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:40:52.400328+0000","last_peered":"2024-04-26T12:40:52.400328+0000","last_clean":"2024-04-26T12:40:52.400328+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:40:52.400328+0000","last_undegraded":"2024-04-26T12:40:52.400328+0000","last_fullsized":"2024-04-26T12:40:52.400328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":317,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400163+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:40:52.400163+0000","last_peered":"2024-04-26T12:40:52.400163+0000","last_clean":"2024-04-26T12:40:52.400163+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:40:52.400163+0000","last_undegraded":"2024-04-26T12:40:52.400163+0000","last_fullsized":"2024-04-26T12:40:52.400163+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389381+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:40:52.389381+0000","last_peered":"2024-04-26T12:40:52.389381+0000","last_clean":"2024-04-26T12:40:52.389381+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:40:52.389381+0000","last_undegraded":"2024-04-26T12:40:52.389381+0000","last_fullsized":"2024-04-26T12:40:52.389381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"91'14","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394076+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:40:52.394076+0000","last_peered":"2024-04-26T12:40:52.394076+0000","last_clean":"2024-04-26T12:40:52.394076+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:40:52.394076+0000","last_undegraded":"2024-04-26T12:40:52.394076+0000","last_fullsized":"2024-04-26T12:40:52.394076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395821+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:40:52.395821+0000","last_peered":"2024-04-26T12:40:52.395821+0000","last_clean":"2024-04-26T12:40:52.395821+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:40:52.395821+0000","last_undegraded":"2024-04-26T12:40:52.395821+0000","last_fullsized":"2024-04-26T12:40:52.395821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"91'32","reported_seq":197,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398199+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:40:52.398199+0000","last_peered":"2024-04-26T12:40:52.398199+0000","last_clean":"2024-04-26T12:40:52.398199+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:40:52.398199+0000","last_undegraded":"2024-04-26T12:40:52.398199+0000","last_fullsized":"2024-04-26T12:40:52.398199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382862+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:40:52.382862+0000","last_peered":"2024-04-26T12:40:52.382862+0000","last_clean":"2024-04-26T12:40:52.382862+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:40:52.382862+0000","last_undegraded":"2024-04-26T12:40:52.382862+0000","last_fullsized":"2024-04-26T12:40:52.382862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393262+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:40:52.393262+0000","last_peered":"2024-04-26T12:40:52.393262+0000","last_clean":"2024-04-26T12:40:52.393262+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:40:52.393262+0000","last_undegraded":"2024-04-26T12:40:52.393262+0000","last_fullsized":"2024-04-26T12:40:52.393262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383223+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:40:52.383223+0000","last_peered":"2024-04-26T12:40:52.383223+0000","last_clean":"2024-04-26T12:40:52.383223+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:40:52.383223+0000","last_undegraded":"2024-04-26T12:40:52.383223+0000","last_fullsized":"2024-04-26T12:40:52.383223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396680+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:40:52.396680+0000","last_peered":"2024-04-26T12:40:52.396680+0000","last_clean":"2024-04-26T12:40:52.396680+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:40:52.396680+0000","last_undegraded":"2024-04-26T12:40:52.396680+0000","last_fullsized":"2024-04-26T12:40:52.396680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'4","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382198+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:40:52.382198+0000","last_peered":"2024-04-26T12:40:52.382198+0000","last_clean":"2024-04-26T12:40:52.382198+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:40:52.382198+0000","last_undegraded":"2024-04-26T12:40:52.382198+0000","last_fullsized":"2024-04-26T12:40:52.382198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398540+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:40:52.398540+0000","last_peered":"2024-04-26T12:40:52.398540+0000","last_clean":"2024-04-26T12:40:52.398540+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:40:52.398540+0000","last_undegraded":"2024-04-26T12:40:52.398540+0000","last_fullsized":"2024-04-26T12:40:52.398540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"91'112","reported_seq":346,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382680+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:40:52.382680+0000","last_peered":"2024-04-26T12:40:52.382680+0000","last_clean":"2024-04-26T12:40:52.382680+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:40:52.382680+0000","last_undegraded":"2024-04-26T12:40:52.382680+0000","last_fullsized":"2024-04-26T12:40:52.382680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396316+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:40:52.396316+0000","last_peered":"2024-04-26T12:40:52.396316+0000","last_clean":"2024-04-26T12:40:52.396316+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:40:52.396316+0000","last_undegraded":"2024-04-26T12:40:52.396316+0000","last_fullsized":"2024-04-26T12:40:52.396316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381472+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:40:52.381472+0000","last_peered":"2024-04-26T12:40:52.381472+0000","last_clean":"2024-04-26T12:40:52.381472+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:40:52.381472+0000","last_undegraded":"2024-04-26T12:40:52.381472+0000","last_fullsized":"2024-04-26T12:40:52.381472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"74'8","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384903+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:40:52.384903+0000","last_peered":"2024-04-26T12:40:52.384903+0000","last_clean":"2024-04-26T12:40:52.384903+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:40:52.384903+0000","last_undegraded":"2024-04-26T12:40:52.384903+0000","last_fullsized":"2024-04-26T12:40:52.384903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390260+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:40:52.390260+0000","last_peered":"2024-04-26T12:40:52.390260+0000","last_clean":"2024-04-26T12:40:52.390260+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:40:52.390260+0000","last_undegraded":"2024-04-26T12:40:52.390260+0000","last_fullsized":"2024-04-26T12:40:52.390260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"91'19","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.380799+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:40:52.380799+0000","last_peered":"2024-04-26T12:40:52.380799+0000","last_clean":"2024-04-26T12:40:52.380799+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:40:52.380799+0000","last_undegraded":"2024-04-26T12:40:52.380799+0000","last_fullsized":"2024-04-26T12:40:52.380799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":227,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391190+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:40:52.391190+0000","last_peered":"2024-04-26T12:40:52.391190+0000","last_clean":"2024-04-26T12:40:52.391190+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:40:52.391190+0000","last_undegraded":"2024-04-26T12:40:52.391190+0000","last_fullsized":"2024-04-26T12:40:52.391190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"91'17","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397415+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:40:52.397415+0000","last_peered":"2024-04-26T12:40:52.397415+0000","last_clean":"2024-04-26T12:40:52.397415+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:40:52.397415+0000","last_undegraded":"2024-04-26T12:40:52.397415+0000","last_fullsized":"2024-04-26T12:40:52.397415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382777+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:40:52.382777+0000","last_peered":"2024-04-26T12:40:52.382777+0000","last_clean":"2024-04-26T12:40:52.382777+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:40:52.382777+0000","last_undegraded":"2024-04-26T12:40:52.382777+0000","last_fullsized":"2024-04-26T12:40:52.382777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394945+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:40:52.394945+0000","last_peered":"2024-04-26T12:40:52.394945+0000","last_clean":"2024-04-26T12:40:52.394945+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:40:52.394945+0000","last_undegraded":"2024-04-26T12:40:52.394945+0000","last_fullsized":"2024-04-26T12:40:52.394945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383127+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:40:52.383127+0000","last_peered":"2024-04-26T12:40:52.383127+0000","last_clean":"2024-04-26T12:40:52.383127+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:40:52.383127+0000","last_undegraded":"2024-04-26T12:40:52.383127+0000","last_fullsized":"2024-04-26T12:40:52.383127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389724+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:40:52.389724+0000","last_peered":"2024-04-26T12:40:52.389724+0000","last_clean":"2024-04-26T12:40:52.389724+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:40:52.389724+0000","last_undegraded":"2024-04-26T12:40:52.389724+0000","last_fullsized":"2024-04-26T12:40:52.389724+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383463+0000","last_change":"2024-04-26T12:38:32.099375+0000","last_active":"2024-04-26T12:40:52.383463+0000","last_peered":"2024-04-26T12:40:52.383463+0000","last_clean":"2024-04-26T12:40:52.383463+0000","last_became_active":"2024-04-26T12:38:32.098983+0000","last_became_peered":"2024-04-26T12:38:32.098983+0000","last_unstale":"2024-04-26T12:40:52.383463+0000","last_undegraded":"2024-04-26T12:40:52.383463+0000","last_fullsized":"2024-04-26T12:40:52.383463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.281648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382427+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:40:52.382427+0000","last_peered":"2024-04-26T12:40:52.382427+0000","last_clean":"2024-04-26T12:40:52.382427+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:40:52.382427+0000","last_undegraded":"2024-04-26T12:40:52.382427+0000","last_fullsized":"2024-04-26T12:40:52.382427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395578+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:40:52.395578+0000","last_peered":"2024-04-26T12:40:52.395578+0000","last_clean":"2024-04-26T12:40:52.395578+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:40:52.395578+0000","last_undegraded":"2024-04-26T12:40:52.395578+0000","last_fullsized":"2024-04-26T12:40:52.395578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401429+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:40:52.401429+0000","last_peered":"2024-04-26T12:40:52.401429+0000","last_clean":"2024-04-26T12:40:52.401429+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:40:52.401429+0000","last_undegraded":"2024-04-26T12:40:52.401429+0000","last_fullsized":"2024-04-26T12:40:52.401429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389570+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:40:52.389570+0000","last_peered":"2024-04-26T12:40:52.389570+0000","last_clean":"2024-04-26T12:40:52.389570+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:40:52.389570+0000","last_undegraded":"2024-04-26T12:40:52.389570+0000","last_fullsized":"2024-04-26T12:40:52.389570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381923+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:40:52.381923+0000","last_peered":"2024-04-26T12:40:52.381923+0000","last_clean":"2024-04-26T12:40:52.381923+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:40:52.381923+0000","last_undegraded":"2024-04-26T12:40:52.381923+0000","last_fullsized":"2024-04-26T12:40:52.381923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"91'8","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396553+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:40:52.396553+0000","last_peered":"2024-04-26T12:40:52.396553+0000","last_clean":"2024-04-26T12:40:52.396553+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:40:52.396553+0000","last_undegraded":"2024-04-26T12:40:52.396553+0000","last_fullsized":"2024-04-26T12:40:52.396553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383559+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:40:52.383559+0000","last_peered":"2024-04-26T12:40:52.383559+0000","last_clean":"2024-04-26T12:40:52.383559+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:40:52.383559+0000","last_undegraded":"2024-04-26T12:40:52.383559+0000","last_fullsized":"2024-04-26T12:40:52.383559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383078+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:40:52.383078+0000","last_peered":"2024-04-26T12:40:52.383078+0000","last_clean":"2024-04-26T12:40:52.383078+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:40:52.383078+0000","last_undegraded":"2024-04-26T12:40:52.383078+0000","last_fullsized":"2024-04-26T12:40:52.383078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"91'30","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381398+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:40:52.381398+0000","last_peered":"2024-04-26T12:40:52.381398+0000","last_clean":"2024-04-26T12:40:52.381398+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:40:52.381398+0000","last_undegraded":"2024-04-26T12:40:52.381398+0000","last_fullsized":"2024-04-26T12:40:52.381398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392506+0000","last_change":"2024-04-26T12:38:32.094008+0000","last_active":"2024-04-26T12:40:52.392506+0000","last_peered":"2024-04-26T12:40:52.392506+0000","last_clean":"2024-04-26T12:40:52.392506+0000","last_became_active":"2024-04-26T12:38:32.092362+0000","last_became_peered":"2024-04-26T12:38:32.092362+0000","last_unstale":"2024-04-26T12:40:52.392506+0000","last_undegraded":"2024-04-26T12:40:52.392506+0000","last_fullsized":"2024-04-26T12:40:52.392506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.395782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382469+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:40:52.382469+0000","last_peered":"2024-04-26T12:40:52.382469+0000","last_clean":"2024-04-26T12:40:52.382469+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:40:52.382469+0000","last_undegraded":"2024-04-26T12:40:52.382469+0000","last_fullsized":"2024-04-26T12:40:52.382469+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383602+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:40:52.383602+0000","last_peered":"2024-04-26T12:40:52.383602+0000","last_clean":"2024-04-26T12:40:52.383602+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:40:52.383602+0000","last_undegraded":"2024-04-26T12:40:52.383602+0000","last_fullsized":"2024-04-26T12:40:52.383602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"91'10","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383275+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:40:52.383275+0000","last_peered":"2024-04-26T12:40:52.383275+0000","last_clean":"2024-04-26T12:40:52.383275+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:40:52.383275+0000","last_undegraded":"2024-04-26T12:40:52.383275+0000","last_fullsized":"2024-04-26T12:40:52.383275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400633+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:40:52.400633+0000","last_peered":"2024-04-26T12:40:52.400633+0000","last_clean":"2024-04-26T12:40:52.400633+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:40:52.400633+0000","last_undegraded":"2024-04-26T12:40:52.400633+0000","last_fullsized":"2024-04-26T12:40:52.400633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398007+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:40:52.398007+0000","last_peered":"2024-04-26T12:40:52.398007+0000","last_clean":"2024-04-26T12:40:52.398007+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:40:52.398007+0000","last_undegraded":"2024-04-26T12:40:52.398007+0000","last_fullsized":"2024-04-26T12:40:52.398007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.380990+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:40:52.380990+0000","last_peered":"2024-04-26T12:40:52.380990+0000","last_clean":"2024-04-26T12:40:52.380990+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:40:52.380990+0000","last_undegraded":"2024-04-26T12:40:52.380990+0000","last_fullsized":"2024-04-26T12:40:52.380990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"91'107","reported_seq":285,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390457+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:40:52.390457+0000","last_peered":"2024-04-26T12:40:52.390457+0000","last_clean":"2024-04-26T12:40:52.390457+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:40:52.390457+0000","last_undegraded":"2024-04-26T12:40:52.390457+0000","last_fullsized":"2024-04-26T12:40:52.390457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395588+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:40:52.395588+0000","last_peered":"2024-04-26T12:40:52.395588+0000","last_clean":"2024-04-26T12:40:52.395588+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:40:52.395588+0000","last_undegraded":"2024-04-26T12:40:52.395588+0000","last_fullsized":"2024-04-26T12:40:52.395588+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391600+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:40:52.391600+0000","last_peered":"2024-04-26T12:40:52.391600+0000","last_clean":"2024-04-26T12:40:52.391600+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:40:52.391600+0000","last_undegraded":"2024-04-26T12:40:52.391600+0000","last_fullsized":"2024-04-26T12:40:52.391600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"91'3","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395300+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:40:52.395300+0000","last_peered":"2024-04-26T12:40:52.395300+0000","last_clean":"2024-04-26T12:40:52.395300+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:40:52.395300+0000","last_undegraded":"2024-04-26T12:40:52.395300+0000","last_fullsized":"2024-04-26T12:40:52.395300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384535+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:40:52.384535+0000","last_peered":"2024-04-26T12:40:52.384535+0000","last_clean":"2024-04-26T12:40:52.384535+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:40:52.384535+0000","last_undegraded":"2024-04-26T12:40:52.384535+0000","last_fullsized":"2024-04-26T12:40:52.384535+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392399+0000","last_change":"2024-04-26T12:38:32.094625+0000","last_active":"2024-04-26T12:40:52.392399+0000","last_peered":"2024-04-26T12:40:52.392399+0000","last_clean":"2024-04-26T12:40:52.392399+0000","last_became_active":"2024-04-26T12:38:32.093266+0000","last_became_peered":"2024-04-26T12:38:32.093266+0000","last_unstale":"2024-04-26T12:40:52.392399+0000","last_undegraded":"2024-04-26T12:40:52.392399+0000","last_fullsized":"2024-04-26T12:40:52.392399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:18:18.695479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393718+0000","last_change":"2024-04-26T12:38:32.097625+0000","last_active":"2024-04-26T12:40:52.393718+0000","last_peered":"2024-04-26T12:40:52.393718+0000","last_clean":"2024-04-26T12:40:52.393718+0000","last_became_active":"2024-04-26T12:38:32.097186+0000","last_became_peered":"2024-04-26T12:38:32.097186+0000","last_unstale":"2024-04-26T12:40:52.393718+0000","last_undegraded":"2024-04-26T12:40:52.393718+0000","last_fullsized":"2024-04-26T12:40:52.393718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:09.866995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"91'107","reported_seq":284,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395810+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:40:52.395810+0000","last_peered":"2024-04-26T12:40:52.395810+0000","last_clean":"2024-04-26T12:40:52.395810+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:40:52.395810+0000","last_undegraded":"2024-04-26T12:40:52.395810+0000","last_fullsized":"2024-04-26T12:40:52.395810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382909+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:40:52.382909+0000","last_peered":"2024-04-26T12:40:52.382909+0000","last_clean":"2024-04-26T12:40:52.382909+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:40:52.382909+0000","last_undegraded":"2024-04-26T12:40:52.382909+0000","last_fullsized":"2024-04-26T12:40:52.382909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391268+0000","last_change":"2024-04-26T12:38:32.089371+0000","last_active":"2024-04-26T12:40:52.391268+0000","last_peered":"2024-04-26T12:40:52.391268+0000","last_clean":"2024-04-26T12:40:52.391268+0000","last_became_active":"2024-04-26T12:38:32.088665+0000","last_became_peered":"2024-04-26T12:38:32.088665+0000","last_unstale":"2024-04-26T12:40:52.391268+0000","last_undegraded":"2024-04-26T12:40:52.391268+0000","last_fullsized":"2024-04-26T12:40:52.391268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:48.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"91'9","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383582+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:40:52.383582+0000","last_peered":"2024-04-26T12:40:52.383582+0000","last_clean":"2024-04-26T12:40:52.383582+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:40:52.383582+0000","last_undegraded":"2024-04-26T12:40:52.383582+0000","last_fullsized":"2024-04-26T12:40:52.383582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.402016+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:40:52.402016+0000","last_peered":"2024-04-26T12:40:52.402016+0000","last_clean":"2024-04-26T12:40:52.402016+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:40:52.402016+0000","last_undegraded":"2024-04-26T12:40:52.402016+0000","last_fullsized":"2024-04-26T12:40:52.402016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391411+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:40:52.391411+0000","last_peered":"2024-04-26T12:40:52.391411+0000","last_clean":"2024-04-26T12:40:52.391411+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:40:52.391411+0000","last_undegraded":"2024-04-26T12:40:52.391411+0000","last_fullsized":"2024-04-26T12:40:52.391411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"91'37","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394465+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:40:52.394465+0000","last_peered":"2024-04-26T12:40:52.394465+0000","last_clean":"2024-04-26T12:40:52.394465+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:40:52.394465+0000","last_undegraded":"2024-04-26T12:40:52.394465+0000","last_fullsized":"2024-04-26T12:40:52.394465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393591+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:40:52.393591+0000","last_peered":"2024-04-26T12:40:52.393591+0000","last_clean":"2024-04-26T12:40:52.393591+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:40:52.393591+0000","last_undegraded":"2024-04-26T12:40:52.393591+0000","last_fullsized":"2024-04-26T12:40:52.393591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392472+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:40:52.392472+0000","last_peered":"2024-04-26T12:40:52.392472+0000","last_clean":"2024-04-26T12:40:52.392472+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:40:52.392472+0000","last_undegraded":"2024-04-26T12:40:52.392472+0000","last_fullsized":"2024-04-26T12:40:52.392472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383283+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:40:52.383283+0000","last_peered":"2024-04-26T12:40:52.383283+0000","last_clean":"2024-04-26T12:40:52.383283+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:40:52.383283+0000","last_undegraded":"2024-04-26T12:40:52.383283+0000","last_fullsized":"2024-04-26T12:40:52.383283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397657+0000","last_change":"2024-04-26T12:38:32.098082+0000","last_active":"2024-04-26T12:40:52.397657+0000","last_peered":"2024-04-26T12:40:52.397657+0000","last_clean":"2024-04-26T12:40:52.397657+0000","last_became_active":"2024-04-26T12:38:32.097658+0000","last_became_peered":"2024-04-26T12:38:32.097658+0000","last_unstale":"2024-04-26T12:40:52.397657+0000","last_undegraded":"2024-04-26T12:40:52.397657+0000","last_fullsized":"2024-04-26T12:40:52.397657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:15.092930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"91'5","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396496+0000","last_change":"2024-04-26T12:38:32.090992+0000","last_active":"2024-04-26T12:40:52.396496+0000","last_peered":"2024-04-26T12:40:52.396496+0000","last_clean":"2024-04-26T12:40:52.396496+0000","last_became_active":"2024-04-26T12:38:32.090197+0000","last_became_peered":"2024-04-26T12:38:32.090197+0000","last_unstale":"2024-04-26T12:40:52.396496+0000","last_undegraded":"2024-04-26T12:40:52.396496+0000","last_fullsized":"2024-04-26T12:40:52.396496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:51.388263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382091+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:40:52.382091+0000","last_peered":"2024-04-26T12:40:52.382091+0000","last_clean":"2024-04-26T12:40:52.382091+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:40:52.382091+0000","last_undegraded":"2024-04-26T12:40:52.382091+0000","last_fullsized":"2024-04-26T12:40:52.382091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"91'17","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392281+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:40:52.392281+0000","last_peered":"2024-04-26T12:40:52.392281+0000","last_clean":"2024-04-26T12:40:52.392281+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:40:52.392281+0000","last_undegraded":"2024-04-26T12:40:52.392281+0000","last_fullsized":"2024-04-26T12:40:52.392281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391223+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:40:52.391223+0000","last_peered":"2024-04-26T12:40:52.391223+0000","last_clean":"2024-04-26T12:40:52.391223+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:40:52.391223+0000","last_undegraded":"2024-04-26T12:40:52.391223+0000","last_fullsized":"2024-04-26T12:40:52.391223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395138+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:40:52.395138+0000","last_peered":"2024-04-26T12:40:52.395138+0000","last_clean":"2024-04-26T12:40:52.395138+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:40:52.395138+0000","last_undegraded":"2024-04-26T12:40:52.395138+0000","last_fullsized":"2024-04-26T12:40:52.395138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381794+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:40:52.381794+0000","last_peered":"2024-04-26T12:40:52.381794+0000","last_clean":"2024-04-26T12:40:52.381794+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:40:52.381794+0000","last_undegraded":"2024-04-26T12:40:52.381794+0000","last_fullsized":"2024-04-26T12:40:52.381794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"91'4","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399935+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:40:52.399935+0000","last_peered":"2024-04-26T12:40:52.399935+0000","last_clean":"2024-04-26T12:40:52.399935+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:40:52.399935+0000","last_undegraded":"2024-04-26T12:40:52.399935+0000","last_fullsized":"2024-04-26T12:40:52.399935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394801+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:40:52.394801+0000","last_peered":"2024-04-26T12:40:52.394801+0000","last_clean":"2024-04-26T12:40:52.394801+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:40:52.394801+0000","last_undegraded":"2024-04-26T12:40:52.394801+0000","last_fullsized":"2024-04-26T12:40:52.394801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"93'7","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381211+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:40:52.381211+0000","last_peered":"2024-04-26T12:40:52.381211+0000","last_clean":"2024-04-26T12:40:52.381211+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:40:52.381211+0000","last_undegraded":"2024-04-26T12:40:52.381211+0000","last_fullsized":"2024-04-26T12:40:52.381211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":26,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394828+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:40:52.394828+0000","last_peered":"2024-04-26T12:40:52.394828+0000","last_clean":"2024-04-26T12:40:52.394828+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:40:52.394828+0000","last_undegraded":"2024-04-26T12:40:52.394828+0000","last_fullsized":"2024-04-26T12:40:52.394828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382375+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:40:52.382375+0000","last_peered":"2024-04-26T12:40:52.382375+0000","last_clean":"2024-04-26T12:40:52.382375+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:40:52.382375+0000","last_undegraded":"2024-04-26T12:40:52.382375+0000","last_fullsized":"2024-04-26T12:40:52.382375+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392844+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:40:52.392844+0000","last_peered":"2024-04-26T12:40:52.392844+0000","last_clean":"2024-04-26T12:40:52.392844+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:40:52.392844+0000","last_undegraded":"2024-04-26T12:40:52.392844+0000","last_fullsized":"2024-04-26T12:40:52.392844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"91'4","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397620+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:40:52.397620+0000","last_peered":"2024-04-26T12:40:52.397620+0000","last_clean":"2024-04-26T12:40:52.397620+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:40:52.397620+0000","last_undegraded":"2024-04-26T12:40:52.397620+0000","last_fullsized":"2024-04-26T12:40:52.397620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397466+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:40:52.397466+0000","last_peered":"2024-04-26T12:40:52.397466+0000","last_clean":"2024-04-26T12:40:52.397466+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:40:52.397466+0000","last_undegraded":"2024-04-26T12:40:52.397466+0000","last_fullsized":"2024-04-26T12:40:52.397466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"91'17","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394523+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:40:52.394523+0000","last_peered":"2024-04-26T12:40:52.394523+0000","last_clean":"2024-04-26T12:40:52.394523+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:40:52.394523+0000","last_undegraded":"2024-04-26T12:40:52.394523+0000","last_fullsized":"2024-04-26T12:40:52.394523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397907+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:40:52.397907+0000","last_peered":"2024-04-26T12:40:52.397907+0000","last_clean":"2024-04-26T12:40:52.397907+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:40:52.397907+0000","last_undegraded":"2024-04-26T12:40:52.397907+0000","last_fullsized":"2024-04-26T12:40:52.397907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391195+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:40:52.391195+0000","last_peered":"2024-04-26T12:40:52.391195+0000","last_clean":"2024-04-26T12:40:52.391195+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:40:52.391195+0000","last_undegraded":"2024-04-26T12:40:52.391195+0000","last_fullsized":"2024-04-26T12:40:52.391195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391795+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:40:52.391795+0000","last_peered":"2024-04-26T12:40:52.391795+0000","last_clean":"2024-04-26T12:40:52.391795+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:40:52.391795+0000","last_undegraded":"2024-04-26T12:40:52.391795+0000","last_fullsized":"2024-04-26T12:40:52.391795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"91'6","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384357+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:40:52.384357+0000","last_peered":"2024-04-26T12:40:52.384357+0000","last_clean":"2024-04-26T12:40:52.384357+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:40:52.384357+0000","last_undegraded":"2024-04-26T12:40:52.384357+0000","last_fullsized":"2024-04-26T12:40:52.384357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397204+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:40:52.397204+0000","last_peered":"2024-04-26T12:40:52.397204+0000","last_clean":"2024-04-26T12:40:52.397204+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:40:52.397204+0000","last_undegraded":"2024-04-26T12:40:52.397204+0000","last_fullsized":"2024-04-26T12:40:52.397204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"91'17","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393831+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:40:52.393831+0000","last_peered":"2024-04-26T12:40:52.393831+0000","last_clean":"2024-04-26T12:40:52.393831+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:40:52.393831+0000","last_undegraded":"2024-04-26T12:40:52.393831+0000","last_fullsized":"2024-04-26T12:40:52.393831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382507+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:40:52.382507+0000","last_peered":"2024-04-26T12:40:52.382507+0000","last_clean":"2024-04-26T12:40:52.382507+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:40:52.382507+0000","last_undegraded":"2024-04-26T12:40:52.382507+0000","last_fullsized":"2024-04-26T12:40:52.382507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401799+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:40:52.401799+0000","last_peered":"2024-04-26T12:40:52.401799+0000","last_clean":"2024-04-26T12:40:52.401799+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:40:52.401799+0000","last_undegraded":"2024-04-26T12:40:52.401799+0000","last_fullsized":"2024-04-26T12:40:52.401799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'9","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392029+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:40:52.392029+0000","last_peered":"2024-04-26T12:40:52.392029+0000","last_clean":"2024-04-26T12:40:52.392029+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:40:52.392029+0000","last_undegraded":"2024-04-26T12:40:52.392029+0000","last_fullsized":"2024-04-26T12:40:52.392029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382964+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:40:52.382964+0000","last_peered":"2024-04-26T12:40:52.382964+0000","last_clean":"2024-04-26T12:40:52.382964+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:40:52.382964+0000","last_undegraded":"2024-04-26T12:40:52.382964+0000","last_fullsized":"2024-04-26T12:40:52.382964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"91'24","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382854+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:40:52.382854+0000","last_peered":"2024-04-26T12:40:52.382854+0000","last_clean":"2024-04-26T12:40:52.382854+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:40:52.382854+0000","last_undegraded":"2024-04-26T12:40:52.382854+0000","last_fullsized":"2024-04-26T12:40:52.382854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391617+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:40:52.391617+0000","last_peered":"2024-04-26T12:40:52.391617+0000","last_clean":"2024-04-26T12:40:52.391617+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:40:52.391617+0000","last_undegraded":"2024-04-26T12:40:52.391617+0000","last_fullsized":"2024-04-26T12:40:52.391617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394238+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:40:52.394238+0000","last_peered":"2024-04-26T12:40:52.394238+0000","last_clean":"2024-04-26T12:40:52.394238+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:40:52.394238+0000","last_undegraded":"2024-04-26T12:40:52.394238+0000","last_fullsized":"2024-04-26T12:40:52.394238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":214,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383112+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:40:52.383112+0000","last_peered":"2024-04-26T12:40:52.383112+0000","last_clean":"2024-04-26T12:40:52.383112+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:40:52.383112+0000","last_undegraded":"2024-04-26T12:40:52.383112+0000","last_fullsized":"2024-04-26T12:40:52.383112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'13","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384567+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:40:52.384567+0000","last_peered":"2024-04-26T12:40:52.384567+0000","last_clean":"2024-04-26T12:40:52.384567+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:40:52.384567+0000","last_undegraded":"2024-04-26T12:40:52.384567+0000","last_fullsized":"2024-04-26T12:40:52.384567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401567+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:40:52.401567+0000","last_peered":"2024-04-26T12:40:52.401567+0000","last_clean":"2024-04-26T12:40:52.401567+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:40:52.401567+0000","last_undegraded":"2024-04-26T12:40:52.401567+0000","last_fullsized":"2024-04-26T12:40:52.401567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"91'21","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395238+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:40:52.395238+0000","last_peered":"2024-04-26T12:40:52.395238+0000","last_clean":"2024-04-26T12:40:52.395238+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:40:52.395238+0000","last_undegraded":"2024-04-26T12:40:52.395238+0000","last_fullsized":"2024-04-26T12:40:52.395238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383008+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:40:52.383008+0000","last_peered":"2024-04-26T12:40:52.383008+0000","last_clean":"2024-04-26T12:40:52.383008+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:40:52.383008+0000","last_undegraded":"2024-04-26T12:40:52.383008+0000","last_fullsized":"2024-04-26T12:40:52.383008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397238+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:40:52.397238+0000","last_peered":"2024-04-26T12:40:52.397238+0000","last_clean":"2024-04-26T12:40:52.397238+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:40:52.397238+0000","last_undegraded":"2024-04-26T12:40:52.397238+0000","last_fullsized":"2024-04-26T12:40:52.397238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390062+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:40:52.390062+0000","last_peered":"2024-04-26T12:40:52.390062+0000","last_clean":"2024-04-26T12:40:52.390062+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:40:52.390062+0000","last_undegraded":"2024-04-26T12:40:52.390062+0000","last_fullsized":"2024-04-26T12:40:52.390062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382344+0000","last_change":"2024-04-26T12:38:32.097004+0000","last_active":"2024-04-26T12:40:52.382344+0000","last_peered":"2024-04-26T12:40:52.382344+0000","last_clean":"2024-04-26T12:40:52.382344+0000","last_became_active":"2024-04-26T12:38:32.096196+0000","last_became_peered":"2024-04-26T12:38:32.096196+0000","last_unstale":"2024-04-26T12:40:52.382344+0000","last_undegraded":"2024-04-26T12:40:52.382344+0000","last_fullsized":"2024-04-26T12:40:52.382344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:00.173484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390434+0000","last_change":"2024-04-26T12:38:32.100356+0000","last_active":"2024-04-26T12:40:52.390434+0000","last_peered":"2024-04-26T12:40:52.390434+0000","last_clean":"2024-04-26T12:40:52.390434+0000","last_became_active":"2024-04-26T12:38:32.099529+0000","last_became_peered":"2024-04-26T12:38:32.099529+0000","last_unstale":"2024-04-26T12:40:52.390434+0000","last_undegraded":"2024-04-26T12:40:52.390434+0000","last_fullsized":"2024-04-26T12:40:52.390434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:32.397561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"91'17","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395817+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:40:52.395817+0000","last_peered":"2024-04-26T12:40:52.395817+0000","last_clean":"2024-04-26T12:40:52.395817+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:40:52.395817+0000","last_undegraded":"2024-04-26T12:40:52.395817+0000","last_fullsized":"2024-04-26T12:40:52.395817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383956+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:40:52.383956+0000","last_peered":"2024-04-26T12:40:52.383956+0000","last_clean":"2024-04-26T12:40:52.383956+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:40:52.383956+0000","last_undegraded":"2024-04-26T12:40:52.383956+0000","last_fullsized":"2024-04-26T12:40:52.383956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390505+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:40:52.390505+0000","last_peered":"2024-04-26T12:40:52.390505+0000","last_clean":"2024-04-26T12:40:52.390505+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:40:52.390505+0000","last_undegraded":"2024-04-26T12:40:52.390505+0000","last_fullsized":"2024-04-26T12:40:52.390505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392224+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:40:52.392224+0000","last_peered":"2024-04-26T12:40:52.392224+0000","last_clean":"2024-04-26T12:40:52.392224+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:40:52.392224+0000","last_undegraded":"2024-04-26T12:40:52.392224+0000","last_fullsized":"2024-04-26T12:40:52.392224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382641+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:40:52.382641+0000","last_peered":"2024-04-26T12:40:52.382641+0000","last_clean":"2024-04-26T12:40:52.382641+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:40:52.382641+0000","last_undegraded":"2024-04-26T12:40:52.382641+0000","last_fullsized":"2024-04-26T12:40:52.382641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383458+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:40:52.383458+0000","last_peered":"2024-04-26T12:40:52.383458+0000","last_clean":"2024-04-26T12:40:52.383458+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:40:52.383458+0000","last_undegraded":"2024-04-26T12:40:52.383458+0000","last_fullsized":"2024-04-26T12:40:52.383458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"68'11","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401614+0000","last_change":"2024-04-26T12:38:32.098589+0000","last_active":"2024-04-26T12:40:52.401614+0000","last_peered":"2024-04-26T12:40:52.401614+0000","last_clean":"2024-04-26T12:40:52.401614+0000","last_became_active":"2024-04-26T12:38:32.097940+0000","last_became_peered":"2024-04-26T12:38:32.097940+0000","last_unstale":"2024-04-26T12:40:52.401614+0000","last_undegraded":"2024-04-26T12:40:52.401614+0000","last_fullsized":"2024-04-26T12:40:52.401614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"91'107","reported_seq":287,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401163+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:40:52.401163+0000","last_peered":"2024-04-26T12:40:52.401163+0000","last_clean":"2024-04-26T12:40:52.401163+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:40:52.401163+0000","last_undegraded":"2024-04-26T12:40:52.401163+0000","last_fullsized":"2024-04-26T12:40:52.401163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397126+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:40:52.397126+0000","last_peered":"2024-04-26T12:40:52.397126+0000","last_clean":"2024-04-26T12:40:52.397126+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:40:52.397126+0000","last_undegraded":"2024-04-26T12:40:52.397126+0000","last_fullsized":"2024-04-26T12:40:52.397126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"91'8","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395379+0000","last_change":"2024-04-26T12:38:32.097299+0000","last_active":"2024-04-26T12:40:52.395379+0000","last_peered":"2024-04-26T12:40:52.395379+0000","last_clean":"2024-04-26T12:40:52.395379+0000","last_became_active":"2024-04-26T12:38:32.096485+0000","last_became_peered":"2024-04-26T12:38:32.096485+0000","last_unstale":"2024-04-26T12:40:52.395379+0000","last_undegraded":"2024-04-26T12:40:52.395379+0000","last_fullsized":"2024-04-26T12:40:52.395379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:18.433433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391935+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:40:52.391935+0000","last_peered":"2024-04-26T12:40:52.391935+0000","last_clean":"2024-04-26T12:40:52.391935+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:40:52.391935+0000","last_undegraded":"2024-04-26T12:40:52.391935+0000","last_fullsized":"2024-04-26T12:40:52.391935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394201+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:40:52.394201+0000","last_peered":"2024-04-26T12:40:52.394201+0000","last_clean":"2024-04-26T12:40:52.394201+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:40:52.394201+0000","last_undegraded":"2024-04-26T12:40:52.394201+0000","last_fullsized":"2024-04-26T12:40:52.394201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"91'22","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390980+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:40:52.390980+0000","last_peered":"2024-04-26T12:40:52.390980+0000","last_clean":"2024-04-26T12:40:52.390980+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:40:52.390980+0000","last_undegraded":"2024-04-26T12:40:52.390980+0000","last_fullsized":"2024-04-26T12:40:52.390980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.380854+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:40:52.380854+0000","last_peered":"2024-04-26T12:40:52.380854+0000","last_clean":"2024-04-26T12:40:52.380854+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:40:52.380854+0000","last_undegraded":"2024-04-26T12:40:52.380854+0000","last_fullsized":"2024-04-26T12:40:52.380854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399030+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:40:52.399030+0000","last_peered":"2024-04-26T12:40:52.399030+0000","last_clean":"2024-04-26T12:40:52.399030+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:40:52.399030+0000","last_undegraded":"2024-04-26T12:40:52.399030+0000","last_fullsized":"2024-04-26T12:40:52.399030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'2","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393863+0000","last_change":"2024-04-26T12:38:32.097693+0000","last_active":"2024-04-26T12:40:52.393863+0000","last_peered":"2024-04-26T12:40:52.393863+0000","last_clean":"2024-04-26T12:40:52.393863+0000","last_became_active":"2024-04-26T12:38:32.096141+0000","last_became_peered":"2024-04-26T12:38:32.096141+0000","last_unstale":"2024-04-26T12:40:52.393863+0000","last_undegraded":"2024-04-26T12:40:52.393863+0000","last_fullsized":"2024-04-26T12:40:52.393863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.450059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"91'12","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396255+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:40:52.396255+0000","last_peered":"2024-04-26T12:40:52.396255+0000","last_clean":"2024-04-26T12:40:52.396255+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:40:52.396255+0000","last_undegraded":"2024-04-26T12:40:52.396255+0000","last_fullsized":"2024-04-26T12:40:52.396255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390499+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:40:52.390499+0000","last_peered":"2024-04-26T12:40:52.390499+0000","last_clean":"2024-04-26T12:40:52.390499+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:40:52.390499+0000","last_undegraded":"2024-04-26T12:40:52.390499+0000","last_fullsized":"2024-04-26T12:40:52.390499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"91'15","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.380958+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:40:52.380958+0000","last_peered":"2024-04-26T12:40:52.380958+0000","last_clean":"2024-04-26T12:40:52.380958+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:40:52.380958+0000","last_undegraded":"2024-04-26T12:40:52.380958+0000","last_fullsized":"2024-04-26T12:40:52.380958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396542+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:40:52.396542+0000","last_peered":"2024-04-26T12:40:52.396542+0000","last_clean":"2024-04-26T12:40:52.396542+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:40:52.396542+0000","last_undegraded":"2024-04-26T12:40:52.396542+0000","last_fullsized":"2024-04-26T12:40:52.396542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395336+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:40:52.395336+0000","last_peered":"2024-04-26T12:40:52.395336+0000","last_clean":"2024-04-26T12:40:52.395336+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:40:52.395336+0000","last_undegraded":"2024-04-26T12:40:52.395336+0000","last_fullsized":"2024-04-26T12:40:52.395336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393055+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:40:52.393055+0000","last_peered":"2024-04-26T12:40:52.393055+0000","last_clean":"2024-04-26T12:40:52.393055+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:40:52.393055+0000","last_undegraded":"2024-04-26T12:40:52.393055+0000","last_fullsized":"2024-04-26T12:40:52.393055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"90'9","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396010+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:40:52.396010+0000","last_peered":"2024-04-26T12:40:52.396010+0000","last_clean":"2024-04-26T12:40:52.396010+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:40:52.396010+0000","last_undegraded":"2024-04-26T12:40:52.396010+0000","last_fullsized":"2024-04-26T12:40:52.396010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393266+0000","last_change":"2024-04-26T12:38:32.098077+0000","last_active":"2024-04-26T12:40:52.393266+0000","last_peered":"2024-04-26T12:40:52.393266+0000","last_clean":"2024-04-26T12:40:52.393266+0000","last_became_active":"2024-04-26T12:38:32.097608+0000","last_became_peered":"2024-04-26T12:38:32.097608+0000","last_unstale":"2024-04-26T12:40:52.393266+0000","last_undegraded":"2024-04-26T12:40:52.393266+0000","last_fullsized":"2024-04-26T12:40:52.393266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:52.163433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"91'12","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395595+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:40:52.395595+0000","last_peered":"2024-04-26T12:40:52.395595+0000","last_clean":"2024-04-26T12:40:52.395595+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:40:52.395595+0000","last_undegraded":"2024-04-26T12:40:52.395595+0000","last_fullsized":"2024-04-26T12:40:52.395595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397589+0000","last_change":"2024-04-26T12:38:32.097869+0000","last_active":"2024-04-26T12:40:52.397589+0000","last_peered":"2024-04-26T12:40:52.397589+0000","last_clean":"2024-04-26T12:40:52.397589+0000","last_became_active":"2024-04-26T12:38:32.097545+0000","last_became_peered":"2024-04-26T12:38:32.097545+0000","last_unstale":"2024-04-26T12:40:52.397589+0000","last_undegraded":"2024-04-26T12:40:52.397589+0000","last_fullsized":"2024-04-26T12:40:52.397589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:00.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397041+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:40:52.397041+0000","last_peered":"2024-04-26T12:40:52.397041+0000","last_clean":"2024-04-26T12:40:52.397041+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:40:52.397041+0000","last_undegraded":"2024-04-26T12:40:52.397041+0000","last_fullsized":"2024-04-26T12:40:52.397041+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"68'12","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393631+0000","last_change":"2024-04-26T12:38:32.098742+0000","last_active":"2024-04-26T12:40:52.393631+0000","last_peered":"2024-04-26T12:40:52.393631+0000","last_clean":"2024-04-26T12:40:52.393631+0000","last_became_active":"2024-04-26T12:38:32.098197+0000","last_became_peered":"2024-04-26T12:38:32.098197+0000","last_unstale":"2024-04-26T12:40:52.393631+0000","last_undegraded":"2024-04-26T12:40:52.393631+0000","last_fullsized":"2024-04-26T12:40:52.393631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.480181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384262+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:40:52.384262+0000","last_peered":"2024-04-26T12:40:52.384262+0000","last_clean":"2024-04-26T12:40:52.384262+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:40:52.384262+0000","last_undegraded":"2024-04-26T12:40:52.384262+0000","last_fullsized":"2024-04-26T12:40:52.384262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":227,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381141+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:40:52.381141+0000","last_peered":"2024-04-26T12:40:52.381141+0000","last_clean":"2024-04-26T12:40:52.381141+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:40:52.381141+0000","last_undegraded":"2024-04-26T12:40:52.381141+0000","last_fullsized":"2024-04-26T12:40:52.381141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"91'15","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390823+0000","last_change":"2024-04-26T12:38:32.089759+0000","last_active":"2024-04-26T12:40:52.390823+0000","last_peered":"2024-04-26T12:40:52.390823+0000","last_clean":"2024-04-26T12:40:52.390823+0000","last_became_active":"2024-04-26T12:38:32.088214+0000","last_became_peered":"2024-04-26T12:38:32.088214+0000","last_unstale":"2024-04-26T12:40:52.390823+0000","last_undegraded":"2024-04-26T12:40:52.390823+0000","last_fullsized":"2024-04-26T12:40:52.390823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:38.656355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382362+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:40:52.382362+0000","last_peered":"2024-04-26T12:40:52.382362+0000","last_clean":"2024-04-26T12:40:52.382362+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:40:52.382362+0000","last_undegraded":"2024-04-26T12:40:52.382362+0000","last_fullsized":"2024-04-26T12:40:52.382362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382707+0000","last_change":"2024-04-26T12:38:32.098228+0000","last_active":"2024-04-26T12:40:52.382707+0000","last_peered":"2024-04-26T12:40:52.382707+0000","last_clean":"2024-04-26T12:40:52.382707+0000","last_became_active":"2024-04-26T12:38:32.092404+0000","last_became_peered":"2024-04-26T12:38:32.092404+0000","last_unstale":"2024-04-26T12:40:52.382707+0000","last_undegraded":"2024-04-26T12:40:52.382707+0000","last_fullsized":"2024-04-26T12:40:52.382707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"91'6","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384775+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:40:52.384775+0000","last_peered":"2024-04-26T12:40:52.384775+0000","last_clean":"2024-04-26T12:40:52.384775+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:40:52.384775+0000","last_undegraded":"2024-04-26T12:40:52.384775+0000","last_fullsized":"2024-04-26T12:40:52.384775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394337+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:40:52.394337+0000","last_peered":"2024-04-26T12:40:52.394337+0000","last_clean":"2024-04-26T12:40:52.394337+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:40:52.394337+0000","last_undegraded":"2024-04-26T12:40:52.394337+0000","last_fullsized":"2024-04-26T12:40:52.394337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":207,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384317+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:40:52.384317+0000","last_peered":"2024-04-26T12:40:52.384317+0000","last_clean":"2024-04-26T12:40:52.384317+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:40:52.384317+0000","last_undegraded":"2024-04-26T12:40:52.384317+0000","last_fullsized":"2024-04-26T12:40:52.384317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"91'9","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389944+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:40:52.389944+0000","last_peered":"2024-04-26T12:40:52.389944+0000","last_clean":"2024-04-26T12:40:52.389944+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:40:52.389944+0000","last_undegraded":"2024-04-26T12:40:52.389944+0000","last_fullsized":"2024-04-26T12:40:52.389944+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"74'2","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395365+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:40:52.395365+0000","last_peered":"2024-04-26T12:40:52.395365+0000","last_clean":"2024-04-26T12:40:52.395365+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:40:52.395365+0000","last_undegraded":"2024-04-26T12:40:52.395365+0000","last_fullsized":"2024-04-26T12:40:52.395365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"91'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391153+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:40:52.391153+0000","last_peered":"2024-04-26T12:40:52.391153+0000","last_clean":"2024-04-26T12:40:52.391153+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:40:52.391153+0000","last_undegraded":"2024-04-26T12:40:52.391153+0000","last_fullsized":"2024-04-26T12:40:52.391153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"68'2","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383416+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:40:52.383416+0000","last_peered":"2024-04-26T12:40:52.383416+0000","last_clean":"2024-04-26T12:40:52.383416+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:40:52.383416+0000","last_undegraded":"2024-04-26T12:40:52.383416+0000","last_fullsized":"2024-04-26T12:40:52.383416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"91'10","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382933+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:40:52.382933+0000","last_peered":"2024-04-26T12:40:52.382933+0000","last_clean":"2024-04-26T12:40:52.382933+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:40:52.382933+0000","last_undegraded":"2024-04-26T12:40:52.382933+0000","last_fullsized":"2024-04-26T12:40:52.382933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395096+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:40:52.395096+0000","last_peered":"2024-04-26T12:40:52.395096+0000","last_clean":"2024-04-26T12:40:52.395096+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:40:52.395096+0000","last_undegraded":"2024-04-26T12:40:52.395096+0000","last_fullsized":"2024-04-26T12:40:52.395096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391698+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:40:52.391698+0000","last_peered":"2024-04-26T12:40:52.391698+0000","last_clean":"2024-04-26T12:40:52.391698+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:40:52.391698+0000","last_undegraded":"2024-04-26T12:40:52.391698+0000","last_fullsized":"2024-04-26T12:40:52.391698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398317+0000","last_change":"2024-04-26T12:38:32.099762+0000","last_active":"2024-04-26T12:40:52.398317+0000","last_peered":"2024-04-26T12:40:52.398317+0000","last_clean":"2024-04-26T12:40:52.398317+0000","last_became_active":"2024-04-26T12:38:32.099061+0000","last_became_peered":"2024-04-26T12:38:32.099061+0000","last_unstale":"2024-04-26T12:40:52.398317+0000","last_undegraded":"2024-04-26T12:40:52.398317+0000","last_fullsized":"2024-04-26T12:40:52.398317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:17.530530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'5","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383794+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:40:52.383794+0000","last_peered":"2024-04-26T12:40:52.383794+0000","last_clean":"2024-04-26T12:40:52.383794+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:40:52.383794+0000","last_undegraded":"2024-04-26T12:40:52.383794+0000","last_fullsized":"2024-04-26T12:40:52.383794+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392732+0000","last_change":"2024-04-26T12:38:58.795730+0000","last_active":"2024-04-26T12:40:52.392732+0000","last_peered":"2024-04-26T12:40:52.392732+0000","last_clean":"2024-04-26T12:40:52.392732+0000","last_became_active":"2024-04-26T12:38:58.795097+0000","last_became_peered":"2024-04-26T12:38:58.795097+0000","last_unstale":"2024-04-26T12:40:52.392732+0000","last_undegraded":"2024-04-26T12:40:52.392732+0000","last_fullsized":"2024-04-26T12:40:52.392732+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.166788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401853+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:40:52.401853+0000","last_peered":"2024-04-26T12:40:52.401853+0000","last_clean":"2024-04-26T12:40:52.401853+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:40:52.401853+0000","last_undegraded":"2024-04-26T12:40:52.401853+0000","last_fullsized":"2024-04-26T12:40:52.401853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"74'10","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393984+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:40:52.393984+0000","last_peered":"2024-04-26T12:40:52.393984+0000","last_clean":"2024-04-26T12:40:52.393984+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:40:52.393984+0000","last_undegraded":"2024-04-26T12:40:52.393984+0000","last_fullsized":"2024-04-26T12:40:52.393984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"90'10","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395603+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:40:52.395603+0000","last_peered":"2024-04-26T12:40:52.395603+0000","last_clean":"2024-04-26T12:40:52.395603+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:40:52.395603+0000","last_undegraded":"2024-04-26T12:40:52.395603+0000","last_fullsized":"2024-04-26T12:40:52.395603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384171+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:40:52.384171+0000","last_peered":"2024-04-26T12:40:52.384171+0000","last_clean":"2024-04-26T12:40:52.384171+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:40:52.384171+0000","last_undegraded":"2024-04-26T12:40:52.384171+0000","last_fullsized":"2024-04-26T12:40:52.384171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"90'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391555+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:40:52.391555+0000","last_peered":"2024-04-26T12:40:52.391555+0000","last_clean":"2024-04-26T12:40:52.391555+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:40:52.391555+0000","last_undegraded":"2024-04-26T12:40:52.391555+0000","last_fullsized":"2024-04-26T12:40:52.391555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391368+0000","last_change":"2024-04-26T12:38:32.101184+0000","last_active":"2024-04-26T12:40:52.391368+0000","last_peered":"2024-04-26T12:40:52.391368+0000","last_clean":"2024-04-26T12:40:52.391368+0000","last_became_active":"2024-04-26T12:38:32.100885+0000","last_became_peered":"2024-04-26T12:38:32.100885+0000","last_unstale":"2024-04-26T12:40:52.391368+0000","last_undegraded":"2024-04-26T12:40:52.391368+0000","last_fullsized":"2024-04-26T12:40:52.391368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:14.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"91'6","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393208+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:40:52.393208+0000","last_peered":"2024-04-26T12:40:52.393208+0000","last_clean":"2024-04-26T12:40:52.393208+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:40:52.393208+0000","last_undegraded":"2024-04-26T12:40:52.393208+0000","last_fullsized":"2024-04-26T12:40:52.393208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"68'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390767+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:40:52.390767+0000","last_peered":"2024-04-26T12:40:52.390767+0000","last_clean":"2024-04-26T12:40:52.390767+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:40:52.390767+0000","last_undegraded":"2024-04-26T12:40:52.390767+0000","last_fullsized":"2024-04-26T12:40:52.390767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'8","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391099+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:40:52.391099+0000","last_peered":"2024-04-26T12:40:52.391099+0000","last_clean":"2024-04-26T12:40:52.391099+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:40:52.391099+0000","last_undegraded":"2024-04-26T12:40:52.391099+0000","last_fullsized":"2024-04-26T12:40:52.391099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"68'4","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398917+0000","last_change":"2024-04-26T12:38:32.097249+0000","last_active":"2024-04-26T12:40:52.398917+0000","last_peered":"2024-04-26T12:40:52.398917+0000","last_clean":"2024-04-26T12:40:52.398917+0000","last_became_active":"2024-04-26T12:38:32.096972+0000","last_became_peered":"2024-04-26T12:38:32.096972+0000","last_unstale":"2024-04-26T12:40:52.398917+0000","last_undegraded":"2024-04-26T12:40:52.398917+0000","last_fullsized":"2024-04-26T12:40:52.398917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:06.018406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"91'9","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383216+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:40:52.383216+0000","last_peered":"2024-04-26T12:40:52.383216+0000","last_clean":"2024-04-26T12:40:52.383216+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:40:52.383216+0000","last_undegraded":"2024-04-26T12:40:52.383216+0000","last_fullsized":"2024-04-26T12:40:52.383216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395238+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:40:52.395238+0000","last_peered":"2024-04-26T12:40:52.395238+0000","last_clean":"2024-04-26T12:40:52.395238+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:40:52.395238+0000","last_undegraded":"2024-04-26T12:40:52.395238+0000","last_fullsized":"2024-04-26T12:40:52.395238+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"90'4","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399438+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:40:52.399438+0000","last_peered":"2024-04-26T12:40:52.399438+0000","last_clean":"2024-04-26T12:40:52.399438+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:40:52.399438+0000","last_undegraded":"2024-04-26T12:40:52.399438+0000","last_fullsized":"2024-04-26T12:40:52.399438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"68'4","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381702+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:40:52.381702+0000","last_peered":"2024-04-26T12:40:52.381702+0000","last_clean":"2024-04-26T12:40:52.381702+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:40:52.381702+0000","last_undegraded":"2024-04-26T12:40:52.381702+0000","last_fullsized":"2024-04-26T12:40:52.381702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"91'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400421+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:40:52.400421+0000","last_peered":"2024-04-26T12:40:52.400421+0000","last_clean":"2024-04-26T12:40:52.400421+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:40:52.400421+0000","last_undegraded":"2024-04-26T12:40:52.400421+0000","last_fullsized":"2024-04-26T12:40:52.400421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392618+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:40:52.392618+0000","last_peered":"2024-04-26T12:40:52.392618+0000","last_clean":"2024-04-26T12:40:52.392618+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:40:52.392618+0000","last_undegraded":"2024-04-26T12:40:52.392618+0000","last_fullsized":"2024-04-26T12:40:52.392618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"90'5","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391593+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:40:52.391593+0000","last_peered":"2024-04-26T12:40:52.391593+0000","last_clean":"2024-04-26T12:40:52.391593+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:40:52.391593+0000","last_undegraded":"2024-04-26T12:40:52.391593+0000","last_fullsized":"2024-04-26T12:40:52.391593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399194+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:40:52.399194+0000","last_peered":"2024-04-26T12:40:52.399194+0000","last_clean":"2024-04-26T12:40:52.399194+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:40:52.399194+0000","last_undegraded":"2024-04-26T12:40:52.399194+0000","last_fullsized":"2024-04-26T12:40:52.399194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"91'6","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398888+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:40:52.398888+0000","last_peered":"2024-04-26T12:40:52.398888+0000","last_clean":"2024-04-26T12:40:52.398888+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:40:52.398888+0000","last_undegraded":"2024-04-26T12:40:52.398888+0000","last_fullsized":"2024-04-26T12:40:52.398888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"91'7","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391298+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:40:52.391298+0000","last_peered":"2024-04-26T12:40:52.391298+0000","last_clean":"2024-04-26T12:40:52.391298+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:40:52.391298+0000","last_undegraded":"2024-04-26T12:40:52.391298+0000","last_fullsized":"2024-04-26T12:40:52.391298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384079+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:40:52.384079+0000","last_peered":"2024-04-26T12:40:52.384079+0000","last_clean":"2024-04-26T12:40:52.384079+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:40:52.384079+0000","last_undegraded":"2024-04-26T12:40:52.384079+0000","last_fullsized":"2024-04-26T12:40:52.384079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'12","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384274+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:40:52.384274+0000","last_peered":"2024-04-26T12:40:52.384274+0000","last_clean":"2024-04-26T12:40:52.384274+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:40:52.384274+0000","last_undegraded":"2024-04-26T12:40:52.384274+0000","last_fullsized":"2024-04-26T12:40:52.384274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397233+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:40:52.397233+0000","last_peered":"2024-04-26T12:40:52.397233+0000","last_clean":"2024-04-26T12:40:52.397233+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:40:52.397233+0000","last_undegraded":"2024-04-26T12:40:52.397233+0000","last_fullsized":"2024-04-26T12:40:52.397233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":293,"num_read_kb":277,"num_write":246,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":141660,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":811,"num_read_kb":573,"num_write":451,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":243460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":354,"num_read_kb":354,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1250,"num_read_kb":1226,"num_write":256,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2113929216,"num_objects":506,"num_object_clones":0,"num_object_copies":1012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":506,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":578,"num_write_kb":2088960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4227858432,"data_stored":4227858432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":518,"ondisk_log_size":518,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536752,"kb_used_data":505568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835088,"statfs":{"total":96636764160,"available":96087130112,"internally_reserved":0,"allocated":517701632,"data_stored":517185459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398864,"kb_used_data":367684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93972976,"statfs":{"total":96636764160,"available":96228327424,"internally_reserved":0,"allocated":376508416,"data_stored":376025985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":720544,"kb_used_data":689364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93651296,"statfs":{"total":96636764160,"available":95898927104,"internally_reserved":0,"allocated":705908736,"data_stored":705355568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":570912,"kb_used_data":539732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93800928,"statfs":{"total":96636764160,"available":96052150272,"internally_reserved":0,"allocated":552685568,"data_stored":552201958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712360,"kb_used_data":677020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93659480,"statfs":{"total":96636764160,"available":95907307520,"internally_reserved":0,"allocated":693268480,"data_stored":692755500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409160,"kb_used_data":373820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93962680,"statfs":{"total":96636764160,"available":96217784320,"internally_reserved":0,"allocated":382791680,"data_stored":382317439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433792,"kb_used_data":398448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93938048,"statfs":{"total":96636764160,"available":96192561152,"internally_reserved":0,"allocated":408010752,"data_stored":407493862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":622820,"kb_used_data":587476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93749020,"statfs":{"total":96636764160,"available":95998996480,"internally_reserved":0,"allocated":601575424,"data_stored":601077681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":599785472,"data_stored":599785472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":406847488,"data_stored":406847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":381681664,"data_stored":381681664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":692060160,"data_stored":692060160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":551550976,"data_stored":551550976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":704643072,"data_stored":704643072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":375390208,"data_stored":375390208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":60224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:40:57.891 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:40:57.940 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:40:57.940+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:40:57.988 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:40:57.989 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:40:58.007 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:40:58.007 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:40:58.014 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:40:58.014 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:40:58.024 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:40:58.024 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:40:58.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:40:58.041 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:40:58.041 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:40:58.060 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:40:58.060 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:40:58.073 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:40:58.072+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:40:58.091 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:40:58.091 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:40:58.110 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:40:58.111 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:40:58.130 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:40:58.130 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:40:58.133 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:58.133+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:58.194 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:58.195 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:58.208 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:40:58.252 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:58.252+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:58.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:40:58.286 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:40:58.298 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-04-26T12:40:57.444631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2114663260,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":2848,"num_read_kb":2548,"num_write":1700,"num_write_kb":2091651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2510,"ondisk_log_size":2510,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4405204,"kb_used_data":4139112,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":750569516,"statfs":{"total":773094113280,"available":768583184384,"internally_reserved":0,"allocated":4238450688,"data_stored":4234413452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038514"},"pg_stats":[{"pgid":"3.3f","version":"91'6","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396811+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:40:52.396811+0000","last_peered":"2024-04-26T12:40:52.396811+0000","last_clean":"2024-04-26T12:40:52.396811+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:40:52.396811+0000","last_undegraded":"2024-04-26T12:40:52.396811+0000","last_fullsized":"2024-04-26T12:40:52.396811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"68'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390147+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:40:52.390147+0000","last_peered":"2024-04-26T12:40:52.390147+0000","last_clean":"2024-04-26T12:40:52.390147+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:40:52.390147+0000","last_undegraded":"2024-04-26T12:40:52.390147+0000","last_fullsized":"2024-04-26T12:40:52.390147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"71'1","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384463+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:40:52.384463+0000","last_peered":"2024-04-26T12:40:52.384463+0000","last_clean":"2024-04-26T12:40:52.384463+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:40:52.384463+0000","last_undegraded":"2024-04-26T12:40:52.384463+0000","last_fullsized":"2024-04-26T12:40:52.384463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395174+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:40:52.395174+0000","last_peered":"2024-04-26T12:40:52.395174+0000","last_clean":"2024-04-26T12:40:52.395174+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:40:52.395174+0000","last_undegraded":"2024-04-26T12:40:52.395174+0000","last_fullsized":"2024-04-26T12:40:52.395174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"90'4","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383841+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:40:52.383841+0000","last_peered":"2024-04-26T12:40:52.383841+0000","last_clean":"2024-04-26T12:40:52.383841+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:40:52.383841+0000","last_undegraded":"2024-04-26T12:40:52.383841+0000","last_fullsized":"2024-04-26T12:40:52.383841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382212+0000","last_change":"2024-04-26T12:38:32.099160+0000","last_active":"2024-04-26T12:40:52.382212+0000","last_peered":"2024-04-26T12:40:52.382212+0000","last_clean":"2024-04-26T12:40:52.382212+0000","last_became_active":"2024-04-26T12:38:32.093033+0000","last_became_peered":"2024-04-26T12:38:32.093033+0000","last_unstale":"2024-04-26T12:40:52.382212+0000","last_undegraded":"2024-04-26T12:40:52.382212+0000","last_fullsized":"2024-04-26T12:40:52.382212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:22.221188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'15","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391885+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:40:52.391885+0000","last_peered":"2024-04-26T12:40:52.391885+0000","last_clean":"2024-04-26T12:40:52.391885+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:40:52.391885+0000","last_undegraded":"2024-04-26T12:40:52.391885+0000","last_fullsized":"2024-04-26T12:40:52.391885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382785+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:40:52.382785+0000","last_peered":"2024-04-26T12:40:52.382785+0000","last_clean":"2024-04-26T12:40:52.382785+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:40:52.382785+0000","last_undegraded":"2024-04-26T12:40:52.382785+0000","last_fullsized":"2024-04-26T12:40:52.382785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"91'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398931+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:40:52.398931+0000","last_peered":"2024-04-26T12:40:52.398931+0000","last_clean":"2024-04-26T12:40:52.398931+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:40:52.398931+0000","last_undegraded":"2024-04-26T12:40:52.398931+0000","last_fullsized":"2024-04-26T12:40:52.398931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"68'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399093+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:40:52.399093+0000","last_peered":"2024-04-26T12:40:52.399093+0000","last_clean":"2024-04-26T12:40:52.399093+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:40:52.399093+0000","last_undegraded":"2024-04-26T12:40:52.399093+0000","last_fullsized":"2024-04-26T12:40:52.399093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"91'11","reported_seq":124,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393658+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:40:52.393658+0000","last_peered":"2024-04-26T12:40:52.393658+0000","last_clean":"2024-04-26T12:40:52.393658+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:40:52.393658+0000","last_undegraded":"2024-04-26T12:40:52.393658+0000","last_fullsized":"2024-04-26T12:40:52.393658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383815+0000","last_change":"2024-04-26T12:38:32.092960+0000","last_active":"2024-04-26T12:40:52.383815+0000","last_peered":"2024-04-26T12:40:52.383815+0000","last_clean":"2024-04-26T12:40:52.383815+0000","last_became_active":"2024-04-26T12:38:32.092562+0000","last_became_peered":"2024-04-26T12:38:32.092562+0000","last_unstale":"2024-04-26T12:40:52.383815+0000","last_undegraded":"2024-04-26T12:40:52.383815+0000","last_fullsized":"2024-04-26T12:40:52.383815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:43.474569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"91'7","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395918+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:40:52.395918+0000","last_peered":"2024-04-26T12:40:52.395918+0000","last_clean":"2024-04-26T12:40:52.395918+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:40:52.395918+0000","last_undegraded":"2024-04-26T12:40:52.395918+0000","last_fullsized":"2024-04-26T12:40:52.395918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396553+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:40:52.396553+0000","last_peered":"2024-04-26T12:40:52.396553+0000","last_clean":"2024-04-26T12:40:52.396553+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:40:52.396553+0000","last_undegraded":"2024-04-26T12:40:52.396553+0000","last_fullsized":"2024-04-26T12:40:52.396553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"90'5","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391907+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:40:52.391907+0000","last_peered":"2024-04-26T12:40:52.391907+0000","last_clean":"2024-04-26T12:40:52.391907+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:40:52.391907+0000","last_undegraded":"2024-04-26T12:40:52.391907+0000","last_fullsized":"2024-04-26T12:40:52.391907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391110+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:40:52.391110+0000","last_peered":"2024-04-26T12:40:52.391110+0000","last_clean":"2024-04-26T12:40:52.391110+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:40:52.391110+0000","last_undegraded":"2024-04-26T12:40:52.391110+0000","last_fullsized":"2024-04-26T12:40:52.391110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381156+0000","last_change":"2024-04-26T12:38:32.098437+0000","last_active":"2024-04-26T12:40:52.381156+0000","last_peered":"2024-04-26T12:40:52.381156+0000","last_clean":"2024-04-26T12:40:52.381156+0000","last_became_active":"2024-04-26T12:38:32.093038+0000","last_became_peered":"2024-04-26T12:38:32.093038+0000","last_unstale":"2024-04-26T12:40:52.381156+0000","last_undegraded":"2024-04-26T12:40:52.381156+0000","last_fullsized":"2024-04-26T12:40:52.381156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:11.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397606+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:40:52.397606+0000","last_peered":"2024-04-26T12:40:52.397606+0000","last_clean":"2024-04-26T12:40:52.397606+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:40:52.397606+0000","last_undegraded":"2024-04-26T12:40:52.397606+0000","last_fullsized":"2024-04-26T12:40:52.397606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"68'2","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395532+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:40:52.395532+0000","last_peered":"2024-04-26T12:40:52.395532+0000","last_clean":"2024-04-26T12:40:52.395532+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:40:52.395532+0000","last_undegraded":"2024-04-26T12:40:52.395532+0000","last_fullsized":"2024-04-26T12:40:52.395532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'12","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401403+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:40:52.401403+0000","last_peered":"2024-04-26T12:40:52.401403+0000","last_clean":"2024-04-26T12:40:52.401403+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:40:52.401403+0000","last_undegraded":"2024-04-26T12:40:52.401403+0000","last_fullsized":"2024-04-26T12:40:52.401403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390910+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:40:52.390910+0000","last_peered":"2024-04-26T12:40:52.390910+0000","last_clean":"2024-04-26T12:40:52.390910+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:40:52.390910+0000","last_undegraded":"2024-04-26T12:40:52.390910+0000","last_fullsized":"2024-04-26T12:40:52.390910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"91'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400466+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:40:52.400466+0000","last_peered":"2024-04-26T12:40:52.400466+0000","last_clean":"2024-04-26T12:40:52.400466+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:40:52.400466+0000","last_undegraded":"2024-04-26T12:40:52.400466+0000","last_fullsized":"2024-04-26T12:40:52.400466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"68'6","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390972+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:40:52.390972+0000","last_peered":"2024-04-26T12:40:52.390972+0000","last_clean":"2024-04-26T12:40:52.390972+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:40:52.390972+0000","last_undegraded":"2024-04-26T12:40:52.390972+0000","last_fullsized":"2024-04-26T12:40:52.390972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"90'6","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399265+0000","last_change":"2024-04-26T12:38:32.097333+0000","last_active":"2024-04-26T12:40:52.399265+0000","last_peered":"2024-04-26T12:40:52.399265+0000","last_clean":"2024-04-26T12:40:52.399265+0000","last_became_active":"2024-04-26T12:38:32.097076+0000","last_became_peered":"2024-04-26T12:38:32.097076+0000","last_unstale":"2024-04-26T12:40:52.399265+0000","last_undegraded":"2024-04-26T12:40:52.399265+0000","last_fullsized":"2024-04-26T12:40:52.399265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:52.365241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392098+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:40:52.392098+0000","last_peered":"2024-04-26T12:40:52.392098+0000","last_clean":"2024-04-26T12:40:52.392098+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:40:52.392098+0000","last_undegraded":"2024-04-26T12:40:52.392098+0000","last_fullsized":"2024-04-26T12:40:52.392098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394667+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:40:52.394667+0000","last_peered":"2024-04-26T12:40:52.394667+0000","last_clean":"2024-04-26T12:40:52.394667+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:40:52.394667+0000","last_undegraded":"2024-04-26T12:40:52.394667+0000","last_fullsized":"2024-04-26T12:40:52.394667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383681+0000","last_change":"2024-04-26T12:38:32.098711+0000","last_active":"2024-04-26T12:40:52.383681+0000","last_peered":"2024-04-26T12:40:52.383681+0000","last_clean":"2024-04-26T12:40:52.383681+0000","last_became_active":"2024-04-26T12:38:32.097887+0000","last_became_peered":"2024-04-26T12:38:32.097887+0000","last_unstale":"2024-04-26T12:40:52.383681+0000","last_undegraded":"2024-04-26T12:40:52.383681+0000","last_fullsized":"2024-04-26T12:40:52.383681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:43.980582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"91'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382350+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:40:52.382350+0000","last_peered":"2024-04-26T12:40:52.382350+0000","last_clean":"2024-04-26T12:40:52.382350+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:40:52.382350+0000","last_undegraded":"2024-04-26T12:40:52.382350+0000","last_fullsized":"2024-04-26T12:40:52.382350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390074+0000","last_change":"2024-04-26T12:38:32.091108+0000","last_active":"2024-04-26T12:40:52.390074+0000","last_peered":"2024-04-26T12:40:52.390074+0000","last_clean":"2024-04-26T12:40:52.390074+0000","last_became_active":"2024-04-26T12:38:32.090800+0000","last_became_peered":"2024-04-26T12:38:32.090800+0000","last_unstale":"2024-04-26T12:40:52.390074+0000","last_undegraded":"2024-04-26T12:40:52.390074+0000","last_fullsized":"2024-04-26T12:40:52.390074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:54.159328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390893+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:40:52.390893+0000","last_peered":"2024-04-26T12:40:52.390893+0000","last_clean":"2024-04-26T12:40:52.390893+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:40:52.390893+0000","last_undegraded":"2024-04-26T12:40:52.390893+0000","last_fullsized":"2024-04-26T12:40:52.390893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"91'3","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396111+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:40:52.396111+0000","last_peered":"2024-04-26T12:40:52.396111+0000","last_clean":"2024-04-26T12:40:52.396111+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:40:52.396111+0000","last_undegraded":"2024-04-26T12:40:52.396111+0000","last_fullsized":"2024-04-26T12:40:52.396111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393089+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:40:52.393089+0000","last_peered":"2024-04-26T12:40:52.393089+0000","last_clean":"2024-04-26T12:40:52.393089+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:40:52.393089+0000","last_undegraded":"2024-04-26T12:40:52.393089+0000","last_fullsized":"2024-04-26T12:40:52.393089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"91'16","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382655+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:40:52.382655+0000","last_peered":"2024-04-26T12:40:52.382655+0000","last_clean":"2024-04-26T12:40:52.382655+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:40:52.382655+0000","last_undegraded":"2024-04-26T12:40:52.382655+0000","last_fullsized":"2024-04-26T12:40:52.382655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395971+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:40:52.395971+0000","last_peered":"2024-04-26T12:40:52.395971+0000","last_clean":"2024-04-26T12:40:52.395971+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:40:52.395971+0000","last_undegraded":"2024-04-26T12:40:52.395971+0000","last_fullsized":"2024-04-26T12:40:52.395971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"91'40","reported_seq":198,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390237+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:40:52.390237+0000","last_peered":"2024-04-26T12:40:52.390237+0000","last_clean":"2024-04-26T12:40:52.390237+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:40:52.390237+0000","last_undegraded":"2024-04-26T12:40:52.390237+0000","last_fullsized":"2024-04-26T12:40:52.390237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396025+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:40:52.396025+0000","last_peered":"2024-04-26T12:40:52.396025+0000","last_clean":"2024-04-26T12:40:52.396025+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:40:52.396025+0000","last_undegraded":"2024-04-26T12:40:52.396025+0000","last_fullsized":"2024-04-26T12:40:52.396025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"91'11","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382485+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:40:52.382485+0000","last_peered":"2024-04-26T12:40:52.382485+0000","last_clean":"2024-04-26T12:40:52.382485+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:40:52.382485+0000","last_undegraded":"2024-04-26T12:40:52.382485+0000","last_fullsized":"2024-04-26T12:40:52.382485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390628+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:40:52.390628+0000","last_peered":"2024-04-26T12:40:52.390628+0000","last_clean":"2024-04-26T12:40:52.390628+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:40:52.390628+0000","last_undegraded":"2024-04-26T12:40:52.390628+0000","last_fullsized":"2024-04-26T12:40:52.390628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390681+0000","last_change":"2024-04-26T12:38:32.099862+0000","last_active":"2024-04-26T12:40:52.390681+0000","last_peered":"2024-04-26T12:40:52.390681+0000","last_clean":"2024-04-26T12:40:52.390681+0000","last_became_active":"2024-04-26T12:38:32.098951+0000","last_became_peered":"2024-04-26T12:38:32.098951+0000","last_unstale":"2024-04-26T12:40:52.390681+0000","last_undegraded":"2024-04-26T12:40:52.390681+0000","last_fullsized":"2024-04-26T12:40:52.390681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:37.401523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382564+0000","last_change":"2024-04-26T12:38:32.100120+0000","last_active":"2024-04-26T12:40:52.382564+0000","last_peered":"2024-04-26T12:40:52.382564+0000","last_clean":"2024-04-26T12:40:52.382564+0000","last_became_active":"2024-04-26T12:38:32.099583+0000","last_became_peered":"2024-04-26T12:38:32.099583+0000","last_unstale":"2024-04-26T12:40:52.382564+0000","last_undegraded":"2024-04-26T12:40:52.382564+0000","last_fullsized":"2024-04-26T12:40:52.382564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:16.598403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381902+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:40:52.381902+0000","last_peered":"2024-04-26T12:40:52.381902+0000","last_clean":"2024-04-26T12:40:52.381902+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:40:52.381902+0000","last_undegraded":"2024-04-26T12:40:52.381902+0000","last_fullsized":"2024-04-26T12:40:52.381902+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383442+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:40:52.383442+0000","last_peered":"2024-04-26T12:40:52.383442+0000","last_clean":"2024-04-26T12:40:52.383442+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:40:52.383442+0000","last_undegraded":"2024-04-26T12:40:52.383442+0000","last_fullsized":"2024-04-26T12:40:52.383442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"91'5","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396321+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:40:52.396321+0000","last_peered":"2024-04-26T12:40:52.396321+0000","last_clean":"2024-04-26T12:40:52.396321+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:40:52.396321+0000","last_undegraded":"2024-04-26T12:40:52.396321+0000","last_fullsized":"2024-04-26T12:40:52.396321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396004+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:40:52.396004+0000","last_peered":"2024-04-26T12:40:52.396004+0000","last_clean":"2024-04-26T12:40:52.396004+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:40:52.396004+0000","last_undegraded":"2024-04-26T12:40:52.396004+0000","last_fullsized":"2024-04-26T12:40:52.396004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391913+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:40:52.391913+0000","last_peered":"2024-04-26T12:40:52.391913+0000","last_clean":"2024-04-26T12:40:52.391913+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:40:52.391913+0000","last_undegraded":"2024-04-26T12:40:52.391913+0000","last_fullsized":"2024-04-26T12:40:52.391913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"91'107","reported_seq":361,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395952+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:40:52.395952+0000","last_peered":"2024-04-26T12:40:52.395952+0000","last_clean":"2024-04-26T12:40:52.395952+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:40:52.395952+0000","last_undegraded":"2024-04-26T12:40:52.395952+0000","last_fullsized":"2024-04-26T12:40:52.395952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390649+0000","last_change":"2024-04-26T12:38:32.097189+0000","last_active":"2024-04-26T12:40:52.390649+0000","last_peered":"2024-04-26T12:40:52.390649+0000","last_clean":"2024-04-26T12:40:52.390649+0000","last_became_active":"2024-04-26T12:38:32.096313+0000","last_became_peered":"2024-04-26T12:38:32.096313+0000","last_unstale":"2024-04-26T12:40:52.390649+0000","last_undegraded":"2024-04-26T12:40:52.390649+0000","last_fullsized":"2024-04-26T12:40:52.390649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:26.879794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395449+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:40:52.395449+0000","last_peered":"2024-04-26T12:40:52.395449+0000","last_clean":"2024-04-26T12:40:52.395449+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:40:52.395449+0000","last_undegraded":"2024-04-26T12:40:52.395449+0000","last_fullsized":"2024-04-26T12:40:52.395449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"91'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394740+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:40:52.394740+0000","last_peered":"2024-04-26T12:40:52.394740+0000","last_clean":"2024-04-26T12:40:52.394740+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:40:52.394740+0000","last_undegraded":"2024-04-26T12:40:52.394740+0000","last_fullsized":"2024-04-26T12:40:52.394740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396254+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:40:52.396254+0000","last_peered":"2024-04-26T12:40:52.396254+0000","last_clean":"2024-04-26T12:40:52.396254+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:40:52.396254+0000","last_undegraded":"2024-04-26T12:40:52.396254+0000","last_fullsized":"2024-04-26T12:40:52.396254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"91'15","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396650+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:40:52.396650+0000","last_peered":"2024-04-26T12:40:52.396650+0000","last_clean":"2024-04-26T12:40:52.396650+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:40:52.396650+0000","last_undegraded":"2024-04-26T12:40:52.396650+0000","last_fullsized":"2024-04-26T12:40:52.396650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"91'107","reported_seq":284,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390166+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:40:52.390166+0000","last_peered":"2024-04-26T12:40:52.390166+0000","last_clean":"2024-04-26T12:40:52.390166+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:40:52.390166+0000","last_undegraded":"2024-04-26T12:40:52.390166+0000","last_fullsized":"2024-04-26T12:40:52.390166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398190+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:40:52.398190+0000","last_peered":"2024-04-26T12:40:52.398190+0000","last_clean":"2024-04-26T12:40:52.398190+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:40:52.398190+0000","last_undegraded":"2024-04-26T12:40:52.398190+0000","last_fullsized":"2024-04-26T12:40:52.398190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"91'6","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390559+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:40:52.390559+0000","last_peered":"2024-04-26T12:40:52.390559+0000","last_clean":"2024-04-26T12:40:52.390559+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:40:52.390559+0000","last_undegraded":"2024-04-26T12:40:52.390559+0000","last_fullsized":"2024-04-26T12:40:52.390559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394238+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:40:52.394238+0000","last_peered":"2024-04-26T12:40:52.394238+0000","last_clean":"2024-04-26T12:40:52.394238+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:40:52.394238+0000","last_undegraded":"2024-04-26T12:40:52.394238+0000","last_fullsized":"2024-04-26T12:40:52.394238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"91'25","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390095+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:40:52.390095+0000","last_peered":"2024-04-26T12:40:52.390095+0000","last_clean":"2024-04-26T12:40:52.390095+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:40:52.390095+0000","last_undegraded":"2024-04-26T12:40:52.390095+0000","last_fullsized":"2024-04-26T12:40:52.390095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382507+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:40:52.382507+0000","last_peered":"2024-04-26T12:40:52.382507+0000","last_clean":"2024-04-26T12:40:52.382507+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:40:52.382507+0000","last_undegraded":"2024-04-26T12:40:52.382507+0000","last_fullsized":"2024-04-26T12:40:52.382507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391517+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:40:52.391517+0000","last_peered":"2024-04-26T12:40:52.391517+0000","last_clean":"2024-04-26T12:40:52.391517+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:40:52.391517+0000","last_undegraded":"2024-04-26T12:40:52.391517+0000","last_fullsized":"2024-04-26T12:40:52.391517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"68'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384415+0000","last_change":"2024-04-26T12:38:32.097378+0000","last_active":"2024-04-26T12:40:52.384415+0000","last_peered":"2024-04-26T12:40:52.384415+0000","last_clean":"2024-04-26T12:40:52.384415+0000","last_became_active":"2024-04-26T12:38:32.096994+0000","last_became_peered":"2024-04-26T12:38:32.096994+0000","last_unstale":"2024-04-26T12:40:52.384415+0000","last_undegraded":"2024-04-26T12:40:52.384415+0000","last_fullsized":"2024-04-26T12:40:52.384415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:26.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"90'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399421+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:40:52.399421+0000","last_peered":"2024-04-26T12:40:52.399421+0000","last_clean":"2024-04-26T12:40:52.399421+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:40:52.399421+0000","last_undegraded":"2024-04-26T12:40:52.399421+0000","last_fullsized":"2024-04-26T12:40:52.399421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389645+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:40:52.389645+0000","last_peered":"2024-04-26T12:40:52.389645+0000","last_clean":"2024-04-26T12:40:52.389645+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:40:52.389645+0000","last_undegraded":"2024-04-26T12:40:52.389645+0000","last_fullsized":"2024-04-26T12:40:52.389645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"91'17","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395201+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:40:52.395201+0000","last_peered":"2024-04-26T12:40:52.395201+0000","last_clean":"2024-04-26T12:40:52.395201+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:40:52.395201+0000","last_undegraded":"2024-04-26T12:40:52.395201+0000","last_fullsized":"2024-04-26T12:40:52.395201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393472+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:40:52.393472+0000","last_peered":"2024-04-26T12:40:52.393472+0000","last_clean":"2024-04-26T12:40:52.393472+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:40:52.393472+0000","last_undegraded":"2024-04-26T12:40:52.393472+0000","last_fullsized":"2024-04-26T12:40:52.393472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"68'3","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397619+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:40:52.397619+0000","last_peered":"2024-04-26T12:40:52.397619+0000","last_clean":"2024-04-26T12:40:52.397619+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:40:52.397619+0000","last_undegraded":"2024-04-26T12:40:52.397619+0000","last_fullsized":"2024-04-26T12:40:52.397619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398350+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:40:52.398350+0000","last_peered":"2024-04-26T12:40:52.398350+0000","last_clean":"2024-04-26T12:40:52.398350+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:40:52.398350+0000","last_undegraded":"2024-04-26T12:40:52.398350+0000","last_fullsized":"2024-04-26T12:40:52.398350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"90'9","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399998+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:40:52.399998+0000","last_peered":"2024-04-26T12:40:52.399998+0000","last_clean":"2024-04-26T12:40:52.399998+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:40:52.399998+0000","last_undegraded":"2024-04-26T12:40:52.399998+0000","last_fullsized":"2024-04-26T12:40:52.399998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391544+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:40:52.391544+0000","last_peered":"2024-04-26T12:40:52.391544+0000","last_clean":"2024-04-26T12:40:52.391544+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:40:52.391544+0000","last_undegraded":"2024-04-26T12:40:52.391544+0000","last_fullsized":"2024-04-26T12:40:52.391544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"91'22","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399801+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:40:52.399801+0000","last_peered":"2024-04-26T12:40:52.399801+0000","last_clean":"2024-04-26T12:40:52.399801+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:40:52.399801+0000","last_undegraded":"2024-04-26T12:40:52.399801+0000","last_fullsized":"2024-04-26T12:40:52.399801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"91'107","reported_seq":293,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381824+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:40:52.381824+0000","last_peered":"2024-04-26T12:40:52.381824+0000","last_clean":"2024-04-26T12:40:52.381824+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:40:52.381824+0000","last_undegraded":"2024-04-26T12:40:52.381824+0000","last_fullsized":"2024-04-26T12:40:52.381824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382757+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:40:52.382757+0000","last_peered":"2024-04-26T12:40:52.382757+0000","last_clean":"2024-04-26T12:40:52.382757+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:40:52.382757+0000","last_undegraded":"2024-04-26T12:40:52.382757+0000","last_fullsized":"2024-04-26T12:40:52.382757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383628+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:40:52.383628+0000","last_peered":"2024-04-26T12:40:52.383628+0000","last_clean":"2024-04-26T12:40:52.383628+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:40:52.383628+0000","last_undegraded":"2024-04-26T12:40:52.383628+0000","last_fullsized":"2024-04-26T12:40:52.383628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"91'8","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392220+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:40:52.392220+0000","last_peered":"2024-04-26T12:40:52.392220+0000","last_clean":"2024-04-26T12:40:52.392220+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:40:52.392220+0000","last_undegraded":"2024-04-26T12:40:52.392220+0000","last_fullsized":"2024-04-26T12:40:52.392220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391547+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:40:52.391547+0000","last_peered":"2024-04-26T12:40:52.391547+0000","last_clean":"2024-04-26T12:40:52.391547+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:40:52.391547+0000","last_undegraded":"2024-04-26T12:40:52.391547+0000","last_fullsized":"2024-04-26T12:40:52.391547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"91'25","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382103+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:40:52.382103+0000","last_peered":"2024-04-26T12:40:52.382103+0000","last_clean":"2024-04-26T12:40:52.382103+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:40:52.382103+0000","last_undegraded":"2024-04-26T12:40:52.382103+0000","last_fullsized":"2024-04-26T12:40:52.382103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389505+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:40:52.389505+0000","last_peered":"2024-04-26T12:40:52.389505+0000","last_clean":"2024-04-26T12:40:52.389505+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:40:52.389505+0000","last_undegraded":"2024-04-26T12:40:52.389505+0000","last_fullsized":"2024-04-26T12:40:52.389505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"85'6","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384620+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:40:52.384620+0000","last_peered":"2024-04-26T12:40:52.384620+0000","last_clean":"2024-04-26T12:40:52.384620+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:40:52.384620+0000","last_undegraded":"2024-04-26T12:40:52.384620+0000","last_fullsized":"2024-04-26T12:40:52.384620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"68'2","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390751+0000","last_change":"2024-04-26T12:38:32.098058+0000","last_active":"2024-04-26T12:40:52.390751+0000","last_peered":"2024-04-26T12:40:52.390751+0000","last_clean":"2024-04-26T12:40:52.390751+0000","last_became_active":"2024-04-26T12:38:32.095643+0000","last_became_peered":"2024-04-26T12:38:32.095643+0000","last_unstale":"2024-04-26T12:40:52.390751+0000","last_undegraded":"2024-04-26T12:40:52.390751+0000","last_fullsized":"2024-04-26T12:40:52.390751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:56.628368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"91'11","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394374+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:40:52.394374+0000","last_peered":"2024-04-26T12:40:52.394374+0000","last_clean":"2024-04-26T12:40:52.394374+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:40:52.394374+0000","last_undegraded":"2024-04-26T12:40:52.394374+0000","last_fullsized":"2024-04-26T12:40:52.394374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390393+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:40:52.390393+0000","last_peered":"2024-04-26T12:40:52.390393+0000","last_clean":"2024-04-26T12:40:52.390393+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:40:52.390393+0000","last_undegraded":"2024-04-26T12:40:52.390393+0000","last_fullsized":"2024-04-26T12:40:52.390393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"91'17","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384202+0000","last_change":"2024-04-26T12:38:32.096426+0000","last_active":"2024-04-26T12:40:52.384202+0000","last_peered":"2024-04-26T12:40:52.384202+0000","last_clean":"2024-04-26T12:40:52.384202+0000","last_became_active":"2024-04-26T12:38:32.095992+0000","last_became_peered":"2024-04-26T12:38:32.095992+0000","last_unstale":"2024-04-26T12:40:52.384202+0000","last_undegraded":"2024-04-26T12:40:52.384202+0000","last_fullsized":"2024-04-26T12:40:52.384202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:27.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383584+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:40:52.383584+0000","last_peered":"2024-04-26T12:40:52.383584+0000","last_clean":"2024-04-26T12:40:52.383584+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:40:52.383584+0000","last_undegraded":"2024-04-26T12:40:52.383584+0000","last_fullsized":"2024-04-26T12:40:52.383584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391095+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:40:52.391095+0000","last_peered":"2024-04-26T12:40:52.391095+0000","last_clean":"2024-04-26T12:40:52.391095+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:40:52.391095+0000","last_undegraded":"2024-04-26T12:40:52.391095+0000","last_fullsized":"2024-04-26T12:40:52.391095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390541+0000","last_change":"2024-04-26T12:38:32.097968+0000","last_active":"2024-04-26T12:40:52.390541+0000","last_peered":"2024-04-26T12:40:52.390541+0000","last_clean":"2024-04-26T12:40:52.390541+0000","last_became_active":"2024-04-26T12:38:32.095619+0000","last_became_peered":"2024-04-26T12:38:32.095619+0000","last_unstale":"2024-04-26T12:40:52.390541+0000","last_undegraded":"2024-04-26T12:40:52.390541+0000","last_fullsized":"2024-04-26T12:40:52.390541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398724+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:40:52.398724+0000","last_peered":"2024-04-26T12:40:52.398724+0000","last_clean":"2024-04-26T12:40:52.398724+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:40:52.398724+0000","last_undegraded":"2024-04-26T12:40:52.398724+0000","last_fullsized":"2024-04-26T12:40:52.398724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382823+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:40:52.382823+0000","last_peered":"2024-04-26T12:40:52.382823+0000","last_clean":"2024-04-26T12:40:52.382823+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:40:52.382823+0000","last_undegraded":"2024-04-26T12:40:52.382823+0000","last_fullsized":"2024-04-26T12:40:52.382823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"91'21","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390882+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:40:52.390882+0000","last_peered":"2024-04-26T12:40:52.390882+0000","last_clean":"2024-04-26T12:40:52.390882+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:40:52.390882+0000","last_undegraded":"2024-04-26T12:40:52.390882+0000","last_fullsized":"2024-04-26T12:40:52.390882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"91'107","reported_seq":296,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390399+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:40:52.390399+0000","last_peered":"2024-04-26T12:40:52.390399+0000","last_clean":"2024-04-26T12:40:52.390399+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:40:52.390399+0000","last_undegraded":"2024-04-26T12:40:52.390399+0000","last_fullsized":"2024-04-26T12:40:52.390399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381473+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:40:52.381473+0000","last_peered":"2024-04-26T12:40:52.381473+0000","last_clean":"2024-04-26T12:40:52.381473+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:40:52.381473+0000","last_undegraded":"2024-04-26T12:40:52.381473+0000","last_fullsized":"2024-04-26T12:40:52.381473+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400915+0000","last_change":"2024-04-26T12:38:32.098436+0000","last_active":"2024-04-26T12:40:52.400915+0000","last_peered":"2024-04-26T12:40:52.400915+0000","last_clean":"2024-04-26T12:40:52.400915+0000","last_became_active":"2024-04-26T12:38:32.097675+0000","last_became_peered":"2024-04-26T12:38:32.097675+0000","last_unstale":"2024-04-26T12:40:52.400915+0000","last_undegraded":"2024-04-26T12:40:52.400915+0000","last_fullsized":"2024-04-26T12:40:52.400915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:10.967994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"91'8","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389751+0000","last_change":"2024-04-26T12:38:32.091912+0000","last_active":"2024-04-26T12:40:52.389751+0000","last_peered":"2024-04-26T12:40:52.389751+0000","last_clean":"2024-04-26T12:40:52.389751+0000","last_became_active":"2024-04-26T12:38:32.091595+0000","last_became_peered":"2024-04-26T12:38:32.091595+0000","last_unstale":"2024-04-26T12:40:52.389751+0000","last_undegraded":"2024-04-26T12:40:52.389751+0000","last_fullsized":"2024-04-26T12:40:52.389751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:30.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":299,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397922+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:40:52.397922+0000","last_peered":"2024-04-26T12:40:52.397922+0000","last_clean":"2024-04-26T12:40:52.397922+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:40:52.397922+0000","last_undegraded":"2024-04-26T12:40:52.397922+0000","last_fullsized":"2024-04-26T12:40:52.397922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390312+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:40:52.390312+0000","last_peered":"2024-04-26T12:40:52.390312+0000","last_clean":"2024-04-26T12:40:52.390312+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:40:52.390312+0000","last_undegraded":"2024-04-26T12:40:52.390312+0000","last_fullsized":"2024-04-26T12:40:52.390312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"91'107","reported_seq":324,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399885+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:40:52.399885+0000","last_peered":"2024-04-26T12:40:52.399885+0000","last_clean":"2024-04-26T12:40:52.399885+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:40:52.399885+0000","last_undegraded":"2024-04-26T12:40:52.399885+0000","last_fullsized":"2024-04-26T12:40:52.399885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382068+0000","last_change":"2024-04-26T12:38:32.092303+0000","last_active":"2024-04-26T12:40:52.382068+0000","last_peered":"2024-04-26T12:40:52.382068+0000","last_clean":"2024-04-26T12:40:52.382068+0000","last_became_active":"2024-04-26T12:38:32.091872+0000","last_became_peered":"2024-04-26T12:38:32.091872+0000","last_unstale":"2024-04-26T12:40:52.382068+0000","last_undegraded":"2024-04-26T12:40:52.382068+0000","last_fullsized":"2024-04-26T12:40:52.382068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384843+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:40:52.384843+0000","last_peered":"2024-04-26T12:40:52.384843+0000","last_clean":"2024-04-26T12:40:52.384843+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:40:52.384843+0000","last_undegraded":"2024-04-26T12:40:52.384843+0000","last_fullsized":"2024-04-26T12:40:52.384843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392147+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:40:52.392147+0000","last_peered":"2024-04-26T12:40:52.392147+0000","last_clean":"2024-04-26T12:40:52.392147+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:40:52.392147+0000","last_undegraded":"2024-04-26T12:40:52.392147+0000","last_fullsized":"2024-04-26T12:40:52.392147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397019+0000","last_change":"2024-04-26T12:38:32.094763+0000","last_active":"2024-04-26T12:40:52.397019+0000","last_peered":"2024-04-26T12:40:52.397019+0000","last_clean":"2024-04-26T12:40:52.397019+0000","last_became_active":"2024-04-26T12:38:32.094384+0000","last_became_peered":"2024-04-26T12:38:32.094384+0000","last_unstale":"2024-04-26T12:40:52.397019+0000","last_undegraded":"2024-04-26T12:40:52.397019+0000","last_fullsized":"2024-04-26T12:40:52.397019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"91'24","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392811+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:40:52.392811+0000","last_peered":"2024-04-26T12:40:52.392811+0000","last_clean":"2024-04-26T12:40:52.392811+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:40:52.392811+0000","last_undegraded":"2024-04-26T12:40:52.392811+0000","last_fullsized":"2024-04-26T12:40:52.392811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398347+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:40:52.398347+0000","last_peered":"2024-04-26T12:40:52.398347+0000","last_clean":"2024-04-26T12:40:52.398347+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:40:52.398347+0000","last_undegraded":"2024-04-26T12:40:52.398347+0000","last_fullsized":"2024-04-26T12:40:52.398347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382363+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:40:52.382363+0000","last_peered":"2024-04-26T12:40:52.382363+0000","last_clean":"2024-04-26T12:40:52.382363+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:40:52.382363+0000","last_undegraded":"2024-04-26T12:40:52.382363+0000","last_fullsized":"2024-04-26T12:40:52.382363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400328+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:40:52.400328+0000","last_peered":"2024-04-26T12:40:52.400328+0000","last_clean":"2024-04-26T12:40:52.400328+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:40:52.400328+0000","last_undegraded":"2024-04-26T12:40:52.400328+0000","last_fullsized":"2024-04-26T12:40:52.400328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":317,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400163+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:40:52.400163+0000","last_peered":"2024-04-26T12:40:52.400163+0000","last_clean":"2024-04-26T12:40:52.400163+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:40:52.400163+0000","last_undegraded":"2024-04-26T12:40:52.400163+0000","last_fullsized":"2024-04-26T12:40:52.400163+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389381+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:40:52.389381+0000","last_peered":"2024-04-26T12:40:52.389381+0000","last_clean":"2024-04-26T12:40:52.389381+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:40:52.389381+0000","last_undegraded":"2024-04-26T12:40:52.389381+0000","last_fullsized":"2024-04-26T12:40:52.389381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"91'14","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394076+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:40:52.394076+0000","last_peered":"2024-04-26T12:40:52.394076+0000","last_clean":"2024-04-26T12:40:52.394076+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:40:52.394076+0000","last_undegraded":"2024-04-26T12:40:52.394076+0000","last_fullsized":"2024-04-26T12:40:52.394076+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395821+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:40:52.395821+0000","last_peered":"2024-04-26T12:40:52.395821+0000","last_clean":"2024-04-26T12:40:52.395821+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:40:52.395821+0000","last_undegraded":"2024-04-26T12:40:52.395821+0000","last_fullsized":"2024-04-26T12:40:52.395821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"91'32","reported_seq":197,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398199+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:40:52.398199+0000","last_peered":"2024-04-26T12:40:52.398199+0000","last_clean":"2024-04-26T12:40:52.398199+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:40:52.398199+0000","last_undegraded":"2024-04-26T12:40:52.398199+0000","last_fullsized":"2024-04-26T12:40:52.398199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382862+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:40:52.382862+0000","last_peered":"2024-04-26T12:40:52.382862+0000","last_clean":"2024-04-26T12:40:52.382862+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:40:52.382862+0000","last_undegraded":"2024-04-26T12:40:52.382862+0000","last_fullsized":"2024-04-26T12:40:52.382862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393262+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:40:52.393262+0000","last_peered":"2024-04-26T12:40:52.393262+0000","last_clean":"2024-04-26T12:40:52.393262+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:40:52.393262+0000","last_undegraded":"2024-04-26T12:40:52.393262+0000","last_fullsized":"2024-04-26T12:40:52.393262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383223+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:40:52.383223+0000","last_peered":"2024-04-26T12:40:52.383223+0000","last_clean":"2024-04-26T12:40:52.383223+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:40:52.383223+0000","last_undegraded":"2024-04-26T12:40:52.383223+0000","last_fullsized":"2024-04-26T12:40:52.383223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396680+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:40:52.396680+0000","last_peered":"2024-04-26T12:40:52.396680+0000","last_clean":"2024-04-26T12:40:52.396680+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:40:52.396680+0000","last_undegraded":"2024-04-26T12:40:52.396680+0000","last_fullsized":"2024-04-26T12:40:52.396680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"91'4","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382198+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:40:52.382198+0000","last_peered":"2024-04-26T12:40:52.382198+0000","last_clean":"2024-04-26T12:40:52.382198+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:40:52.382198+0000","last_undegraded":"2024-04-26T12:40:52.382198+0000","last_fullsized":"2024-04-26T12:40:52.382198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398540+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:40:52.398540+0000","last_peered":"2024-04-26T12:40:52.398540+0000","last_clean":"2024-04-26T12:40:52.398540+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:40:52.398540+0000","last_undegraded":"2024-04-26T12:40:52.398540+0000","last_fullsized":"2024-04-26T12:40:52.398540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"91'112","reported_seq":346,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382680+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:40:52.382680+0000","last_peered":"2024-04-26T12:40:52.382680+0000","last_clean":"2024-04-26T12:40:52.382680+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:40:52.382680+0000","last_undegraded":"2024-04-26T12:40:52.382680+0000","last_fullsized":"2024-04-26T12:40:52.382680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":149,"num_read_kb":134,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396316+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:40:52.396316+0000","last_peered":"2024-04-26T12:40:52.396316+0000","last_clean":"2024-04-26T12:40:52.396316+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:40:52.396316+0000","last_undegraded":"2024-04-26T12:40:52.396316+0000","last_fullsized":"2024-04-26T12:40:52.396316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381472+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:40:52.381472+0000","last_peered":"2024-04-26T12:40:52.381472+0000","last_clean":"2024-04-26T12:40:52.381472+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:40:52.381472+0000","last_undegraded":"2024-04-26T12:40:52.381472+0000","last_fullsized":"2024-04-26T12:40:52.381472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"74'8","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384903+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:40:52.384903+0000","last_peered":"2024-04-26T12:40:52.384903+0000","last_clean":"2024-04-26T12:40:52.384903+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:40:52.384903+0000","last_undegraded":"2024-04-26T12:40:52.384903+0000","last_fullsized":"2024-04-26T12:40:52.384903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390260+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:40:52.390260+0000","last_peered":"2024-04-26T12:40:52.390260+0000","last_clean":"2024-04-26T12:40:52.390260+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:40:52.390260+0000","last_undegraded":"2024-04-26T12:40:52.390260+0000","last_fullsized":"2024-04-26T12:40:52.390260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"91'19","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.380799+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:40:52.380799+0000","last_peered":"2024-04-26T12:40:52.380799+0000","last_clean":"2024-04-26T12:40:52.380799+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:40:52.380799+0000","last_undegraded":"2024-04-26T12:40:52.380799+0000","last_fullsized":"2024-04-26T12:40:52.380799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":227,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391190+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:40:52.391190+0000","last_peered":"2024-04-26T12:40:52.391190+0000","last_clean":"2024-04-26T12:40:52.391190+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:40:52.391190+0000","last_undegraded":"2024-04-26T12:40:52.391190+0000","last_fullsized":"2024-04-26T12:40:52.391190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"91'17","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397415+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:40:52.397415+0000","last_peered":"2024-04-26T12:40:52.397415+0000","last_clean":"2024-04-26T12:40:52.397415+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:40:52.397415+0000","last_undegraded":"2024-04-26T12:40:52.397415+0000","last_fullsized":"2024-04-26T12:40:52.397415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382777+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:40:52.382777+0000","last_peered":"2024-04-26T12:40:52.382777+0000","last_clean":"2024-04-26T12:40:52.382777+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:40:52.382777+0000","last_undegraded":"2024-04-26T12:40:52.382777+0000","last_fullsized":"2024-04-26T12:40:52.382777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394945+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:40:52.394945+0000","last_peered":"2024-04-26T12:40:52.394945+0000","last_clean":"2024-04-26T12:40:52.394945+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:40:52.394945+0000","last_undegraded":"2024-04-26T12:40:52.394945+0000","last_fullsized":"2024-04-26T12:40:52.394945+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383127+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:40:52.383127+0000","last_peered":"2024-04-26T12:40:52.383127+0000","last_clean":"2024-04-26T12:40:52.383127+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:40:52.383127+0000","last_undegraded":"2024-04-26T12:40:52.383127+0000","last_fullsized":"2024-04-26T12:40:52.383127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389724+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:40:52.389724+0000","last_peered":"2024-04-26T12:40:52.389724+0000","last_clean":"2024-04-26T12:40:52.389724+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:40:52.389724+0000","last_undegraded":"2024-04-26T12:40:52.389724+0000","last_fullsized":"2024-04-26T12:40:52.389724+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383463+0000","last_change":"2024-04-26T12:38:32.099375+0000","last_active":"2024-04-26T12:40:52.383463+0000","last_peered":"2024-04-26T12:40:52.383463+0000","last_clean":"2024-04-26T12:40:52.383463+0000","last_became_active":"2024-04-26T12:38:32.098983+0000","last_became_peered":"2024-04-26T12:38:32.098983+0000","last_unstale":"2024-04-26T12:40:52.383463+0000","last_undegraded":"2024-04-26T12:40:52.383463+0000","last_fullsized":"2024-04-26T12:40:52.383463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.281648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382427+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:40:52.382427+0000","last_peered":"2024-04-26T12:40:52.382427+0000","last_clean":"2024-04-26T12:40:52.382427+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:40:52.382427+0000","last_undegraded":"2024-04-26T12:40:52.382427+0000","last_fullsized":"2024-04-26T12:40:52.382427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395578+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:40:52.395578+0000","last_peered":"2024-04-26T12:40:52.395578+0000","last_clean":"2024-04-26T12:40:52.395578+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:40:52.395578+0000","last_undegraded":"2024-04-26T12:40:52.395578+0000","last_fullsized":"2024-04-26T12:40:52.395578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401429+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:40:52.401429+0000","last_peered":"2024-04-26T12:40:52.401429+0000","last_clean":"2024-04-26T12:40:52.401429+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:40:52.401429+0000","last_undegraded":"2024-04-26T12:40:52.401429+0000","last_fullsized":"2024-04-26T12:40:52.401429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389570+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:40:52.389570+0000","last_peered":"2024-04-26T12:40:52.389570+0000","last_clean":"2024-04-26T12:40:52.389570+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:40:52.389570+0000","last_undegraded":"2024-04-26T12:40:52.389570+0000","last_fullsized":"2024-04-26T12:40:52.389570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381923+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:40:52.381923+0000","last_peered":"2024-04-26T12:40:52.381923+0000","last_clean":"2024-04-26T12:40:52.381923+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:40:52.381923+0000","last_undegraded":"2024-04-26T12:40:52.381923+0000","last_fullsized":"2024-04-26T12:40:52.381923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"91'8","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396553+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:40:52.396553+0000","last_peered":"2024-04-26T12:40:52.396553+0000","last_clean":"2024-04-26T12:40:52.396553+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:40:52.396553+0000","last_undegraded":"2024-04-26T12:40:52.396553+0000","last_fullsized":"2024-04-26T12:40:52.396553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383559+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:40:52.383559+0000","last_peered":"2024-04-26T12:40:52.383559+0000","last_clean":"2024-04-26T12:40:52.383559+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:40:52.383559+0000","last_undegraded":"2024-04-26T12:40:52.383559+0000","last_fullsized":"2024-04-26T12:40:52.383559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383078+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:40:52.383078+0000","last_peered":"2024-04-26T12:40:52.383078+0000","last_clean":"2024-04-26T12:40:52.383078+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:40:52.383078+0000","last_undegraded":"2024-04-26T12:40:52.383078+0000","last_fullsized":"2024-04-26T12:40:52.383078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"91'30","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381398+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:40:52.381398+0000","last_peered":"2024-04-26T12:40:52.381398+0000","last_clean":"2024-04-26T12:40:52.381398+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:40:52.381398+0000","last_undegraded":"2024-04-26T12:40:52.381398+0000","last_fullsized":"2024-04-26T12:40:52.381398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392506+0000","last_change":"2024-04-26T12:38:32.094008+0000","last_active":"2024-04-26T12:40:52.392506+0000","last_peered":"2024-04-26T12:40:52.392506+0000","last_clean":"2024-04-26T12:40:52.392506+0000","last_became_active":"2024-04-26T12:38:32.092362+0000","last_became_peered":"2024-04-26T12:38:32.092362+0000","last_unstale":"2024-04-26T12:40:52.392506+0000","last_undegraded":"2024-04-26T12:40:52.392506+0000","last_fullsized":"2024-04-26T12:40:52.392506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.395782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382469+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:40:52.382469+0000","last_peered":"2024-04-26T12:40:52.382469+0000","last_clean":"2024-04-26T12:40:52.382469+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:40:52.382469+0000","last_undegraded":"2024-04-26T12:40:52.382469+0000","last_fullsized":"2024-04-26T12:40:52.382469+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383602+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:40:52.383602+0000","last_peered":"2024-04-26T12:40:52.383602+0000","last_clean":"2024-04-26T12:40:52.383602+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:40:52.383602+0000","last_undegraded":"2024-04-26T12:40:52.383602+0000","last_fullsized":"2024-04-26T12:40:52.383602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"91'10","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383275+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:40:52.383275+0000","last_peered":"2024-04-26T12:40:52.383275+0000","last_clean":"2024-04-26T12:40:52.383275+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:40:52.383275+0000","last_undegraded":"2024-04-26T12:40:52.383275+0000","last_fullsized":"2024-04-26T12:40:52.383275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400633+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:40:52.400633+0000","last_peered":"2024-04-26T12:40:52.400633+0000","last_clean":"2024-04-26T12:40:52.400633+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:40:52.400633+0000","last_undegraded":"2024-04-26T12:40:52.400633+0000","last_fullsized":"2024-04-26T12:40:52.400633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398007+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:40:52.398007+0000","last_peered":"2024-04-26T12:40:52.398007+0000","last_clean":"2024-04-26T12:40:52.398007+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:40:52.398007+0000","last_undegraded":"2024-04-26T12:40:52.398007+0000","last_fullsized":"2024-04-26T12:40:52.398007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.380990+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:40:52.380990+0000","last_peered":"2024-04-26T12:40:52.380990+0000","last_clean":"2024-04-26T12:40:52.380990+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:40:52.380990+0000","last_undegraded":"2024-04-26T12:40:52.380990+0000","last_fullsized":"2024-04-26T12:40:52.380990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"91'107","reported_seq":285,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390457+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:40:52.390457+0000","last_peered":"2024-04-26T12:40:52.390457+0000","last_clean":"2024-04-26T12:40:52.390457+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:40:52.390457+0000","last_undegraded":"2024-04-26T12:40:52.390457+0000","last_fullsized":"2024-04-26T12:40:52.390457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395588+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:40:52.395588+0000","last_peered":"2024-04-26T12:40:52.395588+0000","last_clean":"2024-04-26T12:40:52.395588+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:40:52.395588+0000","last_undegraded":"2024-04-26T12:40:52.395588+0000","last_fullsized":"2024-04-26T12:40:52.395588+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391600+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:40:52.391600+0000","last_peered":"2024-04-26T12:40:52.391600+0000","last_clean":"2024-04-26T12:40:52.391600+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:40:52.391600+0000","last_undegraded":"2024-04-26T12:40:52.391600+0000","last_fullsized":"2024-04-26T12:40:52.391600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"91'3","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395300+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:40:52.395300+0000","last_peered":"2024-04-26T12:40:52.395300+0000","last_clean":"2024-04-26T12:40:52.395300+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:40:52.395300+0000","last_undegraded":"2024-04-26T12:40:52.395300+0000","last_fullsized":"2024-04-26T12:40:52.395300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384535+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:40:52.384535+0000","last_peered":"2024-04-26T12:40:52.384535+0000","last_clean":"2024-04-26T12:40:52.384535+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:40:52.384535+0000","last_undegraded":"2024-04-26T12:40:52.384535+0000","last_fullsized":"2024-04-26T12:40:52.384535+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392399+0000","last_change":"2024-04-26T12:38:32.094625+0000","last_active":"2024-04-26T12:40:52.392399+0000","last_peered":"2024-04-26T12:40:52.392399+0000","last_clean":"2024-04-26T12:40:52.392399+0000","last_became_active":"2024-04-26T12:38:32.093266+0000","last_became_peered":"2024-04-26T12:38:32.093266+0000","last_unstale":"2024-04-26T12:40:52.392399+0000","last_undegraded":"2024-04-26T12:40:52.392399+0000","last_fullsized":"2024-04-26T12:40:52.392399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:18:18.695479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393718+0000","last_change":"2024-04-26T12:38:32.097625+0000","last_active":"2024-04-26T12:40:52.393718+0000","last_peered":"2024-04-26T12:40:52.393718+0000","last_clean":"2024-04-26T12:40:52.393718+0000","last_became_active":"2024-04-26T12:38:32.097186+0000","last_became_peered":"2024-04-26T12:38:32.097186+0000","last_unstale":"2024-04-26T12:40:52.393718+0000","last_undegraded":"2024-04-26T12:40:52.393718+0000","last_fullsized":"2024-04-26T12:40:52.393718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:09.866995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"91'107","reported_seq":284,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395810+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:40:52.395810+0000","last_peered":"2024-04-26T12:40:52.395810+0000","last_clean":"2024-04-26T12:40:52.395810+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:40:52.395810+0000","last_undegraded":"2024-04-26T12:40:52.395810+0000","last_fullsized":"2024-04-26T12:40:52.395810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382909+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:40:52.382909+0000","last_peered":"2024-04-26T12:40:52.382909+0000","last_clean":"2024-04-26T12:40:52.382909+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:40:52.382909+0000","last_undegraded":"2024-04-26T12:40:52.382909+0000","last_fullsized":"2024-04-26T12:40:52.382909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391268+0000","last_change":"2024-04-26T12:38:32.089371+0000","last_active":"2024-04-26T12:40:52.391268+0000","last_peered":"2024-04-26T12:40:52.391268+0000","last_clean":"2024-04-26T12:40:52.391268+0000","last_became_active":"2024-04-26T12:38:32.088665+0000","last_became_peered":"2024-04-26T12:38:32.088665+0000","last_unstale":"2024-04-26T12:40:52.391268+0000","last_undegraded":"2024-04-26T12:40:52.391268+0000","last_fullsized":"2024-04-26T12:40:52.391268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:48.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"91'9","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383582+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:40:52.383582+0000","last_peered":"2024-04-26T12:40:52.383582+0000","last_clean":"2024-04-26T12:40:52.383582+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:40:52.383582+0000","last_undegraded":"2024-04-26T12:40:52.383582+0000","last_fullsized":"2024-04-26T12:40:52.383582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.402016+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:40:52.402016+0000","last_peered":"2024-04-26T12:40:52.402016+0000","last_clean":"2024-04-26T12:40:52.402016+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:40:52.402016+0000","last_undegraded":"2024-04-26T12:40:52.402016+0000","last_fullsized":"2024-04-26T12:40:52.402016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391411+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:40:52.391411+0000","last_peered":"2024-04-26T12:40:52.391411+0000","last_clean":"2024-04-26T12:40:52.391411+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:40:52.391411+0000","last_undegraded":"2024-04-26T12:40:52.391411+0000","last_fullsized":"2024-04-26T12:40:52.391411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"91'37","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394465+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:40:52.394465+0000","last_peered":"2024-04-26T12:40:52.394465+0000","last_clean":"2024-04-26T12:40:52.394465+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:40:52.394465+0000","last_undegraded":"2024-04-26T12:40:52.394465+0000","last_fullsized":"2024-04-26T12:40:52.394465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393591+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:40:52.393591+0000","last_peered":"2024-04-26T12:40:52.393591+0000","last_clean":"2024-04-26T12:40:52.393591+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:40:52.393591+0000","last_undegraded":"2024-04-26T12:40:52.393591+0000","last_fullsized":"2024-04-26T12:40:52.393591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392472+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:40:52.392472+0000","last_peered":"2024-04-26T12:40:52.392472+0000","last_clean":"2024-04-26T12:40:52.392472+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:40:52.392472+0000","last_undegraded":"2024-04-26T12:40:52.392472+0000","last_fullsized":"2024-04-26T12:40:52.392472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383283+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:40:52.383283+0000","last_peered":"2024-04-26T12:40:52.383283+0000","last_clean":"2024-04-26T12:40:52.383283+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:40:52.383283+0000","last_undegraded":"2024-04-26T12:40:52.383283+0000","last_fullsized":"2024-04-26T12:40:52.383283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397657+0000","last_change":"2024-04-26T12:38:32.098082+0000","last_active":"2024-04-26T12:40:52.397657+0000","last_peered":"2024-04-26T12:40:52.397657+0000","last_clean":"2024-04-26T12:40:52.397657+0000","last_became_active":"2024-04-26T12:38:32.097658+0000","last_became_peered":"2024-04-26T12:38:32.097658+0000","last_unstale":"2024-04-26T12:40:52.397657+0000","last_undegraded":"2024-04-26T12:40:52.397657+0000","last_fullsized":"2024-04-26T12:40:52.397657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:15.092930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"91'5","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396496+0000","last_change":"2024-04-26T12:38:32.090992+0000","last_active":"2024-04-26T12:40:52.396496+0000","last_peered":"2024-04-26T12:40:52.396496+0000","last_clean":"2024-04-26T12:40:52.396496+0000","last_became_active":"2024-04-26T12:38:32.090197+0000","last_became_peered":"2024-04-26T12:38:32.090197+0000","last_unstale":"2024-04-26T12:40:52.396496+0000","last_undegraded":"2024-04-26T12:40:52.396496+0000","last_fullsized":"2024-04-26T12:40:52.396496+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:51.388263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382091+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:40:52.382091+0000","last_peered":"2024-04-26T12:40:52.382091+0000","last_clean":"2024-04-26T12:40:52.382091+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:40:52.382091+0000","last_undegraded":"2024-04-26T12:40:52.382091+0000","last_fullsized":"2024-04-26T12:40:52.382091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"91'17","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392281+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:40:52.392281+0000","last_peered":"2024-04-26T12:40:52.392281+0000","last_clean":"2024-04-26T12:40:52.392281+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:40:52.392281+0000","last_undegraded":"2024-04-26T12:40:52.392281+0000","last_fullsized":"2024-04-26T12:40:52.392281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391223+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:40:52.391223+0000","last_peered":"2024-04-26T12:40:52.391223+0000","last_clean":"2024-04-26T12:40:52.391223+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:40:52.391223+0000","last_undegraded":"2024-04-26T12:40:52.391223+0000","last_fullsized":"2024-04-26T12:40:52.391223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395138+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:40:52.395138+0000","last_peered":"2024-04-26T12:40:52.395138+0000","last_clean":"2024-04-26T12:40:52.395138+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:40:52.395138+0000","last_undegraded":"2024-04-26T12:40:52.395138+0000","last_fullsized":"2024-04-26T12:40:52.395138+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381794+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:40:52.381794+0000","last_peered":"2024-04-26T12:40:52.381794+0000","last_clean":"2024-04-26T12:40:52.381794+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:40:52.381794+0000","last_undegraded":"2024-04-26T12:40:52.381794+0000","last_fullsized":"2024-04-26T12:40:52.381794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"91'4","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399935+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:40:52.399935+0000","last_peered":"2024-04-26T12:40:52.399935+0000","last_clean":"2024-04-26T12:40:52.399935+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:40:52.399935+0000","last_undegraded":"2024-04-26T12:40:52.399935+0000","last_fullsized":"2024-04-26T12:40:52.399935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394801+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:40:52.394801+0000","last_peered":"2024-04-26T12:40:52.394801+0000","last_clean":"2024-04-26T12:40:52.394801+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:40:52.394801+0000","last_undegraded":"2024-04-26T12:40:52.394801+0000","last_fullsized":"2024-04-26T12:40:52.394801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"93'7","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381211+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:40:52.381211+0000","last_peered":"2024-04-26T12:40:52.381211+0000","last_clean":"2024-04-26T12:40:52.381211+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:40:52.381211+0000","last_undegraded":"2024-04-26T12:40:52.381211+0000","last_fullsized":"2024-04-26T12:40:52.381211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":26,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394828+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:40:52.394828+0000","last_peered":"2024-04-26T12:40:52.394828+0000","last_clean":"2024-04-26T12:40:52.394828+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:40:52.394828+0000","last_undegraded":"2024-04-26T12:40:52.394828+0000","last_fullsized":"2024-04-26T12:40:52.394828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382375+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:40:52.382375+0000","last_peered":"2024-04-26T12:40:52.382375+0000","last_clean":"2024-04-26T12:40:52.382375+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:40:52.382375+0000","last_undegraded":"2024-04-26T12:40:52.382375+0000","last_fullsized":"2024-04-26T12:40:52.382375+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392844+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:40:52.392844+0000","last_peered":"2024-04-26T12:40:52.392844+0000","last_clean":"2024-04-26T12:40:52.392844+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:40:52.392844+0000","last_undegraded":"2024-04-26T12:40:52.392844+0000","last_fullsized":"2024-04-26T12:40:52.392844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"91'4","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397620+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:40:52.397620+0000","last_peered":"2024-04-26T12:40:52.397620+0000","last_clean":"2024-04-26T12:40:52.397620+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:40:52.397620+0000","last_undegraded":"2024-04-26T12:40:52.397620+0000","last_fullsized":"2024-04-26T12:40:52.397620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397466+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:40:52.397466+0000","last_peered":"2024-04-26T12:40:52.397466+0000","last_clean":"2024-04-26T12:40:52.397466+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:40:52.397466+0000","last_undegraded":"2024-04-26T12:40:52.397466+0000","last_fullsized":"2024-04-26T12:40:52.397466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"91'17","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394523+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:40:52.394523+0000","last_peered":"2024-04-26T12:40:52.394523+0000","last_clean":"2024-04-26T12:40:52.394523+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:40:52.394523+0000","last_undegraded":"2024-04-26T12:40:52.394523+0000","last_fullsized":"2024-04-26T12:40:52.394523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397907+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:40:52.397907+0000","last_peered":"2024-04-26T12:40:52.397907+0000","last_clean":"2024-04-26T12:40:52.397907+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:40:52.397907+0000","last_undegraded":"2024-04-26T12:40:52.397907+0000","last_fullsized":"2024-04-26T12:40:52.397907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391195+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:40:52.391195+0000","last_peered":"2024-04-26T12:40:52.391195+0000","last_clean":"2024-04-26T12:40:52.391195+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:40:52.391195+0000","last_undegraded":"2024-04-26T12:40:52.391195+0000","last_fullsized":"2024-04-26T12:40:52.391195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391795+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:40:52.391795+0000","last_peered":"2024-04-26T12:40:52.391795+0000","last_clean":"2024-04-26T12:40:52.391795+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:40:52.391795+0000","last_undegraded":"2024-04-26T12:40:52.391795+0000","last_fullsized":"2024-04-26T12:40:52.391795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"91'6","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384357+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:40:52.384357+0000","last_peered":"2024-04-26T12:40:52.384357+0000","last_clean":"2024-04-26T12:40:52.384357+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:40:52.384357+0000","last_undegraded":"2024-04-26T12:40:52.384357+0000","last_fullsized":"2024-04-26T12:40:52.384357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397204+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:40:52.397204+0000","last_peered":"2024-04-26T12:40:52.397204+0000","last_clean":"2024-04-26T12:40:52.397204+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:40:52.397204+0000","last_undegraded":"2024-04-26T12:40:52.397204+0000","last_fullsized":"2024-04-26T12:40:52.397204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"91'17","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393831+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:40:52.393831+0000","last_peered":"2024-04-26T12:40:52.393831+0000","last_clean":"2024-04-26T12:40:52.393831+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:40:52.393831+0000","last_undegraded":"2024-04-26T12:40:52.393831+0000","last_fullsized":"2024-04-26T12:40:52.393831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382507+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:40:52.382507+0000","last_peered":"2024-04-26T12:40:52.382507+0000","last_clean":"2024-04-26T12:40:52.382507+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:40:52.382507+0000","last_undegraded":"2024-04-26T12:40:52.382507+0000","last_fullsized":"2024-04-26T12:40:52.382507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401799+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:40:52.401799+0000","last_peered":"2024-04-26T12:40:52.401799+0000","last_clean":"2024-04-26T12:40:52.401799+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:40:52.401799+0000","last_undegraded":"2024-04-26T12:40:52.401799+0000","last_fullsized":"2024-04-26T12:40:52.401799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'9","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392029+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:40:52.392029+0000","last_peered":"2024-04-26T12:40:52.392029+0000","last_clean":"2024-04-26T12:40:52.392029+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:40:52.392029+0000","last_undegraded":"2024-04-26T12:40:52.392029+0000","last_fullsized":"2024-04-26T12:40:52.392029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382964+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:40:52.382964+0000","last_peered":"2024-04-26T12:40:52.382964+0000","last_clean":"2024-04-26T12:40:52.382964+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:40:52.382964+0000","last_undegraded":"2024-04-26T12:40:52.382964+0000","last_fullsized":"2024-04-26T12:40:52.382964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"91'24","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382854+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:40:52.382854+0000","last_peered":"2024-04-26T12:40:52.382854+0000","last_clean":"2024-04-26T12:40:52.382854+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:40:52.382854+0000","last_undegraded":"2024-04-26T12:40:52.382854+0000","last_fullsized":"2024-04-26T12:40:52.382854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391617+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:40:52.391617+0000","last_peered":"2024-04-26T12:40:52.391617+0000","last_clean":"2024-04-26T12:40:52.391617+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:40:52.391617+0000","last_undegraded":"2024-04-26T12:40:52.391617+0000","last_fullsized":"2024-04-26T12:40:52.391617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394238+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:40:52.394238+0000","last_peered":"2024-04-26T12:40:52.394238+0000","last_clean":"2024-04-26T12:40:52.394238+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:40:52.394238+0000","last_undegraded":"2024-04-26T12:40:52.394238+0000","last_fullsized":"2024-04-26T12:40:52.394238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":214,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383112+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:40:52.383112+0000","last_peered":"2024-04-26T12:40:52.383112+0000","last_clean":"2024-04-26T12:40:52.383112+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:40:52.383112+0000","last_undegraded":"2024-04-26T12:40:52.383112+0000","last_fullsized":"2024-04-26T12:40:52.383112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'13","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384567+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:40:52.384567+0000","last_peered":"2024-04-26T12:40:52.384567+0000","last_clean":"2024-04-26T12:40:52.384567+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:40:52.384567+0000","last_undegraded":"2024-04-26T12:40:52.384567+0000","last_fullsized":"2024-04-26T12:40:52.384567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401567+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:40:52.401567+0000","last_peered":"2024-04-26T12:40:52.401567+0000","last_clean":"2024-04-26T12:40:52.401567+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:40:52.401567+0000","last_undegraded":"2024-04-26T12:40:52.401567+0000","last_fullsized":"2024-04-26T12:40:52.401567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"91'21","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395238+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:40:52.395238+0000","last_peered":"2024-04-26T12:40:52.395238+0000","last_clean":"2024-04-26T12:40:52.395238+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:40:52.395238+0000","last_undegraded":"2024-04-26T12:40:52.395238+0000","last_fullsized":"2024-04-26T12:40:52.395238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383008+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:40:52.383008+0000","last_peered":"2024-04-26T12:40:52.383008+0000","last_clean":"2024-04-26T12:40:52.383008+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:40:52.383008+0000","last_undegraded":"2024-04-26T12:40:52.383008+0000","last_fullsized":"2024-04-26T12:40:52.383008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397238+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:40:52.397238+0000","last_peered":"2024-04-26T12:40:52.397238+0000","last_clean":"2024-04-26T12:40:52.397238+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:40:52.397238+0000","last_undegraded":"2024-04-26T12:40:52.397238+0000","last_fullsized":"2024-04-26T12:40:52.397238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390062+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:40:52.390062+0000","last_peered":"2024-04-26T12:40:52.390062+0000","last_clean":"2024-04-26T12:40:52.390062+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:40:52.390062+0000","last_undegraded":"2024-04-26T12:40:52.390062+0000","last_fullsized":"2024-04-26T12:40:52.390062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382344+0000","last_change":"2024-04-26T12:38:32.097004+0000","last_active":"2024-04-26T12:40:52.382344+0000","last_peered":"2024-04-26T12:40:52.382344+0000","last_clean":"2024-04-26T12:40:52.382344+0000","last_became_active":"2024-04-26T12:38:32.096196+0000","last_became_peered":"2024-04-26T12:38:32.096196+0000","last_unstale":"2024-04-26T12:40:52.382344+0000","last_undegraded":"2024-04-26T12:40:52.382344+0000","last_fullsized":"2024-04-26T12:40:52.382344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:00.173484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390434+0000","last_change":"2024-04-26T12:38:32.100356+0000","last_active":"2024-04-26T12:40:52.390434+0000","last_peered":"2024-04-26T12:40:52.390434+0000","last_clean":"2024-04-26T12:40:52.390434+0000","last_became_active":"2024-04-26T12:38:32.099529+0000","last_became_peered":"2024-04-26T12:38:32.099529+0000","last_unstale":"2024-04-26T12:40:52.390434+0000","last_undegraded":"2024-04-26T12:40:52.390434+0000","last_fullsized":"2024-04-26T12:40:52.390434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:32.397561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"91'17","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395817+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:40:52.395817+0000","last_peered":"2024-04-26T12:40:52.395817+0000","last_clean":"2024-04-26T12:40:52.395817+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:40:52.395817+0000","last_undegraded":"2024-04-26T12:40:52.395817+0000","last_fullsized":"2024-04-26T12:40:52.395817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383956+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:40:52.383956+0000","last_peered":"2024-04-26T12:40:52.383956+0000","last_clean":"2024-04-26T12:40:52.383956+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:40:52.383956+0000","last_undegraded":"2024-04-26T12:40:52.383956+0000","last_fullsized":"2024-04-26T12:40:52.383956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390505+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:40:52.390505+0000","last_peered":"2024-04-26T12:40:52.390505+0000","last_clean":"2024-04-26T12:40:52.390505+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:40:52.390505+0000","last_undegraded":"2024-04-26T12:40:52.390505+0000","last_fullsized":"2024-04-26T12:40:52.390505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392224+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:40:52.392224+0000","last_peered":"2024-04-26T12:40:52.392224+0000","last_clean":"2024-04-26T12:40:52.392224+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:40:52.392224+0000","last_undegraded":"2024-04-26T12:40:52.392224+0000","last_fullsized":"2024-04-26T12:40:52.392224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382641+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:40:52.382641+0000","last_peered":"2024-04-26T12:40:52.382641+0000","last_clean":"2024-04-26T12:40:52.382641+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:40:52.382641+0000","last_undegraded":"2024-04-26T12:40:52.382641+0000","last_fullsized":"2024-04-26T12:40:52.382641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383458+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:40:52.383458+0000","last_peered":"2024-04-26T12:40:52.383458+0000","last_clean":"2024-04-26T12:40:52.383458+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:40:52.383458+0000","last_undegraded":"2024-04-26T12:40:52.383458+0000","last_fullsized":"2024-04-26T12:40:52.383458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"68'11","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401614+0000","last_change":"2024-04-26T12:38:32.098589+0000","last_active":"2024-04-26T12:40:52.401614+0000","last_peered":"2024-04-26T12:40:52.401614+0000","last_clean":"2024-04-26T12:40:52.401614+0000","last_became_active":"2024-04-26T12:38:32.097940+0000","last_became_peered":"2024-04-26T12:38:32.097940+0000","last_unstale":"2024-04-26T12:40:52.401614+0000","last_undegraded":"2024-04-26T12:40:52.401614+0000","last_fullsized":"2024-04-26T12:40:52.401614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"91'107","reported_seq":287,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401163+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:40:52.401163+0000","last_peered":"2024-04-26T12:40:52.401163+0000","last_clean":"2024-04-26T12:40:52.401163+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:40:52.401163+0000","last_undegraded":"2024-04-26T12:40:52.401163+0000","last_fullsized":"2024-04-26T12:40:52.401163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397126+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:40:52.397126+0000","last_peered":"2024-04-26T12:40:52.397126+0000","last_clean":"2024-04-26T12:40:52.397126+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:40:52.397126+0000","last_undegraded":"2024-04-26T12:40:52.397126+0000","last_fullsized":"2024-04-26T12:40:52.397126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"91'8","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395379+0000","last_change":"2024-04-26T12:38:32.097299+0000","last_active":"2024-04-26T12:40:52.395379+0000","last_peered":"2024-04-26T12:40:52.395379+0000","last_clean":"2024-04-26T12:40:52.395379+0000","last_became_active":"2024-04-26T12:38:32.096485+0000","last_became_peered":"2024-04-26T12:38:32.096485+0000","last_unstale":"2024-04-26T12:40:52.395379+0000","last_undegraded":"2024-04-26T12:40:52.395379+0000","last_fullsized":"2024-04-26T12:40:52.395379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:18.433433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391935+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:40:52.391935+0000","last_peered":"2024-04-26T12:40:52.391935+0000","last_clean":"2024-04-26T12:40:52.391935+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:40:52.391935+0000","last_undegraded":"2024-04-26T12:40:52.391935+0000","last_fullsized":"2024-04-26T12:40:52.391935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394201+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:40:52.394201+0000","last_peered":"2024-04-26T12:40:52.394201+0000","last_clean":"2024-04-26T12:40:52.394201+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:40:52.394201+0000","last_undegraded":"2024-04-26T12:40:52.394201+0000","last_fullsized":"2024-04-26T12:40:52.394201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"91'22","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390980+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:40:52.390980+0000","last_peered":"2024-04-26T12:40:52.390980+0000","last_clean":"2024-04-26T12:40:52.390980+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:40:52.390980+0000","last_undegraded":"2024-04-26T12:40:52.390980+0000","last_fullsized":"2024-04-26T12:40:52.390980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.380854+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:40:52.380854+0000","last_peered":"2024-04-26T12:40:52.380854+0000","last_clean":"2024-04-26T12:40:52.380854+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:40:52.380854+0000","last_undegraded":"2024-04-26T12:40:52.380854+0000","last_fullsized":"2024-04-26T12:40:52.380854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399030+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:40:52.399030+0000","last_peered":"2024-04-26T12:40:52.399030+0000","last_clean":"2024-04-26T12:40:52.399030+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:40:52.399030+0000","last_undegraded":"2024-04-26T12:40:52.399030+0000","last_fullsized":"2024-04-26T12:40:52.399030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'2","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393863+0000","last_change":"2024-04-26T12:38:32.097693+0000","last_active":"2024-04-26T12:40:52.393863+0000","last_peered":"2024-04-26T12:40:52.393863+0000","last_clean":"2024-04-26T12:40:52.393863+0000","last_became_active":"2024-04-26T12:38:32.096141+0000","last_became_peered":"2024-04-26T12:38:32.096141+0000","last_unstale":"2024-04-26T12:40:52.393863+0000","last_undegraded":"2024-04-26T12:40:52.393863+0000","last_fullsized":"2024-04-26T12:40:52.393863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.450059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"91'12","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396255+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:40:52.396255+0000","last_peered":"2024-04-26T12:40:52.396255+0000","last_clean":"2024-04-26T12:40:52.396255+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:40:52.396255+0000","last_undegraded":"2024-04-26T12:40:52.396255+0000","last_fullsized":"2024-04-26T12:40:52.396255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390499+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:40:52.390499+0000","last_peered":"2024-04-26T12:40:52.390499+0000","last_clean":"2024-04-26T12:40:52.390499+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:40:52.390499+0000","last_undegraded":"2024-04-26T12:40:52.390499+0000","last_fullsized":"2024-04-26T12:40:52.390499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"91'15","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.380958+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:40:52.380958+0000","last_peered":"2024-04-26T12:40:52.380958+0000","last_clean":"2024-04-26T12:40:52.380958+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:40:52.380958+0000","last_undegraded":"2024-04-26T12:40:52.380958+0000","last_fullsized":"2024-04-26T12:40:52.380958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396542+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:40:52.396542+0000","last_peered":"2024-04-26T12:40:52.396542+0000","last_clean":"2024-04-26T12:40:52.396542+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:40:52.396542+0000","last_undegraded":"2024-04-26T12:40:52.396542+0000","last_fullsized":"2024-04-26T12:40:52.396542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395336+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:40:52.395336+0000","last_peered":"2024-04-26T12:40:52.395336+0000","last_clean":"2024-04-26T12:40:52.395336+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:40:52.395336+0000","last_undegraded":"2024-04-26T12:40:52.395336+0000","last_fullsized":"2024-04-26T12:40:52.395336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393055+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:40:52.393055+0000","last_peered":"2024-04-26T12:40:52.393055+0000","last_clean":"2024-04-26T12:40:52.393055+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:40:52.393055+0000","last_undegraded":"2024-04-26T12:40:52.393055+0000","last_fullsized":"2024-04-26T12:40:52.393055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"90'9","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.396010+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:40:52.396010+0000","last_peered":"2024-04-26T12:40:52.396010+0000","last_clean":"2024-04-26T12:40:52.396010+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:40:52.396010+0000","last_undegraded":"2024-04-26T12:40:52.396010+0000","last_fullsized":"2024-04-26T12:40:52.396010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393266+0000","last_change":"2024-04-26T12:38:32.098077+0000","last_active":"2024-04-26T12:40:52.393266+0000","last_peered":"2024-04-26T12:40:52.393266+0000","last_clean":"2024-04-26T12:40:52.393266+0000","last_became_active":"2024-04-26T12:38:32.097608+0000","last_became_peered":"2024-04-26T12:38:32.097608+0000","last_unstale":"2024-04-26T12:40:52.393266+0000","last_undegraded":"2024-04-26T12:40:52.393266+0000","last_fullsized":"2024-04-26T12:40:52.393266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:52.163433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"91'12","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395595+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:40:52.395595+0000","last_peered":"2024-04-26T12:40:52.395595+0000","last_clean":"2024-04-26T12:40:52.395595+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:40:52.395595+0000","last_undegraded":"2024-04-26T12:40:52.395595+0000","last_fullsized":"2024-04-26T12:40:52.395595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397589+0000","last_change":"2024-04-26T12:38:32.097869+0000","last_active":"2024-04-26T12:40:52.397589+0000","last_peered":"2024-04-26T12:40:52.397589+0000","last_clean":"2024-04-26T12:40:52.397589+0000","last_became_active":"2024-04-26T12:38:32.097545+0000","last_became_peered":"2024-04-26T12:38:32.097545+0000","last_unstale":"2024-04-26T12:40:52.397589+0000","last_undegraded":"2024-04-26T12:40:52.397589+0000","last_fullsized":"2024-04-26T12:40:52.397589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:00.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397041+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:40:52.397041+0000","last_peered":"2024-04-26T12:40:52.397041+0000","last_clean":"2024-04-26T12:40:52.397041+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:40:52.397041+0000","last_undegraded":"2024-04-26T12:40:52.397041+0000","last_fullsized":"2024-04-26T12:40:52.397041+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"68'12","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393631+0000","last_change":"2024-04-26T12:38:32.098742+0000","last_active":"2024-04-26T12:40:52.393631+0000","last_peered":"2024-04-26T12:40:52.393631+0000","last_clean":"2024-04-26T12:40:52.393631+0000","last_became_active":"2024-04-26T12:38:32.098197+0000","last_became_peered":"2024-04-26T12:38:32.098197+0000","last_unstale":"2024-04-26T12:40:52.393631+0000","last_undegraded":"2024-04-26T12:40:52.393631+0000","last_fullsized":"2024-04-26T12:40:52.393631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.480181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384262+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:40:52.384262+0000","last_peered":"2024-04-26T12:40:52.384262+0000","last_clean":"2024-04-26T12:40:52.384262+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:40:52.384262+0000","last_undegraded":"2024-04-26T12:40:52.384262+0000","last_fullsized":"2024-04-26T12:40:52.384262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":227,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381141+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:40:52.381141+0000","last_peered":"2024-04-26T12:40:52.381141+0000","last_clean":"2024-04-26T12:40:52.381141+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:40:52.381141+0000","last_undegraded":"2024-04-26T12:40:52.381141+0000","last_fullsized":"2024-04-26T12:40:52.381141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"91'15","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390823+0000","last_change":"2024-04-26T12:38:32.089759+0000","last_active":"2024-04-26T12:40:52.390823+0000","last_peered":"2024-04-26T12:40:52.390823+0000","last_clean":"2024-04-26T12:40:52.390823+0000","last_became_active":"2024-04-26T12:38:32.088214+0000","last_became_peered":"2024-04-26T12:38:32.088214+0000","last_unstale":"2024-04-26T12:40:52.390823+0000","last_undegraded":"2024-04-26T12:40:52.390823+0000","last_fullsized":"2024-04-26T12:40:52.390823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:38.656355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382362+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:40:52.382362+0000","last_peered":"2024-04-26T12:40:52.382362+0000","last_clean":"2024-04-26T12:40:52.382362+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:40:52.382362+0000","last_undegraded":"2024-04-26T12:40:52.382362+0000","last_fullsized":"2024-04-26T12:40:52.382362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382707+0000","last_change":"2024-04-26T12:38:32.098228+0000","last_active":"2024-04-26T12:40:52.382707+0000","last_peered":"2024-04-26T12:40:52.382707+0000","last_clean":"2024-04-26T12:40:52.382707+0000","last_became_active":"2024-04-26T12:38:32.092404+0000","last_became_peered":"2024-04-26T12:38:32.092404+0000","last_unstale":"2024-04-26T12:40:52.382707+0000","last_undegraded":"2024-04-26T12:40:52.382707+0000","last_fullsized":"2024-04-26T12:40:52.382707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"91'6","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384775+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:40:52.384775+0000","last_peered":"2024-04-26T12:40:52.384775+0000","last_clean":"2024-04-26T12:40:52.384775+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:40:52.384775+0000","last_undegraded":"2024-04-26T12:40:52.384775+0000","last_fullsized":"2024-04-26T12:40:52.384775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.394337+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:40:52.394337+0000","last_peered":"2024-04-26T12:40:52.394337+0000","last_clean":"2024-04-26T12:40:52.394337+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:40:52.394337+0000","last_undegraded":"2024-04-26T12:40:52.394337+0000","last_fullsized":"2024-04-26T12:40:52.394337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":207,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384317+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:40:52.384317+0000","last_peered":"2024-04-26T12:40:52.384317+0000","last_clean":"2024-04-26T12:40:52.384317+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:40:52.384317+0000","last_undegraded":"2024-04-26T12:40:52.384317+0000","last_fullsized":"2024-04-26T12:40:52.384317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"91'9","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.389944+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:40:52.389944+0000","last_peered":"2024-04-26T12:40:52.389944+0000","last_clean":"2024-04-26T12:40:52.389944+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:40:52.389944+0000","last_undegraded":"2024-04-26T12:40:52.389944+0000","last_fullsized":"2024-04-26T12:40:52.389944+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"74'2","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395365+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:40:52.395365+0000","last_peered":"2024-04-26T12:40:52.395365+0000","last_clean":"2024-04-26T12:40:52.395365+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:40:52.395365+0000","last_undegraded":"2024-04-26T12:40:52.395365+0000","last_fullsized":"2024-04-26T12:40:52.395365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"91'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391153+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:40:52.391153+0000","last_peered":"2024-04-26T12:40:52.391153+0000","last_clean":"2024-04-26T12:40:52.391153+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:40:52.391153+0000","last_undegraded":"2024-04-26T12:40:52.391153+0000","last_fullsized":"2024-04-26T12:40:52.391153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"68'2","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383416+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:40:52.383416+0000","last_peered":"2024-04-26T12:40:52.383416+0000","last_clean":"2024-04-26T12:40:52.383416+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:40:52.383416+0000","last_undegraded":"2024-04-26T12:40:52.383416+0000","last_fullsized":"2024-04-26T12:40:52.383416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"91'10","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.382933+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:40:52.382933+0000","last_peered":"2024-04-26T12:40:52.382933+0000","last_clean":"2024-04-26T12:40:52.382933+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:40:52.382933+0000","last_undegraded":"2024-04-26T12:40:52.382933+0000","last_fullsized":"2024-04-26T12:40:52.382933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395096+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:40:52.395096+0000","last_peered":"2024-04-26T12:40:52.395096+0000","last_clean":"2024-04-26T12:40:52.395096+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:40:52.395096+0000","last_undegraded":"2024-04-26T12:40:52.395096+0000","last_fullsized":"2024-04-26T12:40:52.395096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391698+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:40:52.391698+0000","last_peered":"2024-04-26T12:40:52.391698+0000","last_clean":"2024-04-26T12:40:52.391698+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:40:52.391698+0000","last_undegraded":"2024-04-26T12:40:52.391698+0000","last_fullsized":"2024-04-26T12:40:52.391698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398317+0000","last_change":"2024-04-26T12:38:32.099762+0000","last_active":"2024-04-26T12:40:52.398317+0000","last_peered":"2024-04-26T12:40:52.398317+0000","last_clean":"2024-04-26T12:40:52.398317+0000","last_became_active":"2024-04-26T12:38:32.099061+0000","last_became_peered":"2024-04-26T12:38:32.099061+0000","last_unstale":"2024-04-26T12:40:52.398317+0000","last_undegraded":"2024-04-26T12:40:52.398317+0000","last_fullsized":"2024-04-26T12:40:52.398317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:17.530530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'5","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383794+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:40:52.383794+0000","last_peered":"2024-04-26T12:40:52.383794+0000","last_clean":"2024-04-26T12:40:52.383794+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:40:52.383794+0000","last_undegraded":"2024-04-26T12:40:52.383794+0000","last_fullsized":"2024-04-26T12:40:52.383794+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392732+0000","last_change":"2024-04-26T12:38:58.795730+0000","last_active":"2024-04-26T12:40:52.392732+0000","last_peered":"2024-04-26T12:40:52.392732+0000","last_clean":"2024-04-26T12:40:52.392732+0000","last_became_active":"2024-04-26T12:38:58.795097+0000","last_became_peered":"2024-04-26T12:38:58.795097+0000","last_unstale":"2024-04-26T12:40:52.392732+0000","last_undegraded":"2024-04-26T12:40:52.392732+0000","last_fullsized":"2024-04-26T12:40:52.392732+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.166788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"91'8","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.401853+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:40:52.401853+0000","last_peered":"2024-04-26T12:40:52.401853+0000","last_clean":"2024-04-26T12:40:52.401853+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:40:52.401853+0000","last_undegraded":"2024-04-26T12:40:52.401853+0000","last_fullsized":"2024-04-26T12:40:52.401853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"74'10","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393984+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:40:52.393984+0000","last_peered":"2024-04-26T12:40:52.393984+0000","last_clean":"2024-04-26T12:40:52.393984+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:40:52.393984+0000","last_undegraded":"2024-04-26T12:40:52.393984+0000","last_fullsized":"2024-04-26T12:40:52.393984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"90'10","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395603+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:40:52.395603+0000","last_peered":"2024-04-26T12:40:52.395603+0000","last_clean":"2024-04-26T12:40:52.395603+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:40:52.395603+0000","last_undegraded":"2024-04-26T12:40:52.395603+0000","last_fullsized":"2024-04-26T12:40:52.395603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384171+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:40:52.384171+0000","last_peered":"2024-04-26T12:40:52.384171+0000","last_clean":"2024-04-26T12:40:52.384171+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:40:52.384171+0000","last_undegraded":"2024-04-26T12:40:52.384171+0000","last_fullsized":"2024-04-26T12:40:52.384171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"90'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391555+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:40:52.391555+0000","last_peered":"2024-04-26T12:40:52.391555+0000","last_clean":"2024-04-26T12:40:52.391555+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:40:52.391555+0000","last_undegraded":"2024-04-26T12:40:52.391555+0000","last_fullsized":"2024-04-26T12:40:52.391555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391368+0000","last_change":"2024-04-26T12:38:32.101184+0000","last_active":"2024-04-26T12:40:52.391368+0000","last_peered":"2024-04-26T12:40:52.391368+0000","last_clean":"2024-04-26T12:40:52.391368+0000","last_became_active":"2024-04-26T12:38:32.100885+0000","last_became_peered":"2024-04-26T12:38:32.100885+0000","last_unstale":"2024-04-26T12:40:52.391368+0000","last_undegraded":"2024-04-26T12:40:52.391368+0000","last_fullsized":"2024-04-26T12:40:52.391368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:14.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"91'6","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.393208+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:40:52.393208+0000","last_peered":"2024-04-26T12:40:52.393208+0000","last_clean":"2024-04-26T12:40:52.393208+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:40:52.393208+0000","last_undegraded":"2024-04-26T12:40:52.393208+0000","last_fullsized":"2024-04-26T12:40:52.393208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"68'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.390767+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:40:52.390767+0000","last_peered":"2024-04-26T12:40:52.390767+0000","last_clean":"2024-04-26T12:40:52.390767+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:40:52.390767+0000","last_undegraded":"2024-04-26T12:40:52.390767+0000","last_fullsized":"2024-04-26T12:40:52.390767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'8","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391099+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:40:52.391099+0000","last_peered":"2024-04-26T12:40:52.391099+0000","last_clean":"2024-04-26T12:40:52.391099+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:40:52.391099+0000","last_undegraded":"2024-04-26T12:40:52.391099+0000","last_fullsized":"2024-04-26T12:40:52.391099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"68'4","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398917+0000","last_change":"2024-04-26T12:38:32.097249+0000","last_active":"2024-04-26T12:40:52.398917+0000","last_peered":"2024-04-26T12:40:52.398917+0000","last_clean":"2024-04-26T12:40:52.398917+0000","last_became_active":"2024-04-26T12:38:32.096972+0000","last_became_peered":"2024-04-26T12:38:32.096972+0000","last_unstale":"2024-04-26T12:40:52.398917+0000","last_undegraded":"2024-04-26T12:40:52.398917+0000","last_fullsized":"2024-04-26T12:40:52.398917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:06.018406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"91'9","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.383216+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:40:52.383216+0000","last_peered":"2024-04-26T12:40:52.383216+0000","last_clean":"2024-04-26T12:40:52.383216+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:40:52.383216+0000","last_undegraded":"2024-04-26T12:40:52.383216+0000","last_fullsized":"2024-04-26T12:40:52.383216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.395238+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:40:52.395238+0000","last_peered":"2024-04-26T12:40:52.395238+0000","last_clean":"2024-04-26T12:40:52.395238+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:40:52.395238+0000","last_undegraded":"2024-04-26T12:40:52.395238+0000","last_fullsized":"2024-04-26T12:40:52.395238+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"90'4","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399438+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:40:52.399438+0000","last_peered":"2024-04-26T12:40:52.399438+0000","last_clean":"2024-04-26T12:40:52.399438+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:40:52.399438+0000","last_undegraded":"2024-04-26T12:40:52.399438+0000","last_fullsized":"2024-04-26T12:40:52.399438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"68'4","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.381702+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:40:52.381702+0000","last_peered":"2024-04-26T12:40:52.381702+0000","last_clean":"2024-04-26T12:40:52.381702+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:40:52.381702+0000","last_undegraded":"2024-04-26T12:40:52.381702+0000","last_fullsized":"2024-04-26T12:40:52.381702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"91'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.400421+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:40:52.400421+0000","last_peered":"2024-04-26T12:40:52.400421+0000","last_clean":"2024-04-26T12:40:52.400421+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:40:52.400421+0000","last_undegraded":"2024-04-26T12:40:52.400421+0000","last_fullsized":"2024-04-26T12:40:52.400421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.392618+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:40:52.392618+0000","last_peered":"2024-04-26T12:40:52.392618+0000","last_clean":"2024-04-26T12:40:52.392618+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:40:52.392618+0000","last_undegraded":"2024-04-26T12:40:52.392618+0000","last_fullsized":"2024-04-26T12:40:52.392618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"90'5","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391593+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:40:52.391593+0000","last_peered":"2024-04-26T12:40:52.391593+0000","last_clean":"2024-04-26T12:40:52.391593+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:40:52.391593+0000","last_undegraded":"2024-04-26T12:40:52.391593+0000","last_fullsized":"2024-04-26T12:40:52.391593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.399194+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:40:52.399194+0000","last_peered":"2024-04-26T12:40:52.399194+0000","last_clean":"2024-04-26T12:40:52.399194+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:40:52.399194+0000","last_undegraded":"2024-04-26T12:40:52.399194+0000","last_fullsized":"2024-04-26T12:40:52.399194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"91'6","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.398888+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:40:52.398888+0000","last_peered":"2024-04-26T12:40:52.398888+0000","last_clean":"2024-04-26T12:40:52.398888+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:40:52.398888+0000","last_undegraded":"2024-04-26T12:40:52.398888+0000","last_fullsized":"2024-04-26T12:40:52.398888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"91'7","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.391298+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:40:52.391298+0000","last_peered":"2024-04-26T12:40:52.391298+0000","last_clean":"2024-04-26T12:40:52.391298+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:40:52.391298+0000","last_undegraded":"2024-04-26T12:40:52.391298+0000","last_fullsized":"2024-04-26T12:40:52.391298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384079+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:40:52.384079+0000","last_peered":"2024-04-26T12:40:52.384079+0000","last_clean":"2024-04-26T12:40:52.384079+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:40:52.384079+0000","last_undegraded":"2024-04-26T12:40:52.384079+0000","last_fullsized":"2024-04-26T12:40:52.384079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'12","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.384274+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:40:52.384274+0000","last_peered":"2024-04-26T12:40:52.384274+0000","last_clean":"2024-04-26T12:40:52.384274+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:40:52.384274+0000","last_undegraded":"2024-04-26T12:40:52.384274+0000","last_fullsized":"2024-04-26T12:40:52.384274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T12:40:52.397233+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:40:52.397233+0000","last_peered":"2024-04-26T12:40:52.397233+0000","last_clean":"2024-04-26T12:40:52.397233+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:40:52.397233+0000","last_undegraded":"2024-04-26T12:40:52.397233+0000","last_fullsized":"2024-04-26T12:40:52.397233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":293,"num_read_kb":277,"num_write":246,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":141660,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":811,"num_read_kb":573,"num_write":451,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":243460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":354,"num_read_kb":354,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1250,"num_read_kb":1226,"num_write":256,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2113929216,"num_objects":506,"num_object_clones":0,"num_object_copies":1012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":506,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":578,"num_write_kb":2088960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4227858432,"data_stored":4227858432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":518,"ondisk_log_size":518,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536752,"kb_used_data":505568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835088,"statfs":{"total":96636764160,"available":96087130112,"internally_reserved":0,"allocated":517701632,"data_stored":517185459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":398864,"kb_used_data":367684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93972976,"statfs":{"total":96636764160,"available":96228327424,"internally_reserved":0,"allocated":376508416,"data_stored":376025985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":720544,"kb_used_data":689364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93651296,"statfs":{"total":96636764160,"available":95898927104,"internally_reserved":0,"allocated":705908736,"data_stored":705355568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":570912,"kb_used_data":539732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93800928,"statfs":{"total":96636764160,"available":96052150272,"internally_reserved":0,"allocated":552685568,"data_stored":552201958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712360,"kb_used_data":677020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93659480,"statfs":{"total":96636764160,"available":95907307520,"internally_reserved":0,"allocated":693268480,"data_stored":692755500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409160,"kb_used_data":373820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93962680,"statfs":{"total":96636764160,"available":96217784320,"internally_reserved":0,"allocated":382791680,"data_stored":382317439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433792,"kb_used_data":398448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93938048,"statfs":{"total":96636764160,"available":96192561152,"internally_reserved":0,"allocated":408010752,"data_stored":407493862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":622820,"kb_used_data":587476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93749020,"statfs":{"total":96636764160,"available":95998996480,"internally_reserved":0,"allocated":601575424,"data_stored":601077681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":599785472,"data_stored":599785472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":406847488,"data_stored":406847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":381681664,"data_stored":381681664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":692060160,"data_stored":692060160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":551550976,"data_stored":551550976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":704643072,"data_stored":704643072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":375390208,"data_stored":375390208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":60224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:40:58.307 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:40:58.307 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T12:40:58.307 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-26T12:40:58.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-26T12:40:58.335 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:58.332+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:58.336 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1325 3.34 3:2cf99e10:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 60.495631447000001, 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020543797999999999, 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1325 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837059+0000", 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2140000000000001e-06 2024-04-26T12:40:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843506+0000", 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064467209999999999 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843561+0000", 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.5291999999999998e-05 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843589+0000", 2024-04-26T12:40:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8354999999999999e-05 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843720+0000", 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013083999999999999 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843945+0000", 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000224782 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.844155+0000", 2024-04-26T12:40:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000209743 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857491+0000", 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013336249 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857520+0000", 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8941e-05 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857557+0000", 2024-04-26T12:40:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7115e-05 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857600+0000", 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2546000000000002e-05 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1460 3.36 3:6e35934d:::d749f084-3851-4e95-9492-490675b43f90.4382.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 59.707315647999998, 2024-04-26T12:40:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025121213, 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1460 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625375+0000", 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631320+0000", 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059444809999999997 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631360+0000", 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0398999999999997e-05 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631378+0000", 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8050000000000002e-05 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631551+0000", 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017255800000000001 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631822+0000", 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027131799999999999 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.632685+0000", 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00086248900000000003 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.649790+0000", 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017105170999999999 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650179+0000", 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000389284 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650359+0000", 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180061 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650493+0000", 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133876 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2331 3.26 3:660a096e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.835060554999998, 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018877251000000001, 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2331 2024-04-26T12:40:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497630+0000", 2024-04-26T12:40:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4400000000000001e-06 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501943+0000", 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004312715 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501979+0000", 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6365999999999997e-05 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501997+0000", 2024-04-26T12:40:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7793000000000001e-05 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502089+0000", 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1958000000000003e-05 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502288+0000", 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019909800000000001 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502477+0000", 2024-04-26T12:40:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018923200000000001 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.509874+0000", 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073965639999999996 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516336+0000", 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006461629 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516433+0000", 2024-04-26T12:40:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7807999999999996e-05 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516504+0000", 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0648000000000005e-05 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2341 3.35 3:ad2a0070:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.726606631999999, 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020122823000000001, 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2341 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606084+0000", 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5030000000000002e-06 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610523+0000", 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004439035 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610563+0000", 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9305999999999999e-05 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610582+0000", 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9083e-05 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610736+0000", 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015433999999999999 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611020+0000", 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028411000000000002 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611253+0000", 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023267200000000001 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.625380+0000", 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014127366000000001 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626034+0000", 2024-04-26T12:40:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00065407499999999995 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626133+0000", 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9141000000000005e-05 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626204+0000", 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2347 3.a 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.652621613000001, 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025995128999999999, 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2347 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680068+0000", 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2699999999999999e-06 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684436+0000", 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043681800000000002 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684474+0000", 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7696e-05 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684498+0000", 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3736000000000001e-05 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684647+0000", 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014935999999999999 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684905+0000", 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000257767 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685154+0000", 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024906499999999997 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.694110+0000", 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0089561629999999996 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011663118 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705931+0000", 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015790699999999999 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706061+0000", 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012986700000000001 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2354 3.3f e73/17 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head v 73'1, mlcod=0'0)", 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.569078742999999, 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023388658, 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3699999999999999e-07 2024-04-26T12:40:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767456+0000", 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038463529999999998 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767493+0000", 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7058999999999999e-05 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767512+0000", 2024-04-26T12:40:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426e-05 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767810+0000", 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029746500000000001 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767864+0000", 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3974999999999997e-05 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786741+0000", 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018876885999999999 2024-04-26T12:40:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786997+0000", 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025665699999999998 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2361 3.26 3:6509be61:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.499561364000002, 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020183629000000002, 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2361 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833130+0000", 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7330000000000001e-06 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837748+0000", 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046180049999999997 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837801+0000", 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3458999999999998e-05 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837829+0000", 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8299000000000001e-05 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837988+0000", 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015878100000000001 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838269+0000", 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028097000000000002 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838507+0000", 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238118 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.852548+0000", 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014040777000000001 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853137+0000", 2024-04-26T12:40:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00058917099999999999 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853233+0000", 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5338000000000001e-05 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853310+0000", 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6977999999999994e-05 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2379 3.2c 3:3590e7ea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.311612916999998, 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022546869000000001, 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2379 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021078+0000", 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026404+0000", 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053251669999999996 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026452+0000", 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8304999999999999e-05 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026472+0000", 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.959e-05 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026612+0000", 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014085700000000001 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027080+0000", 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00046714499999999997 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027701+0000", 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00062184600000000001 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041035+0000", 2024-04-26T12:40:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013333617000000001 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043446+0000", 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024114359999999999 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043546+0000", 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100041 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043621+0000", 2024-04-26T12:40:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4808000000000006e-05 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2381 3.26 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.291143192, 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.027555486000000001, 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2381 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.380 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041549+0000", 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5539999999999999e-06 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046113+0000", 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045646840000000003 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046153+0000", 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046178+0000", 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4743e-05 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046298+0000", 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120087 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046514+0000", 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021600800000000001 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046746+0000", 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000232241 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056160+0000", 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094137170000000003 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068838+0000", 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012678149999999999 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069011+0000", 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173129 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069100+0000", 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8694000000000002e-05 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2394 3.26 3:649f95b9:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.146274038000001, 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023463999999999999, 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2394 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186417+0000", 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2030000000000001e-06 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191437+0000", 2024-04-26T12:40:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005020488 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191475+0000", 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7879000000000001e-05 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191493+0000", 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7703e-05 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191654+0000", 2024-04-26T12:40:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016161600000000001 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191908+0000", 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025423399999999999 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.192139+0000", 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230184 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.207939+0000", 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015800715999999999 2024-04-26T12:40:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209724+0000", 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001784461 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209809+0000", 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5014999999999998e-05 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209877+0000", 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8501e-05 2024-04-26T12:40:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2404 3.20 3:079a3e14:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.047076107000002, 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017213770999999999, 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2404 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285615+0000", 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5729999999999999e-06 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290079+0000", 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044646399999999998 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290120+0000", 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290140+0000", 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290273+0000", 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013316000000000001 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290551+0000", 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027847599999999999 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290916+0000", 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000364306 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.301035+0000", 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010119360000000001 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302519+0000", 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001484031 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302691+0000", 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017180599999999999 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302825+0000", 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013415000000000001 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2408 3.20 3:07238821:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.001315630000001, 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017149066000000001, 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2408 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331375+0000", 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4630000000000001e-06 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336575+0000", 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052001240000000004 2024-04-26T12:40:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336603+0000", 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7526e-05 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336622+0000", 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9613e-05 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336759+0000", 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013698399999999999 2024-04-26T12:40:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337044+0000", 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028474300000000001 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337284+0000", 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023956699999999999 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.345871+0000", 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0085868230000000004 2024-04-26T12:40:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348358+0000", 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024872269999999998 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348449+0000", 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0795000000000001e-05 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348521+0000", 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2200999999999995e-05 2024-04-26T12:40:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2433 3.2c 3:352e35ac:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.729553801999998, 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019506391000000001, 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2433 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603138+0000", 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.386e-06 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607459+0000", 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043213210000000004 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607499+0000", 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0228999999999997e-05 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607517+0000", 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7895999999999999e-05 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607651+0000", 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133487 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607918+0000", 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026730100000000001 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.608152+0000", 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023403399999999999 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621350+0000", 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013197416999999999 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622407+0000", 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001057805 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622498+0000", 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0390999999999996e-05 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622640+0000", 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014212400000000001 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2434 3.35 3:ac41eaea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.716624551999999, 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022970694999999999, 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2434 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616067+0000", 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.907e-06 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620671+0000", 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046047070000000004 2024-04-26T12:40:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620709+0000", 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7392999999999999e-05 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620728+0000", 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9199e-05 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620876+0000", 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014752299999999999 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621360+0000", 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048465200000000002 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621810+0000", 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044939600000000002 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638455+0000", 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016645172 2024-04-26T12:40:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638848+0000", 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000393137 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638951+0000", 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102771 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.639033+0000", 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2837999999999995e-05 2024-04-26T12:40:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2437 3.26 3:65b96022:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.683489148, 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020654793000000001, 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2437 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649201+0000", 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.247e-06 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654391+0000", 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051896090000000004 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654430+0000", 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8906000000000003e-05 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654449+0000", 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8960000000000001e-05 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654577+0000", 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012784299999999999 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654838+0000", 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026151100000000002 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.655052+0000", 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021390800000000001 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.668862+0000", 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013810206 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669649+0000", 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00078632500000000004 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669747+0000", 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8478000000000001e-05 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669853+0000", 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001058 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2438 3.36 3:6cea662e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 45.674424989999999, 2024-04-26T12:40:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021295308999999998, 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2438 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658266+0000", 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9870000000000001e-06 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662764+0000", 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044975229999999998 2024-04-26T12:40:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662804+0000", 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0575999999999999e-05 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662832+0000", 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8019000000000001e-05 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663009+0000", 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017632600000000001 2024-04-26T12:40:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663314+0000", 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030489299999999998 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663544+0000", 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230564 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.678407+0000", 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014862254 2024-04-26T12:40:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679337+0000", 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00093039800000000003 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679443+0000", 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105908 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679558+0000", 2024-04-26T12:40:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114861 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2871 3.26 3:6787126b:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 9.4130208599999996, 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019856490000000001, 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2871 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919669+0000", 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923715+0000", 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040457449999999999 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923745+0000", 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9442999999999999e-05 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923760+0000", 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5899000000000001e-05 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923881+0000", 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120099 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.924116+0000", 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023545799999999999 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.924459+0000", 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034342999999999998 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.938038+0000", 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013578392999999999 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939226+0000", 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011884549999999999 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939398+0000", 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017150600000000001 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939523+0000", 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012520200000000001 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2882 3.a 3:52be8611:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:40:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 9.2584453829999998, 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021456744999999999, 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2882 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074247+0000", 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3959999999999997e-06 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078878+0000", 2024-04-26T12:40:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046305039999999997 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078917+0000", 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9125999999999998e-05 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078936+0000", 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8787000000000002e-05 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079079+0000", 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143318 2024-04-26T12:40:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079309+0000", 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000229865 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079533+0000", 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022415400000000001 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.092322+0000", 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012788620000000001 2024-04-26T12:40:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095522+0000", 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032001170000000002 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095620+0000", 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8312000000000003e-05 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095699+0000", 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8546000000000003e-05 2024-04-26T12:40:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2892 3.20 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 9.1323035380000004, 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028217702000000001, 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2892 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200388+0000", 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9600000000000002e-06 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206310+0000", 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059217280000000002 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206354+0000", 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206374+0000", 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0163e-05 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206504+0000", 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013038899999999999 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206764+0000", 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026011200000000001 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206980+0000", 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021612199999999999 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.216070+0000", 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0090894280000000001 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228367+0000", 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01229715 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228481+0000", 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114491 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228602+0000", 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120079 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2896 3.35 3:ad957356:::d749f084-3851-4e95-9492-490675b43f90.4382.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:40:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 9.0782707059999996, 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018487367000000001, 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2896 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254420+0000", 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258671+0000", 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004250813 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258698+0000", 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7746000000000002e-05 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258710+0000", 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1904e-05 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258792+0000", 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1879000000000007e-05 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258957+0000", 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016524899999999999 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.259486+0000", 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052866199999999995 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272598+0000", 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013112047 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272802+0000", 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020374100000000001 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272860+0000", 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8451e-05 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272904+0000", 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3671000000000003e-05 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.445 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:58.446 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:40:58.447 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:58.445+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:58.547 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:58.545+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:58.617 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:40:58.617 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:58.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-26T12:40:58.632 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:40:58.673 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:58.673+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:58.748 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:58.748+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:58.755 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:40:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:40:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:40:58.756 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:58.769 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:40:58.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-26T12:40:58.848 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:58.849+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:40:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:40:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:40:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:40:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 174.54279818500001, 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:40:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:40:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 174.23877103699999, 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 174.23873097000001, 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:40:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:40:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:40:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:40:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 174.23853575199999, 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:40:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:40:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 174.23849867499999, 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2349 3.37 3:ec3a3f83:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 47.230205730999998, 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023512585999999999, 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2349 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:40:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.701002+0000", 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047707940000000001 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705810+0000", 2024-04-26T12:40:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7543000000000003e-05 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705828+0000", 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705952+0000", 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123967 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706240+0000", 2024-04-26T12:40:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028815399999999999 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706474+0000", 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233878 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.716974+0000", 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010500061999999999 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724253+0000", 2024-04-26T12:40:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0072788139999999998 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724383+0000", 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013002000000000001 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724511+0000", 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128164 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2351 3.14 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 47.208093259999998, 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029175587999999999, 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2351 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723115+0000", 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8500000000000004e-06 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727939+0000", 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048243670000000004 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727979+0000", 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0326e-05 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728003+0000", 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4193e-05 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728157+0000", 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015328 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728534+0000", 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037701500000000002 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728958+0000", 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042402 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.742778+0000", 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013820426 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752106+0000", 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0093279780000000007 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752210+0000", 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103854 2024-04-26T12:40:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752286+0000", 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6279000000000006e-05 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2353 3.2b e73/17 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head v 73'2, mlcod=0'0)", 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 47.178817658, 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022414480000000001, 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752388+0000", 2024-04-26T12:40:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9530000000000002e-06 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760303+0000", 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079148240000000009 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760339+0000", 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5615999999999999e-05 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760363+0000", 2024-04-26T12:40:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4272000000000001e-05 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760530+0000", 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167047 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760593+0000", 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3214999999999997e-05 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774684+0000", 2024-04-26T12:40:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01409087 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774801+0000", 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011668299999999999 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2354 3.3f 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 47.171996221000001, 2024-04-26T12:40:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028337384, 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2354 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759211+0000", 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762648+0000", 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003436854 2024-04-26T12:40:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762685+0000", 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7004e-05 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762709+0000", 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3482999999999999e-05 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762871+0000", 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016273399999999999 2024-04-26T12:40:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763073+0000", 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020189599999999999 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763271+0000", 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000197412 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.775210+0000", 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011939171 2024-04-26T12:40:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787276+0000", 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012066464000000001 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787428+0000", 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000151383 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787545+0000", 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000117457 2024-04-26T12:40:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2355 3.37 3:eff17c6c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 47.164789966999997, 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02156363, 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2355 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766417+0000", 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3440000000000001e-06 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.770991+0000", 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004573756 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771029+0000", 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7821999999999998e-05 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771053+0000", 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.387e-05 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771215+0000", 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016220300000000001 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771568+0000", 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000352472 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771951+0000", 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038302699999999998 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787714+0000", 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015763065999999999 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787794+0000", 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0259999999999994e-05 2024-04-26T12:40:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787886+0000", 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2472000000000005e-05 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787978+0000", 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1337999999999999e-05 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2373 3.13 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.969008985000002, 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030808384000000001, 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2373 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962198+0000", 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1200000000000002e-06 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966728+0000", 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045301170000000002 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966768+0000", 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9619000000000001e-05 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966787+0000", 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8933999999999999e-05 2024-04-26T12:40:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966954+0000", 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016689600000000001 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967341+0000", 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038776099999999998 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967720+0000", 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037867100000000002 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.980012+0000", 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012291717000000001 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992693+0000", 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012681192000000001 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016807000000000001 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.993003+0000", 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142287 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2381 3.26 e73/17 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head v 73'4, mlcod=72'2)", 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.884234923000001, 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021426161999999999, 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046971+0000", 2024-04-26T12:40:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051948+0000", 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049762549999999997 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051984+0000", 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.625e-05 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052007+0000", 2024-04-26T12:40:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2572e-05 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052200+0000", 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193372 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052261+0000", 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1471999999999997e-05 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068271+0000", 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016010027999999999 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068395+0000", 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012382300000000001 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2384 3.37 3:eff1e373:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.858974869000001, 2024-04-26T12:40:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022518564000000001, 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2384 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072232+0000", 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2569999999999999e-06 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076853+0000", 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046206870000000001 2024-04-26T12:40:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076884+0000", 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1049e-05 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076902+0000", 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8070000000000001e-05 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077053+0000", 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015034 2024-04-26T12:40:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077312+0000", 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025907300000000002 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077559+0000", 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024693099999999998 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.087260+0000", 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097015409999999993 2024-04-26T12:40:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094578+0000", 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073179739999999997 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094666+0000", 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8160999999999998e-05 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094748+0000", 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1481000000000001e-05 2024-04-26T12:40:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2402 3.11 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.663926572000001, 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026287990000000001, 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2402 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267281+0000", 2024-04-26T12:40:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.557e-06 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271739+0000", 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004457524 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271771+0000", 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2852999999999999e-05 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271790+0000", 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8889000000000002e-05 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271949+0000", 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015870000000000001 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272198+0000", 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024856800000000001 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272455+0000", 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025784700000000001 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.291321+0000", 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018865189000000001 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293294+0000", 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001973196 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293449+0000", 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001552 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293565+0000", 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011646699999999999 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2413 3.2d 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.539298080999998, 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020394760000000001, 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2413 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:40:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391909+0000", 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0429999999999999e-06 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396691+0000", 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047820140000000002 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396734+0000", 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396751+0000", 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7011999999999999e-05 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396899+0000", 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014740399999999999 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397244+0000", 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034543200000000001 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397484+0000", 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024016099999999999 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.405191+0000", 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0077069340000000004 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412133+0000", 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006941465 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412231+0000", 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7770999999999996e-05 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412301+0000", 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2414 3.37 3:efe9b32a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.525124329999997, 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019629488, 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2414 2024-04-26T12:40:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406083+0000", 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2729999999999998e-06 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411790+0000", 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0057067749999999999 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411830+0000", 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0525000000000002e-05 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411856+0000", 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5695999999999999e-05 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411994+0000", 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013798400000000001 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412226+0000", 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023230399999999999 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412447+0000", 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022097499999999999 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.423387+0000", 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010939574000000001 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425535+0000", 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002148109 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425634+0000", 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8851000000000006e-05 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425709+0000", 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5421999999999997e-05 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2427 3.d 3:b1e8d312:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.388777994999998, 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021368552999999998, 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2427 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542430+0000", 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547450+0000", 2024-04-26T12:40:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050205040000000003 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547487+0000", 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6866000000000002e-05 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547506+0000", 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9343000000000001e-05 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547680+0000", 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017347599999999999 2024-04-26T12:40:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548089+0000", 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040960699999999998 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548515+0000", 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042551999999999998 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.558096+0000", 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0095806929999999995 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563571+0000", 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054753329999999998 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563674+0000", 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010266400000000001 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563795+0000", 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012098 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2430 3.37 3:eff5ab0a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.359508165000001, 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020751628000000001, 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2430 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571699+0000", 2024-04-26T12:40:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5360000000000001e-06 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576275+0000", 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045753479999999999 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576311+0000", 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5865999999999998e-05 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576328+0000", 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576501+0000", 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000172659 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576910+0000", 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040915 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.577329+0000", 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041870699999999999 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.591164+0000", 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013835896 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592117+0000", 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00095214699999999998 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592309+0000", 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019207600000000001 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592447+0000", 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013884999999999999 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2440 3.d 3:b0894f88:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 46.211058002999998, 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020963463000000002, 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2440 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720150+0000", 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5200000000000002e-06 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724635+0000", 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004485447 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724675+0000", 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9938999999999998e-05 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724694+0000", 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724859+0000", 2024-04-26T12:40:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016413899999999999 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725146+0000", 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000287387 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725469+0000", 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032321900000000002 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:40:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.739743+0000", 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014273485000000001 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.740904+0000", 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011612790000000001 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741034+0000", 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130314 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741109+0000", 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5221000000000004e-05 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2884 3.2f e91/17 3:f6197e28:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_239:head v 91'6, mlcod=90'4)", 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 9.8290359540000001, 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022275581999999999, 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102172+0000", 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.76e-06 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104815+0000", 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002643088 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104864+0000", 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9450000000000003e-05 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104891+0000", 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6990000000000001e-05 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.105091+0000", 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019925499999999999 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.105154+0000", 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2954999999999996e-05 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124376+0000", 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019222123000000001 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:40:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:40:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124444+0000", 2024-04-26T12:40:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7960999999999995e-05 2024-04-26T12:40:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:40:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:40:59.044 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:40:59.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-04-26T12:40:59.046 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:40:59.044+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:40:59.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:40:59.147 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:59.145+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:59.168 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:59.168 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:59.169 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:59.169 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:59.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:40:59.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-04-26T12:40:59.248 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:59.244+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:59.349 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:59.349+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:59.368 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:59.369 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:59.369 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:59.369 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:59.369 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:59.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:40:59.413 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-04-26T12:40:59.450 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:59.448+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:59.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:40:59.551 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:40:59.549+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:40:59.582 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:59.582 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:40:59.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:40:59.582 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:40:59.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.720345078999998, 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2333 3.12 3:49fff330:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.062618321999999, 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014903046, 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.588 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2333 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519355+0000", 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1739999999999999e-06 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520939+0000", 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015836960000000001 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520971+0000", 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1930000000000001e-05 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520986+0000", 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5420000000000001e-05 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521057+0000", 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0825e-05 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521178+0000", 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120316 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521332+0000", 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015460800000000001 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.526796+0000", 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054637089999999998 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534174+0000", 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073778660000000003 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534216+0000", 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1869000000000002e-05 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534256+0000", 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0633000000000002e-05 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.593 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2337 3.1b 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.023537521999998, 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018047987000000001, 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.594 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2337 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558438+0000", 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6239999999999999e-06 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559867+0000", 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014292490000000001 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559886+0000", 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8697000000000001e-05 2024-04-26T12:40:59.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559898+0000", 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2542e-05 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559976+0000", 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7610999999999999e-05 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560136+0000", 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160443 2024-04-26T12:40:59.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560298+0000", 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016194899999999999 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.566613+0000", 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063145279999999998 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576388+0000", 2024-04-26T12:40:59.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097756340000000001 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576434+0000", 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6020000000000003e-05 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576482+0000", 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7689999999999999e-05 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2342 3.12 3:4a564d9a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.961365061999999, 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020986402000000001, 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2342 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620609+0000", 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.601 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622196+0000", 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587045 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622224+0000", 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8028e-05 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622234+0000", 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0577999999999999e-05 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622319+0000", 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4296999999999996e-05 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622520+0000", 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201571 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622753+0000", 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000232501 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.629187+0000", 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064345679999999999 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641429+0000", 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012241573 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641522+0000", 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3239999999999995e-05 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641593+0000", 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0683000000000001e-05 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2344 3.3 3:c3214891:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.933759676999998, 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017793122000000001, 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.605 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2344 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648214+0000", 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649908+0000", 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693069 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649940+0000", 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1974999999999998e-05 2024-04-26T12:40:59.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649956+0000", 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6429000000000001e-05 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650027+0000", 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1346000000000004e-05 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650146+0000", 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118581 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650277+0000", 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013136300000000001 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.654910+0000", 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046332300000000003 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665861+0000", 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01095054 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665942+0000", 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0782e-05 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.666005+0000", 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3146999999999997e-05 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.610 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2350 3.12 3:494cd927:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.868192149999999, 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019319528999999998, 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2350 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713782+0000", 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0759999999999999e-06 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714797+0000", 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010147159999999999 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714824+0000", 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.658e-05 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714838+0000", 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4609e-05 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714950+0000", 2024-04-26T12:40:59.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112185 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715172+0000", 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022140199999999999 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715311+0000", 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000138639 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.721604+0000", 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062931289999999997 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.732954+0000", 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011350314 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733038+0000", 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4445999999999998e-05 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733099+0000", 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0433000000000002e-05 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2353 3.2b 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.834890686999998, 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029788120000000001, 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.616 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2353 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747083+0000", 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748701+0000", 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016182550000000001 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748730+0000", 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8809000000000001e-05 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748741+0000", 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0949e-05 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748822+0000", 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0777000000000003e-05 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748827+0000", 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752276+0000", 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034484350000000001 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752425+0000", 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014880699999999999 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752572+0000", 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014723899999999999 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.757807+0000", 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052354319999999999 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776737+0000", 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018929437 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776811+0000", 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4651000000000001e-05 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776869+0000", 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7541999999999999e-05 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2369 3.12 3:4bcc53b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.662406668999999, 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014928745, 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.622 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2369 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919568+0000", 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0110000000000001e-06 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921453+0000", 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018855079999999999 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921476+0000", 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2705e-05 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921490+0000", 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4049999999999999e-05 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921560+0000", 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9580999999999997e-05 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921710+0000", 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150261 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921810+0000", 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100351 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.926466+0000", 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046561160000000001 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934371+0000", 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079049830000000008 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934442+0000", 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0607999999999999e-05 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934494+0000", 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1570999999999998e-05 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2371 3.12 3:4aa38e60:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.641793395999997, 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016346532, 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2371 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.628 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940181+0000", 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941785+0000", 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016038700000000001 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941813+0000", 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827e-05 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941828+0000", 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5545000000000001e-05 2024-04-26T12:40:59.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941914+0000", 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5353999999999996e-05 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942093+0000", 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000179004 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942264+0000", 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017166999999999999 2024-04-26T12:40:59.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.946973+0000", 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047087179999999998 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956399+0000", 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094257760000000003 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956471+0000", 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1740000000000001e-05 2024-04-26T12:40:59.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956525+0000", 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4097000000000001e-05 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2403 3.3 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.304286431999998, 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019288092999999999, 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.633 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2403 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277689+0000", 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.941e-06 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279232+0000", 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015426719999999999 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279255+0000", 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3059000000000001e-05 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279265+0000", 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9599999999999995e-06 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279330+0000", 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5282000000000003e-05 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279465+0000", 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135413 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279583+0000", 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011731900000000001 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.284332+0000", 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047490700000000002 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296834+0000", 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012501864 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296908+0000", 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3994999999999999e-05 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296973+0000", 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5518000000000005e-05 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.638 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2420 3.1f 3:f85890ec:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.106657001000002, 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016319348000000001, 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2420 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.639 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475317+0000", 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5170000000000002e-06 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476909+0000", 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015916389999999999 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476934+0000", 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5602999999999999e-05 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476944+0000", 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5980000000000003e-06 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477024+0000", 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9969999999999995e-05 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477203+0000", 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017948000000000001 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477363+0000", 2024-04-26T12:40:59.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160008 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.482189+0000", 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048257430000000004 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491558+0000", 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093691820000000002 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491601+0000", 2024-04-26T12:40:59.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3099000000000002e-05 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491634+0000", 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2509000000000003e-05 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2424 3.3 3:c1866c22:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.066654903, 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016771441000000002, 2024-04-26T12:40:59.644 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2424 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515318+0000", 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516904+0000", 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015852570000000001 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516913+0000", 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1679999999999993e-06 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516921+0000", 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6319999999999997e-06 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516980+0000", 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9151999999999999e-05 2024-04-26T12:40:59.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517101+0000", 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012034199999999999 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517259+0000", 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015827300000000001 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.522184+0000", 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004925296 2024-04-26T12:40:59.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.531965+0000", 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009780647 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532033+0000", 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7546999999999996e-05 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532088+0000", 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5452999999999999e-05 2024-04-26T12:40:59.649 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2842 3.1b 3:da1355e5:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.950279573, 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017378536999999999, 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2842 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631695+0000", 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0240000000000002e-06 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633298+0000", 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016033810000000001 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633326+0000", 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8192e-05 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633338+0000", 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1268e-05 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633418+0000", 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9847999999999999e-05 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633585+0000", 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000167496 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633743+0000", 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015822399999999999 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.638928+0000", 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051849690000000002 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.648991+0000", 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010062877 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.649033+0000", 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2197999999999998e-05 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.649070+0000", 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7060000000000001e-05 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2867 3.12 3:4ae9c7d5:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.880794+0000", 2024-04-26T12:40:59.655 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.701177233999999, 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014702395, 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2867 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.880794+0000", 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.880794+0000", 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.880798+0000", 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3170000000000002e-06 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882172+0000", 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001374756 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882202+0000", 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9484000000000001e-05 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882217+0000", 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5332000000000002e-05 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882296+0000", 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8888999999999996e-05 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882434+0000", 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013823000000000001 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882581+0000", 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146592 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.887388+0000", 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048066660000000002 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.895308+0000", 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079201889999999994 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.895425+0000", 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117094 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.895497+0000", 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1846000000000003e-05 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.660 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2870 3.17 3:e8fb4e0e:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.671089908999999, 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017263286999999999, 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2870 2024-04-26T12:40:59.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910884+0000", 2024-04-26T12:40:59.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912208+0000", 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013243 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912239+0000", 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0713999999999998e-05 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912254+0000", 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5048000000000001e-05 2024-04-26T12:40:59.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912333+0000", 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8886000000000003e-05 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912480+0000", 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014738199999999999 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912570+0000", 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9837000000000001e-05 2024-04-26T12:40:59.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.917171+0000", 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046010629999999999 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928063+0000", 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010892341 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928104+0000", 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0222999999999998e-05 2024-04-26T12:40:59.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928145+0000", 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1260000000000001e-05 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2878 3.2b 3:d6ec64be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.558524951000001, 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016634683000000001, 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.666 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2878 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:40:59.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023451+0000", 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025269+0000", 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001818465 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025313+0000", 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4443000000000001e-05 2024-04-26T12:40:59.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025340+0000", 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6454000000000001e-05 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025467+0000", 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012757799999999999 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025786+0000", 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031818999999999999 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.026118+0000", 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000332696 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.034247+0000", 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081283770000000009 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.039934+0000", 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056876699999999997 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.040018+0000", 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3194000000000003e-05 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.040081+0000", 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3578999999999996e-05 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.671 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2879 3.2b 3:d5c534be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.043786+0000", 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.538185469, 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016000855000000001, 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.672 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2879 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.043786+0000", 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.043786+0000", 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.043789+0000", 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045340+0000", 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015508270000000001 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045375+0000", 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5104000000000001e-05 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045391+0000", 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045468+0000", 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7262999999999995e-05 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045582+0000", 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113347 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045712+0000", 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013066299999999999 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.050614+0000", 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049019320000000003 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.059501+0000", 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0088870809999999998 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.059670+0000", 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168319 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.059787+0000", 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117359 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2889 3.12 3:4a48a540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:59.677 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.420960007, 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01761325, 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2889 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:40:59.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161014+0000", 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.249e-06 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164387+0000", 2024-04-26T12:40:59.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003373479 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164426+0000", 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8733999999999999e-05 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164445+0000", 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9483e-05 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164533+0000", 2024-04-26T12:40:59.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7980999999999997e-05 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164700+0000", 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016626400000000001 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164856+0000", 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015638499999999999 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.170310+0000", 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054534889999999997 2024-04-26T12:40:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178389+0000", 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080794509999999996 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178500+0000", 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111399 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178625+0000", 2024-04-26T12:40:59.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012433600000000001 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2891 3.2b 3:d7deca59:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.389239133, 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020816259, 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:40:59.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2891 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192735+0000", 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9399999999999998e-06 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197005+0000", 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042695859999999997 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197044+0000", 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9345999999999999e-05 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197068+0000", 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3788e-05 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197172+0000", 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104063 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197364+0000", 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192239 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197561+0000", 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019647600000000001 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.206860+0000", 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092991719999999996 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213224+0000", 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063636949999999999 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213413+0000", 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018908799999999999 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213549+0000", 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135866 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2892 3.20 e91/17 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head v 91'8, mlcod=90'6)", 2024-04-26T12:40:59.688 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.372954343, 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020804692999999999, 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:40:59.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209019+0000", 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214490+0000", 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054710219999999999 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:40:59.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214515+0000", 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4539999999999999e-05 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214528+0000", 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2914999999999999e-05 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214672+0000", 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143957 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:40:59.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214738+0000", 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6452999999999995e-05 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229776+0000", 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015037897 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229822+0000", 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5583e-05 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.692 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:40:59.693 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:40:59.693 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:59.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:40:59.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-04-26T12:40:59.695 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:40:59.693+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:40:59.795 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:40:59.792+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:40:59.866 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:59.866 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:59.866 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:40:59.866 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:59.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:40:59.892 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-04-26T12:40:59.941 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:59.941+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:40:59.991 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:40:59.991 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:40:59.991 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:40:59.992 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:40:59.992 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:40:59.997 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:40:59.997+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:00.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:41:00.097 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:00.097+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:00.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:41:00.163 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:41:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:41:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 165.72020423399999, 2024-04-26T12:41:00.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:41:00.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2319 3.1a 3:58f869a1:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.783486867999997, 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013146055, 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.168 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2319 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378953+0000", 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.041e-06 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380420+0000", 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001467138 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380454+0000", 2024-04-26T12:41:00.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4236999999999998e-05 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380470+0000", 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6578999999999998e-05 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380544+0000", 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3616999999999997e-05 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380697+0000", 2024-04-26T12:41:00.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015309199999999999 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380801+0000", 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103513 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.385130+0000", 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00432906 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391960+0000", 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068303560000000001 2024-04-26T12:41:00.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392034+0000", 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4119e-05 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392097+0000", 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2303000000000003e-05 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.173 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.427077959999998, 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.174 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.179 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.350821693, 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.339097324999997, 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.185 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:41:00.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2366 3.0 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.274454816000002, 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013182772000000001, 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.191 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2366 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887986+0000", 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3469999999999999e-06 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889575+0000", 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00158928 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889602+0000", 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6840999999999999e-05 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889617+0000", 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4667e-05 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889721+0000", 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104255 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889920+0000", 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019873199999999999 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.890088+0000", 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016799 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895734+0000", 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056464139999999998 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901046+0000", 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053117019999999997 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901114+0000", 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8232999999999995e-05 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901165+0000", 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1310999999999997e-05 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.078888902000003, 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.197 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:00.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:41:00.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:41:00.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2391 3.31 3:8f508897:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 48.009870435000003, 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016948310000000001, 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.203 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2391 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152570+0000", 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154503+0000", 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001933234 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154536+0000", 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3321000000000002e-05 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154553+0000", 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6288000000000001e-05 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154639+0000", 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6236000000000006e-05 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154820+0000", 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181306 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154983+0000", 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162929 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.160656+0000", 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056726550000000004 2024-04-26T12:41:00.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169397+0000", 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087409170000000008 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169465+0000", 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8730000000000001e-05 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169515+0000", 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9795e-05 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2393 3.0 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.986358179, 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010859486999999999, 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.209 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2393 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:41:00.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176082+0000", 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3970000000000001e-06 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178323+0000", 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002241818 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178348+0000", 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4335e-05 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178359+0000", 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1092e-05 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178440+0000", 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0745e-05 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178581+0000", 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014098100000000001 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178682+0000", 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010178099999999999 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.184116+0000", 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054341090000000003 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186805+0000", 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026890529999999998 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186884+0000", 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8336000000000004e-05 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186939+0000", 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4839999999999997e-05 2024-04-26T12:41:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.950245662, 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.215 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:41:00.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.220 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.792943344999998, 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:41:00.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:41:00.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2418 3.25 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.711334289, 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010790129000000001, 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2418 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451105+0000", 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.351e-06 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453261+0000", 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021551169999999998 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453277+0000", 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6935e-05 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453299+0000", 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1701000000000001e-05 2024-04-26T12:41:00.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453368+0000", 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8591999999999997e-05 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453517+0000", 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014963699999999999 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:00.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453638+0000", 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120289 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461242+0000", 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0076041479999999998 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461821+0000", 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057901100000000004 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461860+0000", 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9498e-05 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461893+0000", 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2849999999999999e-05 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.609539964, 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:41:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:00.238 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.579228135999998, 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:41:00.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:41:00.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:41:00.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2866 3.1a 3:58f8f444:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.871584+0000", 2024-04-26T12:41:00.244 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.290853041, 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015223199999999999, 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2866 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.871584+0000", 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.871584+0000", 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.871587+0000", 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873170+0000", 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015824529999999999 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873200+0000", 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0463e-05 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873213+0000", 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.314e-05 2024-04-26T12:41:00.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873305+0000", 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873446+0000", 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014124999999999999 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873545+0000", 2024-04-26T12:41:00.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9390999999999998e-05 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.877677+0000", 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041321600000000002 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.886672+0000", 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0089949639999999994 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.886754+0000", 2024-04-26T12:41:00.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1957000000000002e-05 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.886808+0000", 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3258999999999999e-05 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2876 3.19 3:99dc00a3:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:00.250 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.986476+0000", 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.175961576000001, 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011066484999999999, 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2876 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.986476+0000", 2024-04-26T12:41:00.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.986476+0000", 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.986478+0000", 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.385e-06 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988109+0000", 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001630664 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988143+0000", 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4103999999999997e-05 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988156+0000", 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2798e-05 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988243+0000", 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7635999999999999e-05 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988407+0000", 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016399399999999999 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988573+0000", 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016574499999999999 2024-04-26T12:41:00.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.995806+0000", 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072327279999999999 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.997351+0000", 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015447900000000001 2024-04-26T12:41:00.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.997441+0000", 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0542000000000001e-05 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.997542+0000", 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101099 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2877 3.0 3:034022be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.004200+0000", 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.158237777, 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013380543, 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2877 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.004200+0000", 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.004200+0000", 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.004202+0000", 2024-04-26T12:41:00.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.227e-06 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006212+0000", 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020105230000000002 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006256+0000", 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3713e-05 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006281+0000", 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5415999999999999e-05 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006424+0000", 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014246699999999999 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006705+0000", 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028105799999999999 2024-04-26T12:41:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006965+0000", 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025982400000000002 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.015592+0000", 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0086276059999999995 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.017450+0000", 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018577260000000001 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.017521+0000", 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1132999999999998e-05 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.017580+0000", 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8850000000000001e-05 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.262 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2880 3.4 3:22b427d1:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.107151259, 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017107469, 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.263 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2880 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055289+0000", 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0639999999999998e-06 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056815+0000", 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001525584 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056855+0000", 2024-04-26T12:41:00.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9975000000000003e-05 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056877+0000", 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2082e-05 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056988+0000", 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011092200000000001 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057219+0000", 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023134100000000001 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057442+0000", 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222981 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066157+0000", 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087146340000000006 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072145+0000", 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059887450000000002 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072294+0000", 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014865399999999999 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072394+0000", 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9487000000000005e-05 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.268 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2881 3.31 3:8da41a11:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.096306224999999, 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020325379000000001, 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2881 2024-04-26T12:41:00.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066135+0000", 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4769999999999999e-06 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069604+0000", 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003469654 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069639+0000", 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4814000000000002e-05 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069657+0000", 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7674000000000001e-05 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069764+0000", 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106964 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069958+0000", 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019436099999999999 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.070135+0000", 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017677900000000001 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.078069+0000", 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007933664 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086371+0000", 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083028219999999996 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086413+0000", 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1838000000000002e-05 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086457+0000", 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2888 3.1a 3:59675540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.011074802, 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019783412, 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2888 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151366+0000", 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7859999999999998e-06 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156684+0000", 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053173350000000003 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156726+0000", 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156752+0000", 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6636999999999999e-05 2024-04-26T12:41:00.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156859+0000", 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106698 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157025+0000", 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016556700000000001 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157182+0000", 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157684 2024-04-26T12:41:00.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.165499+0000", 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083164580000000005 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171012+0000", 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055134490000000001 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171082+0000", 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0103000000000003e-05 2024-04-26T12:41:00.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171146+0000", 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3625000000000002e-05 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:00.280 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:00.282 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:41:00.282 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:00.282 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:00.283 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:00.280+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:00.295 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:00.295 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:00.312 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:00.312 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:00.328 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:00.328 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:00.348 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:00.349 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:00.369 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:00.369 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:00.383 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:00.380+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:00.390 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:00.390 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:00.410 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:00.410 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:00.412 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:00.412 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:00.426 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:41:00.470 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:41:00.483 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:00.480+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:00.584 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:00.581+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:00.589 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:00.589 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:00.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:41:00.692 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:00.693+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:00.779 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:00.780 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:00.785 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:00.784+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:00.794 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:41:00.886 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:00.884+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:00.964 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:00.964 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:00.979 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:41:00.986 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:00.984+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:01.087 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:01.085+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:01.105 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:01.106 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:01.120 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:41:01.188 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:01.188+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:01.289 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:01.288+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:01.293 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:01.293 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:01.308 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:41:01.390 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:01.388+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:01.441 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:01.441 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:01.455 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:41:01.501 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:01.500+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:01.592 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:01.589+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:01.624 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:01.624 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:01.638 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:41:01.692 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:01.692+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:01.763 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:01.763 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:01.777 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:41:01.793 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:01.793+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:01.894 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:01.892+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:01.938 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:01.938 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:01.952 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:41:01.995 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:01.993+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:02.096 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:02.097+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:02.120 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:02.120 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:02.134 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:41:02.197 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:02.196+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:02.257 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:02.257 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:02.271 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:41:02.299 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:02.297+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:02.399 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:02.397+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:02.432 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:41:02.436 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:02.436 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:02.452 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:41:02.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:41:02.500 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:02.500+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:02.576 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:02.576 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:02.590 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:41:02.600 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:02.601+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:02.610 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:02.610 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:02.631 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:02.631 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:02.649 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:02.649 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:02.666 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:02.666 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:02.684 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:02.684 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:02.701 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:02.700+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:02.702 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:02.702 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:02.722 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:02.722 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:02.743 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:02.743 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:02.758 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1325 3.34 3:2cf99e10:::d749f084-3851-4e95-9492-490675b43f90.4382.2__shadow_.FwYX1OoK8B56-QsT7Csf4K-sTOTtfNk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 64.917654823999996, 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020543797999999999, 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.759 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.761 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.761 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.761 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.761 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1325 2024-04-26T12:41:02.761 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.761 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.761 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.761 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837056+0000", 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.837059+0000", 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2140000000000001e-06 2024-04-26T12:41:02.762 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843506+0000", 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0064467209999999999 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843561+0000", 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.5291999999999998e-05 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.763 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843589+0000", 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8354999999999999e-05 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843720+0000", 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013083999999999999 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.843945+0000", 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000224782 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:02.764 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.844155+0000", 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000209743 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857491+0000", 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013336249 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857520+0000", 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8941e-05 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857557+0000", 2024-04-26T12:41:02.765 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7115e-05 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:57.857600+0000", 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2546000000000002e-05 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.766 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1460 3.36 3:6e35934d:::d749f084-3851-4e95-9492-490675b43f90.4382.3_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 64.129339024999993, 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025121213, 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1460 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.767 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625372+0000", 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.625375+0000", 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:41:02.768 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631320+0000", 2024-04-26T12:41:02.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059444809999999997 2024-04-26T12:41:02.769 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.769 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.769 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.769 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631360+0000", 2024-04-26T12:41:02.769 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0398999999999997e-05 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631378+0000", 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8050000000000002e-05 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631551+0000", 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017255800000000001 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.770 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.631822+0000", 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027131799999999999 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.632685+0000", 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00086248900000000003 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.649790+0000", 2024-04-26T12:41:02.771 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017105170999999999 2024-04-26T12:41:02.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650179+0000", 2024-04-26T12:41:02.772 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000389284 2024-04-26T12:41:02.772 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.772 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.772 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.772 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650359+0000", 2024-04-26T12:41:02.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000180061 2024-04-26T12:41:02.773 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.773 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.773 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.773 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:58.650493+0000", 2024-04-26T12:41:02.773 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133876 2024-04-26T12:41:02.774 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.774 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.774 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.774 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.774 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.774 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2331 3.26 3:660a096e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:02.774 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.257083932, 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018877251000000001, 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2331 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.775 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497627+0000", 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.497630+0000", 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4400000000000001e-06 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.776 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501943+0000", 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004312715 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501979+0000", 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6365999999999997e-05 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.501997+0000", 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7793000000000001e-05 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.777 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502089+0000", 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1958000000000003e-05 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502288+0000", 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019909800000000001 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.502477+0000", 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018923200000000001 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.778 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.509874+0000", 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073965639999999996 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516336+0000", 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006461629 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516433+0000", 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7807999999999996e-05 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.779 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.516504+0000", 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0648000000000005e-05 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2341 3.35 3:ad2a0070:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.148630009000001, 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020122823000000001, 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.780 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2341 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606081+0000", 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.781 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.606084+0000", 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5030000000000002e-06 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610523+0000", 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004439035 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610563+0000", 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9305999999999999e-05 2024-04-26T12:41:02.782 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610582+0000", 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9083e-05 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.610736+0000", 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015433999999999999 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611020+0000", 2024-04-26T12:41:02.783 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028411000000000002 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.611253+0000", 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023267200000000001 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.625380+0000", 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014127366000000001 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626034+0000", 2024-04-26T12:41:02.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00065407499999999995 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626133+0000", 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9141000000000005e-05 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.626204+0000", 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.785 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2347 3.a 3:52e112f8:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.074644990000003, 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025995128999999999, 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.786 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2347 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680066+0000", 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.680068+0000", 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2699999999999999e-06 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684436+0000", 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043681800000000002 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684474+0000", 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7696e-05 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684498+0000", 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3736000000000001e-05 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684647+0000", 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014935999999999999 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.684905+0000", 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000257767 2024-04-26T12:41:02.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.685154+0000", 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024906499999999997 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.694110+0000", 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0089561629999999996 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:41:02.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011663118 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705931+0000", 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015790699999999999 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706061+0000", 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012986700000000001 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.791 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2354 3.3f e73/17 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head v 73'1, mlcod=0'0)", 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.991102120000001, 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023388658, 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763609+0000", 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3699999999999999e-07 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767456+0000", 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0038463529999999998 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767493+0000", 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7058999999999999e-05 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767512+0000", 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9426e-05 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767810+0000", 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00029746500000000001 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.767864+0000", 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3974999999999997e-05 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786741+0000", 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018876885999999999 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.786997+0000", 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025665699999999998 2024-04-26T12:41:02.795 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2361 3.26 3:6509be61:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.921584740999997, 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020183629000000002, 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.796 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2361 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833126+0000", 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.833130+0000", 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7330000000000001e-06 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837748+0000", 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046180049999999997 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837801+0000", 2024-04-26T12:41:02.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3458999999999998e-05 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837829+0000", 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8299000000000001e-05 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.837988+0000", 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015878100000000001 2024-04-26T12:41:02.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838269+0000", 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028097000000000002 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.838507+0000", 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000238118 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.852548+0000", 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014040777000000001 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853137+0000", 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00058917099999999999 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853233+0000", 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5338000000000001e-05 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.853310+0000", 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6977999999999994e-05 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2379 3.2c 3:3590e7ea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.733636294, 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022546869000000001, 2024-04-26T12:41:02.802 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2379 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021074+0000", 2024-04-26T12:41:02.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.021078+0000", 2024-04-26T12:41:02.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0570000000000003e-06 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026404+0000", 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053251669999999996 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026452+0000", 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8304999999999999e-05 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026472+0000", 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.959e-05 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.026612+0000", 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014085700000000001 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027080+0000", 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00046714499999999997 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.027701+0000", 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00062184600000000001 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041035+0000", 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013333617000000001 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043446+0000", 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024114359999999999 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043546+0000", 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000100041 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.043621+0000", 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4808000000000006e-05 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2381 3.26 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:41:02.808 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.713166569000002, 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.027555486000000001, 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2381 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:41:02.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041544+0000", 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.041549+0000", 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5539999999999999e-06 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046113+0000", 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045646840000000003 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046153+0000", 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9478999999999999e-05 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046178+0000", 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4743e-05 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046298+0000", 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120087 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046514+0000", 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021600800000000001 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046746+0000", 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000232241 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.056160+0000", 2024-04-26T12:41:02.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094137170000000003 2024-04-26T12:41:02.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068838+0000", 2024-04-26T12:41:02.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012678149999999999 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069011+0000", 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000173129 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.069100+0000", 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8694000000000002e-05 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.814 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2394 3.26 3:649f95b9:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.568297415000004, 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023463999999999999, 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2394 2024-04-26T12:41:02.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186413+0000", 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.186417+0000", 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2030000000000001e-06 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191437+0000", 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005020488 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191475+0000", 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7879000000000001e-05 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191493+0000", 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7703e-05 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191654+0000", 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016161600000000001 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.191908+0000", 2024-04-26T12:41:02.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025423399999999999 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.192139+0000", 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230184 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.207939+0000", 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015800715999999999 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209724+0000", 2024-04-26T12:41:02.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001784461 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209809+0000", 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5014999999999998e-05 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.209877+0000", 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8501e-05 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2404 3.20 3:079a3e14:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_213:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.469099483999997, 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017213770999999999, 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2404 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.821 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285611+0000", 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.285615+0000", 2024-04-26T12:41:02.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5729999999999999e-06 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290079+0000", 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044646399999999998 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290120+0000", 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0756000000000001e-05 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290140+0000", 2024-04-26T12:41:02.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290273+0000", 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013316000000000001 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290551+0000", 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027847599999999999 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:02.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.290916+0000", 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000364306 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.301035+0000", 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010119360000000001 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302519+0000", 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001484031 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302691+0000", 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017180599999999999 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.302825+0000", 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013415000000000001 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2408 3.20 3:07238821:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:41:02.826 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.423339007000003, 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017149066000000001, 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2408 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:41:02.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331372+0000", 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.331375+0000", 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4630000000000001e-06 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336575+0000", 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052001240000000004 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336603+0000", 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7526e-05 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336622+0000", 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9613e-05 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.336759+0000", 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013698399999999999 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337044+0000", 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028474300000000001 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.337284+0000", 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023956699999999999 2024-04-26T12:41:02.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.345871+0000", 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0085868230000000004 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348358+0000", 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024872269999999998 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348449+0000", 2024-04-26T12:41:02.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0795000000000001e-05 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.348521+0000", 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2200999999999995e-05 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2433 3.2c 3:352e35ac:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.151577179, 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019506391000000001, 2024-04-26T12:41:02.832 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2433 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603134+0000", 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.603138+0000", 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.386e-06 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607459+0000", 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043213210000000004 2024-04-26T12:41:02.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607499+0000", 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0228999999999997e-05 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607517+0000", 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7895999999999999e-05 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607651+0000", 2024-04-26T12:41:02.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000133487 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.607918+0000", 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026730100000000001 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.608152+0000", 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023403399999999999 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621350+0000", 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013197416999999999 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622407+0000", 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001057805 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622498+0000", 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.0390999999999996e-05 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.622640+0000", 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014212400000000001 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2434 3.35 3:ac41eaea:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.138647929000001, 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022970694999999999, 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.838 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2434 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616063+0000", 2024-04-26T12:41:02.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.616067+0000", 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.907e-06 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620671+0000", 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046047070000000004 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620709+0000", 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7392999999999999e-05 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620728+0000", 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9199e-05 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.620876+0000", 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014752299999999999 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621360+0000", 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00048465200000000002 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.621810+0000", 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00044939600000000002 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638455+0000", 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016645172 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638848+0000", 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000393137 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.638951+0000", 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000102771 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.639033+0000", 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2837999999999995e-05 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.843 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2437 3.26 3:65b96022:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.105512525000002, 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020654793000000001, 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.844 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2437 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649198+0000", 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.649201+0000", 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.247e-06 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654391+0000", 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0051896090000000004 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654430+0000", 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8906000000000003e-05 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654449+0000", 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8960000000000001e-05 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654577+0000", 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012784299999999999 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.654838+0000", 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026151100000000002 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.655052+0000", 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021390800000000001 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.668862+0000", 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013810206 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669649+0000", 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00078632500000000004 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669747+0000", 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8478000000000001e-05 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.669853+0000", 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001058 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2438 3.36 3:6cea662e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.096448367000001, 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021295308999999998, 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2438 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.850 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658262+0000", 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.658266+0000", 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9870000000000001e-06 2024-04-26T12:41:02.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662764+0000", 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044975229999999998 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662804+0000", 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0575999999999999e-05 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.662832+0000", 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8019000000000001e-05 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663009+0000", 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017632600000000001 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663314+0000", 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030489299999999998 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.663544+0000", 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000230564 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.678407+0000", 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014862254 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679337+0000", 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00093039800000000003 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679443+0000", 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105908 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.679558+0000", 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114861 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2871 3.26 3:6787126b:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:02.855 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:41:02.856 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 13.835044237, 2024-04-26T12:41:02.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019856490000000001, 2024-04-26T12:41:02.856 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.856 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.856 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.856 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.856 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.856 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.856 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2871 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919666+0000", 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.919669+0000", 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8600000000000001e-06 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923715+0000", 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0040457449999999999 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923745+0000", 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9442999999999999e-05 2024-04-26T12:41:02.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923760+0000", 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5899000000000001e-05 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.923881+0000", 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120099 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.924116+0000", 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023545799999999999 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.924459+0000", 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034342999999999998 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.938038+0000", 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013578392999999999 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939226+0000", 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011884549999999999 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939398+0000", 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017150600000000001 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:48.939523+0000", 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012520200000000001 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.861 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2882 3.a 3:52be8611:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 13.68046876, 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021456744999999999, 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2882 2024-04-26T12:41:02.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074242+0000", 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.074247+0000", 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3959999999999997e-06 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078878+0000", 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046305039999999997 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078917+0000", 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9125999999999998e-05 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.078936+0000", 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8787000000000002e-05 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079079+0000", 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000143318 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079309+0000", 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000229865 2024-04-26T12:41:02.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.079533+0000", 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022415400000000001 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.092322+0000", 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012788620000000001 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095522+0000", 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032001170000000002 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095620+0000", 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8312000000000003e-05 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.095699+0000", 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8546000000000003e-05 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2892 3.20 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 13.554326915000001, 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028217702000000001, 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2892 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200384+0000", 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.200388+0000", 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9600000000000002e-06 2024-04-26T12:41:02.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206310+0000", 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0059217280000000002 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206354+0000", 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4079999999999998e-05 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206374+0000", 2024-04-26T12:41:02.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0163e-05 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206504+0000", 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013038899999999999 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206764+0000", 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026011200000000001 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:02.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.206980+0000", 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00021612199999999999 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.216070+0000", 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0090894280000000001 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228367+0000", 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01229715 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228481+0000", 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114491 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.228602+0000", 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000120079 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2896 3.35 3:ad957356:::d749f084-3851-4e95-9492-490675b43f90.4382.10_1Gb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:41:02.873 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 13.500294083, 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018487367000000001, 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2896 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:41:02.874 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254417+0000", 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.254420+0000", 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:02.875 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258671+0000", 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004250813 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258698+0000", 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7746000000000002e-05 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258710+0000", 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1904e-05 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:02.876 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258792+0000", 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1879000000000007e-05 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.258957+0000", 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016524899999999999 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.259486+0000", 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00052866199999999995 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.877 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272598+0000", 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013112047 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272802+0000", 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020374100000000001 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272860+0000", 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8451e-05 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:02.878 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.272904+0000", 2024-04-26T12:41:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3671000000000003e-05 2024-04-26T12:41:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:02.879 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:02.879 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:02.881 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:02.881+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:02.881 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:41:02.982 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:02.981+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:03.051 INFO:tasks.workunit.client.0.smithi016.stderr:200+0 records in 2024-04-26T12:41:03.051 INFO:tasks.workunit.client.0.smithi016.stderr:200+0 records out 2024-04-26T12:41:03.051 INFO:tasks.workunit.client.0.smithi016.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.3388 s, 157 MB/s 2024-04-26T12:41:03.053 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:03.053 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:03.053 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:41:03.054 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:03.067 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:41:03.082 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:03.081+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:03.183 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:03.180+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:03.196 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:03.196 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:03.196 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:41:03.196 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:41:03.196 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:03.213 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:41:03.213 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_41_03 2024-04-26T12:41:03.283 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:03.281+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:03.335 INFO:tasks.workunit.client.0.smithi016.stdout:quota set for the bucket: buck_2024_03_26_12_41_03 2024-04-26T12:41:03.384 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:03.381+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:03.387 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:03.387 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:41:03.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:41:03.387 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:03.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 178.99488862600001, 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268133999999999, 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388406+0000", 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388409+0000", 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8030000000000001e-06 2024-04-26T12:41:03.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388423+0000", 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4e-05 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388444+0000", 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1322999999999999e-05 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388461+0000", 2024-04-26T12:41:03.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7496999999999999e-05 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388610+0000", 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000148968 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for peered", 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.388633+0000", 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2744000000000001e-05 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412150+0000", 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023516604999999999 2024-04-26T12:41:03.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412565+0000", 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041506699999999998 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.412956+0000", 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039105699999999999 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414362+0000", 2024-04-26T12:41:03.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0014058429999999999 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414497+0000", 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013487500000000001 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414592+0000", 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5625999999999996e-05 2024-04-26T12:41:03.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.414674+0000", 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1725999999999996e-05 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:41:03.394 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 178.69086147799999, 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020694008, 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 114 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692433+0000", 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692434+0000", 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8700000000000005e-07 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692440+0000", 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5799999999999997e-06 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692452+0000", 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1523e-05 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692460+0000", 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0870000000000007e-06 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.708967+0000", 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016506918999999998 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709097+0000", 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130152 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.709295+0000", 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000198452 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712807+0000", 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035112770000000001 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712851+0000", 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4472999999999999e-05 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713017+0000", 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000165558 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713127+0000", 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001102 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 178.690821411, 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02108471, 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.400 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 115 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.401 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692473+0000", 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692474+0000", 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.7599999999999996e-07 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692631+0000", 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015669499999999999 2024-04-26T12:41:03.402 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692644+0000", 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2994e-05 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692653+0000", 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8859999999999993e-06 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.403 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710033+0000", 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017380630000000001 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710255+0000", 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022154799999999999 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.710664+0000", 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040952300000000002 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.404 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713235+0000", 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0025705049999999998 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713421+0000", 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018665399999999999 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713496+0000", 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4136999999999998e-05 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.405 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713558+0000", 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2261999999999994e-05 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 178.69062619300001, 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022010637, 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.406 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 116 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692668+0000", 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692669+0000", 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4300000000000002e-07 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692675+0000", 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0440000000000001e-06 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692686+0000", 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.118e-05 2024-04-26T12:41:03.408 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692694+0000", 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.8029999999999997e-06 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711607+0000", 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018912541000000001 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.711764+0000", 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015709200000000001 2024-04-26T12:41:03.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.712050+0000", 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028650799999999999 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713388+0000", 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001337766 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714396+0000", 2024-04-26T12:41:03.410 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0010082859999999999 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714573+0000", 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017656099999999999 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714679+0000", 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010611300000000001 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.411 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4160.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 178.69058911600001, 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022642954999999999, 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4160", 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/4102021267", 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 117 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.412 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692705+0000", 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692706+0000", 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7599999999999997e-07 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.413 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692714+0000", 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6699999999999994e-06 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692745+0000", 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0966000000000001e-05 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.692755+0000", 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0657e-05 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.414 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713597+0000", 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020841436000000001 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713725+0000", 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872299999999999 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.713935+0000", 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020946100000000001 2024-04-26T12:41:03.415 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.714957+0000", 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001021969 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715211+0000", 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025409400000000001 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715291+0000", 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9536999999999994e-05 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.416 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:38:04.715348+0000", 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7766000000000002e-05 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2349 3.37 3:ec3a3f83:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.682296172000001, 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023512585999999999, 2024-04-26T12:41:03.417 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2349 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.418 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.700998+0000", 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.701002+0000", 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7969999999999998e-06 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705773+0000", 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047707940000000001 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.419 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705810+0000", 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7543000000000003e-05 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705828+0000", 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.705952+0000", 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000123967 2024-04-26T12:41:03.420 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706240+0000", 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028815399999999999 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.706474+0000", 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000233878 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.716974+0000", 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010500061999999999 2024-04-26T12:41:03.421 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724253+0000", 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0072788139999999998 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724383+0000", 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013002000000000001 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.422 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.724511+0000", 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000128164 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2351 3.14 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.660183701000001, 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029175587999999999, 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.423 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2351 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723115+0000", 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8500000000000004e-06 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727939+0000", 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048243670000000004 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727979+0000", 2024-04-26T12:41:03.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0326e-05 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728003+0000", 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4193e-05 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728157+0000", 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015328 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728534+0000", 2024-04-26T12:41:03.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037701500000000002 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728958+0000", 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042402 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.742778+0000", 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013820426 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752106+0000", 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0093279780000000007 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752210+0000", 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103854 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752286+0000", 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6279000000000006e-05 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2353 3.2b e73/17 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head v 73'2, mlcod=0'0)", 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.630908099000003, 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022414480000000001, 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752386+0000", 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752388+0000", 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9530000000000002e-06 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760303+0000", 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079148240000000009 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760339+0000", 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5615999999999999e-05 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760363+0000", 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4272000000000001e-05 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760530+0000", 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000167047 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.760593+0000", 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3214999999999997e-05 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774684+0000", 2024-04-26T12:41:03.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01409087 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.774801+0000", 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011668299999999999 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2354 3.3f 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:41:03.433 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.624086662000003, 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028337384, 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2354 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:41:03.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759211+0000", 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762648+0000", 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003436854 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762685+0000", 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7004e-05 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762709+0000", 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3482999999999999e-05 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762871+0000", 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016273399999999999 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763073+0000", 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020189599999999999 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763271+0000", 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000197412 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.775210+0000", 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011939171 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787276+0000", 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012066464000000001 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787428+0000", 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000151383 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787545+0000", 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000117457 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2355 3.37 3:eff17c6c:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.616880408, 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02156363, 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.439 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2355 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766414+0000", 2024-04-26T12:41:03.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.766417+0000", 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3440000000000001e-06 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.770991+0000", 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004573756 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771029+0000", 2024-04-26T12:41:03.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7821999999999998e-05 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771053+0000", 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.387e-05 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771215+0000", 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016220300000000001 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771568+0000", 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000352472 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.771951+0000", 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038302699999999998 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787714+0000", 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015763065999999999 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787794+0000", 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0259999999999994e-05 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787886+0000", 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2472000000000005e-05 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787978+0000", 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1337999999999999e-05 2024-04-26T12:41:03.444 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2373 3.13 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.421099425999998, 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030808384000000001, 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.445 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2373 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962198+0000", 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1200000000000002e-06 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966728+0000", 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045301170000000002 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966768+0000", 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9619000000000001e-05 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966787+0000", 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8933999999999999e-05 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966954+0000", 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016689600000000001 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967341+0000", 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038776099999999998 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:03.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967720+0000", 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037867100000000002 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.980012+0000", 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012291717000000001 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992693+0000", 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012681192000000001 2024-04-26T12:41:03.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016807000000000001 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.993003+0000", 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142287 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2381 3.26 e73/17 3:66089a74:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_190:head v 73'4, mlcod=72'2)", 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.336325363999997, 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021426161999999999, 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046969+0000", 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.046971+0000", 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.39e-06 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051948+0000", 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049762549999999997 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.051984+0000", 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.625e-05 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052007+0000", 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2572e-05 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052200+0000", 2024-04-26T12:41:03.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000193372 2024-04-26T12:41:03.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.052261+0000", 2024-04-26T12:41:03.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.1471999999999997e-05 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068271+0000", 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016010027999999999 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.068395+0000", 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012382300000000001 2024-04-26T12:41:03.455 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2384 3.37 3:eff1e373:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_193:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.311065309999996, 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022518564000000001, 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.456 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2384 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072229+0000", 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.072232+0000", 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2569999999999999e-06 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076853+0000", 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046206870000000001 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076884+0000", 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1049e-05 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.076902+0000", 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8070000000000001e-05 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077053+0000", 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015034 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077312+0000", 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025907300000000002 2024-04-26T12:41:03.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.077559+0000", 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024693099999999998 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.087260+0000", 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0097015409999999993 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094578+0000", 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0073179739999999997 2024-04-26T12:41:03.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094666+0000", 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8160999999999998e-05 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.094748+0000", 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.1481000000000001e-05 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.461 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2402 3.11 3:8b6a636e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 51.116017012999997, 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026287990000000001, 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2402 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267277+0000", 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.267281+0000", 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.557e-06 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271739+0000", 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004457524 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271771+0000", 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2852999999999999e-05 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271790+0000", 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8889000000000002e-05 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271949+0000", 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015870000000000001 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272198+0000", 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024856800000000001 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.272455+0000", 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025784700000000001 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.291321+0000", 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018865189000000001 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293294+0000", 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.001973196 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293449+0000", 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0001552 2024-04-26T12:41:03.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.293565+0000", 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011646699999999999 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2413 3.2d 3:b6031bb3:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.991388522000001, 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020394760000000001, 2024-04-26T12:41:03.467 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2413 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391906+0000", 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.391909+0000", 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0429999999999999e-06 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396691+0000", 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047820140000000002 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396734+0000", 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396751+0000", 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7011999999999999e-05 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.396899+0000", 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014740399999999999 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397244+0000", 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034543200000000001 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.397484+0000", 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024016099999999999 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.405191+0000", 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0077069340000000004 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412133+0000", 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.006941465 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412231+0000", 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.7770999999999996e-05 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412301+0000", 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0191999999999995e-05 2024-04-26T12:41:03.472 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2414 3.37 3:efe9b32a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_223:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.977214771, 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019629488, 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.473 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2414 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406080+0000", 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.406083+0000", 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2729999999999998e-06 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411790+0000", 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0057067749999999999 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411830+0000", 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0525000000000002e-05 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411856+0000", 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5695999999999999e-05 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.411994+0000", 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013798400000000001 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412226+0000", 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023230399999999999 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.412447+0000", 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022097499999999999 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.423387+0000", 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010939574000000001 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425535+0000", 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002148109 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425634+0000", 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.8851000000000006e-05 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.425709+0000", 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5421999999999997e-05 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2427 3.d 3:b1e8d312:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.840868436000001, 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021368552999999998, 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2427 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542426+0000", 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.542430+0000", 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5669999999999999e-06 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547450+0000", 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050205040000000003 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547487+0000", 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6866000000000002e-05 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547506+0000", 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9343000000000001e-05 2024-04-26T12:41:03.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.547680+0000", 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017347599999999999 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548089+0000", 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040960699999999998 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.548515+0000", 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042551999999999998 2024-04-26T12:41:03.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.558096+0000", 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0095806929999999995 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563571+0000", 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054753329999999998 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563674+0000", 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010266400000000001 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.563795+0000", 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012098 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2430 3.37 3:eff5ab0a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.811598605999997, 2024-04-26T12:41:03.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020751628000000001, 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2430 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571696+0000", 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.571699+0000", 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5360000000000001e-06 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576275+0000", 2024-04-26T12:41:03.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045753479999999999 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576311+0000", 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5865999999999998e-05 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576328+0000", 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7393000000000001e-05 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576501+0000", 2024-04-26T12:41:03.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000172659 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.576910+0000", 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040915 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.577329+0000", 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041870699999999999 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.591164+0000", 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013835896 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592117+0000", 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00095214699999999998 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592309+0000", 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019207600000000001 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.592447+0000", 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013884999999999999 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2440 3.d 3:b0894f88:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_249:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 50.663148444000001, 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020963463000000002, 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:03.490 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2440 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720146+0000", 2024-04-26T12:41:03.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.720150+0000", 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5200000000000002e-06 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724635+0000", 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004485447 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724675+0000", 2024-04-26T12:41:03.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9938999999999998e-05 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724694+0000", 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9513000000000001e-05 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.724859+0000", 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016413899999999999 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725146+0000", 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000287387 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.725469+0000", 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00032321900000000002 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.739743+0000", 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014273485000000001 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.740904+0000", 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011612790000000001 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741034+0000", 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000130314 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.741109+0000", 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5221000000000004e-05 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.495 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2884 3.2f e91/17 3:f6197e28:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_239:head v 91'6, mlcod=90'4)", 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.281126394999999, 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022275581999999999, 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102168+0000", 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.102172+0000", 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.76e-06 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104815+0000", 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002643088 2024-04-26T12:41:03.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104864+0000", 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9450000000000003e-05 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.104891+0000", 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6990000000000001e-05 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.105091+0000", 2024-04-26T12:41:03.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019925499999999999 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.105154+0000", 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.2954999999999996e-05 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124376+0000", 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019222123000000001 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124444+0000", 2024-04-26T12:41:03.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7960999999999995e-05 2024-04-26T12:41:03.500 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.500 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.500 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.500 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:03.500 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:03.500 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:03.501 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:03.500+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:03.501 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:41:03.602 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:03.600+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:03.614 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:03.614 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:03.614 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:03.614 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:03.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:41:03.637 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:41:03.703 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:03.700+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:03.748 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:03.748 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:03.748 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:03.748 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:03.749 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:03.761 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:41:03.804 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:03.805+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:03.882 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:03.882 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:03.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:03.882 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:03.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.018482446999997, 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:41:03.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:41:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:41:03.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:41:03.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2333 3.12 3:49fff330:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.360755689999998, 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014903046, 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.888 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2333 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.889 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519353+0000", 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.519355+0000", 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1739999999999999e-06 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520939+0000", 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015836960000000001 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520971+0000", 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1930000000000001e-05 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.520986+0000", 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5420000000000001e-05 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521057+0000", 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0825e-05 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521178+0000", 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120316 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.521332+0000", 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015460800000000001 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.526796+0000", 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054637089999999998 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534174+0000", 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0073778660000000003 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534216+0000", 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1869000000000002e-05 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.534256+0000", 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0633000000000002e-05 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2337 3.1b 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.321674889999997, 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018047987000000001, 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2337 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.894 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558438+0000", 2024-04-26T12:41:03.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6239999999999999e-06 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559867+0000", 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014292490000000001 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559886+0000", 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8697000000000001e-05 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559898+0000", 2024-04-26T12:41:03.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2542e-05 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559976+0000", 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7610999999999999e-05 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560136+0000", 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160443 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560298+0000", 2024-04-26T12:41:03.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016194899999999999 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.566613+0000", 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063145279999999998 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576388+0000", 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097756340000000001 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576434+0000", 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6020000000000003e-05 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576482+0000", 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7689999999999999e-05 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2342 3.12 3:4a564d9a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.259502429999998, 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020986402000000001, 2024-04-26T12:41:03.899 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2342 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620609+0000", 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622196+0000", 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587045 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.901 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622224+0000", 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8028e-05 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622234+0000", 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0577999999999999e-05 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622319+0000", 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4296999999999996e-05 2024-04-26T12:41:03.902 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622520+0000", 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201571 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622753+0000", 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000232501 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.629187+0000", 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064345679999999999 2024-04-26T12:41:03.903 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641429+0000", 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012241573 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641522+0000", 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3239999999999995e-05 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641593+0000", 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0683000000000001e-05 2024-04-26T12:41:03.904 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2344 3.3 3:c3214891:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.231897044999997, 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017793122000000001, 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.905 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2344 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648214+0000", 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649908+0000", 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693069 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649940+0000", 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1974999999999998e-05 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649956+0000", 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6429000000000001e-05 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650027+0000", 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1346000000000004e-05 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650146+0000", 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118581 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650277+0000", 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013136300000000001 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.654910+0000", 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046332300000000003 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665861+0000", 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01095054 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665942+0000", 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0782e-05 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.666005+0000", 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3146999999999997e-05 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2350 3.12 3:494cd927:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:03.910 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.166329517999998, 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019319528999999998, 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2350 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713782+0000", 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0759999999999999e-06 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714797+0000", 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010147159999999999 2024-04-26T12:41:03.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714824+0000", 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.658e-05 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714838+0000", 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4609e-05 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714950+0000", 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112185 2024-04-26T12:41:03.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715172+0000", 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022140199999999999 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715311+0000", 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000138639 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.721604+0000", 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062931289999999997 2024-04-26T12:41:03.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.732954+0000", 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011350314 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733038+0000", 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4445999999999998e-05 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733099+0000", 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0433000000000002e-05 2024-04-26T12:41:03.915 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2353 3.2b 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.133028054999997, 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029788120000000001, 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.916 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2353 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747083+0000", 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748701+0000", 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016182550000000001 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748730+0000", 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8809000000000001e-05 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748741+0000", 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0949e-05 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748822+0000", 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0777000000000003e-05 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748827+0000", 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752276+0000", 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034484350000000001 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752425+0000", 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014880699999999999 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752572+0000", 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014723899999999999 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.757807+0000", 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052354319999999999 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776737+0000", 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018929437 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776811+0000", 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4651000000000001e-05 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776869+0000", 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7541999999999999e-05 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2369 3.12 3:4bcc53b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.960544036999998, 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014928745, 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.922 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2369 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919565+0000", 2024-04-26T12:41:03.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.919568+0000", 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0110000000000001e-06 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921453+0000", 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018855079999999999 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921476+0000", 2024-04-26T12:41:03.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2705e-05 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921490+0000", 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4049999999999999e-05 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921560+0000", 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9580999999999997e-05 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921710+0000", 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000150261 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.921810+0000", 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100351 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.926466+0000", 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046561160000000001 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934371+0000", 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079049830000000008 2024-04-26T12:41:03.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934442+0000", 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0607999999999999e-05 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.934494+0000", 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1570999999999998e-05 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2371 3.12 3:4aa38e60:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.939930764000003, 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016346532, 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2371 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940178+0000", 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.940181+0000", 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.931e-06 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941785+0000", 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016038700000000001 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941813+0000", 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827e-05 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941828+0000", 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5545000000000001e-05 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.941914+0000", 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5353999999999996e-05 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942093+0000", 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000179004 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.942264+0000", 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017166999999999999 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.946973+0000", 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047087179999999998 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956399+0000", 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094257760000000003 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956471+0000", 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1740000000000001e-05 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.956525+0000", 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4097000000000001e-05 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2403 3.3 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.602423799999997, 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019288092999999999, 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.933 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2403 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:41:03.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277689+0000", 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.941e-06 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279232+0000", 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015426719999999999 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279255+0000", 2024-04-26T12:41:03.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3059000000000001e-05 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279265+0000", 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9599999999999995e-06 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279330+0000", 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5282000000000003e-05 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279465+0000", 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135413 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279583+0000", 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011731900000000001 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.284332+0000", 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047490700000000002 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296834+0000", 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012501864 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296908+0000", 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3994999999999999e-05 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296973+0000", 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5518000000000005e-05 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2420 3.1f 3:f85890ec:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.404794369000001, 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016319348000000001, 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2420 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.939 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475314+0000", 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.475317+0000", 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5170000000000002e-06 2024-04-26T12:41:03.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476909+0000", 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015916389999999999 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476934+0000", 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5602999999999999e-05 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.476944+0000", 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5980000000000003e-06 2024-04-26T12:41:03.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477024+0000", 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9969999999999995e-05 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477203+0000", 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017948000000000001 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.477363+0000", 2024-04-26T12:41:03.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160008 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.482189+0000", 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048257430000000004 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491558+0000", 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093691820000000002 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491601+0000", 2024-04-26T12:41:03.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3099000000000002e-05 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.491634+0000", 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2509000000000003e-05 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2424 3.3 3:c1866c22:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.364792270999999, 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016771441000000002, 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.944 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2424 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515318+0000", 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516904+0000", 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015852570000000001 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516913+0000", 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1679999999999993e-06 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516921+0000", 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6319999999999997e-06 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516980+0000", 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9151999999999999e-05 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517101+0000", 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012034199999999999 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517259+0000", 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015827300000000001 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.522184+0000", 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004925296 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.531965+0000", 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009780647 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532033+0000", 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7546999999999996e-05 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532088+0000", 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5452999999999999e-05 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2842 3.1b 3:da1355e5:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.248416941, 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017378536999999999, 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2842 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631695+0000", 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0240000000000002e-06 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633298+0000", 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016033810000000001 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633326+0000", 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8192e-05 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633338+0000", 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1268e-05 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633418+0000", 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9847999999999999e-05 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633585+0000", 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000167496 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633743+0000", 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015822399999999999 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.638928+0000", 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051849690000000002 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.648991+0000", 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010062877 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.649033+0000", 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2197999999999998e-05 2024-04-26T12:41:03.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.649070+0000", 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7060000000000001e-05 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2867 3.12 3:4ae9c7d5:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.880794+0000", 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.999314602, 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014702395, 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.955 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2867 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.880794+0000", 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.880794+0000", 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.880798+0000", 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3170000000000002e-06 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882172+0000", 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001374756 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882202+0000", 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9484000000000001e-05 2024-04-26T12:41:03.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882217+0000", 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5332000000000002e-05 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882296+0000", 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8888999999999996e-05 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882434+0000", 2024-04-26T12:41:03.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013823000000000001 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.882581+0000", 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146592 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.887388+0000", 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048066660000000002 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.895308+0000", 2024-04-26T12:41:03.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079201889999999994 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.895425+0000", 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117094 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.895497+0000", 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1846000000000003e-05 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.960 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2870 3.17 3:e8fb4e0e:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.969227277, 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017263286999999999, 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2870 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910884+0000", 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912208+0000", 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013243 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912239+0000", 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0713999999999998e-05 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912254+0000", 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5048000000000001e-05 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912333+0000", 2024-04-26T12:41:03.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8886000000000003e-05 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912480+0000", 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014738199999999999 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912570+0000", 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9837000000000001e-05 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.917171+0000", 2024-04-26T12:41:03.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046010629999999999 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928063+0000", 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010892341 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928104+0000", 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0222999999999998e-05 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928145+0000", 2024-04-26T12:41:03.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1260000000000001e-05 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2878 3.2b 3:d6ec64be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.856662319, 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016634683000000001, 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2878 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023451+0000", 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025269+0000", 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001818465 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025313+0000", 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4443000000000001e-05 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025340+0000", 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6454000000000001e-05 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025467+0000", 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012757799999999999 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025786+0000", 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031818999999999999 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.026118+0000", 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000332696 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.034247+0000", 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081283770000000009 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.039934+0000", 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056876699999999997 2024-04-26T12:41:03.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.040018+0000", 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3194000000000003e-05 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.040081+0000", 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3578999999999996e-05 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.971 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2879 3.2b 3:d5c534be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_234:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.043786+0000", 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.836322837000001, 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016000855000000001, 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2879 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.043786+0000", 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.043786+0000", 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.043789+0000", 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045340+0000", 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015508270000000001 2024-04-26T12:41:03.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045375+0000", 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5104000000000001e-05 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045391+0000", 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045468+0000", 2024-04-26T12:41:03.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7262999999999995e-05 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045582+0000", 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113347 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.045712+0000", 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013066299999999999 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.050614+0000", 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049019320000000003 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.059501+0000", 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0088870809999999998 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.059670+0000", 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000168319 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.059787+0000", 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117359 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.976 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2889 3.12 3:4a48a540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.719097375, 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01761325, 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2889 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161014+0000", 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.249e-06 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164387+0000", 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003373479 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164426+0000", 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8733999999999999e-05 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164445+0000", 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9483e-05 2024-04-26T12:41:03.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164533+0000", 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7980999999999997e-05 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164700+0000", 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016626400000000001 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164856+0000", 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015638499999999999 2024-04-26T12:41:03.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.170310+0000", 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054534889999999997 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178389+0000", 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080794509999999996 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178500+0000", 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111399 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178625+0000", 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012433600000000001 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2891 3.2b 3:d7deca59:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.687376500999999, 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020816259, 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.982 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:03.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2891 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192735+0000", 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9399999999999998e-06 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197005+0000", 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042695859999999997 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197044+0000", 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9345999999999999e-05 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197068+0000", 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3788e-05 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197172+0000", 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104063 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197364+0000", 2024-04-26T12:41:03.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192239 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197561+0000", 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019647600000000001 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.206860+0000", 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092991719999999996 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213224+0000", 2024-04-26T12:41:03.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063636949999999999 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213413+0000", 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018908799999999999 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213549+0000", 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135866 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2892 3.20 e91/17 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head v 91'8, mlcod=90'6)", 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.671091711000001, 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020804692999999999, 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209019+0000", 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214490+0000", 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054710219999999999 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:03.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214515+0000", 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4539999999999999e-05 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214528+0000", 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2914999999999999e-05 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214672+0000", 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143957 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214738+0000", 2024-04-26T12:41:03.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6452999999999995e-05 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229776+0000", 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015037897 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229822+0000", 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5583e-05 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:03.993 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:03.995 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:41:03.995 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:03.992+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:04.095 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:04.093+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:04.154 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:04.154 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:04.154 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:04.154 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:04.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:41:04.197 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:04.196+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:04.298 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:04.296+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:04.337 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:04.338 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:04.338 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:04.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:41:04.399 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:04.397+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:04.468 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 170.02548656499999, 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:41:04.469 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2319 3.1a 3:58f869a1:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 53.088769198999998, 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013146055, 2024-04-26T12:41:04.474 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2319 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378950+0000", 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.378953+0000", 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.041e-06 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380420+0000", 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001467138 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380454+0000", 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4236999999999998e-05 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380470+0000", 2024-04-26T12:41:04.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6578999999999998e-05 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380544+0000", 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3616999999999997e-05 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380697+0000", 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015309199999999999 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.380801+0000", 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103513 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.385130+0000", 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00432906 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391960+0000", 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068303560000000001 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392034+0000", 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4119e-05 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.392097+0000", 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2303000000000003e-05 2024-04-26T12:41:04.480 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.732360290999999, 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.481 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:41:04.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.656104024000001, 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.487 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:04.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:41:04.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.492 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.644379655999998, 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.493 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2366 3.0 3:00ffdec7:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.579737147000003, 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013182772000000001, 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.499 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2366 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887983+0000", 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.887986+0000", 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3469999999999999e-06 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889575+0000", 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00158928 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889602+0000", 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6840999999999999e-05 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889617+0000", 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4667e-05 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889721+0000", 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104255 2024-04-26T12:41:04.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.889920+0000", 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019873199999999999 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.890088+0000", 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016799 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.895734+0000", 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056464139999999998 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901046+0000", 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053117019999999997 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901114+0000", 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8232999999999995e-05 2024-04-26T12:41:04.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.901165+0000", 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1310999999999997e-05 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.384171233000004, 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.505 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:41:04.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:41:04.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:41:04.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2391 3.31 3:8f508897:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.315152765999997, 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016948310000000001, 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2391 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152570+0000", 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154503+0000", 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001933234 2024-04-26T12:41:04.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154536+0000", 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3321000000000002e-05 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154553+0000", 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6288000000000001e-05 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154639+0000", 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6236000000000006e-05 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154820+0000", 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181306 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154983+0000", 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162929 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.160656+0000", 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056726550000000004 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169397+0000", 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087409170000000008 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169465+0000", 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8730000000000001e-05 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169515+0000", 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9795e-05 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2393 3.0 3:00caacb0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.291640510000001, 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010859486999999999, 2024-04-26T12:41:04.517 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2393 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176079+0000", 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.176082+0000", 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3970000000000001e-06 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178323+0000", 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002241818 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178348+0000", 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4335e-05 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178359+0000", 2024-04-26T12:41:04.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1092e-05 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178440+0000", 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0745e-05 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178581+0000", 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014098100000000001 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:04.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.178682+0000", 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010178099999999999 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.184116+0000", 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054341090000000003 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186805+0000", 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0026890529999999998 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186884+0000", 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8336000000000004e-05 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.186939+0000", 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4839999999999997e-05 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.255527993000001, 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:41:04.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:41:04.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.529 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.098225675999998, 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:41:04.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2418 3.25 3:a5c59874:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 52.016616620000001, 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010790129000000001, 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.535 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2418 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451103+0000", 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.451105+0000", 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.351e-06 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453261+0000", 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021551169999999998 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453277+0000", 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6935e-05 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453299+0000", 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1701000000000001e-05 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453368+0000", 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8591999999999997e-05 2024-04-26T12:41:04.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453517+0000", 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014963699999999999 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.453638+0000", 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120289 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461242+0000", 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0076041479999999998 2024-04-26T12:41:04.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461821+0000", 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00057901100000000004 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461860+0000", 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9498e-05 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.461893+0000", 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2849999999999999e-05 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.914822295, 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.541 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:41:04.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 51.884510466999998, 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.547 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.548 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.549 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:41:04.550 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:41:04.551 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.552 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2866 3.1a 3:58f8f444:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.871584+0000", 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.596135371999999, 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015223199999999999, 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.553 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2866 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.871584+0000", 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.554 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.871584+0000", 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.871587+0000", 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873170+0000", 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015824529999999999 2024-04-26T12:41:04.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873200+0000", 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0463e-05 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873213+0000", 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.314e-05 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873305+0000", 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873446+0000", 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014124999999999999 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873545+0000", 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9390999999999998e-05 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.877677+0000", 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041321600000000002 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.886672+0000", 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0089949639999999994 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.886754+0000", 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1957000000000002e-05 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.886808+0000", 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3258999999999999e-05 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2876 3.19 3:99dc00a3:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_231:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:04.559 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.986476+0000", 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.481243907, 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011066484999999999, 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2876 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.560 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.986476+0000", 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.986476+0000", 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.986478+0000", 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.385e-06 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988109+0000", 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001630664 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988143+0000", 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4103999999999997e-05 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988156+0000", 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2798e-05 2024-04-26T12:41:04.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988243+0000", 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7635999999999999e-05 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988407+0000", 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016399399999999999 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 3", 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.988573+0000", 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016574499999999999 2024-04-26T12:41:04.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.995806+0000", 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072327279999999999 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.997351+0000", 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015447900000000001 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.997441+0000", 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0542000000000001e-05 2024-04-26T12:41:04.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.997542+0000", 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101099 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2877 3.0 3:034022be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.004200+0000", 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.463520108000001, 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013380543, 2024-04-26T12:41:04.565 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2877 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.004200+0000", 2024-04-26T12:41:04.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.004200+0000", 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.004202+0000", 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.227e-06 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006212+0000", 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020105230000000002 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006256+0000", 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3713e-05 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006281+0000", 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5415999999999999e-05 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006424+0000", 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014246699999999999 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006705+0000", 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028105799999999999 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006965+0000", 2024-04-26T12:41:04.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025982400000000002 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.015592+0000", 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0086276059999999995 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.017450+0000", 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018577260000000001 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.017521+0000", 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1132999999999998e-05 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.017580+0000", 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8850000000000001e-05 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2880 3.4 3:22b427d1:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.412433589999999, 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017107469, 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2880 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.572 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055289+0000", 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0639999999999998e-06 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056815+0000", 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001525584 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056855+0000", 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9975000000000003e-05 2024-04-26T12:41:04.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056877+0000", 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2082e-05 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056988+0000", 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011092200000000001 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057219+0000", 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023134100000000001 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057442+0000", 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222981 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066157+0000", 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087146340000000006 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072145+0000", 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059887450000000002 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072294+0000", 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014865399999999999 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072394+0000", 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9487000000000005e-05 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2881 3.31 3:8da41a11:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.401588556, 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020325379000000001, 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2881 2024-04-26T12:41:04.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066135+0000", 2024-04-26T12:41:04.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4769999999999999e-06 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069604+0000", 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003469654 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069639+0000", 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4814000000000002e-05 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069657+0000", 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7674000000000001e-05 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069764+0000", 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106964 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069958+0000", 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019436099999999999 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.070135+0000", 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017677900000000001 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.078069+0000", 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007933664 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086371+0000", 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083028219999999996 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086413+0000", 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1838000000000002e-05 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086457+0000", 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2888 3.1a 3:59675540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.316357133, 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019783412, 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:04.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2888 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:04.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151366+0000", 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7859999999999998e-06 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156684+0000", 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053173350000000003 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:04.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156726+0000", 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156752+0000", 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6636999999999999e-05 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156859+0000", 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106698 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157025+0000", 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016556700000000001 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157182+0000", 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157684 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.165499+0000", 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083164580000000005 2024-04-26T12:41:04.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171012+0000", 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055134490000000001 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171082+0000", 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0103000000000003e-05 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171146+0000", 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3625000000000002e-05 2024-04-26T12:41:04.589 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:04.590 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:04.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:41:04.592 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:04.589+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:04.693 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:04.692+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:04.755 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:04.755 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:04.755 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:04.755 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:04.768 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:41:04.812 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:04.813+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:04.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:41:04.895 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:04.896 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:04.896 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:04.896 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:04.896 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:04.896 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:04.893+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:04.910 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:41:04.995 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:04.992+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:05.020 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:05.021 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:05.038 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:05.038 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:05.055 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:05.055 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:05.073 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:05.073 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:05.077 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:05.078 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:05.093 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:41:05.095 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:05.095 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:05.096 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:05.093+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:05.116 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:05.116 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:05.136 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:05.136 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:05.158 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:05.159 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:05.207 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:05.207 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:05.209 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:05.205+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:05.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:41:05.297 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:05.296+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:05.392 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:05.392 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:05.398 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:05.396+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:05.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:41:05.499 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:05.496+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:05.519 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:05.519 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:05.532 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:41:05.600 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:05.596+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:05.659 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:41:05.664 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:05.664 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:05.679 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:41:05.721 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:05.720+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:05.801 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:05.801+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:05.845 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:05.845 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:05.859 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:41:05.902 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:05.901+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:05.978 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:05.979 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:05.993 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:41:06.003 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:06.001+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:06.104 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:06.104+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:06.117 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:06.118 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:06.132 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:41:06.205 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:06.205+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:06.293 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:06.294 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:06.306 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:06.304+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:06.308 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:41:06.407 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:06.405+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:06.483 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:06.483 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:06.499 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:41:06.507 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:06.505+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:06.608 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:06.605+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:06.622 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:06.622 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:06.636 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:41:06.664 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:41:06.724 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:06.725+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:06.762 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:06.762 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:06.776 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:41:06.820 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:06.820+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:06.900 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:06.900 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:06.911 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:06.909+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:06.914 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:41:07.012 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:07.012+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:07.088 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:07.088 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:07.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:41:07.113 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:07.113+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:07.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:41:07.221 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:07.221+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:07.270 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:07.270 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:07.284 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:41:07.314 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:07.313+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:07.322 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:07.322 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:07.340 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:07.340 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:07.356 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:07.356 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:07.374 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:07.374 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:07.396 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:07.396 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:07.406 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:07.406 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:07.415 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:07.413+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:07.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:41:07.421 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:07.421 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:07.448 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:07.448 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:07.482 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:07.483 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:07.516 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:07.517+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:07.578 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3072 3.17 3:e94dfc04:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.574942+0000", 2024-04-26T12:41:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.0045733589999999999, 2024-04-26T12:41:07.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046280660000000001, 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3072 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.574942+0000", 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.574942+0000", 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.574945+0000", 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.88e-06 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576849+0000", 2024-04-26T12:41:07.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019043269999999999 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576872+0000", 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3255999999999999e-05 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576885+0000", 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2622999999999999e-05 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576959+0000", 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4257000000000004e-05 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.577106+0000", 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146663 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.577235+0000", 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000128925 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.582 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-04-26T12:41:07.583 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 1 2024-04-26T12:41:07.583 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:07.599 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:41:07.649 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:07.645+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:07.717 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:07.717+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:07.745 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:07.745 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:07.745 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:07.745 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:07.745 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:07.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:41:07.849 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:07.849+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:07.919 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:07.916+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:07.956 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:07.956 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:07.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:07.956 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:07.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.956 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:41:07.956 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:07.956 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 70.093398245000003, 2024-04-26T12:41:07.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:41:07.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:41:07.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:41:07.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:41:07.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2337 3.1b 3:dbd269b0:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.396590688000003, 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018047987000000001, 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:07.962 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2337 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558434+0000", 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.558438+0000", 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6239999999999999e-06 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559867+0000", 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014292490000000001 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559886+0000", 2024-04-26T12:41:07.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8697000000000001e-05 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559898+0000", 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2542e-05 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.559976+0000", 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7610999999999999e-05 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:07.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560136+0000", 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000160443 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.560298+0000", 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016194899999999999 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.566613+0000", 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063145279999999998 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576388+0000", 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097756340000000001 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576434+0000", 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6020000000000003e-05 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.576482+0000", 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7689999999999999e-05 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:07.967 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2342 3.12 3:4a564d9a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.334418227999997, 2024-04-26T12:41:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020986402000000001, 2024-04-26T12:41:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:07.968 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2342 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:07.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620609+0000", 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622196+0000", 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587045 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622224+0000", 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8028e-05 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622234+0000", 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0577999999999999e-05 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622319+0000", 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4296999999999996e-05 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622520+0000", 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201571 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:07.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622753+0000", 2024-04-26T12:41:07.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000232501 2024-04-26T12:41:07.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:07.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.629187+0000", 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064345679999999999 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641429+0000", 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012241573 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641522+0000", 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3239999999999995e-05 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641593+0000", 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0683000000000001e-05 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2344 3.3 3:c3214891:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.306812843000003, 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017793122000000001, 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:07.975 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2344 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648212+0000", 2024-04-26T12:41:07.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.648214+0000", 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6599999999999999e-06 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649908+0000", 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693069 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:07.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649940+0000", 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1974999999999998e-05 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.649956+0000", 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6429000000000001e-05 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650027+0000", 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1346000000000004e-05 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650146+0000", 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118581 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.650277+0000", 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013136300000000001 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.654910+0000", 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046332300000000003 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665861+0000", 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01095054 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.665942+0000", 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0782e-05 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.666005+0000", 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3146999999999997e-05 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:07.980 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2350 3.12 3:494cd927:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.241245315999997, 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019319528999999998, 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2350 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.981 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713779+0000", 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.713782+0000", 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0759999999999999e-06 2024-04-26T12:41:07.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714797+0000", 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0010147159999999999 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714824+0000", 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.658e-05 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714838+0000", 2024-04-26T12:41:07.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4609e-05 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.714950+0000", 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112185 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715172+0000", 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022140199999999999 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:07.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.715311+0000", 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000138639 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.721604+0000", 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0062931289999999997 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.732954+0000", 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011350314 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:07.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733038+0000", 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4445999999999998e-05 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.733099+0000", 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0433000000000002e-05 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2353 3.2b 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:07.986 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.207943853000003, 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029788120000000001, 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2353 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:07.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747083+0000", 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:07.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748701+0000", 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016182550000000001 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748730+0000", 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8809000000000001e-05 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748741+0000", 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0949e-05 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748822+0000", 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0777000000000003e-05 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748827+0000", 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752276+0000", 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034484350000000001 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752425+0000", 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014880699999999999 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752572+0000", 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014723899999999999 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.757807+0000", 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052354319999999999 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776737+0000", 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018929437 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776811+0000", 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4651000000000001e-05 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776869+0000", 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7541999999999999e-05 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.992 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2403 3.3 3:c25af494:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 55.677339598000003, 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019288092999999999, 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2403 2024-04-26T12:41:07.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277685+0000", 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:07.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.277689+0000", 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.941e-06 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279232+0000", 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015426719999999999 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279255+0000", 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3059000000000001e-05 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:07.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279265+0000", 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9599999999999995e-06 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279330+0000", 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5282000000000003e-05 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279465+0000", 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135413 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.279583+0000", 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011731900000000001 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.284332+0000", 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047490700000000002 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296834+0000", 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012501864 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296908+0000", 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3994999999999999e-05 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.296973+0000", 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5518000000000005e-05 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2424 3.3 3:c1866c22:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 55.439708068999998, 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016771441000000002, 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2424 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:07.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515317+0000", 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.515318+0000", 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.674e-06 2024-04-26T12:41:08.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516904+0000", 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015852570000000001 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516913+0000", 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1679999999999993e-06 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516921+0000", 2024-04-26T12:41:08.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6319999999999997e-06 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.516980+0000", 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9151999999999999e-05 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517101+0000", 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012034199999999999 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.517259+0000", 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015827300000000001 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.522184+0000", 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004925296 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.531965+0000", 2024-04-26T12:41:08.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.009780647 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532033+0000", 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7546999999999996e-05 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.532088+0000", 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5452999999999999e-05 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2842 3.1b 3:da1355e5:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.323332739000001, 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017378536999999999, 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2842 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.005 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631692+0000", 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.631695+0000", 2024-04-26T12:41:08.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0240000000000002e-06 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633298+0000", 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016033810000000001 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633326+0000", 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8192e-05 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633338+0000", 2024-04-26T12:41:08.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1268e-05 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633418+0000", 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9847999999999999e-05 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633585+0000", 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000167496 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.633743+0000", 2024-04-26T12:41:08.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015822399999999999 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.638928+0000", 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051849690000000002 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.648991+0000", 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010062877 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.649033+0000", 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2197999999999998e-05 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.649070+0000", 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7060000000000001e-05 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2870 3.17 3:e8fb4e0e:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:41:08.010 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.044143075000001, 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017263286999999999, 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2870 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:41:08.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910882+0000", 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.910884+0000", 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912208+0000", 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013243 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912239+0000", 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0713999999999998e-05 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912254+0000", 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5048000000000001e-05 2024-04-26T12:41:08.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912333+0000", 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8886000000000003e-05 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912480+0000", 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014738199999999999 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.912570+0000", 2024-04-26T12:41:08.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9837000000000001e-05 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.917171+0000", 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046010629999999999 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928063+0000", 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010892341 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928104+0000", 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0222999999999998e-05 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.928145+0000", 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1260000000000001e-05 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2878 3.2b 3:d6ec64be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.931578117000001, 2024-04-26T12:41:08.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016634683000000001, 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2878 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023447+0000", 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.023451+0000", 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0369999999999996e-06 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025269+0000", 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001818465 2024-04-26T12:41:08.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025313+0000", 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4443000000000001e-05 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025340+0000", 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6454000000000001e-05 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025467+0000", 2024-04-26T12:41:08.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012757799999999999 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.025786+0000", 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031818999999999999 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.026118+0000", 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000332696 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.034247+0000", 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081283770000000009 2024-04-26T12:41:08.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.039934+0000", 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056876699999999997 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.040018+0000", 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3194000000000003e-05 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.040081+0000", 2024-04-26T12:41:08.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3578999999999996e-05 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2889 3.12 3:4a48a540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_244:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.794013173, 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01761325, 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.022 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2889 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161011+0000", 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.161014+0000", 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.249e-06 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164387+0000", 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003373479 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164426+0000", 2024-04-26T12:41:08.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8733999999999999e-05 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164445+0000", 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9483e-05 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164533+0000", 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7980999999999997e-05 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164700+0000", 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016626400000000001 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.164856+0000", 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015638499999999999 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.170310+0000", 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054534889999999997 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178389+0000", 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0080794509999999996 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178500+0000", 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111399 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.178625+0000", 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012433600000000001 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.027 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2891 3.2b 3:d7deca59:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.762292298999999, 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020816259, 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2891 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.028 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192735+0000", 2024-04-26T12:41:08.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9399999999999998e-06 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197005+0000", 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042695859999999997 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197044+0000", 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9345999999999999e-05 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197068+0000", 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3788e-05 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197172+0000", 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104063 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197364+0000", 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192239 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197561+0000", 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019647600000000001 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.206860+0000", 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092991719999999996 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213224+0000", 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063636949999999999 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213413+0000", 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018908799999999999 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213549+0000", 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135866 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2892 3.20 e91/17 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head v 91'8, mlcod=90'6)", 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:08.033 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.746007509000002, 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020804692999999999, 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:08.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209019+0000", 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214490+0000", 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054710219999999999 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214515+0000", 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4539999999999999e-05 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214528+0000", 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2914999999999999e-05 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214672+0000", 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143957 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214738+0000", 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6452999999999995e-05 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229776+0000", 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015037897 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229822+0000", 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5583e-05 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.037 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3066 3.2b 3:d76415b5:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.513853+0000", 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.44117118399999999, 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019175860999999999, 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3066 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.038 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.513853+0000", 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.513853+0000", 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.513856+0000", 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8140000000000001e-06 2024-04-26T12:41:08.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.516223+0000", 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0023662750000000001 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.516256+0000", 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3389999999999997e-05 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.516270+0000", 2024-04-26T12:41:08.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4409999999999999e-05 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.516377+0000", 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106714 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.516512+0000", 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013504899999999999 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.516669+0000", 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156694 2024-04-26T12:41:08.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.523290+0000", 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0066215730000000004 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.532900+0000", 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0096098610000000008 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.532975+0000", 2024-04-26T12:41:08.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4663e-05 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.533029+0000", 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4418e-05 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3067 3.1 3:8267f722:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.527447+0000", 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.42757799200000002, 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019414417, 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.043 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3067 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.527447+0000", 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.527447+0000", 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.527449+0000", 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1940000000000001e-06 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529507+0000", 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020580770000000002 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529540+0000", 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2642999999999999e-05 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529554+0000", 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4089e-05 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529637+0000", 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3362999999999995e-05 2024-04-26T12:41:08.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529808+0000", 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017100700000000001 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529970+0000", 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016244 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.534830+0000", 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048598570000000004 2024-04-26T12:41:08.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.546750+0000", 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011919641 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.546820+0000", 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9826000000000005e-05 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.546861+0000", 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1279999999999998e-05 2024-04-26T12:41:08.048 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3069 3.1f 3:fb85483d:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.544919+0000", 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.41010535199999998, 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01887467, 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.049 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3069 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.544919+0000", 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.544919+0000", 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.544921+0000", 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0940000000000002e-06 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.546955+0000", 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020331279999999999 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.546972+0000", 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7482e-05 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.546982+0000", 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0215e-05 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.547066+0000", 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3536999999999997e-05 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.547250+0000", 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018439300000000001 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:08.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.547408+0000", 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015831100000000001 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.553095+0000", 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056866959999999998 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.563661+0000", 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010565955 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.563726+0000", 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4728999999999996e-05 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.563794+0000", 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.813e-05 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3084 3.1b 3:d851693d:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.054 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.699052+0000", 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.25597225099999998, 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018777194000000001, 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3084 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.699052+0000", 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.699052+0000", 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.699056+0000", 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.597e-06 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.700994+0000", 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019375970000000001 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.701015+0000", 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1072000000000001e-05 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.701028+0000", 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3766e-05 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.701111+0000", 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2937999999999998e-05 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.701241+0000", 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129264 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.701332+0000", 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1617000000000001e-05 2024-04-26T12:41:08.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.707939+0000", 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0066064269999999998 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.717757+0000", 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0098181029999999999 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.717796+0000", 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9353000000000001e-05 2024-04-26T12:41:08.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.717830+0000", 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3460000000000002e-05 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3093 3.12 3:4a7cc5cd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.795015+0000", 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.16000947700000001, 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019460485999999999, 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.060 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3093 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.795015+0000", 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.795015+0000", 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.795018+0000", 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5390000000000002e-06 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796526+0000", 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015087550000000001 2024-04-26T12:41:08.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796550+0000", 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3493999999999999e-05 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796561+0000", 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0665e-05 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796632+0000", 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1814000000000001e-05 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796752+0000", 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119288 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796844+0000", 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1984999999999994e-05 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.801995+0000", 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051510369999999998 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.814344+0000", 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012349224000000001 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.814422+0000", 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7690999999999999e-05 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.814476+0000", 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3993999999999998e-05 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3104 3.2b 3:d72d56fd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.913481+0000", 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.041543904999999999, 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017456721000000001, 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3104 2024-04-26T12:41:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.913481+0000", 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.913481+0000", 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.913484+0000", 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8049999999999998e-06 2024-04-26T12:41:08.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.915616+0000", 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021320549999999999 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.915636+0000", 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0024e-05 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.915648+0000", 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2564e-05 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.915726+0000", 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7347000000000003e-05 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.915839+0000", 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000113689 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.915946+0000", 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107229 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.920967+0000", 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050202880000000004 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.930793+0000", 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0098261049999999999 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.930880+0000", 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7651000000000005e-05 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.930937+0000", 2024-04-26T12:41:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6963999999999999e-05 2024-04-26T12:41:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.071 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.071 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:08.072 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:41:08.073 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:08.072+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:08.173 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:08.172+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:08.269 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:08.269 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:08.269 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:08.274 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:08.273+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:08.291 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:41:08.376 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:08.377+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:08.476 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:08.473+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:08.479 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:08.479 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:08.480 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:08.480 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:08.480 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:08.497 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:41:08.588 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:08.589+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:08.678 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:08.678 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e22)", 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 174.23564730499999, 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01346055, 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "reached pg", 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4455", 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/4056880142", 2024-04-26T12:41:08.679 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442233+0000", 2024-04-26T12:41:08.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442236+0000", 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6010000000000002e-06 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442246+0000", 2024-04-26T12:41:08.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9119999999999993e-06 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442265+0000", 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9170000000000001e-05 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.442281+0000", 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.577e-05 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443076+0000", 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00079583300000000002 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for peered", 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.443092+0000", 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5712000000000001e-05 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.454972+0000", 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011879704 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:38:14.455694+0000", 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00072184799999999998 2024-04-26T12:41:08.683 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.942521030999998, 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.684 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:41:08.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:41:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:41:08.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.866264764, 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:41:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:41:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:41:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:41:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:41:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:41:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:08.699 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.854540395999997, 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:41:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:41:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:41:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:41:08.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:41:08.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:41:08.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:41:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:41:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:41:08.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.594331973000003, 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.706 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:41:08.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2391 3.31 3:8f508897:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.525313506000003, 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016948310000000001, 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.712 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2391 2024-04-26T12:41:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.713 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:41:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152567+0000", 2024-04-26T12:41:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.152570+0000", 2024-04-26T12:41:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8990000000000001e-06 2024-04-26T12:41:08.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154503+0000", 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001933234 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154536+0000", 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3321000000000002e-05 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154553+0000", 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6288000000000001e-05 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154639+0000", 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6236000000000006e-05 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154820+0000", 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181306 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.154983+0000", 2024-04-26T12:41:08.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162929 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.160656+0000", 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056726550000000004 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169397+0000", 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087409170000000008 2024-04-26T12:41:08.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169465+0000", 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8730000000000001e-05 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.169515+0000", 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9795e-05 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.719 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.465688733, 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.720 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:41:08.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:41:08.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.308386415999998, 2024-04-26T12:41:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:41:08.726 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:41:08.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:41:08.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.124983035, 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:41:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:41:08.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:41:08.739 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.094671206999998, 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.740 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:41:08.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:41:08.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:41:08.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:41:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:41:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2866 3.1a 3:58f8f444:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.871584+0000", 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.806296111999998, 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015223199999999999, 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.747 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2866 2024-04-26T12:41:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.871584+0000", 2024-04-26T12:41:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.871584+0000", 2024-04-26T12:41:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.871587+0000", 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.74e-06 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873170+0000", 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015824529999999999 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873200+0000", 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0463e-05 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873213+0000", 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.314e-05 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873305+0000", 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1422999999999995e-05 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873446+0000", 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014124999999999999 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.873545+0000", 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9390999999999998e-05 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.877677+0000", 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041321600000000002 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.886672+0000", 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0089949639999999994 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.886754+0000", 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1957000000000002e-05 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.886808+0000", 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3258999999999999e-05 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.753 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2877 3.0 3:034022be:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_232:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.004200+0000", 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.673680848, 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013380543, 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2877 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.754 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.004200+0000", 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.004200+0000", 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.004202+0000", 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.227e-06 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006212+0000", 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020105230000000002 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006256+0000", 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3713e-05 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006281+0000", 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5415999999999999e-05 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006424+0000", 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014246699999999999 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006705+0000", 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028105799999999999 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.006965+0000", 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025982400000000002 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.015592+0000", 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0086276059999999995 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.017450+0000", 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018577260000000001 2024-04-26T12:41:08.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.017521+0000", 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1132999999999998e-05 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.017580+0000", 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8850000000000001e-05 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2880 3.4 3:22b427d1:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.759 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.622594329999998, 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017107469, 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2880 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055289+0000", 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0639999999999998e-06 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056815+0000", 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001525584 2024-04-26T12:41:08.762 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056855+0000", 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9975000000000003e-05 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056877+0000", 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2082e-05 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.763 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056988+0000", 2024-04-26T12:41:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011092200000000001 2024-04-26T12:41:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057219+0000", 2024-04-26T12:41:08.764 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023134100000000001 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057442+0000", 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222981 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066157+0000", 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087146340000000006 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.765 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072145+0000", 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059887450000000002 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072294+0000", 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014865399999999999 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072394+0000", 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9487000000000005e-05 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.766 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2881 3.31 3:8da41a11:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.611749295999999, 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020325379000000001, 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2881 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.767 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066135+0000", 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4769999999999999e-06 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069604+0000", 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003469654 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069639+0000", 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4814000000000002e-05 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069657+0000", 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7674000000000001e-05 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069764+0000", 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106964 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069958+0000", 2024-04-26T12:41:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019436099999999999 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.070135+0000", 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017677900000000001 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.078069+0000", 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007933664 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086371+0000", 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083028219999999996 2024-04-26T12:41:08.771 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086413+0000", 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1838000000000002e-05 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086457+0000", 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.772 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2888 3.1a 3:59675540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.526517873, 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019783412, 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2888 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:08.773 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151366+0000", 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7859999999999998e-06 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156684+0000", 2024-04-26T12:41:08.774 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053173350000000003 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156726+0000", 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156752+0000", 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6636999999999999e-05 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156859+0000", 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106698 2024-04-26T12:41:08.775 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157025+0000", 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016556700000000001 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157182+0000", 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157684 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.165499+0000", 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083164580000000005 2024-04-26T12:41:08.776 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171012+0000", 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055134490000000001 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171082+0000", 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0103000000000003e-05 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171146+0000", 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3625000000000002e-05 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.777 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3063 3.25 3:a5f57f88:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.482526+0000", 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.1953542879999999, 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013281306999999999, 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.778 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3063 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.482526+0000", 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.482526+0000", 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.779 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.482529+0000", 2024-04-26T12:41:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6759999999999999e-06 2024-04-26T12:41:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.780 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.484517+0000", 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019885559999999998 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.484544+0000", 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7002e-05 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.484555+0000", 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0727000000000001e-05 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.484634+0000", 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9332999999999994e-05 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.782 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.484763+0000", 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000128069 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.484907+0000", 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144046 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.783 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.492829+0000", 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0079226039999999998 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.495690+0000", 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028608319999999998 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.495756+0000", 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5940999999999998e-05 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.784 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.495807+0000", 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1520999999999997e-05 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3073 3.1a 3:5b06f432:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.0925070990000001, 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021910276999999999, 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.785 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3073 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:08.786 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585375+0000", 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587174+0000", 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017990790000000001 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587195+0000", 2024-04-26T12:41:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0559000000000001e-05 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587205+0000", 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0217000000000001e-05 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587285+0000", 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9320999999999995e-05 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587426+0000", 2024-04-26T12:41:08.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163899999999999 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587534+0000", 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010822700000000001 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.592241+0000", 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047071090000000001 2024-04-26T12:41:08.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607152+0000", 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014910048 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607226+0000", 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4960000000000001e-05 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607284+0000", 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7132000000000001e-05 2024-04-26T12:41:08.790 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3107 3.31 3:8f78493a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.73361548600000004, 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017172129000000001, 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.791 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3107 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944267+0000", 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.069e-06 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946361+0000", 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020936710000000001 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946394+0000", 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3229000000000003e-05 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946409+0000", 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4738e-05 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946488+0000", 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8863999999999996e-05 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946636+0000", 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014802700000000001 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946734+0000", 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.87e-05 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.951880+0000", 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051454980000000001 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961302+0000", 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094217869999999992 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961378+0000", 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6477000000000007e-05 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961437+0000", 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9069e-05 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3112 3.31 3:8d0978ab:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:08.796 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.68408385000000005, 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022999863999999998, 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3112 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993799+0000", 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5909999999999998e-06 2024-04-26T12:41:08.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995315+0000", 2024-04-26T12:41:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015153530000000001 2024-04-26T12:41:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995339+0000", 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4700999999999999e-05 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995349+0000", 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.024e-05 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995427+0000", 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7830999999999994e-05 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995543+0000", 2024-04-26T12:41:08.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115209 2024-04-26T12:41:08.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995684+0000", 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163500000000001 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.001302+0000", 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005617866 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016681+0000", 2024-04-26T12:41:08.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015378660000000001 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016744+0000", 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3674000000000001e-05 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016796+0000", 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2104000000000001e-05 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.803 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3120 3.25 3:a569b8e0:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.086364+0000", 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.591516245, 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013393828999999999, 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3120 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.086364+0000", 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.086364+0000", 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.086368+0000", 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.455e-06 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:08.805 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.088122+0000", 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017544380000000001 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.088158+0000", 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6121000000000002e-05 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.088174+0000", 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6263999999999999e-05 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:08.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.088286+0000", 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111914 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.088464+0000", 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017750700000000001 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.088629+0000", 2024-04-26T12:41:08.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016522499999999999 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.099191+0000", 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010561546 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.099642+0000", 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00045090499999999998 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:08.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.099707+0000", 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5648999999999994e-05 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.099758+0000", 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0804999999999999e-05 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:08.809 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:08.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:41:08.811 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:08.676+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:08.812 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:41:08.812 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:08.809+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:08.912 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:08.913+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:09.001 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:09.001 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:09.001 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:09.013 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:09.013+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:09.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:41:09.115 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:09.112+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:09.204 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:09.204 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:09.204 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:09.204 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:09.204 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:09.216 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:09.213+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:09.227 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:41:09.317 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:09.316+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:09.418 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:09.416+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:09.431 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2364 3.3a 3:5f88866d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.566313774000001, 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017066136999999999, 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.432 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2364 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864870+0000", 2024-04-26T12:41:09.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.864873+0000", 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0989999999999999e-06 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866782+0000", 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001908325 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866804+0000", 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2331999999999999e-05 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866817+0000", 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2951e-05 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866910+0000", 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2817000000000003e-05 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.866915+0000", 2024-04-26T12:41:09.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0699999999999997e-06 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870125+0000", 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032105279999999998 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870302+0000", 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017691699999999999 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:09.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.870475+0000", 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017258400000000001 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.877926+0000", 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074516069999999998 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881845+0000", 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0039187570000000001 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881885+0000", 2024-04-26T12:41:09.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0234000000000001e-05 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.881936+0000", 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0915999999999998e-05 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 57.124818222999998, 2024-04-26T12:41:09.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:41:09.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:41:09.443 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2426 3.f 3:f3fcc542:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 56.897488803999998, 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017310012999999999, 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.444 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2426 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533695+0000", 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.533698+0000", 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8389999999999998e-06 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535314+0000", 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016156949999999999 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535339+0000", 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5117e-05 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535349+0000", 2024-04-26T12:41:09.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0569e-05 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535414+0000", 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5080999999999996e-05 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535529+0000", 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114302 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.535625+0000", 2024-04-26T12:41:09.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6210000000000002e-05 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.542763+0000", 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071382149999999998 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550914+0000", 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081504420000000008 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.550953+0000", 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9597000000000001e-05 2024-04-26T12:41:09.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.551005+0000", 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1946e-05 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2853 3.9 3:91cf5c60:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.740144+0000", 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.691040111, 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017019739999999998, 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2853 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.740144+0000", 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.740144+0000", 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.740147+0000", 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4989999999999999e-06 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.741820+0000", 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001672322 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.741843+0000", 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3020999999999999e-05 2024-04-26T12:41:09.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.741856+0000", 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3105000000000001e-05 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.741928+0000", 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2156000000000005e-05 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.742059+0000", 2024-04-26T12:41:09.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013074699999999999 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.742157+0000", 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8745000000000004e-05 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.746562+0000", 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044046900000000002 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.757035+0000", 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010472673 2024-04-26T12:41:09.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.757096+0000", 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1074000000000005e-05 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.757164+0000", 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7707999999999996e-05 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2875 3.21 3:86472b2d:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.972911+0000", 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.458272578999999, 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013145985000000001, 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2875 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.972911+0000", 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.972911+0000", 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.972914+0000", 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.723e-06 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.974666+0000", 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017515059999999999 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.974696+0000", 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0108e-05 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.974708+0000", 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2447e-05 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.974830+0000", 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012211599999999999 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.975059+0000", 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022834400000000001 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.975241+0000", 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018195799999999999 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.985254+0000", 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010013215000000001 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.985913+0000", 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00065919000000000004 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.985993+0000", 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0487000000000004e-05 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.986057+0000", 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3891000000000002e-05 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2886 3.f 3:f1601af9:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.312367957999999, 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018140835000000001, 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.460 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2886 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:09.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118818+0000", 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.120998+0000", 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021794050000000001 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.462 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121023+0000", 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5063e-05 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121036+0000", 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.308e-05 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121148+0000", 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112575 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121377+0000", 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022841100000000001 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121584+0000", 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020710600000000001 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.127654+0000", 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006070069 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136884+0000", 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092296909999999999 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136926+0000", 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2215000000000002e-05 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136957+0000", 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-05 2024-04-26T12:41:09.465 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3064 3.9 3:9202b9a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.937202756, 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020230000000000001, 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.466 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3064 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493984+0000", 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2289999999999999e-06 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496913+0000", 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029283989999999999 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496937+0000", 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496947+0000", 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497017+0000", 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9735999999999998e-05 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497139+0000", 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012228 2024-04-26T12:41:09.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497237+0000", 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8326999999999996e-05 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.502130+0000", 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048921540000000001 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514064+0000", 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011933918999999999 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514147+0000", 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3065999999999994e-05 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514211+0000", 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4597999999999994e-05 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3079 3.f 3:f046d02e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.646101+0000", 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.785083328, 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016442563, 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3079 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.472 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.646101+0000", 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.646101+0000", 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.646104+0000", 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0709999999999999e-06 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.648068+0000", 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019638899999999998 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.648098+0000", 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0865999999999999e-05 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.648112+0000", 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3651e-05 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.648204+0000", 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2239999999999998e-05 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.648396+0000", 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000191752 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.648578+0000", 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181588 2024-04-26T12:41:09.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.653939+0000", 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053616740000000003 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.662453+0000", 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0085136540000000007 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.662495+0000", 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2376000000000002e-05 2024-04-26T12:41:09.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.662543+0000", 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7800999999999999e-05 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3085 3.9 3:9305a4d5:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.710835+0000", 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.720349388, 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017237296999999999, 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.477 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3085 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.710835+0000", 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.710835+0000", 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.710837+0000", 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5440000000000001e-06 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.712437+0000", 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001600043 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.712466+0000", 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9289999999999999e-05 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.712477+0000", 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0576e-05 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.712550+0000", 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2589999999999994e-05 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.712707+0000", 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015786700000000001 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.712831+0000", 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000123774 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.717084+0000", 2024-04-26T12:41:09.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042526880000000001 2024-04-26T12:41:09.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.727961+0000", 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010876881 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.728031+0000", 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9729999999999998e-05 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.483 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.728072+0000", 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1313999999999998e-05 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3099 3.3a 3:5dfa2a16:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.860270+0000", 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.5709140660000001, 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013433327, 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3099 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.860270+0000", 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.860270+0000", 2024-04-26T12:41:09.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.860273+0000", 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.695e-06 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.862133+0000", 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001860453 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.862164+0000", 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0861000000000001e-05 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.862177+0000", 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2985e-05 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.862269+0000", 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1687000000000005e-05 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.862447+0000", 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178899 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 0", 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.862605+0000", 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000158028 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.872273+0000", 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0096671770000000008 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.873575+0000", 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001302016 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.873641+0000", 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6190000000000002e-05 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.873703+0000", 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2335999999999994e-05 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3106 3.2e 3:75381650:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.497491101, 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020388387000000001, 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3106 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.490 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933696+0000", 2024-04-26T12:41:09.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9359999999999999e-06 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935132+0000", 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001436377 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935165+0000", 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2846999999999999e-05 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935181+0000", 2024-04-26T12:41:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935260+0000", 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9042999999999995e-05 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935412+0000", 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015139299999999999 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:09.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935526+0000", 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114076 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.940843+0000", 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053172339999999997 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.953947+0000", 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01310396 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954024+0000", 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7657000000000005e-05 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954081+0000", 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6733e-05 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:3125 3.2d e102/17 3:b45fdd8b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_70:head v 102'10, mlcod=91'8)", 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.152677+0000", 2024-04-26T12:41:09.495 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.2785069949999999, 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015327577, 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.152677+0000", 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.152677+0000", 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.152678+0000", 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.268e-06 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159656+0000", 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0069775100000000001 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159670+0000", 2024-04-26T12:41:09.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4465e-05 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159679+0000", 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3100000000000006e-06 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159759+0000", 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9195000000000003e-05 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159786+0000", 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7639000000000001e-05 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.167955+0000", 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081682609999999996 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.168005+0000", 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9929000000000003e-05 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3126 3.9 3:914259a4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.274604133, 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017534042, 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3126 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.500 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156583+0000", 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7389999999999999e-06 2024-04-26T12:41:09.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158853+0000", 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022704359999999998 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158907+0000", 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3702000000000002e-05 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158921+0000", 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4416999999999999e-05 2024-04-26T12:41:09.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159038+0000", 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116878 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159233+0000", 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195198 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159411+0000", 2024-04-26T12:41:09.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177839 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.169121+0000", 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097102739999999996 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.173975+0000", 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048540570000000002 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174054+0000", 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174114+0000", 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9718e-05 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3139 3.2e 3:741e0bcf:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.139632523, 2024-04-26T12:41:09.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027404833999999999, 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3139 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291555+0000", 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2839999999999998e-06 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293141+0000", 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001586542 2024-04-26T12:41:09.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293174+0000", 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2898999999999998e-05 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293190+0000", 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5855999999999999e-05 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293274+0000", 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4191999999999996e-05 2024-04-26T12:41:09.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293425+0000", 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015107799999999999 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293532+0000", 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106642 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.298262+0000", 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047298749999999997 2024-04-26T12:41:09.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318804+0000", 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020542525999999998 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318891+0000", 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6808e-05 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318956+0000", 2024-04-26T12:41:09.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5131999999999999e-05 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3144 3.9 3:93416909:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.085521411, 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019208350999999999, 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.511 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3144 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345666+0000", 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7359999999999999e-06 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347400+0000", 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017342130000000001 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347434+0000", 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3559000000000002e-05 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347450+0000", 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6126000000000001e-05 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347525+0000", 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5049999999999995e-05 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347690+0000", 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016434500000000001 2024-04-26T12:41:09.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347782+0000", 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2174000000000002e-05 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.352644+0000", 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048619249999999996 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364731+0000", 2024-04-26T12:41:09.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012087540000000001 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364811+0000", 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9594999999999999e-05 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364871+0000", 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0087999999999998e-05 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3178 3.9 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.69897535899999996, 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.026775441000000001, 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3178 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732211+0000", 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9040000000000001e-06 2024-04-26T12:41:09.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734341+0000", 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002130018 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734370+0000", 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8702000000000001e-05 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734386+0000", 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5423000000000001e-05 2024-04-26T12:41:09.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734474+0000", 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8490000000000001e-05 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734656+0000", 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018186 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734810+0000", 2024-04-26T12:41:09.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015437799999999999 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740557+0000", 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057466710000000001 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758834+0000", 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018276573000000001 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758919+0000", 2024-04-26T12:41:09.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5350000000000001e-05 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758984+0000", 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5072000000000003e-05 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3179 3.9 3:936f954f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:09.522 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.69071750799999998, 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020186769, 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3179 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740469+0000", 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5019999999999999e-06 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741784+0000", 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314824 2024-04-26T12:41:09.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741812+0000", 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8731e-05 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741827+0000", 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.446e-05 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741944+0000", 2024-04-26T12:41:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011712100000000001 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742156+0000", 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000211635 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742381+0000", 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000225174 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.748059+0000", 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056783090000000003 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760598+0000", 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012538396 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760628+0000", 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0278999999999999e-05 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760653+0000", 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5338e-05 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3194 3.9 3:9016d8f2:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.53411693699999996, 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01815512, 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.528 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3194 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897070+0000", 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4309999999999998e-06 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898919+0000", 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018485750000000001 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898950+0000", 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1433000000000002e-05 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898966+0000", 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6011999999999998e-05 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899038+0000", 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1089999999999999e-05 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899181+0000", 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014355600000000001 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899290+0000", 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109381 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.903968+0000", 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046775810000000001 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915142+0000", 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01117362 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915185+0000", 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3118000000000003e-05 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915222+0000", 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7323000000000002e-05 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.533 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3197 3.2e 3:75db4699:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.49890369800000001, 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027033747, 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3197 2024-04-26T12:41:09.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932283+0000", 2024-04-26T12:41:09.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933450+0000", 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001166472 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933472+0000", 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2761000000000001e-05 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933486+0000", 2024-04-26T12:41:09.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3399e-05 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933566+0000", 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0669999999999998e-05 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933735+0000", 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000169087 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933897+0000", 2024-04-26T12:41:09.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016202400000000001 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.938810+0000", 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049125649999999998 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959231+0000", 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020421228 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959273+0000", 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959314+0000", 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0642000000000002e-05 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3229 3.f 3:f3b7f6e7:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.102174388, 2024-04-26T12:41:09.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018966246999999999, 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3229 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329013+0000", 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331482+0000", 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024695390000000002 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331499+0000", 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7175000000000001e-05 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331508+0000", 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331619+0000", 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110567 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331768+0000", 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014950200000000001 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331932+0000", 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389900000000001 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.339084+0000", 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007151887 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347886+0000", 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.008801784 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347928+0000", 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2228999999999998e-05 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347976+0000", 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7497000000000003e-05 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:09.545 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:09.545 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:09.545 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:41:09.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:41:09.547 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:09.545+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:09.647 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:09.644+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:09.746 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:09.746 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:09.746 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:09.747 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:09.744+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:09.776 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:41:09.789 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:41:09.807 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:09.807 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:09.840 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:09.841 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:09.848 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:09.848+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:09.868 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:09.869 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:09.889 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:09.889 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:09.916 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:09.916 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:09.929 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:09.929 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:09.944 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:09.944 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:09.948 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:41:09.950 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:09.948+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:09.972 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:09.972 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:10.011 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:10.012 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:10.050 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:10.048+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:10.120 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:10.120 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:10.143 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:41:10.188 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:10.188+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:10.252 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:10.252+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:10.292 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:10.292 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:10.314 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:41:10.357 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:10.356+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:10.454 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:10.453+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:10.487 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:10.487 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:10.504 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:41:10.555 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:10.552+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:10.632 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:10.632 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:10.653 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:41:10.656 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:10.653+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:10.757 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:10.756+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:10.830 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:10.831 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:10.845 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:41:10.858 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:10.857+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:10.959 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:10.957+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:11.022 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:11.022 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:11.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:41:11.084 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:11.084+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:11.160 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:11.161+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:11.178 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:11.178 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:11.195 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:41:11.261 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:11.261+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:11.362 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:11.360+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:11.375 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:11.376 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:11.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:41:11.480 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:11.480+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:11.565 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:11.560+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:11.570 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:11.570 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:11.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:41:11.665 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:11.665+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:11.758 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:11.758 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:11.766 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:11.764+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:11.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:41:11.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:41:11.877 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:11.877+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:11.940 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:11.940 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:11.954 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:41:11.969 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:11.969+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:12.037 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:41:12.080 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:12.081+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:12.093 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:12.093 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:12.115 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:41:12.170 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:12.169+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:12.219 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:12.219 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:12.242 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:12.242 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:12.249 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:12.249 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:12.262 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:12.263 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:12.271 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:12.268+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:12.272 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:41:12.286 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:12.286 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:12.312 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:12.312 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:12.337 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:12.337 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:12.367 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:12.367 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:12.372 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:12.368+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:12.392 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:12.393 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:12.472 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:12.473+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:12.483 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:12.483 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3469 3.1 3:82e46ef4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_404:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.473324+0000", 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.012041082, 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012067807, 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3469 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.484 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.473324+0000", 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.473324+0000", 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.473326+0000", 2024-04-26T12:41:12.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9870000000000002e-06 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475038+0000", 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00171145 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475056+0000", 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8337000000000001e-05 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475067+0000", 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1146e-05 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475186+0000", 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118968 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475369+0000", 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018261300000000001 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:12.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475532+0000", 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016295799999999999 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.480469+0000", 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049369069999999999 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 1 2024-04-26T12:41:12.488 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:12.509 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:41:12.574 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:12.572+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:12.674 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:12.673+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:12.707 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:12.708 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:12.708 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:12.708 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:12.708 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:12.731 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:41:12.816 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:41:12.816 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:12.813+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:12.876 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:12.876+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.083336040000006, 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.945 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:41:12.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:41:12.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:41:12.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2342 3.12 3:4a564d9a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.324356023, 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020986402000000001, 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.951 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2342 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620609+0000", 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622196+0000", 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587045 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622224+0000", 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8028e-05 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622234+0000", 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0577999999999999e-05 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622319+0000", 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4296999999999996e-05 2024-04-26T12:41:12.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622520+0000", 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201571 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622753+0000", 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000232501 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.629187+0000", 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064345679999999999 2024-04-26T12:41:12.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641429+0000", 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012241573 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641522+0000", 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3239999999999995e-05 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641593+0000", 2024-04-26T12:41:12.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0683000000000001e-05 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2353 3.2b 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.197881647999999, 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029788120000000001, 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.957 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2353 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747083+0000", 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748701+0000", 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016182550000000001 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748730+0000", 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8809000000000001e-05 2024-04-26T12:41:12.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748741+0000", 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0949e-05 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748822+0000", 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0777000000000003e-05 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748827+0000", 2024-04-26T12:41:12.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752276+0000", 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034484350000000001 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752425+0000", 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014880699999999999 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752572+0000", 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014723899999999999 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.757807+0000", 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052354319999999999 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776737+0000", 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018929437 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776811+0000", 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4651000000000001e-05 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776869+0000", 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7541999999999999e-05 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2891 3.2b 3:d7deca59:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.752230094000002, 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020816259, 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2891 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192735+0000", 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9399999999999998e-06 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197005+0000", 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042695859999999997 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197044+0000", 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9345999999999999e-05 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197068+0000", 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3788e-05 2024-04-26T12:41:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197172+0000", 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104063 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197364+0000", 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192239 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197561+0000", 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019647600000000001 2024-04-26T12:41:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.206860+0000", 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092991719999999996 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213224+0000", 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063636949999999999 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213413+0000", 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018908799999999999 2024-04-26T12:41:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213549+0000", 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135866 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2892 3.20 e91/17 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head v 91'8, mlcod=90'6)", 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.735945304000001, 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020804692999999999, 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209019+0000", 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214490+0000", 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054710219999999999 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214515+0000", 2024-04-26T12:41:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4539999999999999e-05 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214528+0000", 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2914999999999999e-05 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214672+0000", 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143957 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214738+0000", 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6452999999999995e-05 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229776+0000", 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015037897 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229822+0000", 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5583e-05 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3067 3.1 3:8267f722:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.527447+0000", 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.4175157870000001, 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019414417, 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3067 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.527447+0000", 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.527447+0000", 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.527449+0000", 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1940000000000001e-06 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529507+0000", 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020580770000000002 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529540+0000", 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2642999999999999e-05 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529554+0000", 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4089e-05 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529637+0000", 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3362999999999995e-05 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529808+0000", 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017100700000000001 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.529970+0000", 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016244 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.534830+0000", 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048598570000000004 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.546750+0000", 2024-04-26T12:41:12.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011919641 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.546820+0000", 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9826000000000005e-05 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.546861+0000", 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1279999999999998e-05 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3093 3.12 3:4a7cc5cd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.795015+0000", 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.1499472720000004, 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019460485999999999, 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3093 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.980 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.795015+0000", 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.795015+0000", 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.795018+0000", 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5390000000000002e-06 2024-04-26T12:41:12.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796526+0000", 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015087550000000001 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796550+0000", 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3493999999999999e-05 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796561+0000", 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0665e-05 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796632+0000", 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1814000000000001e-05 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796752+0000", 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119288 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796844+0000", 2024-04-26T12:41:12.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1984999999999994e-05 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.801995+0000", 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051510369999999998 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.814344+0000", 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012349224000000001 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.814422+0000", 2024-04-26T12:41:12.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7690999999999999e-05 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.814476+0000", 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3993999999999998e-05 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3110 3.3 3:c3505790:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.974371+0000", 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.9705914010000001, 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019582904000000002, 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.985 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3110 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.974371+0000", 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.974371+0000", 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.974374+0000", 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.975920+0000", 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001546251 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.975952+0000", 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1640999999999997e-05 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.975967+0000", 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4979e-05 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.976032+0000", 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5667999999999995e-05 2024-04-26T12:41:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.976198+0000", 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016600400000000001 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.976318+0000", 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120009 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.980796+0000", 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044772090000000002 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993852+0000", 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013056682 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993908+0000", 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6113999999999998e-05 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993954+0000", 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5596999999999997e-05 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3131 3.12 3:4a9b1f7f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.208357+0000", 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7366057619999999, 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022630049999999999, 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3131 2024-04-26T12:41:12.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.208357+0000", 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.208357+0000", 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.208360+0000", 2024-04-26T12:41:12.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2940000000000001e-06 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.209934+0000", 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00157427 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.209957+0000", 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2589e-05 2024-04-26T12:41:12.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.209968+0000", 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1381e-05 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.210059+0000", 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0939999999999993e-05 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.210193+0000", 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013365100000000001 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.210308+0000", 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114712 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.217514+0000", 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072066329999999996 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.230819+0000", 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013304898000000001 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.230916+0000", 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7186000000000001e-05 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.230987+0000", 2024-04-26T12:41:12.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0495999999999997e-05 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3137 3.1f 3:fb1ca43b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.271644+0000", 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.6733182290000004, 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.043694837, 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:12.997 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3137 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.271644+0000", 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.271644+0000", 2024-04-26T12:41:12.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.271647+0000", 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.745e-06 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.273715+0000", 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020682640000000002 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.273749+0000", 2024-04-26T12:41:12.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3846000000000001e-05 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.273764+0000", 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.273901+0000", 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013637 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.274081+0000", 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000179977 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.274236+0000", 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015589400000000001 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.281849+0000", 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007612209 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.315210+0000", 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.033361353000000003 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.315282+0000", 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2439000000000002e-05 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.315339+0000", 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6616000000000001e-05 2024-04-26T12:41:13.002 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3155 3.1 3:801b39f2:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.467691+0000", 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.477271623, 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020925488999999999, 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.003 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3155 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.467691+0000", 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.467691+0000", 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.467693+0000", 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.058e-06 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470568+0000", 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00287478 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470589+0000", 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1098999999999999e-05 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470601+0000", 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2588e-05 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470713+0000", 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112071 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470918+0000", 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020416 2024-04-26T12:41:13.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.471095+0000", 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017773100000000001 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.479295+0000", 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0082000570000000002 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.488542+0000", 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092466479999999997 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.488584+0000", 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1634999999999997e-05 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.488616+0000", 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2662e-05 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3157 3.2b 3:d71772bd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.491404+0000", 2024-04-26T12:41:13.008 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.4535587510000001, 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019742016000000001, 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3157 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.491404+0000", 2024-04-26T12:41:13.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.491404+0000", 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.491406+0000", 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493172+0000", 2024-04-26T12:41:13.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001765293 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493199+0000", 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7132e-05 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493209+0000", 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0383999999999999e-05 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493275+0000", 2024-04-26T12:41:13.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5852000000000006e-05 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493435+0000", 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159915 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493580+0000", 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144666 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.498422+0000", 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048425949999999999 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.511045+0000", 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012622461 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.511099+0000", 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4320000000000002e-05 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.511146+0000", 2024-04-26T12:41:13.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6767999999999997e-05 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3209 3.2b 3:d78b0a4b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.069358+0000", 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 3.8756045339999998, 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023879444, 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.014 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3209 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.069358+0000", 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.069358+0000", 2024-04-26T12:41:13.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.069360+0000", 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.475e-06 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070661+0000", 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00130021 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070686+0000", 2024-04-26T12:41:13.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5011000000000002e-05 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070696+0000", 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0821e-05 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070769+0000", 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2183999999999999e-05 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070949+0000", 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018036899999999999 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.071131+0000", 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181819 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.078913+0000", 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0077817629999999997 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.093101+0000", 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014187984000000001 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.093180+0000", 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9264000000000005e-05 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.093237+0000", 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7544000000000003e-05 2024-04-26T12:41:13.019 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3237 3.2b 3:d5d589cf:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.422669+0000", 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 3.522293908, 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021635252000000001, 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.020 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3237 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.422669+0000", 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.422669+0000", 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.422671+0000", 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.632e-06 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424122+0000", 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001450448 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424149+0000", 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6981000000000001e-05 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424162+0000", 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3597e-05 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424243+0000", 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0753000000000004e-05 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424369+0000", 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126511 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424489+0000", 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011977300000000001 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.429534+0000", 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050446939999999997 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.444153+0000", 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014619395 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.444242+0000", 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8935000000000001e-05 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.444304+0000", 2024-04-26T12:41:13.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1532999999999995e-05 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3246 3.1f 3:fbc6129f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.513552+0000", 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 3.4314101190000001, 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019533492999999999, 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.026 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3246 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.513552+0000", 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.513552+0000", 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.513554+0000", 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6139999999999999e-06 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.514863+0000", 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013093149999999999 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.514907+0000", 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4181999999999998e-05 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.514919+0000", 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1773000000000001e-05 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.514989+0000", 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9839000000000007e-05 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.515101+0000", 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111531 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.515213+0000", 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112599 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.520121+0000", 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049076149999999997 2024-04-26T12:41:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.533007+0000", 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012886267999999999 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.533048+0000", 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0707999999999997e-05 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.533086+0000", 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8049000000000001e-05 2024-04-26T12:41:13.031 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:3279 3.10 e102/17 3:09e4e99a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_214:head v 102'14, mlcod=102'12)", 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.788576+0000", 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 3.1563867760000002, 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020155080999999998, 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.788576+0000", 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.788576+0000", 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.788577+0000", 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.018e-06 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802649+0000", 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014072042 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802665+0000", 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802676+0000", 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1365999999999999e-05 2024-04-26T12:41:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802794+0000", 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011777000000000001 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802819+0000", 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4746e-05 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808660+0000", 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058408280000000002 2024-04-26T12:41:13.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808731+0000", 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0947999999999999e-05 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3449 3.3 3:c3865d96:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_384:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.222929+0000", 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.722033272, 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020001425999999999, 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.036 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3449 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.222929+0000", 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.222929+0000", 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.222932+0000", 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3489999999999999e-06 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.224983+0000", 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002051457 2024-04-26T12:41:13.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225017+0000", 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4405e-05 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225034+0000", 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6524e-05 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225124+0000", 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0192000000000007e-05 2024-04-26T12:41:13.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225325+0000", 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201089 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225484+0000", 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015858199999999999 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.233012+0000", 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0075285300000000003 2024-04-26T12:41:13.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.242789+0000", 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097768460000000005 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.242862+0000", 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2718000000000004e-05 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.242931+0000", 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8733999999999996e-05 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.041 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3454 3.12 3:486c32d0:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_389:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.284234+0000", 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.66072858000000001, 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019671574000000001, 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.042 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3454 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.284234+0000", 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.284234+0000", 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.284237+0000", 2024-04-26T12:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.157e-06 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.286682+0000", 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024445809999999999 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.286709+0000", 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7835e-05 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.286723+0000", 2024-04-26T12:41:13.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4039999999999999e-05 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.286811+0000", 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7627999999999995e-05 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.287025+0000", 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021400799999999999 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.287199+0000", 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017388700000000001 2024-04-26T12:41:13.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.296579+0000", 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093796120000000007 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.303768+0000", 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071895070000000004 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.303849+0000", 2024-04-26T12:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1218999999999996e-05 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.303905+0000", 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6100000000000002e-05 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3469 3.1 3:82e46ef4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_404:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.473324+0000", 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.47163821099999997, 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019765188999999999, 2024-04-26T12:41:13.047 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3469 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.473324+0000", 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.473324+0000", 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.473326+0000", 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9870000000000002e-06 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475038+0000", 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00171145 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475056+0000", 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8337000000000001e-05 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475067+0000", 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1146e-05 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475186+0000", 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118968 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475369+0000", 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018261300000000001 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475532+0000", 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016295799999999999 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.480469+0000", 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049369069999999999 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.492993+0000", 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012524051 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.493038+0000", 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5803000000000002e-05 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.493089+0000", 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0968999999999999e-05 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.052 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3474 3.12 3:4b411b60:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_409:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.531837+0000", 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.41312526999999999, 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020988639999999999, 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3474 2024-04-26T12:41:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.531837+0000", 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.531837+0000", 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.531839+0000", 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.255e-06 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533433+0000", 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001593258 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533459+0000", 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5981000000000001e-05 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533475+0000", 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6175e-05 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533560+0000", 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5599999999999994e-05 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533711+0000", 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000151061 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533858+0000", 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146429 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.538416+0000", 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045575930000000004 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.552744+0000", 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01432811 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.552789+0000", 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5361000000000002e-05 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.552826+0000", 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6816999999999997e-05 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.058 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:13.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:41:13.060 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:13.057+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:13.161 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:13.161+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:13.237 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:13.237 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:13.237 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:13.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:41:13.300 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:13.301+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:13.362 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:13.361+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:13.463 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:13.460+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:13.468 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:13.468 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:13.468 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:13.469 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:13.469 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:13.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:41:13.527 INFO:tasks.workunit.client.0.smithi016.stdout:quota disabled for the bucket: buck_2024_03_26_12_41_03 2024-04-26T12:41:13.527 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 2Gb. 2024-04-26T12:41:13.527 INFO:tasks.workunit.client.0.smithi016.stdout:upload file successful 2024-04-26T12:41:13.527 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:41:13.527 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - bucket quota size doesnt take effect when quota is disabled 2024-04-26T12:41:13.527 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:41:13.572 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:13.573+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:13.647 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:13.647 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:13.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:13.647 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:13.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.912133658999998, 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:41:13.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:41:13.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:41:13.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.835877392, 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:41:13.653 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:41:13.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:41:13.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:41:13.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:41:13.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.824153023999997, 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:41:13.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:41:13.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.664 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.563944601000003, 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:41:13.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:41:13.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:41:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.435301361, 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:41:13.670 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:41:13.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.277999043999998, 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.676 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:41:13.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:41:13.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.094595663, 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.682 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.064283834999998, 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.688 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:41:13.689 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:41:13.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:41:13.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:41:13.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2880 3.4 3:22b427d1:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.592206957999998, 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017107469, 2024-04-26T12:41:13.693 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2880 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055289+0000", 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0639999999999998e-06 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056815+0000", 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001525584 2024-04-26T12:41:13.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056855+0000", 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9975000000000003e-05 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056877+0000", 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2082e-05 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056988+0000", 2024-04-26T12:41:13.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011092200000000001 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057219+0000", 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023134100000000001 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057442+0000", 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222981 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066157+0000", 2024-04-26T12:41:13.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087146340000000006 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072145+0000", 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059887450000000002 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072294+0000", 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014865399999999999 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072394+0000", 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9487000000000005e-05 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2881 3.31 3:8da41a11:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.581361923999999, 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020325379000000001, 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.699 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2881 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066135+0000", 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4769999999999999e-06 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069604+0000", 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003469654 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069639+0000", 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4814000000000002e-05 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069657+0000", 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7674000000000001e-05 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069764+0000", 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106964 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069958+0000", 2024-04-26T12:41:13.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019436099999999999 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.070135+0000", 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017677900000000001 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.078069+0000", 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007933664 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086371+0000", 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083028219999999996 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086413+0000", 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1838000000000002e-05 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086457+0000", 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.704 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2888 3.1a 3:59675540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.496130501, 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019783412, 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2888 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151366+0000", 2024-04-26T12:41:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7859999999999998e-06 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156684+0000", 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053173350000000003 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156726+0000", 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156752+0000", 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6636999999999999e-05 2024-04-26T12:41:13.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156859+0000", 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106698 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157025+0000", 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016556700000000001 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157182+0000", 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157684 2024-04-26T12:41:13.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.165499+0000", 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083164580000000005 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171012+0000", 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055134490000000001 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171082+0000", 2024-04-26T12:41:13.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0103000000000003e-05 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171146+0000", 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3625000000000002e-05 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3073 3.1a 3:5b06f432:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.0621197269999998, 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021910276999999999, 2024-04-26T12:41:13.710 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3073 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585375+0000", 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587174+0000", 2024-04-26T12:41:13.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017990790000000001 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587195+0000", 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0559000000000001e-05 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587205+0000", 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0217000000000001e-05 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587285+0000", 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9320999999999995e-05 2024-04-26T12:41:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587426+0000", 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163899999999999 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587534+0000", 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010822700000000001 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.592241+0000", 2024-04-26T12:41:13.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047071090000000001 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607152+0000", 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014910048 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607226+0000", 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4960000000000001e-05 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607284+0000", 2024-04-26T12:41:13.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7132000000000001e-05 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3107 3.31 3:8f78493a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.7032281139999998, 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017172129000000001, 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.716 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3107 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.717 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944267+0000", 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.069e-06 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946361+0000", 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020936710000000001 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946394+0000", 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3229000000000003e-05 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946409+0000", 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4738e-05 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946488+0000", 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8863999999999996e-05 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946636+0000", 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014802700000000001 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946734+0000", 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.87e-05 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.951880+0000", 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051454980000000001 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961302+0000", 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094217869999999992 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961378+0000", 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6477000000000007e-05 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961437+0000", 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9069e-05 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3112 3.31 3:8d0978ab:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.721 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.6536964779999996, 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022999863999999998, 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3112 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993799+0000", 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5909999999999998e-06 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995315+0000", 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015153530000000001 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995339+0000", 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4700999999999999e-05 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995349+0000", 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.024e-05 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995427+0000", 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7830999999999994e-05 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995543+0000", 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115209 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995684+0000", 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163500000000001 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.001302+0000", 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005617866 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016681+0000", 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015378660000000001 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016744+0000", 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3674000000000001e-05 2024-04-26T12:41:13.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016796+0000", 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2104000000000001e-05 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3190 3.31 3:8e4c6e9a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7927647479999997, 2024-04-26T12:41:13.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018789369, 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3190 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.728 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854732+0000", 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2279999999999998e-06 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856445+0000", 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017136810000000001 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856474+0000", 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8433999999999999e-05 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856490+0000", 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6059e-05 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856574+0000", 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:41:13.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856732+0000", 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015771900000000001 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856840+0000", 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010796100000000001 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.863340+0000", 2024-04-26T12:41:13.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006499978 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873379+0000", 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010038775999999999 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873459+0000", 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0061000000000005e-05 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873518+0000", 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9051000000000001e-05 2024-04-26T12:41:13.732 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3239 3.31 3:8e75628b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.206049095, 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019464433999999999, 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.733 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3239 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441447+0000", 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1300000000000001e-06 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443249+0000", 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001802325 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443284+0000", 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4795999999999997e-05 2024-04-26T12:41:13.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443301+0000", 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6592e-05 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443419+0000", 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118551 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443641+0000", 2024-04-26T12:41:13.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022181100000000001 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443759+0000", 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011775199999999999 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.450805+0000", 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007046259 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460788+0000", 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099830240000000001 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460856+0000", 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7908000000000001e-05 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460908+0000", 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2286e-05 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.738 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3252 3.31 3:8c05cb84:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.061750655, 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017610118000000001, 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3252 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585746+0000", 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588002+0000", 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002256404 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588030+0000", 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7617999999999999e-05 2024-04-26T12:41:13.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588042+0000", 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.259e-05 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588118+0000", 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5875000000000001e-05 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588247+0000", 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000128892 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588363+0000", 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115962 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.593618+0000", 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052545619999999999 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603168+0000", 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0095503849999999998 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603271+0000", 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103078 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603353+0000", 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1438000000000002e-05 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3515 3.1a 3:5b3f0c22:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_450:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.67336561900000003, 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023114013999999999, 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3515 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.745 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974130+0000", 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2979999999999999e-06 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975465+0000", 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013352209999999999 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975496+0000", 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1464000000000002e-05 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975512+0000", 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5767999999999999e-05 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975587+0000", 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4315999999999998e-05 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975706+0000", 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119702 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.748 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975830+0000", 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012368599999999999 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.980572+0000", 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004742202 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997132+0000", 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016559658000000001 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.749 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997192+0000", 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9800999999999999e-05 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997241+0000", 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.750 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3522 3.1a 3:59049034:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.60538534799999999, 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021821969, 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3522 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.751 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042111+0000", 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.752 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043741+0000", 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00163018 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043766+0000", 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4567999999999999e-05 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043779+0000", 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.325e-05 2024-04-26T12:41:13.753 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043861+0000", 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1382000000000001e-05 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.044038+0000", 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017744899999999999 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.044215+0000", 2024-04-26T12:41:13.754 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017687599999999999 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.050811+0000", 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065957359999999996 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063787+0000", 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012976484 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063852+0000", 2024-04-26T12:41:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063930+0000", 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7751999999999997e-05 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3528 3.31 3:8ff53833:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_463:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.54335766799999996, 2024-04-26T12:41:13.756 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029523247999999998, 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3528 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.757 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104138+0000", 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.148e-06 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:13.758 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105585+0000", 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014478189999999999 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105618+0000", 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3012999999999997e-05 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105634+0000", 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6096e-05 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:13.759 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105716+0000", 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1422999999999996e-05 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105876+0000", 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015977499999999999 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105968+0000", 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2791e-05 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.760 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.110618+0000", 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046497070000000003 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133533+0000", 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022914869000000001 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133606+0000", 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2974999999999998e-05 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:13.761 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133659+0000", 2024-04-26T12:41:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2632e-05 2024-04-26T12:41:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:13.762 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:13.762 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:13.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:41:13.764 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:13.761+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:13.797 INFO:tasks.workunit.client.0.smithi016.stdout:user qa_user deleted 2024-04-26T12:41:13.797 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:41:13.865 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:13.864+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:13.908 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:13.908 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:13.908 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:13.908 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:13.921 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:41:13.968 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:13.969+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:14.033 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:14.034 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:14.034 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:14.034 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:14.034 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:14.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:41:14.067 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:14.064+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:14.167 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:14.164+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 61.923929788999999, 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.231 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.233 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:41:14.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:41:14.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:41:14.236 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2886 3.f 3:f1601af9:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 25.111479524, 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018140835000000001, 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2886 2024-04-26T12:41:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118818+0000", 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.120998+0000", 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021794050000000001 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121023+0000", 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5063e-05 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121036+0000", 2024-04-26T12:41:14.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.308e-05 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121148+0000", 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112575 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121377+0000", 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022841100000000001 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121584+0000", 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020710600000000001 2024-04-26T12:41:14.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.127654+0000", 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006070069 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136884+0000", 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092296909999999999 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136926+0000", 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2215000000000002e-05 2024-04-26T12:41:14.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136957+0000", 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-05 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3064 3.9 3:9202b9a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.7363143220000001, 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020230000000000001, 2024-04-26T12:41:14.242 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3064 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493984+0000", 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2289999999999999e-06 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496913+0000", 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029283989999999999 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496937+0000", 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496947+0000", 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497017+0000", 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9735999999999998e-05 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497139+0000", 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012228 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497237+0000", 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8326999999999996e-05 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.502130+0000", 2024-04-26T12:41:14.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048921540000000001 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514064+0000", 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011933918999999999 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514147+0000", 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3065999999999994e-05 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514211+0000", 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4597999999999994e-05 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3106 3.2e 3:75381650:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.2966026670000002, 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020388387000000001, 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.248 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3106 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933696+0000", 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9359999999999999e-06 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935132+0000", 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001436377 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935165+0000", 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2846999999999999e-05 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935181+0000", 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935260+0000", 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9042999999999995e-05 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935412+0000", 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015139299999999999 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935526+0000", 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114076 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.940843+0000", 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053172339999999997 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.953947+0000", 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01310396 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954024+0000", 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7657000000000005e-05 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954081+0000", 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6733e-05 2024-04-26T12:41:14.253 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3126 3.9 3:914259a4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.0737156990000001, 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017534042, 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.254 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3126 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156583+0000", 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7389999999999999e-06 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158853+0000", 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022704359999999998 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158907+0000", 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3702000000000002e-05 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.256 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158921+0000", 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4416999999999999e-05 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159038+0000", 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116878 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159233+0000", 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195198 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159411+0000", 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177839 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.169121+0000", 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097102739999999996 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.173975+0000", 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048540570000000002 2024-04-26T12:41:14.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174054+0000", 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174114+0000", 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9718e-05 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.259 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3139 3.2e 3:741e0bcf:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.9387440890000001, 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027404833999999999, 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3139 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291555+0000", 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2839999999999998e-06 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293141+0000", 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001586542 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293174+0000", 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2898999999999998e-05 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293190+0000", 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5855999999999999e-05 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.262 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293274+0000", 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4191999999999996e-05 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293425+0000", 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015107799999999999 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293532+0000", 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106642 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.298262+0000", 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047298749999999997 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318804+0000", 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020542525999999998 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318891+0000", 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6808e-05 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318956+0000", 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5131999999999999e-05 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3144 3.9 3:93416909:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.8846329769999999, 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019208350999999999, 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.265 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3144 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345666+0000", 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7359999999999999e-06 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347400+0000", 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017342130000000001 2024-04-26T12:41:14.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347434+0000", 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3559000000000002e-05 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347450+0000", 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6126000000000001e-05 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347525+0000", 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5049999999999995e-05 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347690+0000", 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016434500000000001 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347782+0000", 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2174000000000002e-05 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.352644+0000", 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048619249999999996 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364731+0000", 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012087540000000001 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364811+0000", 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9594999999999999e-05 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364871+0000", 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0087999999999998e-05 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.270 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3178 3.9 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.498086925, 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.026775441000000001, 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3178 2024-04-26T12:41:14.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732211+0000", 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9040000000000001e-06 2024-04-26T12:41:14.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734341+0000", 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002130018 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734370+0000", 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8702000000000001e-05 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734386+0000", 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5423000000000001e-05 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734474+0000", 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8490000000000001e-05 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734656+0000", 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018186 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734810+0000", 2024-04-26T12:41:14.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015437799999999999 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740557+0000", 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057466710000000001 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758834+0000", 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018276573000000001 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758919+0000", 2024-04-26T12:41:14.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5350000000000001e-05 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758984+0000", 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5072000000000003e-05 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3179 3.9 3:936f954f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.4898290740000002, 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020186769, 2024-04-26T12:41:14.276 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3179 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740469+0000", 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5019999999999999e-06 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741784+0000", 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314824 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741812+0000", 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8731e-05 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741827+0000", 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.446e-05 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741944+0000", 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011712100000000001 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742156+0000", 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000211635 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742381+0000", 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000225174 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.748059+0000", 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056783090000000003 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760598+0000", 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012538396 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760628+0000", 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0278999999999999e-05 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760653+0000", 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5338e-05 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3194 3.9 3:9016d8f2:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.333228503, 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01815512, 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3194 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897070+0000", 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4309999999999998e-06 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898919+0000", 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018485750000000001 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898950+0000", 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1433000000000002e-05 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898966+0000", 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6011999999999998e-05 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899038+0000", 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1089999999999999e-05 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899181+0000", 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014355600000000001 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899290+0000", 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109381 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.285 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.903968+0000", 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046775810000000001 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915142+0000", 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01117362 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915185+0000", 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3118000000000003e-05 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915222+0000", 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7323000000000002e-05 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3197 3.2e 3:75db4699:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.298015264, 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027033747, 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.287 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3197 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932283+0000", 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933450+0000", 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001166472 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933472+0000", 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2761000000000001e-05 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933486+0000", 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3399e-05 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933566+0000", 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0669999999999998e-05 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933735+0000", 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000169087 2024-04-26T12:41:14.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933897+0000", 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016202400000000001 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.938810+0000", 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049125649999999998 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959231+0000", 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020421228 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959273+0000", 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959314+0000", 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0642000000000002e-05 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3229 3.f 3:f3b7f6e7:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.292 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.9012859540000004, 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018966246999999999, 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3229 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:14.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329013+0000", 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331482+0000", 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024695390000000002 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331499+0000", 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7175000000000001e-05 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331508+0000", 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:41:14.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331619+0000", 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110567 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331768+0000", 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014950200000000001 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331932+0000", 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389900000000001 2024-04-26T12:41:14.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.339084+0000", 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007151887 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347886+0000", 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.008801784 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347928+0000", 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2228999999999998e-05 2024-04-26T12:41:14.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347976+0000", 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7497000000000003e-05 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3245 3.f 3:f14a72c5:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7259898400000004, 2024-04-26T12:41:14.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018443383000000001, 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3245 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504308+0000", 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505670+0000", 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001361478 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505698+0000", 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827999999999999e-05 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505712+0000", 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3839000000000001e-05 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505790+0000", 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8775000000000004e-05 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505941+0000", 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015073899999999999 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.506050+0000", 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010859 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.510891+0000", 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048417549999999997 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522669+0000", 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011778001999999999 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522714+0000", 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4861999999999998e-05 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522749+0000", 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4745e-05 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.303 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3257 3.f 3:f16d7886:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.5860524869999999, 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018067529999999998, 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3257 2024-04-26T12:41:14.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644246+0000", 2024-04-26T12:41:14.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646264+0000", 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020174160000000002 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646295+0000", 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1828000000000001e-05 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646306+0000", 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0546e-05 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646390+0000", 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4321999999999997e-05 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646532+0000", 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141669 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646662+0000", 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129634 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.651808+0000", 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051462610000000001 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662201+0000", 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010392848999999999 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662259+0000", 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8108e-05 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662311+0000", 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1662000000000001e-05 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3280 3.21 3:8431c446:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:14.309 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.4367443370000004, 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018802534999999999, 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3280 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793554+0000", 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.762e-06 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.794995+0000", 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014413270000000001 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795026+0000", 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0260000000000002e-05 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795039+0000", 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3396e-05 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795124+0000", 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5165000000000002e-05 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795132+0000", 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3450000000000006e-06 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.797837+0000", 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027041750000000001 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798009+0000", 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000172456 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798162+0000", 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015279000000000001 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808398+0000", 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010236263000000001 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812214+0000", 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003816285 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812291+0000", 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7035999999999999e-05 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812354+0000", 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2274999999999996e-05 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.315 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3468 3.9 3:92d2bef4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.7702870100000001, 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019140161999999999, 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3468 2024-04-26T12:41:14.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460010+0000", 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6220000000000001e-06 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462069+0000", 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020588350000000002 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462093+0000", 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3841000000000001e-05 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462104+0000", 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0781999999999999e-05 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462169+0000", 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5223999999999998e-05 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462310+0000", 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014092999999999999 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462468+0000", 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015857999999999999 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.467313+0000", 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048449909999999999 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479025+0000", 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011711408 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479095+0000", 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0562000000000006e-05 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479149+0000", 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3387000000000002e-05 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3490 3.9 3:90ed9f24:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_425:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:14.321 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.5305360619999999, 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019930929, 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3490 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:14.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699767+0000", 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-06 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702177+0000", 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024107909999999998 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702216+0000", 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8677000000000003e-05 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702233+0000", 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.677e-05 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702331+0000", 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8522000000000003e-05 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702554+0000", 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222284 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702746+0000", 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192165 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.711473+0000", 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087273230000000004 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719610+0000", 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081368139999999992 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719655+0000", 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5166000000000001e-05 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719690+0000", 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5240999999999997e-05 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3498 3.9 3:90786aa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_433:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.4469306959999999, 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019394081000000001, 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.327 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3498 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783369+0000", 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4780000000000002e-06 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785506+0000", 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00213635 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785535+0000", 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-05 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785551+0000", 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5452e-05 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785654+0000", 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000102951 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785857+0000", 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000202785 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785972+0000", 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011500100000000001 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.792041+0000", 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060695999999999996 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802651+0000", 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010609726999999999 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802702+0000", 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1304000000000002e-05 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802759+0000", 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6703000000000002e-05 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3511 3.2e 3:76d60bde:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.2927189130000001, 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020430932999999998, 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3511 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937578+0000", 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8759999999999999e-06 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939235+0000", 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016561989999999999 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939267+0000", 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2712999999999997e-05 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939283+0000", 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5421e-05 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939362+0000", 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8752999999999996e-05 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939492+0000", 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130844 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939616+0000", 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012401600000000001 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.944163+0000", 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045470329999999998 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957900+0000", 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013737047 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957962+0000", 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1976000000000004e-05 2024-04-26T12:41:14.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.958008+0000", 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5055000000000001e-05 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3518 3.f 3:f20a4de4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_453:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 1.2258590199999999, 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018842589, 2024-04-26T12:41:14.338 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3518 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004440+0000", 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006038+0000", 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015980079999999999 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:14.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006062+0000", 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4779000000000001e-05 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006075+0000", 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2782000000000001e-05 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006152+0000", 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7343999999999997e-05 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:14.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006322+0000", 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016997900000000001 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006415+0000", 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2800999999999995e-05 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.012821+0000", 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064056770000000002 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:14.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023205+0000", 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010383763000000001 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023248+0000", 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2963000000000002e-05 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023279+0000", 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1383000000000001e-05 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.343 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:14.344 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:14.344 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:14.345 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:41:14.345 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:14.345+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:14.421 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:41:14.446 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:14.444+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:14.514 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:14.514 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:14.515 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:14.532 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:41:14.580 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:14.581+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:14.583 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:14.584 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:14.601 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:14.601 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:14.618 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:14.618 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:14.635 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:14.635 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:14.648 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:14.644+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:14.650 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:14.650 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:14.656 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:14.656 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:14.667 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:41:14.678 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:14.678 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:14.699 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:14.699 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:14.720 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:14.720 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:14.788 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:14.789+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:14.794 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:14.794 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:14.811 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:41:14.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:41:14.852 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:14.853+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:14.943 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:14.943 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:14.950 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:14.949+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:14.957 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:41:15.051 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:15.049+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:15.080 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:15.080 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:15.094 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:41:15.152 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:15.148+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:15.217 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:15.217 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:15.231 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:41:15.253 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:15.253+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:15.353 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:15.352+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:15.390 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:15.390 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:15.404 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:41:15.496 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:15.496+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:15.554 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:15.553+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:15.568 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:15.569 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:15.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:41:15.672 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:15.672+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:15.747 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:15.747 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:15.755 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:15.753+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:15.761 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:41:15.833 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:41:15.856 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:15.856+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:15.934 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:15.934 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:15.948 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:41:15.992 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:15.992+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:16.058 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:16.056+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:16.115 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:16.115 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:16.131 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:41:16.172 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:16.172+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:16.260 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:16.260+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:16.296 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:16.310 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:41:16.396 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:16.396+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:16.462 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:16.461+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:16.481 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:16.481 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:16.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:41:16.563 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:16.561+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:16.653 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:16.653 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:16.664 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:16.661+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:16.667 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:41:16.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:41:16.765 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:16.764+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:16.790 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:16.790 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:16.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:41:16.866 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:16.864+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:16.900 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:16.900 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:16.917 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:16.917 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:16.933 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:16.933 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:16.935 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:16.936 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:16.936 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:16.936 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:16.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:41:16.950 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:16.951 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:16.972 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:16.972 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:17.008 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:17.009 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:17.033 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:16.969+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:17.044 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:17.045 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:17.067 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:17.068 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:17.068 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:17.065+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:17.090 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:17.093 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:17.093 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:17.093 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:17.093 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:17.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:41:17.196 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:17.197+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:17.270 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:17.268+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:17.277 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:17.277 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:17.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:17.277 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:17.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.277 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:1328 3.1f 3:f8ab0638:::d749f084-3851-4e95-9492-490675b43f90.4382.2_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 79.413305077999993, 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022828692000000001, 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 1328 2024-04-26T12:41:17.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861626+0000", 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.861628+0000", 2024-04-26T12:41:17.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.641e-06 2024-04-26T12:41:17.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863530+0000", 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001901603 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863556+0000", 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6548000000000001e-05 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863567+0000", 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0339999999999999e-05 2024-04-26T12:41:17.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863633+0000", 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6290000000000004e-05 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.863763+0000", 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013051 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.864109+0000", 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00034564399999999999 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.870687+0000", 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065777520000000001 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884111+0000", 2024-04-26T12:41:17.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013424423 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884321+0000", 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000209559 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:39:57.884455+0000", 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000134382 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.284 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2342 3.12 3:4a564d9a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.654325060999994, 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020986402000000001, 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.285 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2342 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620606+0000", 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.620609+0000", 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3180000000000001e-06 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622196+0000", 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001587045 2024-04-26T12:41:17.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622224+0000", 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8028e-05 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622234+0000", 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0577999999999999e-05 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622319+0000", 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4296999999999996e-05 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622520+0000", 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201571 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.622753+0000", 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000232501 2024-04-26T12:41:17.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.629187+0000", 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064345679999999999 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641429+0000", 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012241573 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641522+0000", 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.3239999999999995e-05 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.641593+0000", 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0683000000000001e-05 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2353 3.2b 3:d5bdbd98:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.527850685999994, 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029788120000000001, 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2353 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.292 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747081+0000", 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.747083+0000", 2024-04-26T12:41:17.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0839999999999999e-06 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748701+0000", 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016182550000000001 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748730+0000", 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8809000000000001e-05 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748741+0000", 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0949e-05 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748822+0000", 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0777000000000003e-05 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.748827+0000", 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7030000000000003e-06 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752276+0000", 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0034484350000000001 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752425+0000", 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014880699999999999 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.296 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.752572+0000", 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014723899999999999 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.757807+0000", 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052354319999999999 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776737+0000", 2024-04-26T12:41:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018929437 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776811+0000", 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4651000000000001e-05 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.776869+0000", 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7541999999999999e-05 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.298 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2891 3.2b 3:d7deca59:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_246:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.082199132, 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020816259, 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.299 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2891 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192732+0000", 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.192735+0000", 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9399999999999998e-06 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197005+0000", 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0042695859999999997 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.301 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197044+0000", 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9345999999999999e-05 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197068+0000", 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3788e-05 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.302 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197172+0000", 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000104063 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197364+0000", 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192239 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.197561+0000", 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019647600000000001 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.206860+0000", 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092991719999999996 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213224+0000", 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063636949999999999 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.304 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213413+0000", 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018908799999999999 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.213549+0000", 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000135866 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.305 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:2892 3.20 e91/17 3:04d32659:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_247:head v 91'8, mlcod=90'6)", 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.065914341999999, 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020804692999999999, 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209017+0000", 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.209019+0000", 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3259999999999998e-06 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.307 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214490+0000", 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054710219999999999 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214515+0000", 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4539999999999999e-05 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214528+0000", 2024-04-26T12:41:17.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2914999999999999e-05 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214672+0000", 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000143957 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.214738+0000", 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6452999999999995e-05 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229776+0000", 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015037897 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.229822+0000", 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5583e-05 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3093 3.12 3:4a7cc5cd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.795015+0000", 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.4799163100000001, 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019460485999999999, 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3093 2024-04-26T12:41:17.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.795015+0000", 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.795015+0000", 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.795018+0000", 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5390000000000002e-06 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796526+0000", 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015087550000000001 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796550+0000", 2024-04-26T12:41:17.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3493999999999999e-05 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796561+0000", 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0665e-05 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796632+0000", 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1814000000000001e-05 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796752+0000", 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119288 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.796844+0000", 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1984999999999994e-05 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.801995+0000", 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051510369999999998 2024-04-26T12:41:17.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.814344+0000", 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012349224000000001 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.814422+0000", 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7690999999999999e-05 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.814476+0000", 2024-04-26T12:41:17.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3993999999999998e-05 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3110 3.3 3:c3505790:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.974371+0000", 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.3005604389999998, 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019582904000000002, 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.317 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3110 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.974371+0000", 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.974371+0000", 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.974374+0000", 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.975920+0000", 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001546251 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.975952+0000", 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1640999999999997e-05 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.975967+0000", 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4979e-05 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.976032+0000", 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5667999999999995e-05 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.976198+0000", 2024-04-26T12:41:17.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016600400000000001 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.976318+0000", 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000120009 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.980796+0000", 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044772090000000002 2024-04-26T12:41:17.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993852+0000", 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013056682 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993908+0000", 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6113999999999998e-05 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993954+0000", 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5596999999999997e-05 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3131 3.12 3:4a9b1f7f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.208357+0000", 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.0665747999999997, 2024-04-26T12:41:17.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022630049999999999, 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3131 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.208357+0000", 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.208357+0000", 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.208360+0000", 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2940000000000001e-06 2024-04-26T12:41:17.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.209934+0000", 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00157427 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.209957+0000", 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2589e-05 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.209968+0000", 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1381e-05 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.210059+0000", 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0939999999999993e-05 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.210193+0000", 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013365100000000001 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.210308+0000", 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114712 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.217514+0000", 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0072066329999999996 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.329 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.230819+0000", 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013304898000000001 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.230916+0000", 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7186000000000001e-05 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.230987+0000", 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0495999999999997e-05 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3137 3.1f 3:fb1ca43b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.271644+0000", 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.0032872669999993, 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.043694837, 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.331 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3137 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.271644+0000", 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.271644+0000", 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.271647+0000", 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.745e-06 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.273715+0000", 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020682640000000002 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.273749+0000", 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3846000000000001e-05 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.273764+0000", 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.273901+0000", 2024-04-26T12:41:17.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013637 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.274081+0000", 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000179977 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.274236+0000", 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015589400000000001 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.281849+0000", 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007612209 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.315210+0000", 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.033361353000000003 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.315282+0000", 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2439000000000002e-05 2024-04-26T12:41:17.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.315339+0000", 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6616000000000001e-05 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3155 3.1 3:801b39f2:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.467691+0000", 2024-04-26T12:41:17.337 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.8072406609999998, 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020925488999999999, 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3155 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.467691+0000", 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.467691+0000", 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.467693+0000", 2024-04-26T12:41:17.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.058e-06 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470568+0000", 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00287478 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470589+0000", 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1098999999999999e-05 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470601+0000", 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2588e-05 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470713+0000", 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112071 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.470918+0000", 2024-04-26T12:41:17.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020416 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.471095+0000", 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017773100000000001 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.479295+0000", 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0082000570000000002 2024-04-26T12:41:17.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.488542+0000", 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092466479999999997 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.488584+0000", 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1634999999999997e-05 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.488616+0000", 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2662e-05 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3157 3.2b 3:d71772bd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.491404+0000", 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.7835277890000008, 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019742016000000001, 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.344 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3157 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.491404+0000", 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.491404+0000", 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.491406+0000", 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6299999999999998e-06 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493172+0000", 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001765293 2024-04-26T12:41:17.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493199+0000", 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7132e-05 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493209+0000", 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0383999999999999e-05 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493275+0000", 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5852000000000006e-05 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493435+0000", 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000159915 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.493580+0000", 2024-04-26T12:41:17.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144666 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.498422+0000", 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048425949999999999 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.511045+0000", 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012622461 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.511099+0000", 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4320000000000002e-05 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.511146+0000", 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6767999999999997e-05 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3209 3.2b 3:d78b0a4b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.069358+0000", 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.2055735720000005, 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023879444, 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.351 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3209 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.069358+0000", 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.069358+0000", 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.069360+0000", 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.475e-06 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070661+0000", 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00130021 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070686+0000", 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5011000000000002e-05 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070696+0000", 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0821e-05 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070769+0000", 2024-04-26T12:41:17.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2183999999999999e-05 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.070949+0000", 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018036899999999999 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.071131+0000", 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000181819 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.078913+0000", 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0077817629999999997 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.093101+0000", 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014187984000000001 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.093180+0000", 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9264000000000005e-05 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.093237+0000", 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7544000000000003e-05 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3237 3.2b 3:d5d589cf:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.357 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.422669+0000", 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 7.8522629459999997, 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021635252000000001, 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3237 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.422669+0000", 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.422669+0000", 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.422671+0000", 2024-04-26T12:41:17.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.632e-06 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424122+0000", 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001450448 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424149+0000", 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6981000000000001e-05 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424162+0000", 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3597e-05 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424243+0000", 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0753000000000004e-05 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424369+0000", 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000126511 2024-04-26T12:41:17.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.424489+0000", 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011977300000000001 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.429534+0000", 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050446939999999997 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.444153+0000", 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014619395 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.444242+0000", 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8935000000000001e-05 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.444304+0000", 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1532999999999995e-05 2024-04-26T12:41:17.363 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3246 3.1f 3:fbc6129f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.513552+0000", 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 7.7613791570000004, 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019533492999999999, 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3246 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.513552+0000", 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.513552+0000", 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.513554+0000", 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6139999999999999e-06 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.514863+0000", 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013093149999999999 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.514907+0000", 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4181999999999998e-05 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.514919+0000", 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1773000000000001e-05 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.514989+0000", 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9839000000000007e-05 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.515101+0000", 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000111531 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.515213+0000", 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112599 2024-04-26T12:41:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.520121+0000", 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049076149999999997 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.533007+0000", 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012886267999999999 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.533048+0000", 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0707999999999997e-05 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.533086+0000", 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8049000000000001e-05 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:3279 3.10 e102/17 3:09e4e99a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_214:head v 102'14, mlcod=102'12)", 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.788576+0000", 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 7.4863558140000004, 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020155080999999998, 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.788576+0000", 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.788576+0000", 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.788577+0000", 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.018e-06 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802649+0000", 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014072042 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802665+0000", 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6362999999999999e-05 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802676+0000", 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1365999999999999e-05 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802794+0000", 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011777000000000001 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.802819+0000", 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4746e-05 2024-04-26T12:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808660+0000", 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0058408280000000002 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808731+0000", 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0947999999999999e-05 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3449 3.3 3:c3865d96:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_384:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.222929+0000", 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.0520023099999998, 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020001425999999999, 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.376 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3449 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.222929+0000", 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.222929+0000", 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.222932+0000", 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3489999999999999e-06 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.224983+0000", 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002051457 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225017+0000", 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4405e-05 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225034+0000", 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6524e-05 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225124+0000", 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0192000000000007e-05 2024-04-26T12:41:17.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225325+0000", 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000201089 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.225484+0000", 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015858199999999999 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.233012+0000", 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0075285300000000003 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.242789+0000", 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097768460000000005 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.242862+0000", 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2718000000000004e-05 2024-04-26T12:41:17.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.242931+0000", 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8733999999999996e-05 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3454 3.12 3:486c32d0:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_389:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:17.382 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.284234+0000", 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.9906976180000004, 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019671574000000001, 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3454 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.284234+0000", 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.284234+0000", 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.284237+0000", 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.157e-06 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.286682+0000", 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024445809999999999 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.286709+0000", 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7835e-05 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.286723+0000", 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4039999999999999e-05 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.286811+0000", 2024-04-26T12:41:17.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7627999999999995e-05 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.287025+0000", 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00021400799999999999 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.287199+0000", 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017388700000000001 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.296579+0000", 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0093796120000000007 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.303768+0000", 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0071895070000000004 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.303849+0000", 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1218999999999996e-05 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.303905+0000", 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6100000000000002e-05 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3469 3.1 3:82e46ef4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_404:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.473324+0000", 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.8016072489999999, 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019765188999999999, 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3469 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.473324+0000", 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.473324+0000", 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.473326+0000", 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9870000000000002e-06 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475038+0000", 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00171145 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475056+0000", 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8337000000000001e-05 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475067+0000", 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1146e-05 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475186+0000", 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118968 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475369+0000", 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018261300000000001 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.475532+0000", 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016295799999999999 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.480469+0000", 2024-04-26T12:41:17.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049369069999999999 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.492993+0000", 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012524051 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.493038+0000", 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5803000000000002e-05 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.493089+0000", 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0968999999999999e-05 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3474 3.12 3:4b411b60:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_409:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.531837+0000", 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.7430943079999999, 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020988639999999999, 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3474 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.531837+0000", 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.531837+0000", 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.531839+0000", 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.255e-06 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533433+0000", 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001593258 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533459+0000", 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5981000000000001e-05 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533475+0000", 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6175e-05 2024-04-26T12:41:17.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533560+0000", 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5599999999999994e-05 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533711+0000", 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000151061 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.533858+0000", 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000146429 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.538416+0000", 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045575930000000004 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.552744+0000", 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01432811 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.552789+0000", 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5361000000000002e-05 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.552826+0000", 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6816999999999997e-05 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3543 3.3 3:c1442bc8:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_478:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.253238+0000", 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.0216933590000004, 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019742889999999999, 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3543 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.403 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.253238+0000", 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.253238+0000", 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.253241+0000", 2024-04-26T12:41:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.191e-06 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.254814+0000", 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001573091 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.254848+0000", 2024-04-26T12:41:17.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3578000000000003e-05 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.254865+0000", 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6582000000000001e-05 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.254960+0000", 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5511000000000001e-05 2024-04-26T12:41:17.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.255133+0000", 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017300900000000001 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.255307+0000", 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017432600000000001 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.261518+0000", 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006210864 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.272888+0000", 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011369357 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.272930+0000", 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2219999999999999e-05 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.272981+0000", 2024-04-26T12:41:17.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1161e-05 2024-04-26T12:41:17.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.409 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.409 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.409 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:17.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:41:17.411 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:17.409+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:17.512 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:17.512+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:17.590 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:17.591 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:17.591 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:17.591 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:17.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:41:17.612 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:17.612+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:17.713 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:17.713+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:17.726 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:17.726 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:17.726 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:17.740 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:41:17.815 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:17.812+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:17.861 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.177000946999996, 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.913 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.917 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.100744680000005, 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:41:17.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:17.924 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.089020312000002, 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:17.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.828811888999994, 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.930 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.935 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.700168649000005, 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:41:17.936 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:41:17.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:41:17.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.941 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:17.942 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.542866332000003, 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:41:17.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:41:17.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:41:17.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:41:17.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.359462950999998, 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.948 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:41:17.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.953 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 65.329151123000003, 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.954 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2880 3.4 3:22b427d1:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.857074246, 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017107469, 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2880 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055289+0000", 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0639999999999998e-06 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056815+0000", 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001525584 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056855+0000", 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9975000000000003e-05 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056877+0000", 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2082e-05 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056988+0000", 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011092200000000001 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057219+0000", 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023134100000000001 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057442+0000", 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222981 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066157+0000", 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087146340000000006 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072145+0000", 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059887450000000002 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072294+0000", 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014865399999999999 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072394+0000", 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9487000000000005e-05 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2881 3.31 3:8da41a11:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.846229212000001, 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020325379000000001, 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2881 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066135+0000", 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4769999999999999e-06 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069604+0000", 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003469654 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069639+0000", 2024-04-26T12:41:17.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4814000000000002e-05 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069657+0000", 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7674000000000001e-05 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069764+0000", 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106964 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069958+0000", 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019436099999999999 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.070135+0000", 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017677900000000001 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.078069+0000", 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007933664 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086371+0000", 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083028219999999996 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086413+0000", 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1838000000000002e-05 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086457+0000", 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:41:17.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2888 3.1a 3:59675540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.760997789000001, 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019783412, 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2888 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151366+0000", 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7859999999999998e-06 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156684+0000", 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053173350000000003 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156726+0000", 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:17.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156752+0000", 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6636999999999999e-05 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156859+0000", 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106698 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157025+0000", 2024-04-26T12:41:17.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016556700000000001 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157182+0000", 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157684 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.165499+0000", 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083164580000000005 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171012+0000", 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055134490000000001 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171082+0000", 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0103000000000003e-05 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171146+0000", 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3625000000000002e-05 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3073 3.1a 3:5b06f432:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.326987015, 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021910276999999999, 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3073 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585375+0000", 2024-04-26T12:41:17.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587174+0000", 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017990790000000001 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587195+0000", 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0559000000000001e-05 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587205+0000", 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0217000000000001e-05 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587285+0000", 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9320999999999995e-05 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587426+0000", 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163899999999999 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587534+0000", 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010822700000000001 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.592241+0000", 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047071090000000001 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607152+0000", 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014910048 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607226+0000", 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4960000000000001e-05 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607284+0000", 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7132000000000001e-05 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3107 3.31 3:8f78493a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.982 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.9680954019999994, 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017172129000000001, 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3107 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:17.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944267+0000", 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.069e-06 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946361+0000", 2024-04-26T12:41:17.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020936710000000001 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946394+0000", 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3229000000000003e-05 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946409+0000", 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4738e-05 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946488+0000", 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8863999999999996e-05 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946636+0000", 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014802700000000001 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946734+0000", 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.87e-05 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.951880+0000", 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051454980000000001 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961302+0000", 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094217869999999992 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961378+0000", 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6477000000000007e-05 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961437+0000", 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9069e-05 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3112 3.31 3:8d0978ab:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.9185637660000001, 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022999863999999998, 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3112 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993799+0000", 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5909999999999998e-06 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995315+0000", 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015153530000000001 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995339+0000", 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4700999999999999e-05 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995349+0000", 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.024e-05 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995427+0000", 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7830999999999994e-05 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995543+0000", 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115209 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995684+0000", 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163500000000001 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.001302+0000", 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005617866 2024-04-26T12:41:17.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016681+0000", 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015378660000000001 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016744+0000", 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3674000000000001e-05 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016796+0000", 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2104000000000001e-05 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3190 3.31 3:8e4c6e9a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.0576320359999993, 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018789369, 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:17.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3190 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:17.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854732+0000", 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2279999999999998e-06 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856445+0000", 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017136810000000001 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856474+0000", 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8433999999999999e-05 2024-04-26T12:41:17.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856490+0000", 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6059e-05 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856574+0000", 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856732+0000", 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015771900000000001 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856840+0000", 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010796100000000001 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.863340+0000", 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006499978 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873379+0000", 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010038775999999999 2024-04-26T12:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873459+0000", 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0061000000000005e-05 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873518+0000", 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9051000000000001e-05 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3239 3.31 3:8e75628b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:17.999 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.4709163830000005, 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019464433999999999, 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3239 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441447+0000", 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1300000000000001e-06 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443249+0000", 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001802325 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443284+0000", 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4795999999999997e-05 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443301+0000", 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6592e-05 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443419+0000", 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118551 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443641+0000", 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022181100000000001 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443759+0000", 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011775199999999999 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.450805+0000", 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007046259 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460788+0000", 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099830240000000001 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460856+0000", 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7908000000000001e-05 2024-04-26T12:41:18.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460908+0000", 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2286e-05 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3252 3.31 3:8c05cb84:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:18.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.3266179430000005, 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017610118000000001, 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3252 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585746+0000", 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588002+0000", 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002256404 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588030+0000", 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7617999999999999e-05 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588042+0000", 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.259e-05 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588118+0000", 2024-04-26T12:41:18.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5875000000000001e-05 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588247+0000", 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000128892 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588363+0000", 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115962 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.593618+0000", 2024-04-26T12:41:18.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052545619999999999 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603168+0000", 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0095503849999999998 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603271+0000", 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103078 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603353+0000", 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1438000000000002e-05 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3515 3.1a 3:5b3f0c22:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_450:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.9382329069999997, 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023114013999999999, 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3515 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974130+0000", 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2979999999999999e-06 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975465+0000", 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013352209999999999 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975496+0000", 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1464000000000002e-05 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975512+0000", 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5767999999999999e-05 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975587+0000", 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4315999999999998e-05 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975706+0000", 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119702 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975830+0000", 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012368599999999999 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.980572+0000", 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004742202 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997132+0000", 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016559658000000001 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997192+0000", 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9800999999999999e-05 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997241+0000", 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3522 3.1a 3:59049034:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:18.016 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.870252636, 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021821969, 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3522 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042111+0000", 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043741+0000", 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00163018 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043766+0000", 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4567999999999999e-05 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043779+0000", 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.325e-05 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043861+0000", 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1382000000000001e-05 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.044038+0000", 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017744899999999999 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.044215+0000", 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017687599999999999 2024-04-26T12:41:18.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.050811+0000", 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065957359999999996 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063787+0000", 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012976484 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063852+0000", 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063930+0000", 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7751999999999997e-05 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3528 3.31 3:8ff53833:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_463:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:18.022 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.8082249560000001, 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029523247999999998, 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3528 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104138+0000", 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.148e-06 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105585+0000", 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014478189999999999 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105618+0000", 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3012999999999997e-05 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105634+0000", 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6096e-05 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105716+0000", 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1422999999999996e-05 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105876+0000", 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015977499999999999 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105968+0000", 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2791e-05 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.110618+0000", 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046497070000000003 2024-04-26T12:41:18.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133533+0000", 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022914869000000001 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133606+0000", 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2974999999999998e-05 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133659+0000", 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2632e-05 2024-04-26T12:41:18.027 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.028 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.028 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:18.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:41:18.030 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:18.028+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:18.130 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:18.128+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:18.150 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:18.150 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:18.151 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:18.151 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:18.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:41:18.231 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:18.228+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:18.288 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:18.288 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:18.288 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:18.288 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:18.288 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:18.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:41:18.332 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:18.328+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:18.433 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:18.433 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.125010399999994, 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:41:18.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:41:18.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:41:18.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.439 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.440 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2886 3.f 3:f1601af9:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:18.440 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:18.440 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.312560134999998, 2024-04-26T12:41:18.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018140835000000001, 2024-04-26T12:41:18.440 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.440 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2886 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:18.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118818+0000", 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.120998+0000", 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021794050000000001 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121023+0000", 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5063e-05 2024-04-26T12:41:18.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121036+0000", 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.308e-05 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121148+0000", 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112575 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121377+0000", 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022841100000000001 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121584+0000", 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020710600000000001 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.127654+0000", 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006070069 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136884+0000", 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092296909999999999 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136926+0000", 2024-04-26T12:41:18.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2215000000000002e-05 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136957+0000", 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-05 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3064 3.9 3:9202b9a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.937394933, 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020230000000000001, 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.445 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3064 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493984+0000", 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2289999999999999e-06 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496913+0000", 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029283989999999999 2024-04-26T12:41:18.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496937+0000", 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496947+0000", 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497017+0000", 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9735999999999998e-05 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497139+0000", 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012228 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497237+0000", 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8326999999999996e-05 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.502130+0000", 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048921540000000001 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514064+0000", 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011933918999999999 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514147+0000", 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3065999999999994e-05 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514211+0000", 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4597999999999994e-05 2024-04-26T12:41:18.450 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3106 3.2e 3:75381650:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.497683278, 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020388387000000001, 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.451 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3106 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933696+0000", 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9359999999999999e-06 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935132+0000", 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001436377 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935165+0000", 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2846999999999999e-05 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935181+0000", 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935260+0000", 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9042999999999995e-05 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935412+0000", 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015139299999999999 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935526+0000", 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114076 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.940843+0000", 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053172339999999997 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.953947+0000", 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01310396 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954024+0000", 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7657000000000005e-05 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954081+0000", 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6733e-05 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3126 3.9 3:914259a4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:18.456 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.274796309999999, 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017534042, 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3126 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156583+0000", 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7389999999999999e-06 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158853+0000", 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022704359999999998 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158907+0000", 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3702000000000002e-05 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158921+0000", 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4416999999999999e-05 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159038+0000", 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116878 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159233+0000", 2024-04-26T12:41:18.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195198 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159411+0000", 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177839 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.169121+0000", 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097102739999999996 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.173975+0000", 2024-04-26T12:41:18.460 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048540570000000002 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174054+0000", 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174114+0000", 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9718e-05 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.461 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3139 3.2e 3:741e0bcf:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.1398247, 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027404833999999999, 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3139 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.462 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291555+0000", 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2839999999999998e-06 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293141+0000", 2024-04-26T12:41:18.463 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001586542 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293174+0000", 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2898999999999998e-05 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293190+0000", 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5855999999999999e-05 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293274+0000", 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4191999999999996e-05 2024-04-26T12:41:18.464 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293425+0000", 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015107799999999999 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293532+0000", 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106642 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.298262+0000", 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047298749999999997 2024-04-26T12:41:18.465 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318804+0000", 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020542525999999998 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318891+0000", 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6808e-05 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318956+0000", 2024-04-26T12:41:18.466 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5131999999999999e-05 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3144 3.9 3:93416909:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.085713588000001, 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019208350999999999, 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.467 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3144 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.468 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345666+0000", 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7359999999999999e-06 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347400+0000", 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017342130000000001 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347434+0000", 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3559000000000002e-05 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.469 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347450+0000", 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6126000000000001e-05 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347525+0000", 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5049999999999995e-05 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347690+0000", 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016434500000000001 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.470 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347782+0000", 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2174000000000002e-05 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.352644+0000", 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048619249999999996 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364731+0000", 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012087540000000001 2024-04-26T12:41:18.471 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364811+0000", 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9594999999999999e-05 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364871+0000", 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0087999999999998e-05 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3178 3.9 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.472 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.6991675360000009, 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.026775441000000001, 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3178 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.473 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732211+0000", 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9040000000000001e-06 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734341+0000", 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002130018 2024-04-26T12:41:18.474 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734370+0000", 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8702000000000001e-05 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734386+0000", 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5423000000000001e-05 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734474+0000", 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8490000000000001e-05 2024-04-26T12:41:18.475 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734656+0000", 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018186 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734810+0000", 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015437799999999999 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740557+0000", 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057466710000000001 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.476 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758834+0000", 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018276573000000001 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758919+0000", 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5350000000000001e-05 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758984+0000", 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5072000000000003e-05 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3179 3.9 3:936f954f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.6909096849999994, 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020186769, 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3179 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.478 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740469+0000", 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5019999999999999e-06 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.479 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741784+0000", 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314824 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741812+0000", 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8731e-05 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741827+0000", 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.446e-05 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.480 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741944+0000", 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011712100000000001 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742156+0000", 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000211635 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742381+0000", 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000225174 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.481 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.748059+0000", 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056783090000000003 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760598+0000", 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012538396 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760628+0000", 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0278999999999999e-05 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.482 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760653+0000", 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5338e-05 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3194 3.9 3:9016d8f2:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.5343091139999991, 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01815512, 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.483 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3194 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.484 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897070+0000", 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4309999999999998e-06 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898919+0000", 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018485750000000001 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898950+0000", 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1433000000000002e-05 2024-04-26T12:41:18.485 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898966+0000", 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6011999999999998e-05 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899038+0000", 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1089999999999999e-05 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.486 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899181+0000", 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014355600000000001 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899290+0000", 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109381 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.903968+0000", 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046775810000000001 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.487 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915142+0000", 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01117362 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915185+0000", 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3118000000000003e-05 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915222+0000", 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7323000000000002e-05 2024-04-26T12:41:18.488 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3197 3.2e 3:75db4699:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.4990958750000001, 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027033747, 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.489 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3197 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.490 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932283+0000", 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933450+0000", 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001166472 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933472+0000", 2024-04-26T12:41:18.491 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2761000000000001e-05 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933486+0000", 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3399e-05 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933566+0000", 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0669999999999998e-05 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.492 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933735+0000", 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000169087 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933897+0000", 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016202400000000001 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.938810+0000", 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049125649999999998 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.493 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959231+0000", 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020421228 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959273+0000", 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959314+0000", 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0642000000000002e-05 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.494 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3229 3.f 3:f3b7f6e7:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.1023665650000005, 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018966246999999999, 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3229 2024-04-26T12:41:18.495 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329013+0000", 2024-04-26T12:41:18.496 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331482+0000", 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024695390000000002 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331499+0000", 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7175000000000001e-05 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.497 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331508+0000", 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331619+0000", 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110567 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331768+0000", 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014950200000000001 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.498 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331932+0000", 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389900000000001 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.339084+0000", 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007151887 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347886+0000", 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.008801784 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.499 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347928+0000", 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2228999999999998e-05 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347976+0000", 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7497000000000003e-05 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3245 3.f 3:f14a72c5:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:18.500 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.9270704510000005, 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018443383000000001, 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3245 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.501 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504308+0000", 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505670+0000", 2024-04-26T12:41:18.502 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001361478 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505698+0000", 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827999999999999e-05 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505712+0000", 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3839000000000001e-05 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505790+0000", 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8775000000000004e-05 2024-04-26T12:41:18.503 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505941+0000", 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015073899999999999 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.506050+0000", 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010859 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.510891+0000", 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048417549999999997 2024-04-26T12:41:18.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522669+0000", 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011778001999999999 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522714+0000", 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4861999999999998e-05 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522749+0000", 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4745e-05 2024-04-26T12:41:18.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3257 3.f 3:f16d7886:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.787133098, 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018067529999999998, 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.506 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3257 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644246+0000", 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646264+0000", 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020174160000000002 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646295+0000", 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1828000000000001e-05 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.508 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646306+0000", 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0546e-05 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646390+0000", 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4321999999999997e-05 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646532+0000", 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141669 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646662+0000", 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129634 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.651808+0000", 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051462610000000001 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662201+0000", 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010392848999999999 2024-04-26T12:41:18.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662259+0000", 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8108e-05 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662311+0000", 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1662000000000001e-05 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.511 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3280 3.21 3:8431c446:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.6378249480000004, 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018802534999999999, 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3280 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.512 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793554+0000", 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.762e-06 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.513 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.794995+0000", 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014413270000000001 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795026+0000", 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0260000000000002e-05 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795039+0000", 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3396e-05 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.514 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795124+0000", 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5165000000000002e-05 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795132+0000", 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3450000000000006e-06 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.797837+0000", 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027041750000000001 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798009+0000", 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000172456 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798162+0000", 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015279000000000001 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808398+0000", 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010236263000000001 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812214+0000", 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003816285 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812291+0000", 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7035999999999999e-05 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812354+0000", 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2274999999999996e-05 2024-04-26T12:41:18.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3468 3.9 3:92d2bef4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.9713676209999997, 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019140161999999999, 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.518 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3468 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.519 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460010+0000", 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6220000000000001e-06 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462069+0000", 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020588350000000002 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462093+0000", 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3841000000000001e-05 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462104+0000", 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0781999999999999e-05 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462169+0000", 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5223999999999998e-05 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462310+0000", 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014092999999999999 2024-04-26T12:41:18.521 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462468+0000", 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015857999999999999 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.467313+0000", 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048449909999999999 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.522 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479025+0000", 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011711408 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479095+0000", 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0562000000000006e-05 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479149+0000", 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3387000000000002e-05 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.523 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3490 3.9 3:90ed9f24:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_425:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.7316166729999996, 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019930929, 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3490 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.524 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699767+0000", 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-06 2024-04-26T12:41:18.525 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702177+0000", 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024107909999999998 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702216+0000", 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8677000000000003e-05 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702233+0000", 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.677e-05 2024-04-26T12:41:18.526 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702331+0000", 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8522000000000003e-05 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702554+0000", 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222284 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702746+0000", 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192165 2024-04-26T12:41:18.527 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.711473+0000", 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087273230000000004 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719610+0000", 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081368139999999992 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.528 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.529 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.529 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719655+0000", 2024-04-26T12:41:18.529 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5166000000000001e-05 2024-04-26T12:41:18.529 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.529 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719690+0000", 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5240999999999997e-05 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3498 3.9 3:90786aa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_433:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.648011307, 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019394081000000001, 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.530 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3498 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.531 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783369+0000", 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4780000000000002e-06 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785506+0000", 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00213635 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.532 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785535+0000", 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-05 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785551+0000", 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5452e-05 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785654+0000", 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000102951 2024-04-26T12:41:18.533 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785857+0000", 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000202785 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785972+0000", 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011500100000000001 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.792041+0000", 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060695999999999996 2024-04-26T12:41:18.534 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802651+0000", 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010609726999999999 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802702+0000", 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1304000000000002e-05 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802759+0000", 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6703000000000002e-05 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.535 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3511 3.2e 3:76d60bde:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.4937995239999999, 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020430932999999998, 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3511 2024-04-26T12:41:18.536 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937578+0000", 2024-04-26T12:41:18.537 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8759999999999999e-06 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939235+0000", 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016561989999999999 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939267+0000", 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2712999999999997e-05 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.538 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939283+0000", 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5421e-05 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939362+0000", 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8752999999999996e-05 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939492+0000", 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130844 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.539 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939616+0000", 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012401600000000001 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.944163+0000", 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045470329999999998 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957900+0000", 2024-04-26T12:41:18.540 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013737047 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957962+0000", 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1976000000000004e-05 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.958008+0000", 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5055000000000001e-05 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.541 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3518 3.f 3:f20a4de4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_453:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.4269396309999998, 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018842589, 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3518 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.542 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004440+0000", 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.543 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006038+0000", 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015980079999999999 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006062+0000", 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4779000000000001e-05 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006075+0000", 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2782000000000001e-05 2024-04-26T12:41:18.544 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006152+0000", 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7343999999999997e-05 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006322+0000", 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016997900000000001 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006415+0000", 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2800999999999995e-05 2024-04-26T12:41:18.545 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.012821+0000", 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064056770000000002 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023205+0000", 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010383763000000001 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023248+0000", 2024-04-26T12:41:18.546 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2963000000000002e-05 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023279+0000", 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1383000000000001e-05 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:18.547 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:18.548 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:18.433+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:18.549 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:41:18.550 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:18.548+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:18.651 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:18.649+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:18.726 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:18.726 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:18.741 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:41:18.789 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:18.789+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:18.849 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:41:18.852 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:18.853+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:18.922 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:18.922 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:18.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:41:18.980 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:18.981+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:19.055 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:19.052+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:19.055 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2320 3.27 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.665451293000004, 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020624966000000002, 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.056 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2320 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:19.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389495+0000", 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390861+0000", 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013652849999999999 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.058 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390898+0000", 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6789000000000003e-05 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390908+0000", 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.065e-05 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390983+0000", 2024-04-26T12:41:19.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391089+0000", 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105752 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391177+0000", 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7596999999999995e-05 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.395646+0000", 2024-04-26T12:41:19.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044690889999999999 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410024+0000", 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014378050999999999 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410065+0000", 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1056000000000001e-05 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410117+0000", 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2485000000000003e-05 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2374 3.38 3:1c1a4d28:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 67.082296892000002, 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020357772999999999, 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.062 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2374 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972649+0000", 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974485+0000", 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018357899999999999 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974516+0000", 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1142000000000001e-05 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974531+0000", 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.455e-05 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974627+0000", 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6543e-05 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974833+0000", 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020613700000000001 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.975018+0000", 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000184267 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.981099+0000", 2024-04-26T12:41:19.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00608093 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011762869 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992942+0000", 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0517000000000002e-05 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.993005+0000", 2024-04-26T12:41:19.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2648000000000001e-05 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.805123206000005, 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:19.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.074 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 66.570460413999996, 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:41:19.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:41:19.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:41:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:41:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:41:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:41:19.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2872 3.7 3:e1a8506b:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 30.121172019999999, 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020999501, 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.081 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2872 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933774+0000", 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7199999999999998e-06 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935453+0000", 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016790850000000001 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935491+0000", 2024-04-26T12:41:19.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7734999999999997e-05 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935504+0000", 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3254999999999999e-05 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935575+0000", 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0339999999999994e-05 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935722+0000", 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014727800000000001 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935854+0000", 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131507 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.940409+0000", 2024-04-26T12:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045550790000000001 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954592+0000", 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014183332 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954696+0000", 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103602 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954771+0000", 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5568000000000006e-05 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2890 3.2 3:422e89e2:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 29.883491802999998, 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023228242999999999, 2024-04-26T12:41:19.087 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2890 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171455+0000", 2024-04-26T12:41:19.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1370000000000002e-06 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175884+0000", 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044289400000000001 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175931+0000", 2024-04-26T12:41:19.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.71e-05 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175950+0000", 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176035+0000", 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4580999999999995e-05 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176145+0000", 2024-04-26T12:41:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010970499999999999 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176237+0000", 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2898000000000004e-05 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.180690+0000", 2024-04-26T12:41:19.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044521550000000002 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194585+0000", 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013895286 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194646+0000", 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0927000000000001e-05 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194680+0000", 2024-04-26T12:41:19.093 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4360999999999998e-05 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3070 3.2 3:41299508:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.499624439, 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021442744, 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.094 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3070 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.095 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555322+0000", 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3879999999999998e-06 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557150+0000", 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018282699999999999 2024-04-26T12:41:19.096 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557177+0000", 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6804999999999998e-05 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557187+0000", 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0042e-05 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557354+0000", 2024-04-26T12:41:19.097 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016743800000000001 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557502+0000", 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0001474 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557642+0000", 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014000300000000001 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.098 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.562888+0000", 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005246031 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576517+0000", 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013629702 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576606+0000", 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9079000000000006e-05 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.099 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576762+0000", 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015558600000000001 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3101 3.1e 3:7930998e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:19.100 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 11.173290572000001, 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020983102999999999, 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3101 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:19.101 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881657+0000", 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6279999999999998e-06 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.102 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883263+0000", 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001606257 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883289+0000", 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6152e-05 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883302+0000", 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2809000000000001e-05 2024-04-26T12:41:19.103 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883389+0000", 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7429999999999995e-05 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883567+0000", 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017797000000000001 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883734+0000", 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016698900000000001 2024-04-26T12:41:19.104 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.890551+0000", 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00681658 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902478+0000", 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011927559000000001 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902561+0000", 2024-04-26T12:41:19.105 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2965000000000003e-05 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902636+0000", 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4764000000000004e-05 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3122 3.29 3:951a57de:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.944624505, 2024-04-26T12:41:19.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021821106, 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3122 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110322+0000", 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.632e-06 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112021+0000", 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016992789999999999 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112052+0000", 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0525000000000003e-05 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112064+0000", 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2768e-05 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112173+0000", 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108119 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112424+0000", 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025160699999999999 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112569+0000", 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144888 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.118043+0000", 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054735959999999998 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132056+0000", 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014013146000000001 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132105+0000", 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8909000000000002e-05 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132140+0000", 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5636999999999998e-05 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3123 3.27 3:e6e77b36:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.933320402, 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021419740999999999, 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.112 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3123 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121626+0000", 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2979999999999999e-06 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123454+0000", 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018283069999999999 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123490+0000", 2024-04-26T12:41:19.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6225e-05 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123506+0000", 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5931999999999999e-05 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123595+0000", 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9151000000000001e-05 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123805+0000", 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020976 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123984+0000", 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017854500000000001 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.129714+0000", 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057303720000000001 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.142950+0000", 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013235660999999999 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.142993+0000", 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3072999999999999e-05 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.143043+0000", 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0417000000000002e-05 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3180 3.38 3:1dc50762:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.303237118, 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020727782, 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3180 2024-04-26T12:41:19.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751708+0000", 2024-04-26T12:41:19.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8899999999999999e-06 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753438+0000", 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001729866 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753472+0000", 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3293999999999997e-05 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753487+0000", 2024-04-26T12:41:19.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5184999999999999e-05 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753568+0000", 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1404999999999997e-05 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753737+0000", 2024-04-26T12:41:19.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016865900000000001 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753855+0000", 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117861 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758867+0000", 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050125059999999999 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772351+0000", 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013484052999999999 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772389+0000", 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7391999999999997e-05 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772434+0000", 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5670999999999997e-05 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.123 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3236 3.7 3:e0b2f0ce:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.6433811620000007, 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025042014000000001, 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3236 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.124 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411565+0000", 2024-04-26T12:41:19.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412947+0000", 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013823349999999999 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412981+0000", 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3386000000000002e-05 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412996+0000", 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5610000000000001e-05 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413076+0000", 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9488999999999997e-05 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413247+0000", 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017079199999999999 2024-04-26T12:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413355+0000", 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108824 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.418245+0000", 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048893299999999999 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436492+0000", 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018247368999999999 2024-04-26T12:41:19.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436567+0000", 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4802000000000007e-05 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436605+0000", 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7592000000000002e-05 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3250 3.33 3:cf65c941:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.4897516880000001, 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022851729000000001, 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3250 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.130 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.131 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565195+0000", 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-06 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567117+0000", 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019217570000000001 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567143+0000", 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6321000000000001e-05 2024-04-26T12:41:19.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567158+0000", 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4712000000000001e-05 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567244+0000", 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6583999999999996e-05 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567400+0000", 2024-04-26T12:41:19.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015599099999999999 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567575+0000", 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017444199999999999 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.574382+0000", 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068072660000000002 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587935+0000", 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013552899 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587991+0000", 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5927999999999997e-05 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588044+0000", 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2731e-05 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3467 3.2 3:4067df0c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.6076972979999997, 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023170046999999999, 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3467 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.136 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447249+0000", 2024-04-26T12:41:19.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9960000000000002e-06 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449053+0000", 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018033369999999999 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449080+0000", 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7608999999999999e-05 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449094+0000", 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3689999999999999e-05 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449175+0000", 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0655999999999995e-05 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449305+0000", 2024-04-26T12:41:19.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012987400000000001 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449412+0000", 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010741799999999999 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.454641+0000", 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052287130000000003 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470316+0000", 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015674837 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470362+0000", 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5998999999999998e-05 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470416+0000", 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4917999999999998e-05 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.141 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3481 3.27 3:e4b6b857:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.4520847610000001, 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020687291, 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.142 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3481 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:19.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602861+0000", 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.604985+0000", 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021233990000000002 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605016+0000", 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1613999999999999e-05 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605028+0000", 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1302e-05 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605113+0000", 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5173999999999995e-05 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605242+0000", 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129443 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605346+0000", 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010377 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.610502+0000", 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051564089999999998 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623416+0000", 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012913614 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623490+0000", 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.149 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623546+0000", 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6617999999999999e-05 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3493 3.33 3:cdefd7bd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_428:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 6.3209904190000001, 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020983978, 2024-04-26T12:41:19.150 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3493 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733956+0000", 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6730000000000001e-06 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735896+0000", 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940382 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735925+0000", 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8700999999999998e-05 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735940+0000", 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4674e-05 2024-04-26T12:41:19.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736035+0000", 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5551999999999996e-05 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736240+0000", 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020428800000000001 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736354+0000", 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114145 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.741363+0000", 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050093840000000004 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754845+0000", 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013481501 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754902+0000", 2024-04-26T12:41:19.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7617000000000001e-05 2024-04-26T12:41:19.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754937+0000", 2024-04-26T12:41:19.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5061000000000002e-05 2024-04-26T12:41:19.156 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3534 3.7 3:e277469f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_469:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.8920592740000002, 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027785351999999999, 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.157 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3534 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:19.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162887+0000", 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6230000000000001e-06 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165295+0000", 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024080019999999998 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165329+0000", 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3800000000000002e-05 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165344+0000", 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5310000000000001e-05 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165433+0000", 2024-04-26T12:41:19.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9015000000000001e-05 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165609+0000", 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175809 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165785+0000", 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000176515 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.170217+0000", 2024-04-26T12:41:19.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044311979999999999 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190550+0000", 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020333235000000002 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190604+0000", 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4026000000000001e-05 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190670+0000", 2024-04-26T12:41:19.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5819000000000001e-05 2024-04-26T12:41:19.163 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.163 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.163 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.163 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3540 3.33 3:ccf326fe:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_475:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:19.163 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:19.163 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.8312776790000003, 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022822643, 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3540 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223669+0000", 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9849999999999998e-06 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225528+0000", 2024-04-26T12:41:19.165 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001859461 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225554+0000", 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5609000000000002e-05 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225567+0000", 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3326000000000001e-05 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.166 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225645+0000", 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7880000000000007e-05 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225758+0000", 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112355 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225854+0000", 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6059999999999998e-05 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.231841+0000", 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059873219999999998 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246370+0000", 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014528983000000001 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246436+0000", 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5889999999999994e-05 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246489+0000", 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2772000000000002e-05 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3544 3.27 3:e5e9dc2a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.7908348680000001, 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020824362999999999, 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.169 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3544 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:19.170 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264111+0000", 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265590+0000", 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014784430000000001 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265615+0000", 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4756000000000002e-05 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265625+0000", 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0445000000000001e-05 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265706+0000", 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1144999999999996e-05 2024-04-26T12:41:19.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265832+0000", 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012604000000000001 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265955+0000", 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012266100000000001 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.270368+0000", 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044134589999999998 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284829+0000", 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014460944999999999 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284875+0000", 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5864e-05 2024-04-26T12:41:19.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284933+0000", 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8063999999999998e-05 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3553 3.7 3:e09c7e82:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_488:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.6929582720000003, 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023273085999999998, 2024-04-26T12:41:19.175 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3553 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361988+0000", 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363819+0000", 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018314119999999999 2024-04-26T12:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363847+0000", 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363861+0000", 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4127999999999999e-05 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363927+0000", 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6342999999999998e-05 2024-04-26T12:41:19.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364037+0000", 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109503 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364138+0000", 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101734 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.368455+0000", 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004317212 2024-04-26T12:41:19.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385075+0000", 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016619425 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385182+0000", 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010734 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385259+0000", 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6268999999999998e-05 2024-04-26T12:41:19.180 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:19.181 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:19.181 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:19.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:41:19.183 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:41:19.184 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:19.180+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:19.284 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:19.280+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:19.316 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:19.317 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:19.317 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:41:19.317 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:19.331 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:41:19.381 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:19.381 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:19.384 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:19.381+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:19.398 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:19.399 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:19.415 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:19.415 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:19.431 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:19.432 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:19.452 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:19.452 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:19.471 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:19.471 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:19.485 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:19.485+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:19.492 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:19.492 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:19.497 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:19.497 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:19.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:41:19.512 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:19.513 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:19.586 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:19.585+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:19.634 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:19.635 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:19.649 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:41:19.692 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:19.692+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:19.767 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:19.767 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:19.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:41:19.787 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:19.785+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:19.888 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:19.888+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:19.942 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:19.942 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:19.956 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:41:20.000 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:20.000+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:20.090 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:20.089+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:20.113 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:20.113 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:20.126 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:41:20.191 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:20.188+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:20.247 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:20.247 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:20.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:41:20.292 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:20.293+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:20.393 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:20.393+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:20.428 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:20.428 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:20.441 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:41:20.494 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:20.492+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:20.565 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:20.565 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:20.579 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:41:20.595 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:20.593+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:20.696 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:20.697+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:20.739 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:20.739 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:20.752 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:41:20.797 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:20.796+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:20.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:41:20.871 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:20.871 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:20.885 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:41:20.917 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:20.917+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:20.999 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:20.997+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:21.051 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:21.051 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:21.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:41:21.112 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:21.113+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:21.186 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:21.186 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:21.201 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:41:21.201 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:21.200+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:21.302 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:21.300+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:21.370 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:21.370 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:21.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:41:21.403 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:21.400+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:21.504 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:21.504+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:21.511 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:21.525 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:41:21.532 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:41:21.620 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:21.621+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:21.654 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:21.669 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:41:21.712 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:21.713+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:21.719 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:21.719 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:21.736 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:21.736 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:21.753 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:21.753 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:21.770 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:21.770 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:21.791 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:21.808 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:21.804+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:21.811 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:21.812 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:21.830 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:21.830 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:21.830 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:21.830 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:21.830 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:21.832 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:21.833 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:21.844 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:41:21.854 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:21.855 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:21.859 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:41:21.932 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:21.933+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:21.976 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:21.976 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:21.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:21.976 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:21.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.976 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:21.976 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:21.976 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 70.240287905000002, 2024-04-26T12:41:21.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:41:21.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:41:21.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:41:21.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 70.164031637999997, 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:21.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:21.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.987 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 70.152307269999994, 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:21.988 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:21.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:41:21.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:41:21.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:41:21.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:21.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 69.892098847, 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:21.994 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:41:21.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:21.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 69.763455606999997, 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:41:22.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:22.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 69.606153289999995, 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:22.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:41:22.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:41:22.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 69.422749909000004, 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:22.016 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 69.392438080999995, 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:22.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:41:22.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:41:22.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2880 3.4 3:22b427d1:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 32.920361204000002, 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017107469, 2024-04-26T12:41:22.022 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2880 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.023 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055289+0000", 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0639999999999998e-06 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.024 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056815+0000", 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001525584 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056855+0000", 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9975000000000003e-05 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056877+0000", 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2082e-05 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.025 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056988+0000", 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011092200000000001 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057219+0000", 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023134100000000001 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057442+0000", 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222981 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.026 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066157+0000", 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087146340000000006 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072145+0000", 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059887450000000002 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072294+0000", 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014865399999999999 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.027 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072394+0000", 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9487000000000005e-05 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2881 3.31 3:8da41a11:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 32.909516170000003, 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020325379000000001, 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.028 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2881 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:22.029 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066135+0000", 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4769999999999999e-06 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069604+0000", 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003469654 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.030 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069639+0000", 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4814000000000002e-05 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069657+0000", 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7674000000000001e-05 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069764+0000", 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106964 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.031 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069958+0000", 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019436099999999999 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.070135+0000", 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017677900000000001 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.078069+0000", 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007933664 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.032 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086371+0000", 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083028219999999996 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086413+0000", 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1838000000000002e-05 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086457+0000", 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.033 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2888 3.1a 3:59675540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 32.824284747, 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019783412, 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.034 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2888 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.035 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151366+0000", 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7859999999999998e-06 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156684+0000", 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053173350000000003 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156726+0000", 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:22.036 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156752+0000", 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6636999999999999e-05 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156859+0000", 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106698 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157025+0000", 2024-04-26T12:41:22.037 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016556700000000001 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157182+0000", 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157684 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.165499+0000", 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083164580000000005 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171012+0000", 2024-04-26T12:41:22.038 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055134490000000001 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171082+0000", 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0103000000000003e-05 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171146+0000", 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3625000000000002e-05 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.039 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3073 3.1a 3:5b06f432:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.390273972999999, 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021910276999999999, 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3073 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.040 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585375+0000", 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-04-26T12:41:22.041 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587174+0000", 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017990790000000001 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587195+0000", 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0559000000000001e-05 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.042 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587205+0000", 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0217000000000001e-05 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587285+0000", 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9320999999999995e-05 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587426+0000", 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163899999999999 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.043 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587534+0000", 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010822700000000001 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.592241+0000", 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047071090000000001 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607152+0000", 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014910048 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.044 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607226+0000", 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4960000000000001e-05 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607284+0000", 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7132000000000001e-05 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.045 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3107 3.31 3:8f78493a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.03138236, 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017172129000000001, 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3107 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.046 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944267+0000", 2024-04-26T12:41:22.047 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.069e-06 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946361+0000", 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020936710000000001 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946394+0000", 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3229000000000003e-05 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.048 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946409+0000", 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4738e-05 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946488+0000", 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8863999999999996e-05 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946636+0000", 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014802700000000001 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946734+0000", 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.87e-05 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.951880+0000", 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051454980000000001 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961302+0000", 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094217869999999992 2024-04-26T12:41:22.050 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961378+0000", 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6477000000000007e-05 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961437+0000", 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9069e-05 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.051 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3112 3.31 3:8d0978ab:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.981850723999999, 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022999863999999998, 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3112 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.052 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993799+0000", 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5909999999999998e-06 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.053 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995315+0000", 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015153530000000001 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995339+0000", 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4700999999999999e-05 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.054 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995349+0000", 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.024e-05 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995427+0000", 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7830999999999994e-05 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995543+0000", 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115209 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.055 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995684+0000", 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163500000000001 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.001302+0000", 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005617866 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016681+0000", 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015378660000000001 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.056 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016744+0000", 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3674000000000001e-05 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016796+0000", 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2104000000000001e-05 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.057 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3190 3.31 3:8e4c6e9a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.120918994, 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018789369, 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3190 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.058 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854732+0000", 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2279999999999998e-06 2024-04-26T12:41:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856445+0000", 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017136810000000001 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856474+0000", 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8433999999999999e-05 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856490+0000", 2024-04-26T12:41:22.060 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6059e-05 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856574+0000", 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856732+0000", 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015771900000000001 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.061 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856840+0000", 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010796100000000001 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.863340+0000", 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006499978 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873379+0000", 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010038775999999999 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.062 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873459+0000", 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0061000000000005e-05 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873518+0000", 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9051000000000001e-05 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3239 3.31 3:8e75628b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.063 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.534203341, 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019464433999999999, 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3239 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.064 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441447+0000", 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1300000000000001e-06 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.065 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443249+0000", 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001802325 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443284+0000", 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4795999999999997e-05 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443301+0000", 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6592e-05 2024-04-26T12:41:22.066 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443419+0000", 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118551 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443641+0000", 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022181100000000001 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.067 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443759+0000", 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011775199999999999 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.450805+0000", 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007046259 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460788+0000", 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099830240000000001 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.068 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460856+0000", 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7908000000000001e-05 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460908+0000", 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2286e-05 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.069 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3252 3.31 3:8c05cb84:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.389904901, 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017610118000000001, 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3252 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.070 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585746+0000", 2024-04-26T12:41:22.071 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588002+0000", 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002256404 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588030+0000", 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7617999999999999e-05 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.072 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588042+0000", 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.259e-05 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588118+0000", 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5875000000000001e-05 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588247+0000", 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000128892 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.073 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588363+0000", 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115962 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.593618+0000", 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052545619999999999 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603168+0000", 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0095503849999999998 2024-04-26T12:41:22.074 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603271+0000", 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103078 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603353+0000", 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1438000000000002e-05 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.075 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3515 3.1a 3:5b3f0c22:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_450:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.0015198650000006, 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023114013999999999, 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3515 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.076 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974130+0000", 2024-04-26T12:41:22.077 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2979999999999999e-06 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975465+0000", 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013352209999999999 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975496+0000", 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1464000000000002e-05 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.078 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975512+0000", 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5767999999999999e-05 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975587+0000", 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4315999999999998e-05 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975706+0000", 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119702 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.079 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975830+0000", 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012368599999999999 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.980572+0000", 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004742202 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997132+0000", 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016559658000000001 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.080 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997192+0000", 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9800999999999999e-05 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997241+0000", 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3522 3.1a 3:59049034:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:22.081 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.9335395939999991, 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021821969, 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3522 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.082 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042111+0000", 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.083 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043741+0000", 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00163018 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043766+0000", 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4567999999999999e-05 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043779+0000", 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.325e-05 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043861+0000", 2024-04-26T12:41:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1382000000000001e-05 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.044038+0000", 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017744899999999999 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.044215+0000", 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017687599999999999 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.050811+0000", 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065957359999999996 2024-04-26T12:41:22.085 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063787+0000", 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012976484 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063852+0000", 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063930+0000", 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7751999999999997e-05 2024-04-26T12:41:22.086 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3528 3.31 3:8ff53833:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_463:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 8.8715119139999992, 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029523247999999998, 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.087 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3528 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.088 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104138+0000", 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.148e-06 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105585+0000", 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014478189999999999 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105618+0000", 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3012999999999997e-05 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.089 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105634+0000", 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6096e-05 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105716+0000", 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1422999999999996e-05 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105876+0000", 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015977499999999999 2024-04-26T12:41:22.090 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105968+0000", 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2791e-05 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.110618+0000", 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046497070000000003 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133533+0000", 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022914869000000001 2024-04-26T12:41:22.091 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133606+0000", 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2974999999999998e-05 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133659+0000", 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2632e-05 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.092 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:22.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:41:22.094 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:22.092+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:22.195 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:22.192+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:22.272 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:22.272 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:22.272 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:22.272 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:22.287 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:41:22.295 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:22.292+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:22.396 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:22.397+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:22.414 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:22.414 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:22.414 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:22.414 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:22.415 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:22.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:41:22.497 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:22.496+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:22.598 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:22.596+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:22.607 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:22.607 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:22.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:22.607 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:22.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 70.298976349, 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:41:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:41:22.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2886 3.f 3:f1601af9:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:22.613 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 33.486526083999998, 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018140835000000001, 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2886 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118818+0000", 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.120998+0000", 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021794050000000001 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121023+0000", 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5063e-05 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121036+0000", 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.308e-05 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121148+0000", 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112575 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121377+0000", 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022841100000000001 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121584+0000", 2024-04-26T12:41:22.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020710600000000001 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.127654+0000", 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006070069 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136884+0000", 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092296909999999999 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136926+0000", 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2215000000000002e-05 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136957+0000", 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-05 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3064 3.9 3:9202b9a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.111360882, 2024-04-26T12:41:22.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020230000000000001, 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3064 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493984+0000", 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2289999999999999e-06 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496913+0000", 2024-04-26T12:41:22.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029283989999999999 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496937+0000", 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496947+0000", 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497017+0000", 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9735999999999998e-05 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497139+0000", 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012228 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497237+0000", 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8326999999999996e-05 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.502130+0000", 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048921540000000001 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514064+0000", 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011933918999999999 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514147+0000", 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3065999999999994e-05 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514211+0000", 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4597999999999994e-05 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3106 3.2e 3:75381650:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.671649227, 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020388387000000001, 2024-04-26T12:41:22.625 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3106 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933696+0000", 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9359999999999999e-06 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935132+0000", 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001436377 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935165+0000", 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2846999999999999e-05 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935181+0000", 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935260+0000", 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9042999999999995e-05 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935412+0000", 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015139299999999999 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935526+0000", 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114076 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.940843+0000", 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053172339999999997 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.953947+0000", 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01310396 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954024+0000", 2024-04-26T12:41:22.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7657000000000005e-05 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954081+0000", 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6733e-05 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3126 3.9 3:914259a4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.448762259, 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017534042, 2024-04-26T12:41:22.631 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3126 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156583+0000", 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7389999999999999e-06 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158853+0000", 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022704359999999998 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158907+0000", 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3702000000000002e-05 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158921+0000", 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4416999999999999e-05 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159038+0000", 2024-04-26T12:41:22.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116878 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159233+0000", 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195198 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159411+0000", 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177839 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.169121+0000", 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097102739999999996 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.173975+0000", 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048540570000000002 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174054+0000", 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:41:22.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174114+0000", 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9718e-05 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3139 3.2e 3:741e0bcf:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.313790649, 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027404833999999999, 2024-04-26T12:41:22.637 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3139 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291555+0000", 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2839999999999998e-06 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293141+0000", 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001586542 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293174+0000", 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2898999999999998e-05 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293190+0000", 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5855999999999999e-05 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293274+0000", 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4191999999999996e-05 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293425+0000", 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015107799999999999 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293532+0000", 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106642 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.298262+0000", 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047298749999999997 2024-04-26T12:41:22.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318804+0000", 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020542525999999998 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318891+0000", 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6808e-05 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318956+0000", 2024-04-26T12:41:22.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5131999999999999e-05 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3144 3.9 3:93416909:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.259679537, 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019208350999999999, 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3144 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345666+0000", 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7359999999999999e-06 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347400+0000", 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017342130000000001 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347434+0000", 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3559000000000002e-05 2024-04-26T12:41:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347450+0000", 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6126000000000001e-05 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347525+0000", 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5049999999999995e-05 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347690+0000", 2024-04-26T12:41:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016434500000000001 2024-04-26T12:41:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347782+0000", 2024-04-26T12:41:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2174000000000002e-05 2024-04-26T12:41:22.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.352644+0000", 2024-04-26T12:41:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048619249999999996 2024-04-26T12:41:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.648 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364731+0000", 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012087540000000001 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364811+0000", 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9594999999999999e-05 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364871+0000", 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0087999999999998e-05 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3178 3.9 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.873133485, 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.026775441000000001, 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3178 2024-04-26T12:41:22.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732211+0000", 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9040000000000001e-06 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734341+0000", 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002130018 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734370+0000", 2024-04-26T12:41:22.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8702000000000001e-05 2024-04-26T12:41:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734386+0000", 2024-04-26T12:41:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5423000000000001e-05 2024-04-26T12:41:22.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734474+0000", 2024-04-26T12:41:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8490000000000001e-05 2024-04-26T12:41:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.654 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734656+0000", 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018186 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734810+0000", 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015437799999999999 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740557+0000", 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057466710000000001 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758834+0000", 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018276573000000001 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758919+0000", 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5350000000000001e-05 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758984+0000", 2024-04-26T12:41:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5072000000000003e-05 2024-04-26T12:41:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3179 3.9 3:936f954f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.864875634000001, 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020186769, 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.658 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3179 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740469+0000", 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5019999999999999e-06 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741784+0000", 2024-04-26T12:41:22.660 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314824 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741812+0000", 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8731e-05 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741827+0000", 2024-04-26T12:41:22.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.446e-05 2024-04-26T12:41:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741944+0000", 2024-04-26T12:41:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011712100000000001 2024-04-26T12:41:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742156+0000", 2024-04-26T12:41:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000211635 2024-04-26T12:41:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742381+0000", 2024-04-26T12:41:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000225174 2024-04-26T12:41:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.748059+0000", 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056783090000000003 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760598+0000", 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012538396 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760628+0000", 2024-04-26T12:41:22.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0278999999999999e-05 2024-04-26T12:41:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760653+0000", 2024-04-26T12:41:22.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5338e-05 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3194 3.9 3:9016d8f2:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.708275063, 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01815512, 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.667 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3194 2024-04-26T12:41:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897070+0000", 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4309999999999998e-06 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898919+0000", 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018485750000000001 2024-04-26T12:41:22.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898950+0000", 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1433000000000002e-05 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898966+0000", 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6011999999999998e-05 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899038+0000", 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1089999999999999e-05 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899181+0000", 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014355600000000001 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899290+0000", 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109381 2024-04-26T12:41:22.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.903968+0000", 2024-04-26T12:41:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046775810000000001 2024-04-26T12:41:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915142+0000", 2024-04-26T12:41:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01117362 2024-04-26T12:41:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915185+0000", 2024-04-26T12:41:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3118000000000003e-05 2024-04-26T12:41:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915222+0000", 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7323000000000002e-05 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3197 3.2e 3:75db4699:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.673061823999999, 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027033747, 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.675 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3197 2024-04-26T12:41:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.676 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.677 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:22.678 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932283+0000", 2024-04-26T12:41:22.679 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:41:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933450+0000", 2024-04-26T12:41:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001166472 2024-04-26T12:41:22.680 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933472+0000", 2024-04-26T12:41:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2761000000000001e-05 2024-04-26T12:41:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.681 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933486+0000", 2024-04-26T12:41:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3399e-05 2024-04-26T12:41:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.682 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933566+0000", 2024-04-26T12:41:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0669999999999998e-05 2024-04-26T12:41:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933735+0000", 2024-04-26T12:41:22.683 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000169087 2024-04-26T12:41:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933897+0000", 2024-04-26T12:41:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016202400000000001 2024-04-26T12:41:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.938810+0000", 2024-04-26T12:41:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049125649999999998 2024-04-26T12:41:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.685 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959231+0000", 2024-04-26T12:41:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020421228 2024-04-26T12:41:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.686 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959273+0000", 2024-04-26T12:41:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.687 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959314+0000", 2024-04-26T12:41:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0642000000000002e-05 2024-04-26T12:41:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.688 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3229 3.f 3:f3b7f6e7:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.276332514, 2024-04-26T12:41:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018966246999999999, 2024-04-26T12:41:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.689 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3229 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.690 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.691 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329013+0000", 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331482+0000", 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024695390000000002 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.692 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331499+0000", 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7175000000000001e-05 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331508+0000", 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331619+0000", 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110567 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.693 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331768+0000", 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014950200000000001 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331932+0000", 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389900000000001 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.694 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.339084+0000", 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007151887 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347886+0000", 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.008801784 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347928+0000", 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2228999999999998e-05 2024-04-26T12:41:22.695 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347976+0000", 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7497000000000003e-05 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.696 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3245 3.f 3:f14a72c5:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.1010364, 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018443383000000001, 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3245 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.697 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504308+0000", 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.698 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505670+0000", 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001361478 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505698+0000", 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827999999999999e-05 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505712+0000", 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3839000000000001e-05 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.699 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505790+0000", 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8775000000000004e-05 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505941+0000", 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015073899999999999 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.506050+0000", 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010859 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.700 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.510891+0000", 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048417549999999997 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522669+0000", 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011778001999999999 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522714+0000", 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4861999999999998e-05 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.701 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522749+0000", 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4745e-05 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3257 3.f 3:f16d7886:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.961099046999999, 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018067529999999998, 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.702 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3257 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.703 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644246+0000", 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646264+0000", 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020174160000000002 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.704 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646295+0000", 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1828000000000001e-05 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646306+0000", 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0546e-05 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646390+0000", 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4321999999999997e-05 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.705 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646532+0000", 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141669 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646662+0000", 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129634 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.651808+0000", 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051462610000000001 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.706 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662201+0000", 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010392848999999999 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662259+0000", 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8108e-05 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.707 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662311+0000", 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1662000000000001e-05 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3280 3.21 3:8431c446:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 12.811790897, 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018802534999999999, 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.708 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3280 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.709 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.710 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793554+0000", 2024-04-26T12:41:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.762e-06 2024-04-26T12:41:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.794995+0000", 2024-04-26T12:41:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014413270000000001 2024-04-26T12:41:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.711 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795026+0000", 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0260000000000002e-05 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795039+0000", 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3396e-05 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.712 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795124+0000", 2024-04-26T12:41:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5165000000000002e-05 2024-04-26T12:41:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:22.713 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795132+0000", 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3450000000000006e-06 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.797837+0000", 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027041750000000001 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798009+0000", 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000172456 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.714 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798162+0000", 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015279000000000001 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808398+0000", 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010236263000000001 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812214+0000", 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003816285 2024-04-26T12:41:22.715 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812291+0000", 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7035999999999999e-05 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812354+0000", 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2274999999999996e-05 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.716 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3468 3.9 3:92d2bef4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.14533357, 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019140161999999999, 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3468 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.717 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460010+0000", 2024-04-26T12:41:22.718 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6220000000000001e-06 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462069+0000", 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020588350000000002 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462093+0000", 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3841000000000001e-05 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.719 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462104+0000", 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0781999999999999e-05 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462169+0000", 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5223999999999998e-05 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462310+0000", 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014092999999999999 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.720 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462468+0000", 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015857999999999999 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.467313+0000", 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048449909999999999 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479025+0000", 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011711408 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.721 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479095+0000", 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0562000000000006e-05 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479149+0000", 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3387000000000002e-05 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3490 3.9 3:90ed9f24:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_425:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:22.722 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.9055826220000007, 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019930929, 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3490 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:22.723 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699767+0000", 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-06 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702177+0000", 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024107909999999998 2024-04-26T12:41:22.724 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702216+0000", 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8677000000000003e-05 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702233+0000", 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.677e-05 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702331+0000", 2024-04-26T12:41:22.725 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8522000000000003e-05 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702554+0000", 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222284 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702746+0000", 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192165 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.726 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.711473+0000", 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087273230000000004 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719610+0000", 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081368139999999992 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719655+0000", 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5166000000000001e-05 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.727 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719690+0000", 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5240999999999997e-05 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3498 3.9 3:90786aa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_433:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.8219772560000003, 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019394081000000001, 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.728 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3498 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:22.729 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783369+0000", 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4780000000000002e-06 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785506+0000", 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00213635 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.730 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785535+0000", 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-05 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785551+0000", 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5452e-05 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785654+0000", 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000102951 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785857+0000", 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000202785 2024-04-26T12:41:22.731 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785972+0000", 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011500100000000001 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.792041+0000", 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060695999999999996 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802651+0000", 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010609726999999999 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.732 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802702+0000", 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1304000000000002e-05 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802759+0000", 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6703000000000002e-05 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3511 3.2e 3:76d60bde:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.6677654729999993, 2024-04-26T12:41:22.733 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020430932999999998, 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3511 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.734 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937578+0000", 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8759999999999999e-06 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939235+0000", 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016561989999999999 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.735 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939267+0000", 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2712999999999997e-05 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939283+0000", 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5421e-05 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939362+0000", 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8752999999999996e-05 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939492+0000", 2024-04-26T12:41:22.736 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130844 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939616+0000", 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012401600000000001 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.944163+0000", 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045470329999999998 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957900+0000", 2024-04-26T12:41:22.737 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013737047 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957962+0000", 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1976000000000004e-05 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.958008+0000", 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5055000000000001e-05 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.738 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3518 3.f 3:f20a4de4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_453:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.6009055799999992, 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018842589, 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3518 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.739 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004440+0000", 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.740 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006038+0000", 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015980079999999999 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006062+0000", 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4779000000000001e-05 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006075+0000", 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2782000000000001e-05 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.741 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006152+0000", 2024-04-26T12:41:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7343999999999997e-05 2024-04-26T12:41:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.742 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006322+0000", 2024-04-26T12:41:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016997900000000001 2024-04-26T12:41:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:22.743 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006415+0000", 2024-04-26T12:41:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2800999999999995e-05 2024-04-26T12:41:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.012821+0000", 2024-04-26T12:41:22.744 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064056770000000002 2024-04-26T12:41:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023205+0000", 2024-04-26T12:41:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010383763000000001 2024-04-26T12:41:22.745 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023248+0000", 2024-04-26T12:41:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2963000000000002e-05 2024-04-26T12:41:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:22.746 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023279+0000", 2024-04-26T12:41:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1383000000000001e-05 2024-04-26T12:41:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.747 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:22.748 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:22.748 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:22.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:41:22.751 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:22.749+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:22.850 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:22.849+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:22.930 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:22.930 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:22.930 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:22.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:41:22.989 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:22.989+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:23.051 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:23.049+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:23.120 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:23.121 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:23.121 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:23.121 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:23.121 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:23.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:41:23.152 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:23.152+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:23.253 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:23.253+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:23.307 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:23.307 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2320 3.27 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.917689867000007, 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020624966000000002, 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2320 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.309 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389495+0000", 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390861+0000", 2024-04-26T12:41:23.310 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013652849999999999 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390898+0000", 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6789000000000003e-05 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390908+0000", 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.065e-05 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390983+0000", 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391089+0000", 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105752 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:23.312 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391177+0000", 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7596999999999995e-05 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.395646+0000", 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044690889999999999 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410024+0000", 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014378050999999999 2024-04-26T12:41:23.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410065+0000", 2024-04-26T12:41:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1056000000000001e-05 2024-04-26T12:41:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.314 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410117+0000", 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2485000000000003e-05 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2374 3.38 3:1c1a4d28:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.334535466000005, 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020357772999999999, 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.315 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2374 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972649+0000", 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.317 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974485+0000", 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018357899999999999 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974516+0000", 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1142000000000001e-05 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974531+0000", 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.455e-05 2024-04-26T12:41:23.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974627+0000", 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6543e-05 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974833+0000", 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020613700000000001 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:23.319 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.975018+0000", 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000184267 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.981099+0000", 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00608093 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011762869 2024-04-26T12:41:23.320 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992942+0000", 2024-04-26T12:41:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0517000000000002e-05 2024-04-26T12:41:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.993005+0000", 2024-04-26T12:41:23.321 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2648000000000001e-05 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 71.057361779999994, 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.322 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.323 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.324 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.325 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:23.326 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.327 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.328 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 70.822698987999999, 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.329 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.330 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.331 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:41:23.332 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.333 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:41:23.334 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2872 3.7 3:e1a8506b:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:23.335 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.373410593999999, 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020999501, 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2872 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.336 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933774+0000", 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7199999999999998e-06 2024-04-26T12:41:23.337 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935453+0000", 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016790850000000001 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935491+0000", 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7734999999999997e-05 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.338 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935504+0000", 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3254999999999999e-05 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935575+0000", 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0339999999999994e-05 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.339 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935722+0000", 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014727800000000001 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935854+0000", 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131507 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.940409+0000", 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045550790000000001 2024-04-26T12:41:23.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954592+0000", 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014183332 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954696+0000", 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103602 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954771+0000", 2024-04-26T12:41:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5568000000000006e-05 2024-04-26T12:41:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2890 3.2 3:422e89e2:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 34.135730377000002, 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023228242999999999, 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2890 2024-04-26T12:41:23.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171455+0000", 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1370000000000002e-06 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175884+0000", 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044289400000000001 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175931+0000", 2024-04-26T12:41:23.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.71e-05 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175950+0000", 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176035+0000", 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4580999999999995e-05 2024-04-26T12:41:23.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176145+0000", 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010970499999999999 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176237+0000", 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2898000000000004e-05 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.180690+0000", 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044521550000000002 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194585+0000", 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013895286 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194646+0000", 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0927000000000001e-05 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194680+0000", 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4360999999999998e-05 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.349 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3070 3.2 3:41299508:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.751863012999999, 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021442744, 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3070 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555322+0000", 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3879999999999998e-06 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557150+0000", 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018282699999999999 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557177+0000", 2024-04-26T12:41:23.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6804999999999998e-05 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557187+0000", 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0042e-05 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557354+0000", 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016743800000000001 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557502+0000", 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0001474 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557642+0000", 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014000300000000001 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.562888+0000", 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005246031 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576517+0000", 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013629702 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576606+0000", 2024-04-26T12:41:23.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9079000000000006e-05 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576762+0000", 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015558600000000001 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3101 3.1e 3:7930998e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:23.356 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.425529146000001, 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020983102999999999, 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3101 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881657+0000", 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6279999999999998e-06 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883263+0000", 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001606257 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883289+0000", 2024-04-26T12:41:23.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6152e-05 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883302+0000", 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2809000000000001e-05 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883389+0000", 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7429999999999995e-05 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883567+0000", 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017797000000000001 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883734+0000", 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016698900000000001 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.890551+0000", 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00681658 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902478+0000", 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011927559000000001 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902561+0000", 2024-04-26T12:41:23.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2965000000000003e-05 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902636+0000", 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4764000000000004e-05 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3122 3.29 3:951a57de:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:23.363 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.196863079, 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021821106, 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3122 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110322+0000", 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.632e-06 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112021+0000", 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016992789999999999 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112052+0000", 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0525000000000003e-05 2024-04-26T12:41:23.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112064+0000", 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2768e-05 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112173+0000", 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108119 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112424+0000", 2024-04-26T12:41:23.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025160699999999999 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112569+0000", 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144888 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.118043+0000", 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054735959999999998 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132056+0000", 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014013146000000001 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132105+0000", 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8909000000000002e-05 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132140+0000", 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5636999999999998e-05 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.369 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3123 3.27 3:e6e77b36:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.185558975999999, 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021419740999999999, 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.370 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3123 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121626+0000", 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2979999999999999e-06 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123454+0000", 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018283069999999999 2024-04-26T12:41:23.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123490+0000", 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6225e-05 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123506+0000", 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5931999999999999e-05 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123595+0000", 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9151000000000001e-05 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123805+0000", 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020976 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123984+0000", 2024-04-26T12:41:23.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017854500000000001 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.129714+0000", 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057303720000000001 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.142950+0000", 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013235660999999999 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.142993+0000", 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3072999999999999e-05 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.143043+0000", 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0417000000000002e-05 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3180 3.38 3:1dc50762:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.555475692, 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020727782, 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3180 2024-04-26T12:41:23.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751708+0000", 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8899999999999999e-06 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753438+0000", 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001729866 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753472+0000", 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3293999999999997e-05 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753487+0000", 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5184999999999999e-05 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753568+0000", 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1404999999999997e-05 2024-04-26T12:41:23.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753737+0000", 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016865900000000001 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753855+0000", 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117861 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758867+0000", 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050125059999999999 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772351+0000", 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013484052999999999 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772389+0000", 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7391999999999997e-05 2024-04-26T12:41:23.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772434+0000", 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5670999999999997e-05 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3236 3.7 3:e0b2f0ce:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.895619736, 2024-04-26T12:41:23.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025042014000000001, 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3236 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411565+0000", 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412947+0000", 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013823349999999999 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412981+0000", 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3386000000000002e-05 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412996+0000", 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5610000000000001e-05 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413076+0000", 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9488999999999997e-05 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413247+0000", 2024-04-26T12:41:23.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017079199999999999 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413355+0000", 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108824 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.418245+0000", 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048893299999999999 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436492+0000", 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018247368999999999 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436567+0000", 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4802000000000007e-05 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436605+0000", 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7592000000000002e-05 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3250 3.33 3:cf65c941:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.741990262, 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022851729000000001, 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3250 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565195+0000", 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-06 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567117+0000", 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019217570000000001 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567143+0000", 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6321000000000001e-05 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567158+0000", 2024-04-26T12:41:23.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4712000000000001e-05 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567244+0000", 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6583999999999996e-05 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567400+0000", 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015599099999999999 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567575+0000", 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017444199999999999 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.574382+0000", 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068072660000000002 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587935+0000", 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013552899 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587991+0000", 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5927999999999997e-05 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588044+0000", 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2731e-05 2024-04-26T12:41:23.396 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3467 3.2 3:4067df0c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.859935871999999, 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023170046999999999, 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.397 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3467 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447249+0000", 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9960000000000002e-06 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449053+0000", 2024-04-26T12:41:23.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018033369999999999 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449080+0000", 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7608999999999999e-05 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449094+0000", 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3689999999999999e-05 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449175+0000", 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0655999999999995e-05 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449305+0000", 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012987400000000001 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449412+0000", 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010741799999999999 2024-04-26T12:41:23.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.454641+0000", 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052287130000000003 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470316+0000", 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015674837 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470362+0000", 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5998999999999998e-05 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470416+0000", 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4917999999999998e-05 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3481 3.27 3:e4b6b857:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.704323335, 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020687291, 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3481 2024-04-26T12:41:23.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602861+0000", 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.604985+0000", 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021233990000000002 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605016+0000", 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1613999999999999e-05 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605028+0000", 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1302e-05 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605113+0000", 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5173999999999995e-05 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605242+0000", 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129443 2024-04-26T12:41:23.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605346+0000", 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010377 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.610502+0000", 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051564089999999998 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623416+0000", 2024-04-26T12:41:23.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012913614 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623490+0000", 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623546+0000", 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6617999999999999e-05 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3493 3.33 3:cdefd7bd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_428:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.573228993000001, 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020983978, 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.410 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3493 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733956+0000", 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6730000000000001e-06 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735896+0000", 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940382 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735925+0000", 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8700999999999998e-05 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735940+0000", 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4674e-05 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736035+0000", 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5551999999999996e-05 2024-04-26T12:41:23.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736240+0000", 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020428800000000001 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736354+0000", 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114145 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.741363+0000", 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050093840000000004 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754845+0000", 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013481501 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754902+0000", 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7617000000000001e-05 2024-04-26T12:41:23.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754937+0000", 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5061000000000002e-05 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3534 3.7 3:e277469f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_469:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.144297848000001, 2024-04-26T12:41:23.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027785351999999999, 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3534 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162887+0000", 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6230000000000001e-06 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165295+0000", 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024080019999999998 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165329+0000", 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3800000000000002e-05 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165344+0000", 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5310000000000001e-05 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165433+0000", 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9015000000000001e-05 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165609+0000", 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175809 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165785+0000", 2024-04-26T12:41:23.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000176515 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.170217+0000", 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044311979999999999 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190550+0000", 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020333235000000002 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190604+0000", 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4026000000000001e-05 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190670+0000", 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5819000000000001e-05 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3540 3.33 3:ccf326fe:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_475:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:23.422 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.083516253000001, 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022822643, 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3540 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223669+0000", 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9849999999999998e-06 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225528+0000", 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001859461 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225554+0000", 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5609000000000002e-05 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225567+0000", 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3326000000000001e-05 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225645+0000", 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7880000000000007e-05 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225758+0000", 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112355 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:23.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225854+0000", 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6059999999999998e-05 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.231841+0000", 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059873219999999998 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246370+0000", 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014528983000000001 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246436+0000", 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5889999999999994e-05 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246489+0000", 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2772000000000002e-05 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.428 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3544 3.27 3:e5e9dc2a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 10.043073442000001, 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020824362999999999, 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3544 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.429 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264111+0000", 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265590+0000", 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014784430000000001 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265615+0000", 2024-04-26T12:41:23.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4756000000000002e-05 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265625+0000", 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0445000000000001e-05 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265706+0000", 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1144999999999996e-05 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265832+0000", 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012604000000000001 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265955+0000", 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012266100000000001 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.270368+0000", 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044134589999999998 2024-04-26T12:41:23.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284829+0000", 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014460944999999999 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284875+0000", 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5864e-05 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284933+0000", 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8063999999999998e-05 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3553 3.7 3:e09c7e82:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_488:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 9.945196846, 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023273085999999998, 2024-04-26T12:41:23.435 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3553 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361988+0000", 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363819+0000", 2024-04-26T12:41:23.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018314119999999999 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363847+0000", 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363861+0000", 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4127999999999999e-05 2024-04-26T12:41:23.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363927+0000", 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6342999999999998e-05 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364037+0000", 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109503 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364138+0000", 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101734 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.368455+0000", 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004317212 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385075+0000", 2024-04-26T12:41:23.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016619425 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385182+0000", 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010734 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385259+0000", 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6268999999999998e-05 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.441 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:23.442 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:23.442 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:23.444 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:41:23.444 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:23.441+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:23.544 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:23.544+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:23.577 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:23.577 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:23.577 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:41:23.577 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:23.591 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:41:23.676 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:23.676+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:23.746 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:23.744+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:23.755 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:23.755 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:23.755 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:41:23.755 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:41:23.755 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:23.769 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:41:23.856 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:23.856+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:23.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:41:23.888 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:41:23.938 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:23.938 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1601 3.1d e67/17 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head v 67'1, mlcod=0'0)", 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 84.209979168999993, 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021057349999999999, 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.939 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727484+0000", 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:41:23.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733321+0000", 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005836351 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733360+0000", 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9648999999999999e-05 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.941 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733383+0000", 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2722999999999999e-05 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733504+0000", 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012115199999999999 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.942 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733558+0000", 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3511999999999999e-05 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748395+0000", 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014836937 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748539+0000", 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144356 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.969470266000002, 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.944 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.945 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.946 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:41:23.947 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.692785595000004, 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:41:23.948 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.949 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:41:23.950 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:41:23.951 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.952 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2400 3.27 e73/17 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head v 73'5, mlcod=72'3)", 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 71.687058614999998, 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020886715, 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.953 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250405+0000", 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254952+0000", 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045466930000000001 2024-04-26T12:41:23.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254991+0000", 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9298999999999998e-05 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255014+0000", 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2711999999999999e-05 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255166+0000", 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015193699999999999 2024-04-26T12:41:23.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255207+0000", 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1436000000000001e-05 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271130+0000", 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015923262000000001 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271289+0000", 2024-04-26T12:41:23.956 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015862600000000001 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3060 3.11 e102/17 3:884a83fa:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_5:head v 102'6, mlcod=90'4)", 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 16.481149810000002, 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023109461000000001, 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.957 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456312+0000", 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8699999999999995e-07 2024-04-26T12:41:23.958 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458724+0000", 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024121659999999999 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458750+0000", 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6208999999999999e-05 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458762+0000", 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1956e-05 2024-04-26T12:41:23.959 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458869+0000", 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010719 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458909+0000", 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9614999999999999e-05 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.479268+0000", 2024-04-26T12:41:23.960 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020358885 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.479421+0000", 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015285299999999999 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3118 3.1d e102/17 3:bb40c566:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_63:head v 102'15, mlcod=102'13)", 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.070353+0000", 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.867107864999999, 2024-04-26T12:41:23.961 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021021374999999998, 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070353+0000", 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.962 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070353+0000", 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070356+0000", 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2169999999999999e-06 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.075801+0000", 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054446729999999997 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.963 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.075838+0000", 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6769e-05 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.075857+0000", 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.931e-05 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.076034+0000", 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000176909 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.964 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.076078+0000", 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4239000000000001e-05 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091201+0000", 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015122399999999999 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091374+0000", 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017385799999999999 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.965 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3138 3.11 e102/17 3:880b1c25:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_83:head v 102'7, mlcod=91'5)", 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.648903631, 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024448279999999999, 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.966 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288560+0000", 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8169999999999999e-06 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.967 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291885+0000", 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033250419999999998 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291935+0000", 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9709999999999997e-05 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291955+0000", 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9683000000000001e-05 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.968 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.292129+0000", 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000174432 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.292195+0000", 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5889000000000006e-05 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.312782+0000", 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020587215999999998 2024-04-26T12:41:23.969 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313006+0000", 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022349100000000001 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3178 3.9 e102/31 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head v 102'13, mlcod=102'11)", 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.204059508, 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023424759999999999, 2024-04-26T12:41:23.970 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.971 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733404+0000", 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1940000000000001e-06 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738411+0000", 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050070699999999998 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738447+0000", 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6380000000000001e-05 2024-04-26T12:41:23.972 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738465+0000", 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8255999999999999e-05 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738601+0000", 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013597899999999999 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738647+0000", 2024-04-26T12:41:23.973 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5293000000000002e-05 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.756721+0000", 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018074446000000001 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.756826+0000", 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105142 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.974 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3210 3.1d e102/17 3:b88fb53e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_155:head v 102'16, mlcod=102'14)", 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.851791747, 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024571928999999999, 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:23.975 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085673+0000", 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.36e-06 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.976 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091170+0000", 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054978630000000004 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091212+0000", 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2129000000000003e-05 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091238+0000", 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5720000000000001e-05 2024-04-26T12:41:23.977 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091395+0000", 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015645200000000001 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091437+0000", 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2199e-05 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110109+0000", 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018672040000000001 2024-04-26T12:41:23.978 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110241+0000", 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013216599999999999 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3284 3.1b e103/17 3:db1037a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_219:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.093023297, 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022520861, 2024-04-26T12:41:23.979 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.980 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844439+0000", 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1769999999999999e-06 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850076+0000", 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056371140000000004 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850105+0000", 2024-04-26T12:41:23.981 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8975999999999998e-05 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850124+0000", 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8827000000000001e-05 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850266+0000", 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142516 2024-04-26T12:41:23.982 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850305+0000", 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8859000000000002e-05 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.866786+0000", 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016480660000000001 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.866958+0000", 2024-04-26T12:41:23.983 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017273200000000001 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3283 3.e e103/17 3:7042574b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_218:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.092824292, 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023100175000000001, 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.984 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:23.985 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4700000000000001e-07 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847832+0000", 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031949299999999999 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847880+0000", 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7806000000000003e-05 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.986 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847906+0000", 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6205999999999999e-05 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.848086+0000", 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017921899999999999 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.848154+0000", 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8485999999999994e-05 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.987 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867575+0000", 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019420823 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867737+0000", 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161958 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.988 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3285 3.f e103/41 3:f2e9bdba:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_220:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.082553750000001, 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021900076000000001, 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.989 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854908+0000", 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1999999999999998e-07 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860748+0000", 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058394420000000002 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.990 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860782+0000", 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4162999999999998e-05 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860800+0000", 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7963000000000001e-05 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860972+0000", 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017237200000000001 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.991 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.861039+0000", 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7182999999999997e-05 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.876678+0000", 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015639304999999999 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.876807+0000", 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872799999999999 2024-04-26T12:41:23.992 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3287 3.e e103/17 3:71707d61:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_222:head v 103'12, mlcod=102'10)", 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.058438044000001, 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024816290000000001, 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.993 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879027+0000", 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0659999999999997e-06 2024-04-26T12:41:23.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881632+0000", 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026051999999999998 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881669+0000", 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7345999999999998e-05 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881688+0000", 2024-04-26T12:41:23.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.878e-05 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881893+0000", 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020426099999999999 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881931+0000", 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.903684+0000", 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021752187999999999 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.903839+0000", 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015550899999999999 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3288 3.34 e103/31 3:2f2ab73e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_223:head v 103'10, mlcod=102'8)", 2024-04-26T12:41:23.997 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.048884798, 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022389650000000001, 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888579+0000", 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5229999999999998e-06 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891518+0000", 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002939218 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:23.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891549+0000", 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0954000000000002e-05 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891570+0000", 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1229e-05 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891703+0000", 2024-04-26T12:41:24.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013248099999999999 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891756+0000", 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3542999999999999e-05 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.910882+0000", 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019125860000000001 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:24.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.910966+0000", 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3842000000000001e-05 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3504 3.14 e103/31 3:2a60a1fc:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_439:head v 103'11, mlcod=103'9)", 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:12.867896+0000", 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 11.069564400000001, 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021257569, 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:24.002 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.867896+0000", 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.867896+0000", 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.867899+0000", 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9629999999999998e-06 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.871930+0000", 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004030156 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.871979+0000", 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9845999999999997e-05 2024-04-26T12:41:24.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.872006+0000", 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6982999999999999e-05 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.872283+0000", 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027671800000000002 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.872332+0000", 2024-04-26T12:41:24.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9279e-05 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.889028+0000", 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016695899 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.889154+0000", 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012572500000000001 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.006 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3519 3.1d e104/17 3:bbcdc9e4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_454:head v 104'18, mlcod=102'16)", 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.918558016, 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024779148000000001, 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:24.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:24.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018904+0000", 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0999999999999998e-07 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022336+0000", 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034327490000000001 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022376+0000", 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9443000000000002e-05 2024-04-26T12:41:24.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022400+0000", 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4280000000000001e-05 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022546+0000", 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014610799999999999 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:24.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022600+0000", 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3483000000000003e-05 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.043590+0000", 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020990609 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.043682+0000", 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1766000000000002e-05 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:24.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3520 3.1d e104/17 3:ba0cfaa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_455:head v 104'19, mlcod=102'16)", 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.029736+0000", 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.907725076, 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021221387000000001, 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029736+0000", 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029736+0000", 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029738+0000", 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.407e-06 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.032948+0000", 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032094239999999998 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.032996+0000", 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8285999999999998e-05 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.033022+0000", 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5919999999999999e-05 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.033219+0000", 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019674100000000001 2024-04-26T12:41:24.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.033295+0000", 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6268999999999998e-05 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.050855+0000", 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017560524000000001 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.050957+0000", 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101816 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.015 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3528 3.31 e104/17 3:8ff53833:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_463:head v 104'22, mlcod=103'20)", 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.832549295, 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026837514999999999, 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:24.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.105724+0000", 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00081230199999999999 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:24.017 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111099+0000", 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053747309999999998 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111142+0000", 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3396000000000003e-05 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111165+0000", 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3070000000000001e-05 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111347+0000", 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018210500000000001 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111419+0000", 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1493000000000001e-05 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.130996+0000", 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019577719 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.131749+0000", 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075269900000000001 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3547 3.1d e104/17 3:bad5b40c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_482:head v 104'21, mlcod=104'19)", 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.638948784, 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030273893999999999, 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:24.020 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298515+0000", 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303081+0000", 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045658840000000001 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303132+0000", 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1053000000000001e-05 2024-04-26T12:41:24.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303167+0000", 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5583000000000001e-05 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303397+0000", 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022938799999999999 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303471+0000", 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4591999999999993e-05 2024-04-26T12:41:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328651+0000", 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025179983999999999 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328786+0000", 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000134676 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3548 3.11 e104/17 3:8824d90c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_483:head v 104'15, mlcod=103'13)", 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 10.630307803999999, 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023247721999999998, 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307157+0000", 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4939999999999999e-06 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311400+0000", 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042435040000000004 2024-04-26T12:41:24.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311434+0000", 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3507999999999998e-05 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311452+0000", 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8253999999999998e-05 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311600+0000", 2024-04-26T12:41:24.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014853300000000001 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311640+0000", 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9585999999999997e-05 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.330239+0000", 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018598607999999999 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.330401+0000", 2024-04-26T12:41:24.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016223499999999999 2024-04-26T12:41:24.029 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.029 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:24.029 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.029 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:24.029 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:24.029 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:24.030 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:41:24.031 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:24.029+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:24.054 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:24.054 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:24.072 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:24.072 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:24.089 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:24.090 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:24.106 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:24.106 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:24.131 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:24.128+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:24.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:24.141 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:24.174 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:24.175 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:24.204 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:24.204 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:24.211 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:24.211 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:24.219 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:41:24.246 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:24.246 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:24.262 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:24.260+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:24.332 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:24.333+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:24.384 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:24.385 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:24.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:41:24.434 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:24.433+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:24.524 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:24.524 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:24.534 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:24.532+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:24.539 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:41:24.635 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:24.633+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:24.706 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:24.706 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:24.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:41:24.764 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:24.764+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:24.838 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:24.836+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:24.839 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:24.839 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:24.853 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:41:24.938 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:24.937+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:25.017 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:25.018 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:25.031 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:41:25.039 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:25.037+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:25.086 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:41:25.140 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:25.136+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:25.151 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:25.151 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:25.166 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:41:25.252 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:25.252+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:25.331 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:25.331 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:25.341 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:25.341+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:25.346 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:41:25.442 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:25.440+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:25.510 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:25.511 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:25.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:41:25.572 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:25.573+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:25.643 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:25.640+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:25.658 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:25.658 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:25.672 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:41:25.744 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:25.744+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:25.836 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:25.836 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:25.845 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:25.845+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:25.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:41:25.946 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:25.944+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:26.020 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:26.021 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:26.035 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:41:26.084 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:26.085+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:26.149 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:26.149+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:26.164 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:26.164 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:26.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:41:26.249 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:26.247+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:26.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:41:26.350 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:26.349+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:26.352 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:26.352 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:26.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:41:26.414 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:26.415 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:26.432 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:26.432 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:26.450 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:26.450 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:26.451 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:26.447+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:26.467 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:26.468 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:26.505 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:26.505 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:26.525 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:26.525 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:26.546 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:26.546 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:26.553 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2352 3.31 3:8f9b04df:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.816925874999995, 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020323783000000002, 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.554 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2352 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735359+0000", 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.555 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.735362+0000", 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5100000000000001e-06 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737140+0000", 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017779339999999999 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737169+0000", 2024-04-26T12:41:26.556 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8773999999999999e-05 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737183+0000", 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4234e-05 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737354+0000", 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017064099999999999 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.557 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737558+0000", 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020440899999999999 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.737740+0000", 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018227 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.743295+0000", 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055552040000000002 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.558 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755547+0000", 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012251151 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755623+0000", 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6161999999999993e-05 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.755683+0000", 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0494000000000001e-05 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.559 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2359 3.31 3:8dab8710:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.740669608000005, 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019045016000000001, 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2359 2024-04-26T12:41:26.560 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811616+0000", 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.561 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.811619+0000", 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3629999999999998e-06 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813915+0000", 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022956209999999999 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813942+0000", 2024-04-26T12:41:26.562 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7739999999999999e-05 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.813957+0000", 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4265e-05 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814032+0000", 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5743999999999999e-05 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814150+0000", 2024-04-26T12:41:26.563 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011739 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.814267+0000", 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011674 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.819314+0000", 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050471559999999997 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.564 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830543+0000", 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011229173 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830615+0000", 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-05 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.830661+0000", 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.6063999999999998e-05 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2360 3.31 3:8d67351a:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.728945240000002, 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018321365999999999, 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2360 2024-04-26T12:41:26.566 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823340+0000", 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.567 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.823343+0000", 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.61e-06 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825360+0000", 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002016889 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825382+0000", 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2776999999999999e-05 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825392+0000", 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4849999999999998e-06 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825472+0000", 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0190000000000003e-05 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825599+0000", 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012660500000000001 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.569 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.825694+0000", 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5364000000000004e-05 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.832421+0000", 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067272900000000004 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841570+0000", 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0091486410000000008 2024-04-26T12:41:26.570 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841611+0000", 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0920000000000001e-05 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.841661+0000", 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0594999999999999e-05 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.571 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2385 3.31 3:8c047361:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_194:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.468736817000007, 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017726853000000001, 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2385 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.572 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083548+0000", 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.083553+0000", 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0500000000000002e-06 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.573 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085768+0000", 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022158569999999999 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085795+0000", 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6913000000000001e-05 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085806+0000", 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0328e-05 2024-04-26T12:41:26.574 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.085887+0000", 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1074000000000003e-05 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086065+0000", 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000178748 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.086231+0000", 2024-04-26T12:41:26.575 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016586300000000001 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.093644+0000", 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0074122279999999999 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101124+0000", 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007480619 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.576 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101207+0000", 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2900999999999998e-05 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.101275+0000", 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.8272e-05 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2396 3.31 3:8c1a344e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:26.577 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.340093577000005, 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018041359, 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2396 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:26.578 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212192+0000", 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.212194+0000", 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5689999999999999e-06 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.579 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213766+0000", 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015720949999999999 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213794+0000", 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7668e-05 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213807+0000", 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3336000000000001e-05 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.213888+0000", 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1089999999999998e-05 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214068+0000", 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017976799999999999 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.214230+0000", 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000161485 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.581 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.218069+0000", 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0038395180000000001 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230147+0000", 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012077581 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230199+0000", 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1690000000000001e-05 2024-04-26T12:41:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.230233+0000", 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4558999999999999e-05 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2411 3.31 3:8dad7f5d:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_220:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.182791260000002, 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018121620000000001, 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.583 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2411 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.584 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369494+0000", 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.369498+0000", 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.613e-06 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371029+0000", 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001531765 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371066+0000", 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6863000000000003e-05 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371080+0000", 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4178e-05 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371162+0000", 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1082999999999996e-05 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.586 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371330+0000", 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016894699999999999 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.371504+0000", 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000173926 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.376225+0000", 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047203690000000003 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.587 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387503+0000", 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011277921999999999 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387564+0000", 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1447999999999998e-05 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.387616+0000", 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1505999999999998e-05 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.588 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2428 3.1a 3:5bd02ed2:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_237:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.999387878999997, 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017844321999999999, 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.589 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2428 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552897+0000", 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.590 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.552900+0000", 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554155+0000", 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001255543 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554183+0000", 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7015000000000001e-05 2024-04-26T12:41:26.591 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554194+0000", 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1089e-05 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554257+0000", 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2984000000000005e-05 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.592 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554384+0000", 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012765399999999999 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.554482+0000", 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7971000000000001e-05 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.558950+0000", 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044679170000000001 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.593 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570595+0000", 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011644468999999999 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570678+0000", 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3150000000000002e-05 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.570742+0000", 2024-04-26T12:41:26.594 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3989e-05 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2431 3.31 3:8d3d155f:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_240:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 73.969076051000002, 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018398563999999999, 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2431 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.596 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583209+0000", 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.583212+0000", 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2040000000000002e-06 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584680+0000", 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014676649999999999 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.597 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584713+0000", 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3353999999999999e-05 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584730+0000", 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6385999999999999e-05 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584814+0000", 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4264000000000005e-05 2024-04-26T12:41:26.598 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.584980+0000", 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016581000000000001 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.585149+0000", 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016868499999999999 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.599 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.590270+0000", 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051217900000000002 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601465+0000", 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011194334 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601544+0000", 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8913999999999997e-05 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.600 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.601608+0000", 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4158000000000005e-05 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2880 3.4 3:22b427d1:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_235:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.496999174000003, 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017107469, 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.601 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2880 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055286+0000", 2024-04-26T12:41:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.055289+0000", 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0639999999999998e-06 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056815+0000", 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001525584 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.603 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056855+0000", 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.9975000000000003e-05 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056877+0000", 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2082e-05 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.056988+0000", 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011092200000000001 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.604 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057219+0000", 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00023134100000000001 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 2", 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.057442+0000", 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222981 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066157+0000", 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087146340000000006 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.605 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072145+0000", 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059887450000000002 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072294+0000", 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014865399999999999 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.072394+0000", 2024-04-26T12:41:26.606 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9487000000000005e-05 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2881 3.31 3:8da41a11:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.486154139999996, 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020325379000000001, 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.607 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2881 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066131+0000", 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.066135+0000", 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4769999999999999e-06 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069604+0000", 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003469654 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069639+0000", 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4814000000000002e-05 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069657+0000", 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7674000000000001e-05 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069764+0000", 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106964 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.069958+0000", 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00019436099999999999 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.070135+0000", 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017677900000000001 2024-04-26T12:41:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.078069+0000", 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007933664 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086371+0000", 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083028219999999996 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086413+0000", 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1838000000000002e-05 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.086457+0000", 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3331999999999998e-05 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2888 3.1a 3:59675540:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_243:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 37.400922717, 2024-04-26T12:41:26.613 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019783412, 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2888 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.614 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151363+0000", 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.151366+0000", 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7859999999999998e-06 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156684+0000", 2024-04-26T12:41:26.615 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053173350000000003 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156726+0000", 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156752+0000", 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6636999999999999e-05 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.156859+0000", 2024-04-26T12:41:26.616 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106698 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157025+0000", 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016556700000000001 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.157182+0000", 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000157684 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.165499+0000", 2024-04-26T12:41:26.617 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0083164580000000005 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171012+0000", 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0055134490000000001 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171082+0000", 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0103000000000003e-05 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.618 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171146+0000", 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3625000000000002e-05 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3073 3.1a 3:5b06f432:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.966911942999999, 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021910276999999999, 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.619 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3073 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585373+0000", 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.620 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.585375+0000", 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9860000000000001e-06 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587174+0000", 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017990790000000001 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.621 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587195+0000", 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.0559000000000001e-05 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587205+0000", 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0217000000000001e-05 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587285+0000", 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9320999999999995e-05 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.622 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587426+0000", 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163899999999999 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.587534+0000", 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010822700000000001 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.592241+0000", 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047071090000000001 2024-04-26T12:41:26.623 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607152+0000", 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014910048 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607226+0000", 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4960000000000001e-05 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.607284+0000", 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7132000000000001e-05 2024-04-26T12:41:26.624 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3107 3.31 3:8f78493a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.608020329999999, 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017172129000000001, 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.625 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3107 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944265+0000", 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.626 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.944267+0000", 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.069e-06 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946361+0000", 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020936710000000001 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946394+0000", 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3229000000000003e-05 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.627 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946409+0000", 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4738e-05 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946488+0000", 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8863999999999996e-05 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946636+0000", 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014802700000000001 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.628 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.946734+0000", 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.87e-05 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.951880+0000", 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051454980000000001 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961302+0000", 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0094217869999999992 2024-04-26T12:41:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961378+0000", 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6477000000000007e-05 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.961437+0000", 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9069e-05 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.630 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3112 3.31 3:8d0978ab:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.558488694000001, 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022999863999999998, 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3112 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.631 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993797+0000", 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.993799+0000", 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5909999999999998e-06 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.632 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995315+0000", 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015153530000000001 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995339+0000", 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4700999999999999e-05 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995349+0000", 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.024e-05 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.633 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995427+0000", 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7830999999999994e-05 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995543+0000", 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115209 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.995684+0000", 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014163500000000001 2024-04-26T12:41:26.634 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.001302+0000", 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005617866 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016681+0000", 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015378660000000001 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016744+0000", 2024-04-26T12:41:26.635 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.3674000000000001e-05 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.016796+0000", 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2104000000000001e-05 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3190 3.31 3:8e4c6e9a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.697556964, 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018789369, 2024-04-26T12:41:26.636 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3190 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.637 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854728+0000", 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.854732+0000", 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2279999999999998e-06 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856445+0000", 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017136810000000001 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.638 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856474+0000", 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8433999999999999e-05 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856490+0000", 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6059e-05 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856574+0000", 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4420999999999997e-05 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.639 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856732+0000", 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015771900000000001 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.856840+0000", 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010796100000000001 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.863340+0000", 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006499978 2024-04-26T12:41:26.640 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873379+0000", 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010038775999999999 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873459+0000", 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0061000000000005e-05 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.641 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.873518+0000", 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9051000000000001e-05 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3239 3.31 3:8e75628b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.110841311000001, 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019464433999999999, 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.642 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3239 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.643 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441444+0000", 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.441447+0000", 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1300000000000001e-06 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443249+0000", 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001802325 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.644 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443284+0000", 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4795999999999997e-05 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443301+0000", 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6592e-05 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443419+0000", 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000118551 2024-04-26T12:41:26.645 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443641+0000", 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022181100000000001 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.443759+0000", 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011775199999999999 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.450805+0000", 2024-04-26T12:41:26.646 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007046259 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460788+0000", 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0099830240000000001 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460856+0000", 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7908000000000001e-05 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.647 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.460908+0000", 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2286e-05 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3252 3.31 3:8c05cb84:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_197:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 16.966542871000001, 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017610118000000001, 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.648 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3252 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.649 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585742+0000", 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.585746+0000", 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3139999999999999e-06 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588002+0000", 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002256404 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.650 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588030+0000", 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7617999999999999e-05 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588042+0000", 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.259e-05 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588118+0000", 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5875000000000001e-05 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.651 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588247+0000", 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000128892 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588363+0000", 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000115962 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.593618+0000", 2024-04-26T12:41:26.652 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052545619999999999 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603168+0000", 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0095503849999999998 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603271+0000", 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103078 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.653 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.603353+0000", 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1438000000000002e-05 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3515 3.1a 3:5b3f0c22:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_450:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.578157835000001, 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023114013999999999, 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.654 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3515 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974127+0000", 2024-04-26T12:41:26.655 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.974130+0000", 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2979999999999999e-06 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975465+0000", 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013352209999999999 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.656 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975496+0000", 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1464000000000002e-05 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975512+0000", 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5767999999999999e-05 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975587+0000", 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4315999999999998e-05 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.657 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975706+0000", 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000119702 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.975830+0000", 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012368599999999999 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.980572+0000", 2024-04-26T12:41:26.658 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004742202 2024-04-26T12:41:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997132+0000", 2024-04-26T12:41:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016559658000000001 2024-04-26T12:41:26.659 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997192+0000", 2024-04-26T12:41:26.661 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9800999999999999e-05 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.997241+0000", 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9898000000000002e-05 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3522 3.1a 3:59049034:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_457:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.510177563999999, 2024-04-26T12:41:26.662 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021821969, 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3522 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.663 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042108+0000", 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.042111+0000", 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4350000000000001e-06 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.664 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043741+0000", 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00163018 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043766+0000", 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4567999999999999e-05 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043779+0000", 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.325e-05 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.665 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.043861+0000", 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1382000000000001e-05 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.044038+0000", 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017744899999999999 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.044215+0000", 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017687599999999999 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.666 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.050811+0000", 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0065957359999999996 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063787+0000", 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012976484 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063852+0000", 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4857000000000006e-05 2024-04-26T12:41:26.667 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.063930+0000", 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7751999999999997e-05 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3528 3.31 3:8ff53833:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_463:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 13.448149883999999, 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.029523247999999998, 2024-04-26T12:41:26.668 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3528 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104135+0000", 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.104138+0000", 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.148e-06 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:26.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105585+0000", 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014478189999999999 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105618+0000", 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3012999999999997e-05 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105634+0000", 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6096e-05 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105716+0000", 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1422999999999996e-05 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105876+0000", 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015977499999999999 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:26.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.105968+0000", 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2791e-05 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.110618+0000", 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046497070000000003 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133533+0000", 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022914869000000001 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133606+0000", 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.2974999999999998e-05 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.133659+0000", 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2632e-05 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:26.674 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:26.675 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:26.553+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:26.676 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:41:26.676 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:26.677 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:26.721 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:26.721+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:26.780 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:26.777+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:26.855 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:26.855 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:26.855 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:26.870 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:41:26.913 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:26.913+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:26.982 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:26.979+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:27.041 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:27.041 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:27.041 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:27.041 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:27.041 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:27.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:41:27.082 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:27.079+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:27.116 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T12:41:27.182 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:27.182 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:27.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:27.182 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:27.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.182 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 74.874180069000005, 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.183 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:41:27.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2886 3.f 3:f1601af9:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.061729804000002, 2024-04-26T12:41:27.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018140835000000001, 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2886 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118818+0000", 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.120998+0000", 2024-04-26T12:41:27.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021794050000000001 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121023+0000", 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5063e-05 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121036+0000", 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.308e-05 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121148+0000", 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112575 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121377+0000", 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022841100000000001 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121584+0000", 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020710600000000001 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.127654+0000", 2024-04-26T12:41:27.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006070069 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136884+0000", 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092296909999999999 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136926+0000", 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2215000000000002e-05 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136957+0000", 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-05 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.193 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3064 3.9 3:9202b9a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.686564602000001, 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020230000000000001, 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.194 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3064 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493984+0000", 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2289999999999999e-06 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496913+0000", 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029283989999999999 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496937+0000", 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496947+0000", 2024-04-26T12:41:27.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497017+0000", 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9735999999999998e-05 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497139+0000", 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012228 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497237+0000", 2024-04-26T12:41:27.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8326999999999996e-05 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.502130+0000", 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048921540000000001 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514064+0000", 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011933918999999999 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514147+0000", 2024-04-26T12:41:27.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3065999999999994e-05 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514211+0000", 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4597999999999994e-05 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3106 3.2e 3:75381650:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.246852947000001, 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020388387000000001, 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.199 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3106 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933696+0000", 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9359999999999999e-06 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935132+0000", 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001436377 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935165+0000", 2024-04-26T12:41:27.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2846999999999999e-05 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935181+0000", 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935260+0000", 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9042999999999995e-05 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935412+0000", 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015139299999999999 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935526+0000", 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114076 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.940843+0000", 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053172339999999997 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.953947+0000", 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01310396 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954024+0000", 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7657000000000005e-05 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954081+0000", 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6733e-05 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3126 3.9 3:914259a4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.023965979, 2024-04-26T12:41:27.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017534042, 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3126 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156583+0000", 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7389999999999999e-06 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158853+0000", 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022704359999999998 2024-04-26T12:41:27.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158907+0000", 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3702000000000002e-05 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158921+0000", 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4416999999999999e-05 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159038+0000", 2024-04-26T12:41:27.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116878 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159233+0000", 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195198 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159411+0000", 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177839 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.169121+0000", 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097102739999999996 2024-04-26T12:41:27.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.173975+0000", 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048540570000000002 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174054+0000", 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174114+0000", 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9718e-05 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.209 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3139 3.2e 3:741e0bcf:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.888994368999999, 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027404833999999999, 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3139 2024-04-26T12:41:27.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291555+0000", 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2839999999999998e-06 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293141+0000", 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001586542 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293174+0000", 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2898999999999998e-05 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293190+0000", 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5855999999999999e-05 2024-04-26T12:41:27.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293274+0000", 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4191999999999996e-05 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293425+0000", 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015107799999999999 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293532+0000", 2024-04-26T12:41:27.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106642 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.298262+0000", 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047298749999999997 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318804+0000", 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020542525999999998 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318891+0000", 2024-04-26T12:41:27.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6808e-05 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318956+0000", 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5131999999999999e-05 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3144 3.9 3:93416909:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.834883257000001, 2024-04-26T12:41:27.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019208350999999999, 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3144 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345666+0000", 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7359999999999999e-06 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347400+0000", 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017342130000000001 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347434+0000", 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3559000000000002e-05 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347450+0000", 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6126000000000001e-05 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347525+0000", 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5049999999999995e-05 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347690+0000", 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016434500000000001 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347782+0000", 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2174000000000002e-05 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.352644+0000", 2024-04-26T12:41:27.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048619249999999996 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364731+0000", 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012087540000000001 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364811+0000", 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9594999999999999e-05 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364871+0000", 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0087999999999998e-05 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3178 3.9 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.448337205000001, 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.026775441000000001, 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.221 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3178 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732211+0000", 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9040000000000001e-06 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734341+0000", 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002130018 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734370+0000", 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8702000000000001e-05 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734386+0000", 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5423000000000001e-05 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734474+0000", 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8490000000000001e-05 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734656+0000", 2024-04-26T12:41:27.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018186 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734810+0000", 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015437799999999999 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740557+0000", 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057466710000000001 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758834+0000", 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018276573000000001 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758919+0000", 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5350000000000001e-05 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758984+0000", 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5072000000000003e-05 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3179 3.9 3:936f954f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.440079354000002, 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020186769, 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.227 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3179 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740469+0000", 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5019999999999999e-06 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741784+0000", 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314824 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741812+0000", 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8731e-05 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741827+0000", 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.446e-05 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741944+0000", 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011712100000000001 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.230 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742156+0000", 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000211635 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742381+0000", 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000225174 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.748059+0000", 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056783090000000003 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.231 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760598+0000", 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012538396 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760628+0000", 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0278999999999999e-05 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760653+0000", 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5338e-05 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.232 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3194 3.9 3:9016d8f2:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.283478783, 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01815512, 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3194 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.233 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897070+0000", 2024-04-26T12:41:27.234 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4309999999999998e-06 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898919+0000", 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018485750000000001 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898950+0000", 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1433000000000002e-05 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.235 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898966+0000", 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6011999999999998e-05 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899038+0000", 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1089999999999999e-05 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899181+0000", 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014355600000000001 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.236 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899290+0000", 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109381 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.903968+0000", 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046775810000000001 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915142+0000", 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01117362 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.237 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915185+0000", 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3118000000000003e-05 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915222+0000", 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7323000000000002e-05 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.238 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3197 3.2e 3:75db4699:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.248265543999999, 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027033747, 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3197 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.239 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932283+0000", 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.240 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933450+0000", 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001166472 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933472+0000", 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2761000000000001e-05 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933486+0000", 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3399e-05 2024-04-26T12:41:27.241 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933566+0000", 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0669999999999998e-05 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933735+0000", 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000169087 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933897+0000", 2024-04-26T12:41:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016202400000000001 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.938810+0000", 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049125649999999998 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959231+0000", 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020421228 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959273+0000", 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:27.243 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959314+0000", 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0642000000000002e-05 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3229 3.f 3:f3b7f6e7:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.851536234000001, 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018966246999999999, 2024-04-26T12:41:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3229 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.245 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329013+0000", 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331482+0000", 2024-04-26T12:41:27.246 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024695390000000002 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331499+0000", 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7175000000000001e-05 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331508+0000", 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.247 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331619+0000", 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110567 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331768+0000", 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014950200000000001 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331932+0000", 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389900000000001 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.339084+0000", 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007151887 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347886+0000", 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.008801784 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347928+0000", 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2228999999999998e-05 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.249 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347976+0000", 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7497000000000003e-05 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3245 3.f 3:f14a72c5:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.676240119999999, 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018443383000000001, 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3245 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:27.251 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504308+0000", 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505670+0000", 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001361478 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505698+0000", 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827999999999999e-05 2024-04-26T12:41:27.252 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505712+0000", 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3839000000000001e-05 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505790+0000", 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8775000000000004e-05 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505941+0000", 2024-04-26T12:41:27.253 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015073899999999999 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.506050+0000", 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010859 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.510891+0000", 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048417549999999997 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.254 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522669+0000", 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011778001999999999 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522714+0000", 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4861999999999998e-05 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522749+0000", 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4745e-05 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.255 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3257 3.f 3:f16d7886:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.536302766999999, 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018067529999999998, 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3257 2024-04-26T12:41:27.256 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644246+0000", 2024-04-26T12:41:27.257 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646264+0000", 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020174160000000002 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646295+0000", 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1828000000000001e-05 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.258 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646306+0000", 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0546e-05 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646390+0000", 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4321999999999997e-05 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646532+0000", 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141669 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.259 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646662+0000", 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129634 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.651808+0000", 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051462610000000001 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662201+0000", 2024-04-26T12:41:27.260 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010392848999999999 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662259+0000", 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8108e-05 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662311+0000", 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1662000000000001e-05 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.261 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3280 3.21 3:8431c446:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 17.386994616999999, 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018802534999999999, 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3280 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.262 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793554+0000", 2024-04-26T12:41:27.263 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.762e-06 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.794995+0000", 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014413270000000001 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795026+0000", 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0260000000000002e-05 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795039+0000", 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3396e-05 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795124+0000", 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5165000000000002e-05 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795132+0000", 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3450000000000006e-06 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.797837+0000", 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027041750000000001 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.265 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798009+0000", 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000172456 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798162+0000", 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015279000000000001 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808398+0000", 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010236263000000001 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.266 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812214+0000", 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003816285 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812291+0000", 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7035999999999999e-05 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812354+0000", 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2274999999999996e-05 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.267 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3468 3.9 3:92d2bef4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.720537289999999, 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019140161999999999, 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3468 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.268 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460010+0000", 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6220000000000001e-06 2024-04-26T12:41:27.269 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462069+0000", 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020588350000000002 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462093+0000", 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3841000000000001e-05 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462104+0000", 2024-04-26T12:41:27.270 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0781999999999999e-05 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462169+0000", 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5223999999999998e-05 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462310+0000", 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014092999999999999 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462468+0000", 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015857999999999999 2024-04-26T12:41:27.271 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.467313+0000", 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048449909999999999 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479025+0000", 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011711408 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479095+0000", 2024-04-26T12:41:27.272 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0562000000000006e-05 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479149+0000", 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3387000000000002e-05 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3490 3.9 3:90ed9f24:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_425:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:27.273 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.480786342, 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019930929, 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3490 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:27.274 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699767+0000", 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-06 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702177+0000", 2024-04-26T12:41:27.275 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024107909999999998 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702216+0000", 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8677000000000003e-05 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702233+0000", 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.677e-05 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702331+0000", 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8522000000000003e-05 2024-04-26T12:41:27.276 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702554+0000", 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222284 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702746+0000", 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192165 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.711473+0000", 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087273230000000004 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.277 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719610+0000", 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081368139999999992 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719655+0000", 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5166000000000001e-05 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719690+0000", 2024-04-26T12:41:27.278 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5240999999999997e-05 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3498 3.9 3:90786aa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_433:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.397180976, 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019394081000000001, 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.279 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3498 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.280 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783369+0000", 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4780000000000002e-06 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785506+0000", 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00213635 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785535+0000", 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-05 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.281 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785551+0000", 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5452e-05 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785654+0000", 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000102951 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785857+0000", 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000202785 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.282 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785972+0000", 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011500100000000001 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.792041+0000", 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060695999999999996 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802651+0000", 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010609726999999999 2024-04-26T12:41:27.283 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802702+0000", 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1304000000000002e-05 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802759+0000", 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6703000000000002e-05 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.284 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3511 3.2e 3:76d60bde:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.242969193, 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020430932999999998, 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3511 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.285 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937578+0000", 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8759999999999999e-06 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.286 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939235+0000", 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016561989999999999 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939267+0000", 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2712999999999997e-05 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939283+0000", 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5421e-05 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.287 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939362+0000", 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8752999999999996e-05 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939492+0000", 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130844 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939616+0000", 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012401600000000001 2024-04-26T12:41:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.944163+0000", 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045470329999999998 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957900+0000", 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013737047 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957962+0000", 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1976000000000004e-05 2024-04-26T12:41:27.289 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.958008+0000", 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5055000000000001e-05 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3518 3.f 3:f20a4de4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_453:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.1761093, 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018842589, 2024-04-26T12:41:27.290 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3518 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.291 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004440+0000", 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006038+0000", 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015980079999999999 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006062+0000", 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4779000000000001e-05 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006075+0000", 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2782000000000001e-05 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006152+0000", 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7343999999999997e-05 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006322+0000", 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016997900000000001 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006415+0000", 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2800999999999995e-05 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.012821+0000", 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064056770000000002 2024-04-26T12:41:27.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023205+0000", 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010383763000000001 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023248+0000", 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2963000000000002e-05 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023279+0000", 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1383000000000001e-05 2024-04-26T12:41:27.295 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.296 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.296 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:27.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:41:27.298 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:27.295+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:27.333 INFO:tasks.workunit.client.0.smithi016.stderr:200+0 records in 2024-04-26T12:41:27.333 INFO:tasks.workunit.client.0.smithi016.stderr:200+0 records out 2024-04-26T12:41:27.333 INFO:tasks.workunit.client.0.smithi016.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.3216 s, 157 MB/s 2024-04-26T12:41:27.398 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:27.397+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:27.429 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:27.429 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:27.429 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:27.429 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:27.445 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:41:27.506 INFO:tasks.workunit.client.0.smithi016.stdout:Bucket Created: buck_2024_03_26_12_41_27 2024-04-26T12:41:27.507 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:27.505+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:27.599 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:27.597+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:27.605 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:27.605 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:27.605 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:27.605 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:27.605 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:27.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:41:27.708 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:27.709+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:27.787 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:27.787 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2320 3.27 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 76.398282573000003, 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020624966000000002, 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.788 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2320 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.789 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389495+0000", 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390861+0000", 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013652849999999999 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390898+0000", 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6789000000000003e-05 2024-04-26T12:41:27.790 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390908+0000", 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.065e-05 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390983+0000", 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391089+0000", 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105752 2024-04-26T12:41:27.791 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391177+0000", 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7596999999999995e-05 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.395646+0000", 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044690889999999999 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410024+0000", 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014378050999999999 2024-04-26T12:41:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410065+0000", 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1056000000000001e-05 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410117+0000", 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2485000000000003e-05 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.793 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2374 3.38 3:1c1a4d28:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.815128172000001, 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020357772999999999, 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2374 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.794 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972649+0000", 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.795 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974485+0000", 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018357899999999999 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974516+0000", 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1142000000000001e-05 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974531+0000", 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.455e-05 2024-04-26T12:41:27.796 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974627+0000", 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6543e-05 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974833+0000", 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020613700000000001 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.975018+0000", 2024-04-26T12:41:27.797 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000184267 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.981099+0000", 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00608093 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011762869 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992942+0000", 2024-04-26T12:41:27.798 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0517000000000002e-05 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.993005+0000", 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2648000000000001e-05 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.537954486000004, 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:41:27.799 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.801 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.802 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.803 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.804 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 75.303291693999995, 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.805 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:41:27.806 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:41:27.807 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.808 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.809 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2872 3.7 3:e1a8506b:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:27.810 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.854003300000002, 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020999501, 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2872 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.811 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933774+0000", 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7199999999999998e-06 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935453+0000", 2024-04-26T12:41:27.812 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016790850000000001 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935491+0000", 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7734999999999997e-05 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935504+0000", 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3254999999999999e-05 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935575+0000", 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0339999999999994e-05 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935722+0000", 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014727800000000001 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935854+0000", 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131507 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.814 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.940409+0000", 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045550790000000001 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954592+0000", 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014183332 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954696+0000", 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103602 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.815 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954771+0000", 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5568000000000006e-05 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2890 3.2 3:422e89e2:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 38.616323082999997, 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023228242999999999, 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.816 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2890 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:27.817 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171455+0000", 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1370000000000002e-06 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175884+0000", 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044289400000000001 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.818 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175931+0000", 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.71e-05 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175950+0000", 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176035+0000", 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4580999999999995e-05 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.819 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176145+0000", 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010970499999999999 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176237+0000", 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2898000000000004e-05 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.180690+0000", 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044521550000000002 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194585+0000", 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013895286 2024-04-26T12:41:27.820 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194646+0000", 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0927000000000001e-05 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194680+0000", 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4360999999999998e-05 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3070 3.2 3:41299508:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.821 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 20.232455719000001, 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021442744, 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3070 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555322+0000", 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3879999999999998e-06 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557150+0000", 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018282699999999999 2024-04-26T12:41:27.823 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557177+0000", 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6804999999999998e-05 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557187+0000", 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0042e-05 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557354+0000", 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016743800000000001 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.824 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557502+0000", 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0001474 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557642+0000", 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014000300000000001 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.562888+0000", 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005246031 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.825 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576517+0000", 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013629702 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576606+0000", 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9079000000000006e-05 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576762+0000", 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015558600000000001 2024-04-26T12:41:27.826 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3101 3.1e 3:7930998e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.906121851999998, 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020983102999999999, 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.827 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3101 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.828 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881657+0000", 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6279999999999998e-06 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883263+0000", 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001606257 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883289+0000", 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6152e-05 2024-04-26T12:41:27.829 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883302+0000", 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2809000000000001e-05 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883389+0000", 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7429999999999995e-05 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883567+0000", 2024-04-26T12:41:27.830 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017797000000000001 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883734+0000", 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016698900000000001 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.890551+0000", 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00681658 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902478+0000", 2024-04-26T12:41:27.831 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011927559000000001 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902561+0000", 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2965000000000003e-05 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902636+0000", 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4764000000000004e-05 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.832 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3122 3.29 3:951a57de:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.677455784999999, 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021821106, 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3122 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.833 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110322+0000", 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.632e-06 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.834 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112021+0000", 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016992789999999999 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112052+0000", 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0525000000000003e-05 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112064+0000", 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2768e-05 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.835 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112173+0000", 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108119 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112424+0000", 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025160699999999999 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112569+0000", 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144888 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.118043+0000", 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054735959999999998 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132056+0000", 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014013146000000001 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132105+0000", 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8909000000000002e-05 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.837 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132140+0000", 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5636999999999998e-05 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3123 3.27 3:e6e77b36:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.666151681999999, 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021419740999999999, 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.838 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3123 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.839 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121626+0000", 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2979999999999999e-06 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123454+0000", 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018283069999999999 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.840 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123490+0000", 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6225e-05 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123506+0000", 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5931999999999999e-05 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123595+0000", 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9151000000000001e-05 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.841 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123805+0000", 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020976 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123984+0000", 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017854500000000001 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.129714+0000", 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057303720000000001 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.842 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.142950+0000", 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013235660999999999 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.142993+0000", 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3072999999999999e-05 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.143043+0000", 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0417000000000002e-05 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.843 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3180 3.38 3:1dc50762:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.036068398000001, 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020727782, 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.844 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3180 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.845 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751708+0000", 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8899999999999999e-06 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753438+0000", 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001729866 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753472+0000", 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3293999999999997e-05 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753487+0000", 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5184999999999999e-05 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753568+0000", 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1404999999999997e-05 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753737+0000", 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016865900000000001 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.847 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753855+0000", 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117861 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758867+0000", 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050125059999999999 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772351+0000", 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013484052999999999 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.848 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772389+0000", 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7391999999999997e-05 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772434+0000", 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5670999999999997e-05 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3236 3.7 3:e0b2f0ce:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:27.849 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.376212442, 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025042014000000001, 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3236 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:27.850 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411565+0000", 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412947+0000", 2024-04-26T12:41:27.851 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013823349999999999 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412981+0000", 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3386000000000002e-05 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412996+0000", 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5610000000000001e-05 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.852 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413076+0000", 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9488999999999997e-05 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413247+0000", 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017079199999999999 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413355+0000", 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108824 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.853 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.418245+0000", 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048893299999999999 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436492+0000", 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018247368999999999 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436567+0000", 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4802000000000007e-05 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.854 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436605+0000", 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7592000000000002e-05 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3250 3.33 3:cf65c941:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.222582968000001, 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022851729000000001, 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.855 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3250 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.856 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565195+0000", 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-06 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567117+0000", 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019217570000000001 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.857 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567143+0000", 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6321000000000001e-05 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567158+0000", 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4712000000000001e-05 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567244+0000", 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6583999999999996e-05 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.858 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567400+0000", 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015599099999999999 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567575+0000", 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017444199999999999 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.574382+0000", 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068072660000000002 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.859 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587935+0000", 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013552899 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587991+0000", 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5927999999999997e-05 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588044+0000", 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2731e-05 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.860 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3467 3.2 3:4067df0c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.340528578000001, 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023170046999999999, 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.861 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3467 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.862 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447249+0000", 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9960000000000002e-06 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449053+0000", 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018033369999999999 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449080+0000", 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7608999999999999e-05 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.863 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449094+0000", 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3689999999999999e-05 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449175+0000", 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0655999999999995e-05 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449305+0000", 2024-04-26T12:41:27.864 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012987400000000001 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449412+0000", 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010741799999999999 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.454641+0000", 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052287130000000003 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.865 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470316+0000", 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015674837 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470362+0000", 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5998999999999998e-05 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470416+0000", 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4917999999999998e-05 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.866 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3481 3.27 3:e4b6b857:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.184916040999999, 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020687291, 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3481 2024-04-26T12:41:27.867 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602861+0000", 2024-04-26T12:41:27.868 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.604985+0000", 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021233990000000002 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605016+0000", 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1613999999999999e-05 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605028+0000", 2024-04-26T12:41:27.869 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1302e-05 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605113+0000", 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5173999999999995e-05 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605242+0000", 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129443 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.870 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605346+0000", 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010377 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.610502+0000", 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051564089999999998 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623416+0000", 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012913614 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623490+0000", 2024-04-26T12:41:27.871 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623546+0000", 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6617999999999999e-05 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3493 3.33 3:cdefd7bd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_428:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 15.053821699, 2024-04-26T12:41:27.872 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020983978, 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3493 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.873 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733956+0000", 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6730000000000001e-06 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735896+0000", 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940382 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.874 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735925+0000", 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8700999999999998e-05 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735940+0000", 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4674e-05 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736035+0000", 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5551999999999996e-05 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.875 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736240+0000", 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020428800000000001 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736354+0000", 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114145 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.741363+0000", 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050093840000000004 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.876 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754845+0000", 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013481501 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754902+0000", 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7617000000000001e-05 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754937+0000", 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5061000000000002e-05 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.877 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3534 3.7 3:e277469f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_469:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.624890554, 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027785351999999999, 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.878 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3534 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.879 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162887+0000", 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6230000000000001e-06 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165295+0000", 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024080019999999998 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165329+0000", 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3800000000000002e-05 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.880 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165344+0000", 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5310000000000001e-05 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165433+0000", 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9015000000000001e-05 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165609+0000", 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175809 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.881 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165785+0000", 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000176515 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.170217+0000", 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044311979999999999 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190550+0000", 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020333235000000002 2024-04-26T12:41:27.882 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190604+0000", 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4026000000000001e-05 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190670+0000", 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5819000000000001e-05 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3540 3.33 3:ccf326fe:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_475:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:27.883 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.564108959, 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022822643, 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3540 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:27.884 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223669+0000", 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9849999999999998e-06 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225528+0000", 2024-04-26T12:41:27.885 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001859461 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225554+0000", 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5609000000000002e-05 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225567+0000", 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3326000000000001e-05 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.886 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225645+0000", 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7880000000000007e-05 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225758+0000", 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112355 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225854+0000", 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6059999999999998e-05 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.231841+0000", 2024-04-26T12:41:27.887 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059873219999999998 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246370+0000", 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014528983000000001 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246436+0000", 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5889999999999994e-05 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.888 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246489+0000", 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2772000000000002e-05 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3544 3.27 3:e5e9dc2a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.523666148, 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020824362999999999, 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.889 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3544 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.890 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264111+0000", 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265590+0000", 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014784430000000001 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265615+0000", 2024-04-26T12:41:27.891 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4756000000000002e-05 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265625+0000", 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0445000000000001e-05 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265706+0000", 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1144999999999996e-05 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265832+0000", 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012604000000000001 2024-04-26T12:41:27.892 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265955+0000", 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012266100000000001 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.270368+0000", 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044134589999999998 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284829+0000", 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014460944999999999 2024-04-26T12:41:27.893 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284875+0000", 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5864e-05 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284933+0000", 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8063999999999998e-05 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.894 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3553 3.7 3:e09c7e82:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_488:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 14.425789551999999, 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023273085999999998, 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3553 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.895 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361988+0000", 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363819+0000", 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018314119999999999 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363847+0000", 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363861+0000", 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4127999999999999e-05 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.897 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363927+0000", 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6342999999999998e-05 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364037+0000", 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109503 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364138+0000", 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101734 2024-04-26T12:41:27.898 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.368455+0000", 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004317212 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385075+0000", 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016619425 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385182+0000", 2024-04-26T12:41:27.899 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010734 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385259+0000", 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6268999999999998e-05 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:27.900 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:27.901 INFO:tasks.workunit.client.0.smithi016.stdout:bucket quota max size set for the given user: buck_2024_03_26_12_41_27 2024-04-26T12:41:27.902 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:41:27.902 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:27.901+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:28.002 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:28.001+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:28.032 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:28.032 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:28.032 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:41:28.032 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:28.046 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:41:28.104 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is set 2024-04-26T12:41:28.105 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:28.105+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:28.164 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:28.164 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:28.164 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:41:28.164 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:41:28.164 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:28.178 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:41:28.204 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:28.205+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:28.305 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:28.305 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:41:28.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:41:28.305 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:28.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.305 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1601 3.1d e67/17 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head v 67'1, mlcod=0'0)", 2024-04-26T12:41:28.305 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:41:28.305 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 88.574590173999994, 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021057349999999999, 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:41:28.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727484+0000", 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733321+0000", 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005836351 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733360+0000", 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9648999999999999e-05 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733383+0000", 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2722999999999999e-05 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733504+0000", 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012115199999999999 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733558+0000", 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3511999999999999e-05 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748395+0000", 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014836937 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748539+0000", 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144356 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.309 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 76.334081271000002, 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.310 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:41:28.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:41:28.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:41:28.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 76.057396600000004, 2024-04-26T12:41:28.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.315 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.316 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.317 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.318 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2400 3.27 e73/17 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head v 73'5, mlcod=72'3)", 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 76.051669619999998, 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020886715, 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.319 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250402+0000", 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.250405+0000", 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7499999999999999e-06 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254952+0000", 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045466930000000001 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.320 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254991+0000", 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9298999999999998e-05 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255014+0000", 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2711999999999999e-05 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255166+0000", 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015193699999999999 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.321 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.255207+0000", 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1436000000000001e-05 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271130+0000", 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015923262000000001 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.271289+0000", 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015862600000000001 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3060 3.11 e102/17 3:884a83fa:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_5:head v 102'6, mlcod=90'4)", 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.845760814999998, 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023109461000000001, 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.323 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456312+0000", 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8699999999999995e-07 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.324 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458724+0000", 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024121659999999999 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458750+0000", 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6208999999999999e-05 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458762+0000", 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1956e-05 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.325 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458869+0000", 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010719 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458909+0000", 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9614999999999999e-05 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.479268+0000", 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020358885 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.326 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.479421+0000", 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015285299999999999 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3118 3.1d e102/17 3:bb40c566:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_63:head v 102'15, mlcod=102'13)", 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.070353+0000", 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.231718870000002, 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021021374999999998, 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.327 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070353+0000", 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070353+0000", 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070356+0000", 2024-04-26T12:41:28.328 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2169999999999999e-06 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.075801+0000", 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054446729999999997 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.075838+0000", 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6769e-05 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.329 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.075857+0000", 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.931e-05 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.076034+0000", 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000176909 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.076078+0000", 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4239000000000001e-05 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.330 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091201+0000", 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015122399999999999 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091374+0000", 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017385799999999999 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3138 3.11 e102/17 3:880b1c25:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_83:head v 102'7, mlcod=91'5)", 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.013514636, 2024-04-26T12:41:28.331 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024448279999999999, 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.332 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288560+0000", 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8169999999999999e-06 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291885+0000", 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033250419999999998 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291935+0000", 2024-04-26T12:41:28.333 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9709999999999997e-05 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291955+0000", 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9683000000000001e-05 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.292129+0000", 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000174432 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.292195+0000", 2024-04-26T12:41:28.334 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5889000000000006e-05 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.312782+0000", 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020587215999999998 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313006+0000", 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022349100000000001 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3178 3.9 e102/31 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head v 102'13, mlcod=102'11)", 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.568670513000001, 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023424759999999999, 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733404+0000", 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1940000000000001e-06 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738411+0000", 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050070699999999998 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.337 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738447+0000", 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6380000000000001e-05 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738465+0000", 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8255999999999999e-05 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738601+0000", 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013597899999999999 2024-04-26T12:41:28.338 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738647+0000", 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5293000000000002e-05 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.756721+0000", 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018074446000000001 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.756826+0000", 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105142 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.339 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3210 3.1d e102/17 3:b88fb53e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_155:head v 102'16, mlcod=102'14)", 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.216402752, 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024571928999999999, 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085673+0000", 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.36e-06 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091170+0000", 2024-04-26T12:41:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054978630000000004 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091212+0000", 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2129000000000003e-05 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091238+0000", 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5720000000000001e-05 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.342 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091395+0000", 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015645200000000001 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091437+0000", 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2199e-05 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110109+0000", 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018672040000000001 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.343 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110241+0000", 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013216599999999999 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3284 3.1b e103/17 3:db1037a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_219:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 18.457634301999999, 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022520861, 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.344 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.345 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844439+0000", 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1769999999999999e-06 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850076+0000", 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056371140000000004 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850105+0000", 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8975999999999998e-05 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.346 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850124+0000", 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8827000000000001e-05 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850266+0000", 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142516 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850305+0000", 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8859000000000002e-05 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.347 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.866786+0000", 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016480660000000001 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.866958+0000", 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017273200000000001 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.348 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3283 3.e e103/17 3:7042574b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_218:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 18.457435297, 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023100175000000001, 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4700000000000001e-07 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847832+0000", 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031949299999999999 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.350 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847880+0000", 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7806000000000003e-05 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847906+0000", 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6205999999999999e-05 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.848086+0000", 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017921899999999999 2024-04-26T12:41:28.351 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.848154+0000", 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8485999999999994e-05 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867575+0000", 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019420823 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867737+0000", 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161958 2024-04-26T12:41:28.352 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3285 3.f e103/41 3:f2e9bdba:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_220:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 18.447164754999999, 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021900076000000001, 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.353 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854908+0000", 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1999999999999998e-07 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.354 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860748+0000", 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058394420000000002 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860782+0000", 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4162999999999998e-05 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860800+0000", 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7963000000000001e-05 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.355 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860972+0000", 2024-04-26T12:41:28.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017237200000000001 2024-04-26T12:41:28.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.356 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.356 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.356 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.861039+0000", 2024-04-26T12:41:28.356 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7182999999999997e-05 2024-04-26T12:41:28.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.876678+0000", 2024-04-26T12:41:28.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015639304999999999 2024-04-26T12:41:28.357 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.357 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.357 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.357 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.876807+0000", 2024-04-26T12:41:28.357 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872799999999999 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3287 3.e e103/17 3:71707d61:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_222:head v 103'12, mlcod=102'10)", 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 18.423049048999999, 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024816290000000001, 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.358 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879027+0000", 2024-04-26T12:41:28.359 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0659999999999997e-06 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881632+0000", 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026051999999999998 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881669+0000", 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7345999999999998e-05 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881688+0000", 2024-04-26T12:41:28.360 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.878e-05 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881893+0000", 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020426099999999999 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881931+0000", 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.361 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.903684+0000", 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021752187999999999 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.903839+0000", 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015550899999999999 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3288 3.34 e103/31 3:2f2ab73e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_223:head v 103'10, mlcod=102'8)", 2024-04-26T12:41:28.362 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 18.413495803, 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022389650000000001, 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.363 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888579+0000", 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5229999999999998e-06 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891518+0000", 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002939218 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.364 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891549+0000", 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0954000000000002e-05 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891570+0000", 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1229e-05 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891703+0000", 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013248099999999999 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.365 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891756+0000", 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3542999999999999e-05 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.910882+0000", 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019125860000000001 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.910966+0000", 2024-04-26T12:41:28.366 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3842000000000001e-05 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3504 3.14 e103/31 3:2a60a1fc:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_439:head v 103'11, mlcod=103'9)", 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:12.867896+0000", 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.434175405, 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021257569, 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.367 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.867896+0000", 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.867896+0000", 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.867899+0000", 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9629999999999998e-06 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.368 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.871930+0000", 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004030156 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.871979+0000", 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9845999999999997e-05 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.872006+0000", 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6982999999999999e-05 2024-04-26T12:41:28.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.872283+0000", 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027671800000000002 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.872332+0000", 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9279e-05 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.889028+0000", 2024-04-26T12:41:28.370 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016695899 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.889154+0000", 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012572500000000001 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3519 3.1d e104/17 3:bbcdc9e4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_454:head v 104'18, mlcod=102'16)", 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.283169021000001, 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024779148000000001, 2024-04-26T12:41:28.371 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.372 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018904+0000", 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0999999999999998e-07 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022336+0000", 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034327490000000001 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022376+0000", 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9443000000000002e-05 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.373 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022400+0000", 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4280000000000001e-05 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022546+0000", 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014610799999999999 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022600+0000", 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3483000000000003e-05 2024-04-26T12:41:28.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.043590+0000", 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020990609 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.043682+0000", 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1766000000000002e-05 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.375 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3520 3.1d e104/17 3:ba0cfaa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_455:head v 104'19, mlcod=102'16)", 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.029736+0000", 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.272336081000001, 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021221387000000001, 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029736+0000", 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029736+0000", 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029738+0000", 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.407e-06 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.032948+0000", 2024-04-26T12:41:28.377 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032094239999999998 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.032996+0000", 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8285999999999998e-05 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.033022+0000", 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5919999999999999e-05 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.033219+0000", 2024-04-26T12:41:28.378 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019674100000000001 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.033295+0000", 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6268999999999998e-05 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.050855+0000", 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017560524000000001 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.379 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.050957+0000", 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101816 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3528 3.31 e104/17 3:8ff53833:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_463:head v 104'22, mlcod=103'20)", 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.1971603, 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026837514999999999, 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.380 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.381 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.105724+0000", 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00081230199999999999 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111099+0000", 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053747309999999998 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111142+0000", 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3396000000000003e-05 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.382 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111165+0000", 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3070000000000001e-05 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111347+0000", 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018210500000000001 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111419+0000", 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1493000000000001e-05 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.383 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.130996+0000", 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019577719 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.131749+0000", 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075269900000000001 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.384 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3547 3.1d e104/17 3:bad5b40c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_482:head v 104'21, mlcod=104'19)", 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 15.003559789000001, 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030273893999999999, 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.385 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298515+0000", 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303081+0000", 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045658840000000001 2024-04-26T12:41:28.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303132+0000", 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1053000000000001e-05 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303167+0000", 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5583000000000001e-05 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303397+0000", 2024-04-26T12:41:28.387 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022938799999999999 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303471+0000", 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4591999999999993e-05 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328651+0000", 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025179983999999999 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.388 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328786+0000", 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000134676 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3548 3.11 e104/17 3:8824d90c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_483:head v 104'15, mlcod=103'13)", 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 14.994918809, 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023247721999999998, 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:28.389 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307157+0000", 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4939999999999999e-06 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.390 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311400+0000", 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042435040000000004 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311434+0000", 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3507999999999998e-05 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311452+0000", 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8253999999999998e-05 2024-04-26T12:41:28.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311600+0000", 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014853300000000001 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311640+0000", 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9585999999999997e-05 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.330239+0000", 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018598607999999999 2024-04-26T12:41:28.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.330401+0000", 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016223499999999999 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:28.393 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:28.393 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:28.303+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:28.394 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:41:28.436 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:28.435+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:28.507 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:28.503+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:28.561 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:28.562 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:28.562 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:41:28.562 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:28.576 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:41:28.607 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:28.605+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:28.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:41:28.708 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:28.707+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:28.746 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:41:28.747 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:41:28.747 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:28.761 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:41:28.809 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:28.809+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:28.819 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:28.819 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:28.837 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:28.837 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:28.855 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:28.855 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:28.872 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:28.872 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:28.893 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:28.893 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:28.910 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:28.909+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:28.925 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:28.925 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:28.926 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:28.926 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:28.940 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:41:28.946 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:28.946 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:28.964 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:29.011 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:29.007+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:29.058 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:29.058 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:29.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:41:29.116 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:29.115+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:29.212 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:29.211+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:29.239 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:29.240 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:29.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:41:29.340 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:29.339+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:29.413 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:29.413+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:29.420 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:29.420 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:29.434 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:41:29.520 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:29.519+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:29.602 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:29.602 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:29.615 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:29.611+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:29.616 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:41:29.715 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:29.713+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:29.783 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:29.785 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:29.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:41:29.816 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:29.813+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:29.916 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:29.915+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:29.920 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:29.920 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:29.934 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:41:30.018 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:30.015+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:30.051 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:30.051 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:30.064 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:41:30.094 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T12:41:30.094 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:41:30.119 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:30.115+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:30.122 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T12:41:30.181 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:30.181 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:30.196 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:41:30.220 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:30.219+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:30.321 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:30.321+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:30.356 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:30.356 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:30.370 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:41:30.456 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:30.457+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:30.466 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:41:30.475 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is set 2024-04-26T12:41:30.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:41:30.537 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:30.537 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:30.538 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:30.537+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:30.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:41:30.624 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:30.623+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:30.704 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:30.705 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:30.723 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:41:30.725 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:30.723+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:30.826 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:30.825+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:30.849 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:30.849 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:30.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:41:30.927 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:30.923+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:30.982 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:41:31.024 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:31.024 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:31.028 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:31.027+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:31.037 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:41:31.129 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:31.127+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:31.131 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:31.132 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:31.149 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:31.150 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:31.167 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:31.167 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:31.185 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:31.185 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:31.205 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:31.205 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:31.205 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:31.205 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:31.206 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:31.206 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:31.206 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:31.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:41:31.225 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:31.226 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:31.230 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:31.229+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:31.247 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:31.247 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:31.268 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:31.268 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:31.331 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:31.327+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 79.030640746000003, 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:41:31.339 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.340 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.341 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:41:31.342 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:41:31.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:41:31.344 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2886 3.f 3:f1601af9:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.218190481000001, 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018140835000000001, 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.345 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2886 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118818+0000", 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.120998+0000", 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021794050000000001 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121023+0000", 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5063e-05 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121036+0000", 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.308e-05 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121148+0000", 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112575 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121377+0000", 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022841100000000001 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121584+0000", 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020710600000000001 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.127654+0000", 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006070069 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136884+0000", 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092296909999999999 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136926+0000", 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2215000000000002e-05 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136957+0000", 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-05 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.350 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3064 3.9 3:9202b9a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.843025278999999, 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020230000000000001, 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3064 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493984+0000", 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2289999999999999e-06 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496913+0000", 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029283989999999999 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496937+0000", 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496947+0000", 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.353 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497017+0000", 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9735999999999998e-05 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497139+0000", 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012228 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497237+0000", 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8326999999999996e-05 2024-04-26T12:41:31.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.502130+0000", 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048921540000000001 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514064+0000", 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011933918999999999 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514147+0000", 2024-04-26T12:41:31.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3065999999999994e-05 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514211+0000", 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4597999999999994e-05 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3106 3.2e 3:75381650:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.403313623999999, 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020388387000000001, 2024-04-26T12:41:31.356 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3106 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933696+0000", 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9359999999999999e-06 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935132+0000", 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001436377 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935165+0000", 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2846999999999999e-05 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935181+0000", 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935260+0000", 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9042999999999995e-05 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935412+0000", 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015139299999999999 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935526+0000", 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114076 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.940843+0000", 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053172339999999997 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.953947+0000", 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01310396 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954024+0000", 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7657000000000005e-05 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954081+0000", 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6733e-05 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.361 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3126 3.9 3:914259a4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.180426656000002, 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017534042, 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3126 2024-04-26T12:41:31.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156580+0000", 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.156583+0000", 2024-04-26T12:41:31.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7389999999999999e-06 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158853+0000", 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022704359999999998 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158907+0000", 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3702000000000002e-05 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.158921+0000", 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4416999999999999e-05 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159038+0000", 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000116878 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159233+0000", 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000195198 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.159411+0000", 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000177839 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.169121+0000", 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0097102739999999996 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.173975+0000", 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048540570000000002 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174054+0000", 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8783999999999997e-05 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.174114+0000", 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9718e-05 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3139 3.2e 3:741e0bcf:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.045455046000001, 2024-04-26T12:41:31.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027404833999999999, 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3139 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291555+0000", 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2839999999999998e-06 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293141+0000", 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001586542 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293174+0000", 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2898999999999998e-05 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293190+0000", 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5855999999999999e-05 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293274+0000", 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4191999999999996e-05 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293425+0000", 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015107799999999999 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293532+0000", 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106642 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.298262+0000", 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047298749999999997 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318804+0000", 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020542525999999998 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318891+0000", 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6808e-05 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318956+0000", 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5131999999999999e-05 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.372 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3144 3.9 3:93416909:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.991343934, 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019208350999999999, 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3144 2024-04-26T12:41:31.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345666+0000", 2024-04-26T12:41:31.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7359999999999999e-06 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347400+0000", 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017342130000000001 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347434+0000", 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3559000000000002e-05 2024-04-26T12:41:31.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347450+0000", 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6126000000000001e-05 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347525+0000", 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5049999999999995e-05 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347690+0000", 2024-04-26T12:41:31.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016434500000000001 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347782+0000", 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2174000000000002e-05 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.352644+0000", 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048619249999999996 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364731+0000", 2024-04-26T12:41:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012087540000000001 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364811+0000", 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9594999999999999e-05 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364871+0000", 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0087999999999998e-05 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3178 3.9 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.604797882, 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.026775441000000001, 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3178 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.379 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732211+0000", 2024-04-26T12:41:31.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9040000000000001e-06 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734341+0000", 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002130018 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734370+0000", 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8702000000000001e-05 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734386+0000", 2024-04-26T12:41:31.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5423000000000001e-05 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734474+0000", 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8490000000000001e-05 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734656+0000", 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018186 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734810+0000", 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015437799999999999 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740557+0000", 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057466710000000001 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758834+0000", 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018276573000000001 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758919+0000", 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5350000000000001e-05 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758984+0000", 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5072000000000003e-05 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3179 3.9 3:936f954f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.596540031, 2024-04-26T12:41:31.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020186769, 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3179 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740469+0000", 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5019999999999999e-06 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741784+0000", 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314824 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741812+0000", 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8731e-05 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741827+0000", 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.446e-05 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741944+0000", 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011712100000000001 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742156+0000", 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000211635 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742381+0000", 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000225174 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.748059+0000", 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056783090000000003 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760598+0000", 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012538396 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760628+0000", 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0278999999999999e-05 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760653+0000", 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5338e-05 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.389 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3194 3.9 3:9016d8f2:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.439939460000002, 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01815512, 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3194 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897070+0000", 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4309999999999998e-06 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898919+0000", 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018485750000000001 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898950+0000", 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1433000000000002e-05 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898966+0000", 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6011999999999998e-05 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899038+0000", 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1089999999999999e-05 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899181+0000", 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014355600000000001 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899290+0000", 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109381 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.903968+0000", 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046775810000000001 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915142+0000", 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01117362 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915185+0000", 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3118000000000003e-05 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915222+0000", 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7323000000000002e-05 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3197 3.2e 3:75db4699:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.395 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.404726221000001, 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027033747, 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3197 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932283+0000", 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933450+0000", 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001166472 2024-04-26T12:41:31.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933472+0000", 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2761000000000001e-05 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933486+0000", 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3399e-05 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933566+0000", 2024-04-26T12:41:31.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0669999999999998e-05 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933735+0000", 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000169087 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933897+0000", 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016202400000000001 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.938810+0000", 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049125649999999998 2024-04-26T12:41:31.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959231+0000", 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020421228 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959273+0000", 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959314+0000", 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0642000000000002e-05 2024-04-26T12:41:31.400 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3229 3.f 3:f3b7f6e7:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.007996910999999, 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018966246999999999, 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3229 2024-04-26T12:41:31.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329013+0000", 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331482+0000", 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024695390000000002 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331499+0000", 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7175000000000001e-05 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331508+0000", 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331619+0000", 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110567 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331768+0000", 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014950200000000001 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331932+0000", 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389900000000001 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.339084+0000", 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007151887 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347886+0000", 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.008801784 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347928+0000", 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2228999999999998e-05 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347976+0000", 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7497000000000003e-05 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.406 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3245 3.f 3:f14a72c5:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.832700797000001, 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018443383000000001, 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3245 2024-04-26T12:41:31.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504308+0000", 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:41:31.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505670+0000", 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001361478 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505698+0000", 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827999999999999e-05 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505712+0000", 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3839000000000001e-05 2024-04-26T12:41:31.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505790+0000", 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8775000000000004e-05 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505941+0000", 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015073899999999999 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.506050+0000", 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010859 2024-04-26T12:41:31.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.510891+0000", 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048417549999999997 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522669+0000", 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011778001999999999 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522714+0000", 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4861999999999998e-05 2024-04-26T12:41:31.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522749+0000", 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4745e-05 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3257 3.f 3:f16d7886:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_202:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.692763444000001, 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018067529999999998, 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.412 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3257 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.413 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644243+0000", 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.644246+0000", 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2349999999999999e-06 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646264+0000", 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020174160000000002 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646295+0000", 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1828000000000001e-05 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646306+0000", 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0546e-05 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646390+0000", 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4321999999999997e-05 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646532+0000", 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000141669 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.646662+0000", 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129634 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.651808+0000", 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051462610000000001 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662201+0000", 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010392848999999999 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662259+0000", 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8108e-05 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.662311+0000", 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1662000000000001e-05 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.417 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3280 3.21 3:8431c446:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 21.543455294000001, 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018802534999999999, 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3280 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.418 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793554+0000", 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.762e-06 2024-04-26T12:41:31.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.794995+0000", 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014413270000000001 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795026+0000", 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0260000000000002e-05 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795039+0000", 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3396e-05 2024-04-26T12:41:31.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795124+0000", 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5165000000000002e-05 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795132+0000", 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3450000000000006e-06 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.797837+0000", 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027041750000000001 2024-04-26T12:41:31.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798009+0000", 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000172456 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798162+0000", 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015279000000000001 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808398+0000", 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010236263000000001 2024-04-26T12:41:31.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812214+0000", 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003816285 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812291+0000", 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7035999999999999e-05 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812354+0000", 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2274999999999996e-05 2024-04-26T12:41:31.423 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3468 3.9 3:92d2bef4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.876997967000001, 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019140161999999999, 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.424 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3468 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460010+0000", 2024-04-26T12:41:31.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6220000000000001e-06 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462069+0000", 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020588350000000002 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462093+0000", 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3841000000000001e-05 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462104+0000", 2024-04-26T12:41:31.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0781999999999999e-05 2024-04-26T12:41:31.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462169+0000", 2024-04-26T12:41:31.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5223999999999998e-05 2024-04-26T12:41:31.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462310+0000", 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014092999999999999 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462468+0000", 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015857999999999999 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.467313+0000", 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048449909999999999 2024-04-26T12:41:31.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479025+0000", 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011711408 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479095+0000", 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0562000000000006e-05 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479149+0000", 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3387000000000002e-05 2024-04-26T12:41:31.431 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3490 3.9 3:90ed9f24:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_425:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.637247019, 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019930929, 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.432 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3490 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699767+0000", 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-06 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702177+0000", 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024107909999999998 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702216+0000", 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8677000000000003e-05 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702233+0000", 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.677e-05 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702331+0000", 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8522000000000003e-05 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702554+0000", 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222284 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702746+0000", 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192165 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.711473+0000", 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087273230000000004 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719610+0000", 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081368139999999992 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719655+0000", 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5166000000000001e-05 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719690+0000", 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5240999999999997e-05 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3498 3.9 3:90786aa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_433:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.553641653, 2024-04-26T12:41:31.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019394081000000001, 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3498 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783369+0000", 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4780000000000002e-06 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785506+0000", 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00213635 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785535+0000", 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-05 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785551+0000", 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5452e-05 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785654+0000", 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000102951 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785857+0000", 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000202785 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785972+0000", 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011500100000000001 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.792041+0000", 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060695999999999996 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802651+0000", 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010609726999999999 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802702+0000", 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1304000000000002e-05 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802759+0000", 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6703000000000002e-05 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.442 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3511 3.2e 3:76d60bde:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.399429869999999, 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020430932999999998, 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.443 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3511 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937578+0000", 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8759999999999999e-06 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939235+0000", 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016561989999999999 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939267+0000", 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2712999999999997e-05 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939283+0000", 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5421e-05 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939362+0000", 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8752999999999996e-05 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939492+0000", 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130844 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939616+0000", 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012401600000000001 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.944163+0000", 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045470329999999998 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957900+0000", 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013737047 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957962+0000", 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1976000000000004e-05 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.958008+0000", 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5055000000000001e-05 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3518 3.f 3:f20a4de4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_453:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:31.448 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.332569976999999, 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018842589, 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3518 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004440+0000", 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006038+0000", 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015980079999999999 2024-04-26T12:41:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006062+0000", 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4779000000000001e-05 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006075+0000", 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2782000000000001e-05 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006152+0000", 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7343999999999997e-05 2024-04-26T12:41:31.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006322+0000", 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016997900000000001 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006415+0000", 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2800999999999995e-05 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.012821+0000", 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064056770000000002 2024-04-26T12:41:31.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023205+0000", 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010383763000000001 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023248+0000", 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2963000000000002e-05 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023279+0000", 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1383000000000001e-05 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.453 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.454 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.454 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.454 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:31.455 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:41:31.456 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:31.451+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:31.484 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:41:31.507 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:41:31.592 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:41:31.592 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:31.593 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:31.589+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:31.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:41:31.657 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:31.655+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:31.758 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:31.755+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:31.759 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:31.759 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:31.759 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:31.759 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:31.759 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:31.772 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:41:31.859 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:31.857+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:31.903 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2320 3.27 3:e76af2e5:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 80.512887921000001, 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020624966000000002, 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.904 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2320 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389492+0000", 2024-04-26T12:41:31.905 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.389495+0000", 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390861+0000", 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013652849999999999 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.906 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390898+0000", 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6789000000000003e-05 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390908+0000", 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.065e-05 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.390983+0000", 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5109000000000002e-05 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.907 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391089+0000", 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000105752 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.391177+0000", 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7596999999999995e-05 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.395646+0000", 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044690889999999999 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.908 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410024+0000", 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014378050999999999 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410065+0000", 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.1056000000000001e-05 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.410117+0000", 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2485000000000003e-05 2024-04-26T12:41:31.909 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2374 3.38 3:1c1a4d28:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 79.929733519999999, 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020357772999999999, 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.910 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2374 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972647+0000", 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.911 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.972649+0000", 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3800000000000001e-06 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974485+0000", 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018357899999999999 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974516+0000", 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1142000000000001e-05 2024-04-26T12:41:31.912 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974531+0000", 2024-04-26T12:41:31.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.455e-05 2024-04-26T12:41:31.913 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.913 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.913 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.913 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974627+0000", 2024-04-26T12:41:31.913 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6543e-05 2024-04-26T12:41:31.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.914 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.914 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.974833+0000", 2024-04-26T12:41:31.914 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020613700000000001 2024-04-26T12:41:31.914 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.914 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.975018+0000", 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000184267 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.981099+0000", 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00608093 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.915 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011762869 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.992942+0000", 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0517000000000002e-05 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.916 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:11.993005+0000", 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2648000000000001e-05 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 79.652559834000002, 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.917 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.918 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.919 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.921 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:41:31.922 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 79.417897042000007, 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:41:31.923 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.924 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:41:31.925 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:41:31.926 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.927 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.928 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2872 3.7 3:e1a8506b:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.968608648, 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020999501, 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.929 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2872 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933772+0000", 2024-04-26T12:41:31.930 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.933774+0000", 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7199999999999998e-06 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935453+0000", 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016790850000000001 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.931 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935491+0000", 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7734999999999997e-05 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935504+0000", 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3254999999999999e-05 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935575+0000", 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0339999999999994e-05 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.932 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935722+0000", 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014727800000000001 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.935854+0000", 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000131507 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.940409+0000", 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045550790000000001 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.933 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954592+0000", 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014183332 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954696+0000", 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000103602 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:48.954771+0000", 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5568000000000006e-05 2024-04-26T12:41:31.934 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2890 3.2 3:422e89e2:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 42.730928431000002, 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023228242999999999, 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2890 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.936 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171455+0000", 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1370000000000002e-06 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175884+0000", 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044289400000000001 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175931+0000", 2024-04-26T12:41:31.937 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.71e-05 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175950+0000", 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176035+0000", 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4580999999999995e-05 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.938 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176145+0000", 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010970499999999999 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176237+0000", 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2898000000000004e-05 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.180690+0000", 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044521550000000002 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.939 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194585+0000", 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013895286 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194646+0000", 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0927000000000001e-05 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194680+0000", 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4360999999999998e-05 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.940 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3070 3.2 3:41299508:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.347061066999999, 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021442744, 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3070 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.941 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555319+0000", 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.555322+0000", 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3879999999999998e-06 2024-04-26T12:41:31.942 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557150+0000", 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018282699999999999 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557177+0000", 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6804999999999998e-05 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557187+0000", 2024-04-26T12:41:31.943 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0042e-05 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557354+0000", 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016743800000000001 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557502+0000", 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0001474 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.557642+0000", 2024-04-26T12:41:31.944 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014000300000000001 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.562888+0000", 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005246031 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576517+0000", 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013629702 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.945 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576606+0000", 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9079000000000006e-05 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.576762+0000", 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015558600000000001 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3101 3.1e 3:7930998e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.946 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.0207272, 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020983102999999999, 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3101 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881653+0000", 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.881657+0000", 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6279999999999998e-06 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.948 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883263+0000", 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001606257 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883289+0000", 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6152e-05 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883302+0000", 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2809000000000001e-05 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.949 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883389+0000", 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7429999999999995e-05 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883567+0000", 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017797000000000001 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.883734+0000", 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016698900000000001 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.950 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.890551+0000", 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00681658 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902478+0000", 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011927559000000001 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902561+0000", 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2965000000000003e-05 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.951 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.902636+0000", 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4764000000000004e-05 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3122 3.29 3:951a57de:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.792061133000001, 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021821106, 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.952 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3122 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:31.953 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110322+0000", 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.632e-06 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112021+0000", 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016992789999999999 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112052+0000", 2024-04-26T12:41:31.954 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0525000000000003e-05 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112064+0000", 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2768e-05 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112173+0000", 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108119 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112424+0000", 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025160699999999999 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112569+0000", 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144888 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.956 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.118043+0000", 2024-04-26T12:41:31.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054735959999999998 2024-04-26T12:41:31.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.957 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.957 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132056+0000", 2024-04-26T12:41:31.957 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014013146000000001 2024-04-26T12:41:31.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132105+0000", 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8909000000000002e-05 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132140+0000", 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5636999999999998e-05 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.958 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3123 3.27 3:e6e77b36:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.78075703, 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021419740999999999, 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3123 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121623+0000", 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.121626+0000", 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2979999999999999e-06 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123454+0000", 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018283069999999999 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123490+0000", 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6225e-05 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123506+0000", 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5931999999999999e-05 2024-04-26T12:41:31.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123595+0000", 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9151000000000001e-05 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123805+0000", 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020976 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.962 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.123984+0000", 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017854500000000001 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.129714+0000", 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057303720000000001 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.142950+0000", 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013235660999999999 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.963 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.142993+0000", 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3072999999999999e-05 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.143043+0000", 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.0417000000000002e-05 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3180 3.38 3:1dc50762:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.150673745999999, 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020727782, 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3180 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:31.965 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751707+0000", 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.751708+0000", 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8899999999999999e-06 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.966 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753438+0000", 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001729866 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753472+0000", 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3293999999999997e-05 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753487+0000", 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5184999999999999e-05 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.967 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753568+0000", 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1404999999999997e-05 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753737+0000", 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016865900000000001 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.753855+0000", 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000117861 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758867+0000", 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050125059999999999 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772351+0000", 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013484052999999999 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772389+0000", 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7391999999999997e-05 2024-04-26T12:41:31.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.772434+0000", 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5670999999999997e-05 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3236 3.7 3:e0b2f0ce:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.490817790000001, 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025042014000000001, 2024-04-26T12:41:31.970 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3236 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.971 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411565+0000", 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412947+0000", 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013823349999999999 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.972 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412981+0000", 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3386000000000002e-05 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412996+0000", 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5610000000000001e-05 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413076+0000", 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9488999999999997e-05 2024-04-26T12:41:31.973 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413247+0000", 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017079199999999999 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413355+0000", 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108824 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.974 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.418245+0000", 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048893299999999999 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436492+0000", 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018247368999999999 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436567+0000", 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4802000000000007e-05 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436605+0000", 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7592000000000002e-05 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3250 3.33 3:cf65c941:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 22.337188315999999, 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022851729000000001, 2024-04-26T12:41:31.976 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3250 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.977 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565195+0000", 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-06 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567117+0000", 2024-04-26T12:41:31.978 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019217570000000001 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567143+0000", 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6321000000000001e-05 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567158+0000", 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4712000000000001e-05 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567244+0000", 2024-04-26T12:41:31.979 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6583999999999996e-05 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567400+0000", 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015599099999999999 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567575+0000", 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017444199999999999 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.980 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.574382+0000", 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068072660000000002 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587935+0000", 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013552899 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587991+0000", 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5927999999999997e-05 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.981 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588044+0000", 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2731e-05 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3467 3.2 3:4067df0c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.455133925999998, 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023170046999999999, 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.982 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3467 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:31.983 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447249+0000", 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9960000000000002e-06 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449053+0000", 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018033369999999999 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.984 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449080+0000", 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7608999999999999e-05 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449094+0000", 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3689999999999999e-05 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449175+0000", 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0655999999999995e-05 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.985 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449305+0000", 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012987400000000001 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449412+0000", 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010741799999999999 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.454641+0000", 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052287130000000003 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.986 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470316+0000", 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015674837 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470362+0000", 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5998999999999998e-05 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470416+0000", 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4917999999999998e-05 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.987 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3481 3.27 3:e4b6b857:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_416:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.299521388999999, 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020687291, 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3481 2024-04-26T12:41:31.988 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602859+0000", 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.602861+0000", 2024-04-26T12:41:31.989 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.339e-06 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.604985+0000", 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021233990000000002 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605016+0000", 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1613999999999999e-05 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.990 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605028+0000", 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1302e-05 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605113+0000", 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5173999999999995e-05 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605242+0000", 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000129443 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:31.991 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.605346+0000", 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010377 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.610502+0000", 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0051564089999999998 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623416+0000", 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012913614 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.992 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623490+0000", 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3609000000000006e-05 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.623546+0000", 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6617999999999999e-05 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3493 3.33 3:cdefd7bd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_428:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 19.168427047000002, 2024-04-26T12:41:31.993 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020983978, 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3493 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.994 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733953+0000", 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.733956+0000", 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6730000000000001e-06 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735896+0000", 2024-04-26T12:41:31.995 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001940382 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735925+0000", 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8700999999999998e-05 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.735940+0000", 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4674e-05 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736035+0000", 2024-04-26T12:41:31.996 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.5551999999999996e-05 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736240+0000", 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020428800000000001 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.736354+0000", 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114145 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.741363+0000", 2024-04-26T12:41:31.997 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050093840000000004 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754845+0000", 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013481501 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754902+0000", 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7617000000000001e-05 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:31.998 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.754937+0000", 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5061000000000002e-05 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3534 3.7 3:e277469f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_469:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.739495902000002, 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027785351999999999, 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:31.999 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3534 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:32.000 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162887+0000", 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6230000000000001e-06 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165295+0000", 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024080019999999998 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165329+0000", 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3800000000000002e-05 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165344+0000", 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5310000000000001e-05 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165433+0000", 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9015000000000001e-05 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:32.002 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165609+0000", 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175809 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165785+0000", 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000176515 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.170217+0000", 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044311979999999999 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:32.003 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190550+0000", 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020333235000000002 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190604+0000", 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4026000000000001e-05 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190670+0000", 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5819000000000001e-05 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:32.004 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3540 3.33 3:ccf326fe:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_475:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.678714307, 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022822643, 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3540 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:32.005 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223669+0000", 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9849999999999998e-06 2024-04-26T12:41:32.006 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225528+0000", 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001859461 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225554+0000", 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5609000000000002e-05 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225567+0000", 2024-04-26T12:41:32.007 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3326000000000001e-05 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225645+0000", 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7880000000000007e-05 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225758+0000", 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112355 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225854+0000", 2024-04-26T12:41:32.008 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6059999999999998e-05 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.231841+0000", 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059873219999999998 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246370+0000", 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014528983000000001 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246436+0000", 2024-04-26T12:41:32.009 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5889999999999994e-05 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246489+0000", 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2772000000000002e-05 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3544 3.27 3:e5e9dc2a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.638271496000002, 2024-04-26T12:41:32.010 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020824362999999999, 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3544 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:32.011 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264109+0000", 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.264111+0000", 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5409999999999999e-06 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265590+0000", 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014784430000000001 2024-04-26T12:41:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265615+0000", 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4756000000000002e-05 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265625+0000", 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0445000000000001e-05 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265706+0000", 2024-04-26T12:41:32.013 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.1144999999999996e-05 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265832+0000", 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012604000000000001 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.265955+0000", 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012266100000000001 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.270368+0000", 2024-04-26T12:41:32.014 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044134589999999998 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284829+0000", 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014460944999999999 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284875+0000", 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5864e-05 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.284933+0000", 2024-04-26T12:41:32.015 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8063999999999998e-05 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3553 3.7 3:e09c7e82:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_488:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 18.540394899999999, 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023273085999999998, 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:32.016 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3553 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.017 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361988+0000", 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363819+0000", 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018314119999999999 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363847+0000", 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.018 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363861+0000", 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4127999999999999e-05 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363927+0000", 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6342999999999998e-05 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364037+0000", 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109503 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.019 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364138+0000", 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101734 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.368455+0000", 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004317212 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385075+0000", 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016619425 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.020 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385182+0000", 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010734 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385259+0000", 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6268999999999998e-05 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:32.021 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:32.023 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:41:32.023 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:32.019+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:32.123 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:32.119+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:32.169 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:32.169 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:32.169 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:41:32.169 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:32.186 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:41:32.228 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:32.227+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:32.326 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:32.323+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:32.373 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:32.373 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:41:32.374 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:41:32.374 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:32.389 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:41:32.427 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:32.425+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:32.493 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:41:32.508 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:41:32.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-26T12:41:32.527 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:32.525+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:32.577 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:32.577 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:41:32.577 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:41:32.577 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:32.577 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.577 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:1601 3.1d e67/17 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head v 67'1, mlcod=0'0)", 2024-04-26T12:41:32.577 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 92.847022189, 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021057349999999999, 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.578 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727482+0000", 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727484+0000", 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6699999999999998e-06 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733321+0000", 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005836351 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.579 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733360+0000", 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9648999999999999e-05 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733383+0000", 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2722999999999999e-05 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733504+0000", 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012115199999999999 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.580 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.733558+0000", 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3511999999999999e-05 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748395+0000", 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014836937 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748539+0000", 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144356 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.581 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.606513285999995, 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.582 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.583 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.584 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.585 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.329828614999997, 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.586 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.587 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:41:32.588 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.589 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3060 3.11 e102/17 3:884a83fa:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_5:head v 102'6, mlcod=90'4)", 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:32.590 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.118192830000002, 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023109461000000001, 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.591 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456312+0000", 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8699999999999995e-07 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458724+0000", 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024121659999999999 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458750+0000", 2024-04-26T12:41:32.592 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6208999999999999e-05 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458762+0000", 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1956e-05 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458869+0000", 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010719 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458909+0000", 2024-04-26T12:41:32.593 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9614999999999999e-05 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.479268+0000", 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020358885 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.479421+0000", 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015285299999999999 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.594 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3118 3.1d e102/17 3:bb40c566:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_63:head v 102'15, mlcod=102'13)", 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.070353+0000", 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.504150885000001, 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021021374999999998, 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070353+0000", 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.595 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070353+0000", 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070356+0000", 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2169999999999999e-06 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.596 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.075801+0000", 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054446729999999997 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.075838+0000", 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6769e-05 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.075857+0000", 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.931e-05 2024-04-26T12:41:32.597 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.076034+0000", 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000176909 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.076078+0000", 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4239000000000001e-05 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091201+0000", 2024-04-26T12:41:32.598 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015122399999999999 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091374+0000", 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017385799999999999 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3138 3.11 e102/17 3:880b1c25:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_83:head v 102'7, mlcod=91'5)", 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.285946651, 2024-04-26T12:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024448279999999999, 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.600 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288560+0000", 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8169999999999999e-06 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291885+0000", 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033250419999999998 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291935+0000", 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9709999999999997e-05 2024-04-26T12:41:32.601 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291955+0000", 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9683000000000001e-05 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.292129+0000", 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000174432 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.292195+0000", 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5889000000000006e-05 2024-04-26T12:41:32.602 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.312782+0000", 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020587215999999998 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313006+0000", 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022349100000000001 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.603 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3178 3.9 e102/31 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head v 102'13, mlcod=102'11)", 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.841102528, 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023424759999999999, 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.604 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733404+0000", 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1940000000000001e-06 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738411+0000", 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050070699999999998 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.605 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738447+0000", 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6380000000000001e-05 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738465+0000", 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8255999999999999e-05 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738601+0000", 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013597899999999999 2024-04-26T12:41:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738647+0000", 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5293000000000002e-05 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.756721+0000", 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018074446000000001 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.756826+0000", 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105142 2024-04-26T12:41:32.607 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3210 3.1d e102/17 3:b88fb53e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_155:head v 102'16, mlcod=102'14)", 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.488834767, 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024571928999999999, 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.608 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085673+0000", 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.36e-06 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.609 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091170+0000", 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054978630000000004 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091212+0000", 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2129000000000003e-05 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091238+0000", 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5720000000000001e-05 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.610 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091395+0000", 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015645200000000001 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091437+0000", 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2199e-05 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110109+0000", 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018672040000000001 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.611 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110241+0000", 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013216599999999999 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3284 3.1b e103/17 3:db1037a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_219:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 22.730066316999999, 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022520861, 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.612 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844439+0000", 2024-04-26T12:41:32.613 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1769999999999999e-06 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850076+0000", 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056371140000000004 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850105+0000", 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8975999999999998e-05 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850124+0000", 2024-04-26T12:41:32.614 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8827000000000001e-05 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850266+0000", 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142516 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850305+0000", 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8859000000000002e-05 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.866786+0000", 2024-04-26T12:41:32.615 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016480660000000001 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.866958+0000", 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017273200000000001 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3283 3.e e103/17 3:7042574b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_218:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 22.729867312, 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023100175000000001, 2024-04-26T12:41:32.616 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.617 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4700000000000001e-07 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847832+0000", 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031949299999999999 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847880+0000", 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7806000000000003e-05 2024-04-26T12:41:32.618 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847906+0000", 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6205999999999999e-05 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.848086+0000", 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017921899999999999 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.848154+0000", 2024-04-26T12:41:32.619 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8485999999999994e-05 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867575+0000", 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019420823 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867737+0000", 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161958 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.620 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3285 3.f e103/41 3:f2e9bdba:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_220:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 22.719596769999999, 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021900076000000001, 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.621 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854908+0000", 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1999999999999998e-07 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860748+0000", 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058394420000000002 2024-04-26T12:41:32.622 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860782+0000", 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4162999999999998e-05 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860800+0000", 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7963000000000001e-05 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860972+0000", 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017237200000000001 2024-04-26T12:41:32.623 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.861039+0000", 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7182999999999997e-05 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.876678+0000", 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015639304999999999 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.876807+0000", 2024-04-26T12:41:32.624 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872799999999999 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3287 3.e e103/17 3:71707d61:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_222:head v 103'12, mlcod=102'10)", 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 22.695481063999999, 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024816290000000001, 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.625 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879027+0000", 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0659999999999997e-06 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.626 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881632+0000", 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026051999999999998 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881669+0000", 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7345999999999998e-05 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881688+0000", 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.878e-05 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.627 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881893+0000", 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020426099999999999 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881931+0000", 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.903684+0000", 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021752187999999999 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.628 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.903839+0000", 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015550899999999999 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3288 3.34 e103/31 3:2f2ab73e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_223:head v 103'10, mlcod=102'8)", 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 22.685927818, 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022389650000000001, 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.629 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.630 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888579+0000", 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5229999999999998e-06 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891518+0000", 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002939218 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891549+0000", 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0954000000000002e-05 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.631 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891570+0000", 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1229e-05 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891703+0000", 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013248099999999999 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891756+0000", 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3542999999999999e-05 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.632 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.910882+0000", 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019125860000000001 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.910966+0000", 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3842000000000001e-05 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.633 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3504 3.14 e103/31 3:2a60a1fc:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_439:head v 103'11, mlcod=103'9)", 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:12.867896+0000", 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.706607420000001, 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021257569, 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.867896+0000", 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.634 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.867896+0000", 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.867899+0000", 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9629999999999998e-06 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.871930+0000", 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004030156 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.635 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.871979+0000", 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9845999999999997e-05 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.872006+0000", 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6982999999999999e-05 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.872283+0000", 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027671800000000002 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.636 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.872332+0000", 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9279e-05 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.889028+0000", 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016695899 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.889154+0000", 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012572500000000001 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.637 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3519 3.1d e104/17 3:bbcdc9e4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_454:head v 104'18, mlcod=102'16)", 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.555601035999999, 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024779148000000001, 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:32.638 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018904+0000", 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0999999999999998e-07 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.639 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022336+0000", 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034327490000000001 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022376+0000", 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9443000000000002e-05 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022400+0000", 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4280000000000001e-05 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.640 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022546+0000", 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014610799999999999 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022600+0000", 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3483000000000003e-05 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.043590+0000", 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020990609 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.641 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.043682+0000", 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1766000000000002e-05 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3520 3.1d e104/17 3:ba0cfaa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_455:head v 104'19, mlcod=102'16)", 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.029736+0000", 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.544768095999999, 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021221387000000001, 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.642 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029736+0000", 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029736+0000", 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.643 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029738+0000", 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.407e-06 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.032948+0000", 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032094239999999998 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.032996+0000", 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.8285999999999998e-05 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.644 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.033022+0000", 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5919999999999999e-05 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.033219+0000", 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019674100000000001 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.033295+0000", 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6268999999999998e-05 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.645 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.050855+0000", 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017560524000000001 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.050957+0000", 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000101816 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.646 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3528 3.31 e104/17 3:8ff53833:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_463:head v 104'22, mlcod=103'20)", 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.469592315, 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026837514999999999, 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.647 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.105724+0000", 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00081230199999999999 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111099+0000", 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053747309999999998 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.648 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111142+0000", 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3396000000000003e-05 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111165+0000", 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3070000000000001e-05 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111347+0000", 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018210500000000001 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.649 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111419+0000", 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1493000000000001e-05 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.130996+0000", 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019577719 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.131749+0000", 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075269900000000001 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.650 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3547 3.1d e104/17 3:bad5b40c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_482:head v 104'21, mlcod=104'19)", 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.275991804, 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030273893999999999, 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.651 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298515+0000", 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303081+0000", 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045658840000000001 2024-04-26T12:41:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303132+0000", 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1053000000000001e-05 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303167+0000", 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5583000000000001e-05 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303397+0000", 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022938799999999999 2024-04-26T12:41:32.653 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303471+0000", 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4591999999999993e-05 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328651+0000", 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025179983999999999 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328786+0000", 2024-04-26T12:41:32.654 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000134676 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3548 3.11 e104/17 3:8824d90c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_483:head v 104'15, mlcod=103'13)", 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.267350824000001, 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023247721999999998, 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.655 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307157+0000", 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4939999999999999e-06 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.656 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311400+0000", 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042435040000000004 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311434+0000", 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3507999999999998e-05 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311452+0000", 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8253999999999998e-05 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.657 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311600+0000", 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014853300000000001 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311640+0000", 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9585999999999997e-05 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.330239+0000", 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018598607999999999 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.658 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.330401+0000", 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016223499999999999 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3753 3.29 e111/17 3:957094bb:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_20:head v 111'11, mlcod=103'9)", 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:32.142073+0000", 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.43243085799999997, 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022934208000000001, 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.659 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.142073+0000", 2024-04-26T12:41:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.661 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.142073+0000", 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.142074+0000", 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7599999999999997e-07 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.147776+0000", 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005702787 2024-04-26T12:41:32.662 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.147808+0000", 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1473999999999997e-05 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.147825+0000", 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7169000000000001e-05 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.147960+0000", 2024-04-26T12:41:32.663 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013469900000000001 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.148003+0000", 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.299e-05 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.164938+0000", 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016934864000000001 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.165007+0000", 2024-04-26T12:41:32.664 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9648999999999997e-05 2024-04-26T12:41:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.665 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.665 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:32.666 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:41:32.668 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:32.665+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:32.768 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:32.763+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3805 3.36 e112/17 3:6d3c28ce:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_72:head v 112'26, mlcod=111'24)", 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:32.795043+0000", 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.013786247, 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013861253, 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:32.809 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "started", 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.795043+0000", 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.795043+0000", 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:32.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.795045+0000", 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.34e-06 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.798475+0000", 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034305310000000001 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.798519+0000", 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3551999999999999e-05 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.798542+0000", 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2813999999999999e-05 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.798773+0000", 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023135500000000001 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.798829+0000", 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6209999999999999e-05 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:32.812 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.813 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:32.813 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2024-04-26T12:41:32.813 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 1 2024-04-26T12:41:32.813 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:32.828 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:41:32.872 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:32.871+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:32.972 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:32.971+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:33.003 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:33.004 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:33.004 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:41:33.004 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:41:33.004 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:33.020 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:41:33.108 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:33.107+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:33.174 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:33.173+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1601 3.1d 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 93.479201201999999, 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028382847999999999, 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.204 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1601 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.205 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720720+0000", 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3300000000000001e-06 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726577+0000", 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005857307 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.206 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726616+0000", 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9224999999999998e-05 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726640+0000", 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3873e-05 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726810+0000", 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016950799999999999 2024-04-26T12:41:33.207 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727033+0000", 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022316600000000001 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727242+0000", 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020876 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748847+0000", 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021605347 2024-04-26T12:41:33.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748917+0000", 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9413999999999996e-05 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749020+0000", 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103383 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749100+0000", 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0535000000000001e-05 2024-04-26T12:41:33.209 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2399 3.1d 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 80.960731215999999, 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029752193999999999, 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.210 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2399 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.211 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239192+0000", 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1829999999999996e-06 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243681+0000", 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044893629999999997 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243722+0000", 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0639000000000002e-05 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.212 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243743+0000", 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0760000000000001e-05 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243882+0000", 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013962600000000001 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244142+0000", 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025946699999999999 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.213 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244378+0000", 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000236839 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254731+0000", 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010353004000000001 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268598+0000", 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013866431 2024-04-26T12:41:33.214 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268779+0000", 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018066499999999999 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268940+0000", 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016121700000000001 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.215 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2884 3.2f 3:f6197e28:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:49.096676+0000", 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 44.103242967, 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028209858000000001, 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2884 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.216 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.096676+0000", 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.096676+0000", 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.096693+0000", 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.73e-05 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.217 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101223+0000", 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045303599999999998 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101266+0000", 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2973999999999999e-05 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101286+0000", 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9266000000000002e-05 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.218 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101452+0000", 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016583799999999999 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101701+0000", 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024983200000000002 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.101924+0000", 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000222487 2024-04-26T12:41:33.219 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.114371+0000", 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012447389999999999 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124747+0000", 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010375654999999999 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124829+0000", 2024-04-26T12:41:33.220 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2124000000000002e-05 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:49.124886+0000", 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.6632000000000003e-05 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3081 3.22 3:47037847:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:07.665410+0000", 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.534508309, 2024-04-26T12:41:33.221 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.034387288000000002, 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3081 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.665410+0000", 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.665410+0000", 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.665427+0000", 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6534000000000001e-05 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673049+0000", 2024-04-26T12:41:33.223 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0076223590000000004 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673082+0000", 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2243000000000003e-05 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673099+0000", 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7396000000000001e-05 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.224 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673225+0000", 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012571699999999999 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673512+0000", 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000287597 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673733+0000", 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022041199999999999 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.683145+0000", 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094119479999999998 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.699468+0000", 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016323502 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.699689+0000", 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022083500000000001 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.226 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.699798+0000", 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108745 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3118 3.1d 3:bb40c566:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.063626+0000", 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.136292870999998, 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028291525000000001, 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.227 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3118 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.063626+0000", 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.063626+0000", 2024-04-26T12:41:33.228 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.063629+0000", 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4970000000000001e-06 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069064+0000", 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054349799999999998 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069097+0000", 2024-04-26T12:41:33.229 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2696e-05 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069121+0000", 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4292999999999999e-05 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069300+0000", 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017843899999999999 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.230 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069726+0000", 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042598199999999999 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070138+0000", 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041179999999999998 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.082195+0000", 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012057538 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.231 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091723+0000", 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0095282519999999992 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091841+0000", 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000117142 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.232 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091917+0000", 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6905999999999999e-05 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3129 3.28 3:16dc108e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.186217+0000", 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.013701574999999, 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.033383336, 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.233 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3129 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.186217+0000", 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.234 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.186217+0000", 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.186220+0000", 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1599999999999998e-06 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.192933+0000", 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0067123169999999998 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.235 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.192969+0000", 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6295999999999999e-05 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.192987+0000", 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8127000000000001e-05 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.193141+0000", 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015373200000000001 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.236 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.193407+0000", 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026666 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.193640+0000", 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023205799999999999 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.214512+0000", 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020872386999999999 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.237 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.219289+0000", 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047768819999999997 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.219471+0000", 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018253200000000001 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.219601+0000", 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000129185 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.238 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3137 3.1f e102/17 3:fb1ca43b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_82:head v 102'10, mlcod=91'8)", 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.277816+0000", 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.922102641999999, 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.035425446999999999, 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.239 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.277816+0000", 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.277816+0000", 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.277818+0000", 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.240 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287142+0000", 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0093239800000000008 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287202+0000", 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9973000000000003e-05 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287227+0000", 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5318999999999999e-05 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.241 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287457+0000", 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000229695 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287525+0000", 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7472999999999996e-05 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313147+0000", 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025621992 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.242 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313242+0000", 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5051999999999997e-05 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3210 3.1d 3:b88fb53e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.079372+0000", 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.120547120000001, 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.031525428000000001, 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.243 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3210 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.079372+0000", 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.244 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.079372+0000", 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.079376+0000", 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8970000000000001e-06 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.084609+0000", 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052335740000000004 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.245 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.084651+0000", 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1987000000000003e-05 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.084672+0000", 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.109e-05 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.084895+0000", 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223088 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.246 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085203+0000", 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030810700000000001 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085439+0000", 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023521100000000001 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.098041+0000", 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012602593 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.247 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110680+0000", 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012638883 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110819+0000", 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013931499999999999 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110897+0000", 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7682999999999995e-05 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.248 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3286 3.2a 3:56bfcbf9:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.863244+0000", 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 23.336674420000001, 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.051172150999999999, 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3286 2024-04-26T12:41:33.249 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.863244+0000", 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.863244+0000", 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.250 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.863249+0000", 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.527e-06 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867973+0000", 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047243789999999999 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868015+0000", 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2123999999999999e-05 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.251 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868040+0000", 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868204+0000", 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000164155 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op must wait for map", 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868224+0000", 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.035e-05 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.252 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.874287+0000", 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060624670000000002 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.874661+0000", 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037397 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.875046+0000", 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038517 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.253 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.887902+0000", 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012856037000000001 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.914170+0000", 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268282 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.914310+0000", 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013964700000000001 2024-04-26T12:41:33.254 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.914417+0000", 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010653 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3513 3.16 3:687ce27e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_448:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:12.954538+0000", 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.245381161000001, 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030555254, 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3513 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.954538+0000", 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.954538+0000", 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.954543+0000", 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3970000000000002e-06 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.958906+0000", 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043632100000000002 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.958942+0000", 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5355999999999998e-05 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.958957+0000", 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5733e-05 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.959102+0000", 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014497199999999999 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.959506+0000", 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040344699999999997 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.959847+0000", 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034168000000000002 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.983905+0000", 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024057490000000001 2024-04-26T12:41:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.984831+0000", 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00092625800000000001 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.985004+0000", 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017273500000000001 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.985093+0000", 2024-04-26T12:41:33.260 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8975999999999996e-05 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3514 3.16 3:6a1f3cb9:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_449:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:12.963454+0000", 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.236464349999999, 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.033068530999999998, 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.261 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3514 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.963454+0000", 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.963454+0000", 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.262 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.963459+0000", 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.967825+0000", 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043663759999999999 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.967868+0000", 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3339e-05 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.263 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.967896+0000", 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7426000000000001e-05 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.971470+0000", 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035737970000000001 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.971760+0000", 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028998499999999998 2024-04-26T12:41:33.264 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.972043+0000", 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028382400000000001 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.993145+0000", 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021101208 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.996364+0000", 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003219183 2024-04-26T12:41:33.265 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.996457+0000", 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2743000000000003e-05 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.996523+0000", 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6402999999999994e-05 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.266 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3519 3.1d 3:bbcdc9e4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_454:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.013121+0000", 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.186798198999998, 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.031095858000000001, 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3519 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.267 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.013121+0000", 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.013121+0000", 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.013123+0000", 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3369999999999998e-06 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.268 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.017897+0000", 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047737439999999999 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.017931+0000", 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3890000000000002e-05 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.017948+0000", 2024-04-26T12:41:33.269 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7499999999999998e-05 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018083+0000", 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000135112 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018350+0000", 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026652099999999998 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:33.270 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018582+0000", 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000232251 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.039842+0000", 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021259937 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.044039+0000", 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004196768 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.271 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.044136+0000", 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6978999999999994e-05 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.044216+0000", 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0819e-05 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3520 3.1d 3:ba0cfaa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_455:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:33.272 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.022168+0000", 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 20.177751106999999, 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029300574999999999, 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3520 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022168+0000", 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022168+0000", 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022180+0000", 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2656999999999999e-05 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.274 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.028839+0000", 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0066590879999999996 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.028873+0000", 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3176000000000002e-05 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.028890+0000", 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7427000000000001e-05 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.275 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029031+0000", 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014076200000000001 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029293+0000", 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026173400000000001 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029520+0000", 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000227975 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.042155+0000", 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012634506 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.051267+0000", 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091124680000000003 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.051360+0000", 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2643000000000001e-05 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.277 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.051468+0000", 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108139 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3545 3.16 3:6beecf10:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_480:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.274191+0000", 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.925727602999999, 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.037917102000000001, 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.278 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3545 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.274191+0000", 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.279 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.274191+0000", 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.274195+0000", 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4769999999999999e-06 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.278727+0000", 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045322979999999997 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.280 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.278768+0000", 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1016000000000002e-05 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.278788+0000", 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0193000000000001e-05 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.278995+0000", 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020664199999999999 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.281 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.279394+0000", 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039876199999999999 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.279814+0000", 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042025999999999999 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.296990+0000", 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017176554 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.282 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311817+0000", 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014826293000000001 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311990+0000", 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017318100000000001 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.312108+0000", 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011842599999999999 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.283 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3546 3.16 3:6af70b60:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_481:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.283056+0000", 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.916862347999999, 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.041315967000000002, 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.284 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3546 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.283056+0000", 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.283056+0000", 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.285 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.283059+0000", 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0259999999999999e-06 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289374+0000", 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0063144450000000001 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289418+0000", 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.286 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289437+0000", 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8783e-05 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289630+0000", 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019282500000000001 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289884+0000", 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025413699999999998 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.287 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.290142+0000", 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000258125 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.301595+0000", 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011452512999999999 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.324197+0000", 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022601678 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.288 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.324293+0000", 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6056000000000003e-05 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.324372+0000", 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9841999999999999e-05 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3547 3.1d 3:bad5b40c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_482:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:33.289 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.292404+0000", 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 19.907514318, 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.036950670999999997, 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3547 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.290 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.292404+0000", 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.292404+0000", 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.292407+0000", 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9569999999999998e-06 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.291 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297044+0000", 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046362189999999996 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297076+0000", 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2227000000000002e-05 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297094+0000", 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7770000000000001e-05 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.292 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297235+0000", 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014136899999999999 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297706+0000", 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047141799999999998 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298278+0000", 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00057111200000000003 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.293 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328020+0000", 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029742630999999999 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.329148+0000", 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011282740000000001 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.329248+0000", 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9421999999999998e-05 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.329355+0000", 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107272 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3736 3.38 e111/17 3:1fe78b8d:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_3:head v 111'9, mlcod=102'7)", 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:31.951990+0000", 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.247928913, 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029512449999999999, 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.295 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.951990+0000", 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.951990+0000", 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.951991+0000", 2024-04-26T12:41:33.296 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0999999999999997e-07 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960355+0000", 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083645170000000001 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960392+0000", 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6915999999999997e-05 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.297 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960415+0000", 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3366999999999998e-05 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960525+0000", 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109589 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960564+0000", 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8455999999999999e-05 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.298 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.981411+0000", 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020847626000000001 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.981502+0000", 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1168999999999994e-05 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3741 3.2 e111/17 3:43273bec:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_8:head v 111'25, mlcod=103'23)", 2024-04-26T12:41:33.299 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:32.014081+0000", 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.1858375720000001, 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.027973403000000001, 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.014081+0000", 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.300 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.014081+0000", 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.015204+0000", 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011231469999999999 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.024681+0000", 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094767629999999992 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.301 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.024865+0000", 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000183752 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.024884+0000", 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9066e-05 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.025043+0000", 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015859899999999999 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.302 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.025117+0000", 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4672000000000006e-05 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.041965+0000", 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016847933999999998 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.042055+0000", 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.9469999999999995e-05 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.303 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3742 3.22 3:4525b8bb:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:32.019996+0000", 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.1799231290000001, 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028617633999999999, 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.304 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3742 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.019996+0000", 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.019996+0000", 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.305 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.020000+0000", 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.89e-06 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028199+0000", 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081995179999999994 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028243+0000", 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4175999999999999e-05 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.306 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028269+0000", 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5846e-05 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028427+0000", 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015762600000000001 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028675+0000", 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024873899999999999 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.307 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028922+0000", 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024609799999999999 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.042779+0000", 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013857395999999999 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.048457+0000", 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056778139999999998 2024-04-26T12:41:33.308 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.048543+0000", 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5935999999999998e-05 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.048613+0000", 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0594999999999997e-05 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.309 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3764 3.1c 3:38e3bac5:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:32.269675+0000", 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.93024353800000004, 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028612426, 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3764 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.310 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.269675+0000", 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.269675+0000", 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.269678+0000", 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9229999999999998e-06 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.311 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.278797+0000", 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091184830000000001 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.278839+0000", 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1875999999999997e-05 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.278859+0000", 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0356999999999998e-05 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.312 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.278967+0000", 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010832600000000001 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.279104+0000", 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000137257 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.279234+0000", 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012919799999999999 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.313 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.289471+0000", 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010236871999999999 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.298156+0000", 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086852790000000006 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.298231+0000", 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4807000000000004e-05 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.314 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.315 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:33.315 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.298288+0000", 2024-04-26T12:41:33.315 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7048e-05 2024-04-26T12:41:33.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.315 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.315 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.315 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.315 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:33.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:41:33.317 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:33.317+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:33.317 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T12:41:33.417 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:33.415+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:33.494 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:33.494 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:33.499 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3871 3.36 3:6f995595:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:33.476672+0000", 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.023256473999999999, 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.02334294, 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "waiting for sub ops", 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3871 2024-04-26T12:41:33.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.476672+0000", 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.476672+0000", 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:33.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.476674+0000", 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3120000000000001e-06 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.480502+0000", 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003828101 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.480520+0000", 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8478000000000002e-05 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:33.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.480530+0000", 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6779999999999995e-06 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.480613+0000", 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.2813999999999997e-05 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.480815+0000", 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020204500000000001 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:33.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.481013+0000", 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019780399999999999 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.499508+0000", 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018495125000000001 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 1 2024-04-26T12:41:33.504 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:33.512 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:41:33.519 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:33.517+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:33.521 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.3 to 1 (10000) 2024-04-26T12:41:33.522 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T12:41:33.539 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:33.539 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:33.560 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-26T12:41:33.566 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:33.567 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:33.592 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:33.592 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:33.615 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:33.615 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:33.619 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:33.617+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:33.640 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:33.640 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:33.666 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:33.667 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:33.690 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:33.691 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:33.700 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:33.717 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T12:41:33.720 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:33.721+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:33.820 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:33.819+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:33.850 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:33.850 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:33.869 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:41:33.956 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:33.955+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:34.023 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:34.019+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:34.049 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:34.067 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:41:34.152 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:34.151+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:34.225 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:34.225+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:34.240 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:34.240 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:34.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:41:34.326 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:34.325+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:34.427 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:34.425+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:34.433 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:34.433 INFO:teuthology.orchestra.run.smithi131.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:34.450 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T12:41:34.516 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.4 to 1 (10000) 2024-04-26T12:41:34.528 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:34.527+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:34.548 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-26T12:41:34.620 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:34.620 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:34.629 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:34.627+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:34.642 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T12:41:34.730 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:34.727+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:34.821 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:34.822 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:34.831 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:34.829+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:34.844 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T12:41:34.932 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:34.931+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:35.033 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:35.033+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:35.051 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:35.051 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:35.069 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T12:41:35.160 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:35.161+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:35.236 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:35.235+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:35.267 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:35.267 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:35.290 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T12:41:35.377 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:35.377+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:35.438 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:35.435+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:35.472 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:35.473 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:35.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T12:41:35.523 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.5 to 1 (10000) 2024-04-26T12:41:35.539 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:35.535+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:35.548 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-26T12:41:35.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:41:35.640 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:35.637+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:35.679 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:35.679 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:35.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T12:41:35.722 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T12:41:35.741 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:35.741+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:35.842 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:35.841+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:35.913 INFO:teuthology.orchestra.run.smithi016.stdout:ERROR: (22) Invalid argument 2024-04-26T12:41:35.913 INFO:teuthology.orchestra.run.smithi016.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T12:41:35.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T12:41:35.944 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:35.941+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:35.987 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:35.987 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:36.013 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:36.014 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:36.044 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:36.044 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:36.045 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:36.043+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:36.076 INFO:teuthology.orchestra.run.smithi016.stdout:osd.3: {} 2024-04-26T12:41:36.077 INFO:teuthology.orchestra.run.smithi016.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T12:41:36.111 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:36.111 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:36.141 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:36.141 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:36.146 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:36.143+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:36.165 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:36.165 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:36.165 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:36.165 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:36.165 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:36.173 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:36.174 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:36.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T12:41:36.199 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:36.200 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:36.272 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:36.273+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:36.341 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2406 3.9 3:90cd7530:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 84.035013913, 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018915904000000001, 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.342 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2406 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.343 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306366+0000", 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.306368+0000", 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6900000000000001e-06 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.307995+0000", 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001626157 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.344 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308025+0000", 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.046e-05 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308040+0000", 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5124e-05 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308131+0000", 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0822000000000006e-05 2024-04-26T12:41:36.345 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308262+0000", 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013065200000000001 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.308404+0000", 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014262500000000001 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.346 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.313460+0000", 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050554730000000004 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325197+0000", 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011737101 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325248+0000", 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1554000000000001e-05 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.347 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.325282+0000", 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3246e-05 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2886 3.f 3:f1601af9:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_241:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.222563647999998, 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018140835000000001, 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.348 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2886 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.349 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118816+0000", 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.118818+0000", 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2400000000000002e-06 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.120998+0000", 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021794050000000001 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.350 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121023+0000", 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5063e-05 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121036+0000", 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.308e-05 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121148+0000", 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112575 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.351 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.352 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.352 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121377+0000", 2024-04-26T12:41:36.352 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00022841100000000001 2024-04-26T12:41:36.352 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.352 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.353 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.353 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.121584+0000", 2024-04-26T12:41:36.353 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00020710600000000001 2024-04-26T12:41:36.353 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.127654+0000", 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.006070069 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136884+0000", 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0092296909999999999 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136926+0000", 2024-04-26T12:41:36.354 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2215000000000002e-05 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.136957+0000", 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-05 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3064 3.9 3:9202b9a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.847398446, 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020230000000000001, 2024-04-26T12:41:36.355 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3064 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.356 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493981+0000", 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.493984+0000", 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2289999999999999e-06 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496913+0000", 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0029283989999999999 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.357 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496937+0000", 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4309999999999999e-05 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.496947+0000", 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9820000000000003e-06 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497017+0000", 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9735999999999998e-05 2024-04-26T12:41:36.358 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497139+0000", 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012228 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.497237+0000", 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8326999999999996e-05 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.502130+0000", 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048921540000000001 2024-04-26T12:41:36.359 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514064+0000", 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011933918999999999 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514147+0000", 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3065999999999994e-05 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.514211+0000", 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.4597999999999994e-05 2024-04-26T12:41:36.360 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3106 3.2e 3:75381650:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.407686791, 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020388387000000001, 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.361 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3106 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933693+0000", 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.362 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.933696+0000", 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9359999999999999e-06 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935132+0000", 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001436377 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935165+0000", 2024-04-26T12:41:36.363 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2846999999999999e-05 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935181+0000", 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6130999999999999e-05 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935260+0000", 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9042999999999995e-05 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.364 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935412+0000", 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015139299999999999 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.935526+0000", 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114076 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.940843+0000", 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0053172339999999997 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.365 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.953947+0000", 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01310396 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954024+0000", 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7657000000000005e-05 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:07.954081+0000", 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6733e-05 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.366 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3139 3.2e 3:741e0bcf:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.049828213000001, 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027404833999999999, 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.367 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3139 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291551+0000", 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.291555+0000", 2024-04-26T12:41:36.368 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2839999999999998e-06 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293141+0000", 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001586542 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293174+0000", 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2898999999999998e-05 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293190+0000", 2024-04-26T12:41:36.369 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5855999999999999e-05 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293274+0000", 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4191999999999996e-05 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293425+0000", 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015107799999999999 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:36.370 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.293532+0000", 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000106642 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.298262+0000", 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0047298749999999997 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318804+0000", 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020542525999999998 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.371 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318891+0000", 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6808e-05 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.318956+0000", 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5131999999999999e-05 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3144 3.9 3:93416909:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.995717101, 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019208350999999999, 2024-04-26T12:41:36.372 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3144 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.373 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345663+0000", 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.345666+0000", 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7359999999999999e-06 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347400+0000", 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0017342130000000001 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.374 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347434+0000", 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3559000000000002e-05 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347450+0000", 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6126000000000001e-05 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347525+0000", 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5049999999999995e-05 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.375 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347690+0000", 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016434500000000001 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.347782+0000", 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2174000000000002e-05 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.352644+0000", 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048619249999999996 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.376 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364731+0000", 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012087540000000001 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364811+0000", 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9594999999999999e-05 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.364871+0000", 2024-04-26T12:41:36.377 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0087999999999998e-05 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3178 3.9 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.609171049, 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.026775441000000001, 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.378 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3178 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732209+0000", 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.732211+0000", 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9040000000000001e-06 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734341+0000", 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002130018 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734370+0000", 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8702000000000001e-05 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.380 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734386+0000", 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5423000000000001e-05 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734474+0000", 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.8490000000000001e-05 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734656+0000", 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018186 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.381 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.734810+0000", 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015437799999999999 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740557+0000", 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057466710000000001 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758834+0000", 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018276573000000001 2024-04-26T12:41:36.382 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758919+0000", 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5350000000000001e-05 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.758984+0000", 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5072000000000003e-05 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.383 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3179 3.9 3:936f954f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.600913198000001, 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020186769, 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3179 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.384 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740466+0000", 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.740469+0000", 2024-04-26T12:41:36.385 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5019999999999999e-06 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741784+0000", 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001314824 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741812+0000", 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8731e-05 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.386 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741827+0000", 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.446e-05 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.741944+0000", 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011712100000000001 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742156+0000", 2024-04-26T12:41:36.387 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000211635 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.742381+0000", 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000225174 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.748059+0000", 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056783090000000003 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.388 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760598+0000", 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.012538396 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760628+0000", 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0278999999999999e-05 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.760653+0000", 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5338e-05 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.389 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3194 3.9 3:9016d8f2:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.444312626999999, 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01815512, 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3194 2024-04-26T12:41:36.390 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897067+0000", 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.897070+0000", 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4309999999999998e-06 2024-04-26T12:41:36.391 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898919+0000", 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018485750000000001 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898950+0000", 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1433000000000002e-05 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.898966+0000", 2024-04-26T12:41:36.392 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6011999999999998e-05 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899038+0000", 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1089999999999999e-05 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899181+0000", 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014355600000000001 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.899290+0000", 2024-04-26T12:41:36.393 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109381 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.903968+0000", 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0046775810000000001 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915142+0000", 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01117362 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.394 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915185+0000", 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.3118000000000003e-05 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.915222+0000", 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7323000000000002e-05 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3197 3.2e 3:75db4699:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.395 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.409099388000001, 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027033747, 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3197 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.396 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932280+0000", 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.932283+0000", 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.8289999999999999e-06 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.397 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933450+0000", 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001166472 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933472+0000", 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.2761000000000001e-05 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933486+0000", 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3399e-05 2024-04-26T12:41:36.398 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933566+0000", 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0669999999999998e-05 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933735+0000", 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000169087 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.933897+0000", 2024-04-26T12:41:36.399 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016202400000000001 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.938810+0000", 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049125649999999998 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959231+0000", 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020421228 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.400 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959273+0000", 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2070000000000002e-05 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.959314+0000", 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.0642000000000002e-05 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3229 3.f 3:f3b7f6e7:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.012370078, 2024-04-26T12:41:36.401 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018966246999999999, 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3229 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.402 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329010+0000", 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.329013+0000", 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0299999999999998e-06 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331482+0000", 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024695390000000002 2024-04-26T12:41:36.403 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331499+0000", 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.7175000000000001e-05 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331508+0000", 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1379999999999996e-06 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331619+0000", 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000110567 2024-04-26T12:41:36.404 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331768+0000", 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014950200000000001 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.331932+0000", 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016389900000000001 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.339084+0000", 2024-04-26T12:41:36.405 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.007151887 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347886+0000", 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.008801784 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347928+0000", 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2228999999999998e-05 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.406 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.347976+0000", 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.7497000000000003e-05 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3245 3.f 3:f14a72c5:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.837073963999998, 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018443383000000001, 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.407 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3245 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504306+0000", 2024-04-26T12:41:36.408 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.504308+0000", 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505670+0000", 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001361478 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.409 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505698+0000", 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7827999999999999e-05 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505712+0000", 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3839000000000001e-05 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505790+0000", 2024-04-26T12:41:36.410 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8775000000000004e-05 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.505941+0000", 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015073899999999999 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.506050+0000", 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010859 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.510891+0000", 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048417549999999997 2024-04-26T12:41:36.411 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522669+0000", 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011778001999999999 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522714+0000", 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4861999999999998e-05 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.522749+0000", 2024-04-26T12:41:36.412 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4745e-05 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3280 3.21 3:8431c446:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 26.547828461000002, 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018802534999999999, 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.413 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3280 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793551+0000", 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.414 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.793554+0000", 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.762e-06 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.794995+0000", 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014413270000000001 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795026+0000", 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0260000000000002e-05 2024-04-26T12:41:36.415 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795039+0000", 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3396e-05 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795124+0000", 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5165000000000002e-05 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op must wait for map", 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.795132+0000", 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.3450000000000006e-06 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.416 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.797837+0000", 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0027041750000000001 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798009+0000", 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000172456 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 1", 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.798162+0000", 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015279000000000001 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.808398+0000", 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010236263000000001 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812214+0000", 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.003816285 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812291+0000", 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7035999999999999e-05 2024-04-26T12:41:36.418 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.812354+0000", 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2274999999999996e-05 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3468 3.9 3:92d2bef4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_403:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.881371133999998, 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019140161999999999, 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.419 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3468 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460008+0000", 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.420 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.460010+0000", 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.6220000000000001e-06 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462069+0000", 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0020588350000000002 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462093+0000", 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3841000000000001e-05 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.421 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462104+0000", 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0781999999999999e-05 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462169+0000", 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5223999999999998e-05 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462310+0000", 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014092999999999999 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.422 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.462468+0000", 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015857999999999999 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.467313+0000", 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048449909999999999 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479025+0000", 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.011711408 2024-04-26T12:41:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479095+0000", 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.0562000000000006e-05 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.479149+0000", 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.3387000000000002e-05 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.424 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3490 3.9 3:90ed9f24:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_425:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.641620186000001, 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019930929, 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3490 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.425 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699759+0000", 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.699767+0000", 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1760000000000004e-06 2024-04-26T12:41:36.426 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702177+0000", 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024107909999999998 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702216+0000", 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8677000000000003e-05 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.427 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702233+0000", 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.677e-05 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702331+0000", 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.8522000000000003e-05 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702554+0000", 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000222284 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.428 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.702746+0000", 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000192165 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.711473+0000", 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0087273230000000004 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719610+0000", 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081368139999999992 2024-04-26T12:41:36.429 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719655+0000", 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5166000000000001e-05 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.719690+0000", 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5240999999999997e-05 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.430 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3498 3.9 3:90786aa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_433:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.55801482, 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.019394081000000001, 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3498 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.431 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783365+0000", 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.783369+0000", 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4780000000000002e-06 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785506+0000", 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00213635 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785535+0000", 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9730000000000002e-05 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785551+0000", 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5452e-05 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.433 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785654+0000", 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000102951 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785857+0000", 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000202785 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.785972+0000", 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011500100000000001 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.434 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.792041+0000", 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0060695999999999996 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802651+0000", 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010609726999999999 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802702+0000", 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.1304000000000002e-05 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.802759+0000", 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6703000000000002e-05 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3511 3.2e 3:76d60bde:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.403803036999999, 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020430932999999998, 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.436 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3511 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.437 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937577+0000", 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.937578+0000", 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.8759999999999999e-06 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939235+0000", 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016561989999999999 2024-04-26T12:41:36.438 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939267+0000", 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2712999999999997e-05 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939283+0000", 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5421e-05 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939362+0000", 2024-04-26T12:41:36.439 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.8752999999999996e-05 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939492+0000", 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000130844 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.939616+0000", 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012401600000000001 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.440 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.944163+0000", 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0045470329999999998 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957900+0000", 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013737047 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.957962+0000", 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1976000000000004e-05 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.958008+0000", 2024-04-26T12:41:36.441 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5055000000000001e-05 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3518 3.f 3:f20a4de4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_453:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.336943143999999, 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018842589, 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.442 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3518 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004436+0000", 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.443 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.004440+0000", 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1099999999999999e-06 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006038+0000", 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015980079999999999 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006062+0000", 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4779000000000001e-05 2024-04-26T12:41:36.444 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006075+0000", 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2782000000000001e-05 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006152+0000", 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7343999999999997e-05 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006322+0000", 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016997900000000001 2024-04-26T12:41:36.445 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.006415+0000", 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2800999999999995e-05 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.012821+0000", 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0064056770000000002 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023205+0000", 2024-04-26T12:41:36.446 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010383763000000001 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023248+0000", 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.2963000000000002e-05 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.023279+0000", 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1383000000000001e-05 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.447 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3761 3.9 3:9304abda:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:32.231291+0000", 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.1100885219999999, 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021247307, 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3761 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.448 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.231291+0000", 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.231291+0000", 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.231294+0000", 2024-04-26T12:41:36.449 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2169999999999999e-06 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.234379+0000", 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0030851680000000001 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.234410+0000", 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0889999999999997e-05 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.234423+0000", 2024-04-26T12:41:36.450 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2248e-05 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.234522+0000", 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.9794e-05 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.234756+0000", 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000234004 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.451 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.235004+0000", 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00024745099999999999 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.241364+0000", 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063601869999999998 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.252364+0000", 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010999866000000001 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.452 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.252465+0000", 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000100678 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.252538+0000", 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3804e-05 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:4095 3.9 3:93d04ba2:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_352:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:36.082510+0000", 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.258869974, 2024-04-26T12:41:36.453 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01870225, 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 4095 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.082510+0000", 2024-04-26T12:41:36.454 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.082510+0000", 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.082513+0000", 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2389999999999998e-06 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.084568+0000", 2024-04-26T12:41:36.455 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.002055585 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.084605+0000", 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.608e-05 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.084619+0000", 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4368e-05 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.084711+0000", 2024-04-26T12:41:36.456 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2e-05 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.084901+0000", 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00018988499999999999 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.085078+0000", 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017755099999999999 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:36.457 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.092923+0000", 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0078449379999999992 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.101083+0000", 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0081598720000000003 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.101155+0000", 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1989000000000005e-05 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.458 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.459 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:36.459 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.101212+0000", 2024-04-26T12:41:36.459 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.6743000000000002e-05 2024-04-26T12:41:36.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.459 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.459 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.459 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.459 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:36.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:41:36.461 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:36.461+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:36.539 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:41:36.545 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.6 to 1 (10000) 2024-04-26T12:41:36.563 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-26T12:41:36.561+0000 7f06d205f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25114) UID: 0 2024-04-26T12:41:36.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-26T12:41:36.662 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:36.659+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:36.668 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:36.668 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:4149 3.15 e116/17 3:a8e71ee5:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_406:head v 116'20, mlcod=113'18)", 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:36.660462+0000", 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.010336728, 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.010364412, 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.660462+0000", 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.669 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.660462+0000", 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.660463+0000", 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2799999999999996e-07 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.665673+0000", 2024-04-26T12:41:36.670 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052106820000000003 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.665712+0000", 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.8316999999999999e-05 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.665731+0000", 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9423999999999999e-05 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.665825+0000", 2024-04-26T12:41:36.671 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.4266999999999997e-05 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.665854+0000", 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9081000000000002e-05 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_repop(client.4382.0:4150 3.23 e116/17 3:c5f64ad7:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_407:head v 116'27, mlcod=113'25)", 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:36.667672+0000", 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.0031266000000000002, 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0032293650000000001, 2024-04-26T12:41:36.672 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "started", 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.667672+0000", 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.667672+0000", 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.673 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.667673+0000", 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1100000000000002e-07 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.668928+0000", 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0012551350000000001 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.668965+0000", 2024-04-26T12:41:36.674 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7271000000000003e-05 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.668980+0000", 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4557e-05 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.669156+0000", 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000176047 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.669188+0000", 2024-04-26T12:41:36.675 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2369999999999997e-05 2024-04-26T12:41:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: ], 2024-04-26T12:41:36.676 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 2 2024-04-26T12:41:36.676 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:36.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T12:41:36.788 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:36.789+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:36.864 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:36.861+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:36.892 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:36.892 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:41:36.892 INFO:teuthology.orchestra.run.smithi016.stdout: "complaint_time": 30, 2024-04-26T12:41:36.892 INFO:teuthology.orchestra.run.smithi016.stdout: "num_blocked_ops": 0 2024-04-26T12:41:36.892 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:36.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T12:41:36.965 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:36.963+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:37.066 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:37.063+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:37.106 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:41:37.106 INFO:teuthology.orchestra.run.smithi016.stdout: "size": 20, 2024-04-26T12:41:37.106 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 600, 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [ 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2400 3.27 3:e7cd00f4:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 84.855663992000004, 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023524092999999999, 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.107 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2400 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249820+0000", 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.108 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.249823+0000", 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3539999999999998e-06 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251512+0000", 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016892509999999999 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251537+0000", 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5386000000000001e-05 2024-04-26T12:41:37.109 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251548+0000", 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0451e-05 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251614+0000", 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6068999999999994e-05 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.110 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251771+0000", 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156699 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.251873+0000", 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010278200000000001 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.256261+0000", 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004387798 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.111 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273218+0000", 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016956751999999999 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273292+0000", 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.3658999999999994e-05 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.273345+0000", 2024-04-26T12:41:37.112 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2892000000000001e-05 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2421 3.27 3:e4730393:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 84.621001199999995, 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022458603000000001, 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.113 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2421 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484483+0000", 2024-04-26T12:41:37.114 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.484486+0000", 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4499999999999998e-06 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486180+0000", 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001693782 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.115 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486210+0000", 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0660000000000001e-05 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486221+0000", 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1301000000000001e-05 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486301+0000", 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9682e-05 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.116 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486476+0000", 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017474100000000001 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.486638+0000", 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000162096 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.493366+0000", 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0067281069999999997 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.117 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506837+0000", 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013470841000000001 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506897+0000", 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0031999999999997e-05 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:12.506942+0000", 2024-04-26T12:41:37.118 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.4910999999999997e-05 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:2890 3.2 3:422e89e2:::d749f084-3851-4e95-9492-490675b43f90.4382.10__shadow_.AjyVjDEEATSQMcJtuqDygF7D8e8nokx_245:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 47.934032588999997, 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023228242999999999, 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.119 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 2890 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171452+0000", 2024-04-26T12:41:37.120 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.171455+0000", 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.1370000000000002e-06 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175884+0000", 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044289400000000001 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175931+0000", 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.71e-05 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.175950+0000", 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9153000000000001e-05 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176035+0000", 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.4580999999999995e-05 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.122 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176145+0000", 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010970499999999999 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.176237+0000", 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2898000000000004e-05 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.180690+0000", 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044521550000000002 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.123 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194585+0000", 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013895286 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194646+0000", 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.0927000000000001e-05 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:40:49.194680+0000", 2024-04-26T12:41:37.124 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4360999999999998e-05 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3122 3.29 3:951a57de:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 28.995165290999999, 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021821106, 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.125 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3122 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110319+0000", 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.126 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.110322+0000", 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.632e-06 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112021+0000", 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016992789999999999 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112052+0000", 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0525000000000003e-05 2024-04-26T12:41:37.127 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112064+0000", 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2768e-05 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112173+0000", 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108119 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112424+0000", 2024-04-26T12:41:37.128 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00025160699999999999 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.112569+0000", 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000144888 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.118043+0000", 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0054735959999999998 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132056+0000", 2024-04-26T12:41:37.129 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014013146000000001 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132105+0000", 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8909000000000002e-05 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:08.132140+0000", 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.5636999999999998e-05 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.130 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3236 3.7 3:e0b2f0ce:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.693921948, 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025042014000000001, 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3236 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.131 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411563+0000", 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.411565+0000", 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.4849999999999999e-06 2024-04-26T12:41:37.132 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412947+0000", 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0013823349999999999 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412981+0000", 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3386000000000002e-05 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.133 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.412996+0000", 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5610000000000001e-05 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413076+0000", 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.9488999999999997e-05 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413247+0000", 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017079199999999999 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.134 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.413355+0000", 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000108824 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.418245+0000", 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0048893299999999999 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436492+0000", 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.018247368999999999 2024-04-26T12:41:37.135 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436567+0000", 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4802000000000007e-05 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.436605+0000", 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.7592000000000002e-05 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.136 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3250 3.33 3:cf65c941:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 27.540292474000001, 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022851729000000001, 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3250 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.137 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565192+0000", 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.138 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.565195+0000", 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0979999999999998e-06 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567117+0000", 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0019217570000000001 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567143+0000", 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6321000000000001e-05 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.139 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567158+0000", 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4712000000000001e-05 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567244+0000", 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.6583999999999996e-05 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567400+0000", 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00015599099999999999 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.140 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.567575+0000", 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017444199999999999 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.574382+0000", 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0068072660000000002 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587935+0000", 2024-04-26T12:41:37.141 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.013552899 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.587991+0000", 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.5927999999999997e-05 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:09.588044+0000", 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2731e-05 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.142 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3467 3.2 3:4067df0c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 24.658238084000001, 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023170046999999999, 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3467 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.143 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447246+0000", 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.447249+0000", 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9960000000000002e-06 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.144 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449053+0000", 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018033369999999999 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449080+0000", 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7608999999999999e-05 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449094+0000", 2024-04-26T12:41:37.145 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3689999999999999e-05 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449175+0000", 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0655999999999995e-05 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449305+0000", 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00012987400000000001 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:37.146 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.449412+0000", 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010741799999999999 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.454641+0000", 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0052287130000000003 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470316+0000", 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015674837 2024-04-26T12:41:37.147 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470362+0000", 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.5998999999999998e-05 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:12.470416+0000", 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4917999999999998e-05 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.148 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3534 3.7 3:e277469f:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_469:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.94260006, 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.027785351999999999, 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3534 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.149 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162884+0000", 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.162887+0000", 2024-04-26T12:41:37.150 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6230000000000001e-06 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165295+0000", 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0024080019999999998 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165329+0000", 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3800000000000002e-05 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.151 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165344+0000", 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.5310000000000001e-05 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165433+0000", 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.9015000000000001e-05 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165609+0000", 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000175809 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.152 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.165785+0000", 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000176515 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.170217+0000", 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0044311979999999999 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190550+0000", 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.020333235000000002 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.153 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190604+0000", 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.4026000000000001e-05 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.190670+0000", 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5819000000000001e-05 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3540 3.33 3:ccf326fe:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_475:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.881818464999998, 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022822643, 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3540 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.155 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223666+0000", 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.223669+0000", 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9849999999999998e-06 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.156 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225528+0000", 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001859461 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225554+0000", 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5609000000000002e-05 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225567+0000", 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3326000000000001e-05 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.157 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225645+0000", 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.7880000000000007e-05 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225758+0000", 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000112355 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.225854+0000", 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.6059999999999998e-05 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.158 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.231841+0000", 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0059873219999999998 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246370+0000", 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014528983000000001 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246436+0000", 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.5889999999999994e-05 2024-04-26T12:41:37.159 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.246489+0000", 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2772000000000002e-05 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3553 3.7 3:e09c7e82:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_488:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 23.743499058000001, 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023273085999999998, 2024-04-26T12:41:37.160 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3553 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.161 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361985+0000", 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.361988+0000", 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.17e-06 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363819+0000", 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0018314119999999999 2024-04-26T12:41:37.162 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363847+0000", 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7549999999999999e-05 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363861+0000", 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4127999999999999e-05 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.363927+0000", 2024-04-26T12:41:37.163 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.6342999999999998e-05 2024-04-26T12:41:37.164 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.166 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.166 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364037+0000", 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000109503 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.364138+0000", 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101734 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.368455+0000", 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.004317212 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.167 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385075+0000", 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.016619425 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385182+0000", 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010734 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:13.385259+0000", 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.6268999999999998e-05 2024-04-26T12:41:37.168 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3735 3.1e 3:79e5fddb:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:31.927741+0000", 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.1777439379999999, 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025205489000000001, 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.169 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.170 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.170 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.170 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.170 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.170 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3735 2024-04-26T12:41:37.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.171 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.171 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.171 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.171 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.927741+0000", 2024-04-26T12:41:37.171 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.171 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.927741+0000", 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.927743+0000", 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1490000000000001e-06 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.930587+0000", 2024-04-26T12:41:37.172 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0028438159999999999 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.930614+0000", 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7095999999999999e-05 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.930625+0000", 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.182e-05 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.173 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.930706+0000", 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.085e-05 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.930846+0000", 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014001899999999999 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.931003+0000", 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000156496 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.174 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.937396+0000", 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0063930699999999998 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.952819+0000", 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015422709999999999 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.952888+0000", 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.9284999999999998e-05 2024-04-26T12:41:37.175 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.952946+0000", 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.8177999999999998e-05 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3736 3.38 3:1fe78b8d:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:31.950481+0000", 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.1550035340000004, 2024-04-26T12:41:37.176 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.033127835000000001, 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3736 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.950481+0000", 2024-04-26T12:41:37.177 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.950481+0000", 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.950483+0000", 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.007e-06 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.178 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.952636+0000", 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0021525749999999999 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.952663+0000", 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7591999999999999e-05 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.952676+0000", 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2439999999999999e-05 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.952777+0000", 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000101195 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.953066+0000", 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00028936400000000002 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.953377+0000", 2024-04-26T12:41:37.180 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00031075800000000001 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.961584+0000", 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0082074320000000006 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.983500+0000", 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021915653 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.181 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.983560+0000", 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.9589999999999997e-05 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:31.983609+0000", 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9228999999999999e-05 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.182 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3741 3.2 3:43273bec:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:32.013056+0000", 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 5.0924285439999997, 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.030930664, 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3741 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.183 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.013056+0000", 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.013056+0000", 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.013059+0000", 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7269999999999999e-06 2024-04-26T12:41:37.184 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.014563+0000", 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0015040400000000001 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.014591+0000", 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7994999999999999e-05 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.014604+0000", 2024-04-26T12:41:37.185 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.3098000000000001e-05 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.014675+0000", 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1573000000000001e-05 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.014789+0000", 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011400099999999999 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:37.186 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.014897+0000", 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010775700000000001 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.019057+0000", 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0041595920000000002 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.043923+0000", 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.024866652 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.187 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.043960+0000", 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.6189999999999997e-05 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.043987+0000", 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7039e-05 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.188 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3753 3.29 3:957094bb:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:32.141525+0000", 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.9639591709999999, 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025504056000000001, 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3753 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.189 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.141525+0000", 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.141525+0000", 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.141528+0000", 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.0520000000000002e-06 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.190 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.143193+0000", 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0016649220000000001 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.143221+0000", 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.7946e-05 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.143233+0000", 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2159e-05 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.191 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.143308+0000", 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.5030999999999994e-05 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.143431+0000", 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000122588 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.143567+0000", 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00013569299999999999 2024-04-26T12:41:37.192 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.149300+0000", 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0057337409999999997 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.166914+0000", 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017613924 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.193 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.166977+0000", 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.2586e-05 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.167029+0000", 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.2414000000000003e-05 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:3760 3.7 3:e08a08ff:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:32.218053+0000", 2024-04-26T12:41:37.194 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 4.8874316450000004, 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023145206000000002, 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 3760 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.218053+0000", 2024-04-26T12:41:37.195 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.218053+0000", 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.218054+0000", 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.621e-06 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.196 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.220038+0000", 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001983809 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.220072+0000", 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3923e-05 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.220089+0000", 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.666e-05 2024-04-26T12:41:37.197 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.220190+0000", 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00010104500000000001 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.220404+0000", 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000214162 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.220549+0000", 2024-04-26T12:41:37.198 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014492500000000001 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.226293+0000", 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.005744084 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.241087+0000", 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014794264999999999 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.199 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.241149+0000", 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.1987000000000001e-05 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:32.241198+0000", 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.8724999999999999e-05 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:4114 3.2 3:4166bd80:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_371:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:36.281140+0000", 2024-04-26T12:41:37.200 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.82434439199999998, 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.02557624, 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 4114 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.201 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.281140+0000", 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.281140+0000", 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.281143+0000", 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5569999999999998e-06 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.283442+0000", 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022998179999999999 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.283476+0000", 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.3127999999999999e-05 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.283490+0000", 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.4533e-05 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.203 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.283572+0000", 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.2268999999999994e-05 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.283739+0000", 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00016697700000000001 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.283847+0000", 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000107438 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.204 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.289456+0000", 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056092319999999996 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.306633+0000", 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.017177090999999998 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.306682+0000", 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9078e-05 2024-04-26T12:41:37.205 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.306716+0000", 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.4119000000000003e-05 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:4117 3.33 3:ccfcff15:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_374:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:36.309462+0000", 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.79602211300000003, 2024-04-26T12:41:37.206 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.023909613999999999, 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 4117 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.309462+0000", 2024-04-26T12:41:37.207 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.309462+0000", 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.309464+0000", 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.9980000000000002e-06 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.208 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.311096+0000", 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001631455 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.311121+0000", 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.5048000000000001e-05 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.311133+0000", 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.2636999999999999e-05 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.209 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.311219+0000", 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.5878999999999995e-05 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.311413+0000", 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000193248 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.311591+0000", 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017812700000000001 2024-04-26T12:41:37.210 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.317249+0000", 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0056579739999999996 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.333240+0000", 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01599153 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.333315+0000", 2024-04-26T12:41:37.211 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.4497000000000002e-05 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.333372+0000", 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 5.7221e-05 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:4125 3.33 3:cfb05feb:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:36.394281+0000", 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.71120304899999998, 2024-04-26T12:41:37.212 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.022037786, 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 4125 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.394281+0000", 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.213 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.394281+0000", 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.394285+0000", 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 3.2820000000000001e-06 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.395762+0000", 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0014769620000000001 2024-04-26T12:41:37.214 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.395791+0000", 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.9716000000000001e-05 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.395803+0000", 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.1782e-05 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.395891+0000", 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.7631000000000002e-05 2024-04-26T12:41:37.215 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.396030+0000", 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000138825 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.396144+0000", 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.000114497 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.400537+0000", 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043928509999999997 2024-04-26T12:41:37.216 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.416160+0000", 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.015623243 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.416251+0000", 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.1148000000000002e-05 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.416319+0000", 2024-04-26T12:41:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 6.7848999999999994e-05 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:4126 3.24 3:2529329f:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_383:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:36.404296+0000", 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.70118869699999997, 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.021553032999999999, 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 4126 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.404296+0000", 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.404296+0000", 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.219 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.404298+0000", 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.368e-06 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.406541+0000", 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0022430589999999999 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.406563+0000", 2024-04-26T12:41:37.220 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.1957e-05 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.406572+0000", 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.2010000000000005e-06 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.406663+0000", 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.0688999999999999e-05 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.221 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.406808+0000", 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014517800000000001 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.406979+0000", 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00017044 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.412038+0000", 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0050589329999999998 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.222 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.425679+0000", 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.01364158 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.425777+0000", 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 9.7675000000000002e-05 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.425849+0000", 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 7.1952999999999994e-05 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.223 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "description": "osd_op(client.4382.0:4137 3.7 3:e11d55dd:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_394:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "initiated_at": "2024-04-26T12:41:36.523261+0000", 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "age": 0.582223343, 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.025364164000000002, 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "continuous": false, 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "type_data": { 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "client_info": { 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "client": "client.4382", 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "tid": 4137 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: "events": [ 2024-04-26T12:41:37.224 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "initiated", 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.523261+0000", 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "header_read", 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.523261+0000", 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "throttled", 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.523264+0000", 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.6280000000000001e-06 2024-04-26T12:41:37.225 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "all_read", 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.524612+0000", 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.001348517 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "dispatched", 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.524636+0000", 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 2.3825999999999999e-05 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.524647+0000", 2024-04-26T12:41:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 1.0594000000000001e-05 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "reached_pg", 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.524727+0000", 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 8.0005000000000004e-05 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "started", 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.524869+0000", 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00014193800000000001 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.227 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.524982+0000", 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.00011372 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "op_commit", 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.529921+0000", 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0049386960000000002 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.544240+0000", 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.014318482 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "commit_sent", 2024-04-26T12:41:37.228 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.548576+0000", 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 0.0043365929999999997 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: "event": "done", 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: "time": "2024-04-26T12:41:36.548625+0000", 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: "duration": 4.9165000000000001e-05 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-04-26T12:41:37.229 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:41:37.231 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T12:41:37.231 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-26T12:41:37.229+0000 7fb219421640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25117) UID: 0 2024-04-26T12:41:37.331 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:37.327+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:37.392 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:37.393 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:37.393 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.393 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:4217 3.1d e116/17 3:b9071dae:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_474:head v 116'37, mlcod=116'35)", 2024-04-26T12:41:37.393 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:37.385495+0000", 2024-04-26T12:41:37.393 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.0072256830000000001, 2024-04-26T12:41:37.393 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0072731860000000001, 2024-04-26T12:41:37.394 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.394 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.394 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "started", 2024-04-26T12:41:37.394 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.394 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.394 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.385495+0000", 2024-04-26T12:41:37.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.395 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.395 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.395 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.385495+0000", 2024-04-26T12:41:37.395 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.396 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.396 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.396 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.385496+0000", 2024-04-26T12:41:37.396 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.4720000000000001e-06 2024-04-26T12:41:37.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.397 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.397 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.388649+0000", 2024-04-26T12:41:37.397 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031525239999999999 2024-04-26T12:41:37.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.397 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.398 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.388671+0000", 2024-04-26T12:41:37.398 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2427000000000001e-05 2024-04-26T12:41:37.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.398 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.398 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.388685+0000", 2024-04-26T12:41:37.399 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3431999999999999e-05 2024-04-26T12:41:37.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.399 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.399 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.399 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.388778+0000", 2024-04-26T12:41:37.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3171999999999995e-05 2024-04-26T12:41:37.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.400 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.400 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.400 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.388808+0000", 2024-04-26T12:41:37.400 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0422000000000001e-05 2024-04-26T12:41:37.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.401 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.401 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2024-04-26T12:41:37.401 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 1 2024-04-26T12:41:37.401 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:37.415 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T12:41:37.460 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-04-26T12:41:37.459+0000 7f33a2be4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25343) UID: 0 2024-04-26T12:41:37.533 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:37.531+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:37.541 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.7 to 1 (10000) 2024-04-26T12:41:37.573 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:41:37.573 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:41:37.592 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:37.592 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:37.592 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:41:37.592 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:41:37.592 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:37.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T12:41:37.634 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-26T12:41:37.633+0000 7ff0ad8e4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25116) UID: 0 2024-04-26T12:41:37.735 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:37.731+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:37.747 INFO:tasks.workunit.client.0.smithi016.stdout:quota disabled for the bucket: buck_2024_03_26_12_41_27 2024-04-26T12:41:37.747 INFO:tasks.workunit.client.0.smithi016.stdout:adding file to bucket: 2Gb. 2024-04-26T12:41:37.747 INFO:tasks.workunit.client.0.smithi016.stdout:upload file successful 2024-04-26T12:41:37.747 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:41:37.747 INFO:tasks.workunit.client.0.smithi016.stdout:Test case: PASSED - bucket quota size for a given user doesnt take effect when quota is disabled 2024-04-26T12:41:37.747 INFO:tasks.workunit.client.0.smithi016.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-26T12:41:37.784 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:37.784 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:41:37.784 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:41:37.784 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:37.784 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2373 3.13 e73/17 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head v 73'1, mlcod=0'0)", 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.813821223000005, 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022675594, 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:37.785 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967991+0000", 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967994+0000", 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1499999999999999e-06 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.786 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972459+0000", 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044650549999999999 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972497+0000", 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8559000000000001e-05 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972517+0000", 2024-04-26T12:41:37.787 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9769e-05 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972676+0000", 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015888299999999999 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.972734+0000", 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8075000000000002e-05 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990560+0000", 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017825998999999999 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.990666+0000", 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000106104 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:2399 3.1d e73/17 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head v 73'6, mlcod=72'4)", 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 85.537136552000007, 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023526478, 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244675+0000", 2024-04-26T12:41:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244678+0000", 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2330000000000001e-06 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247922+0000", 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032442360000000002 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247961+0000", 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9229e-05 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.247979+0000", 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8085999999999999e-05 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248140+0000", 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016071600000000001 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.248200+0000", 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.0569000000000002e-05 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268024+0000", 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01982343 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268202+0000", 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017797900000000001 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3060 3.11 e102/17 3:884a83fa:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_5:head v 102'6, mlcod=90'4)", 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 30.325500767000001, 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023109461000000001, 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456311+0000", 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.456312+0000", 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.8699999999999995e-07 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458724+0000", 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0024121659999999999 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458750+0000", 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6208999999999999e-05 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458762+0000", 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1956e-05 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458869+0000", 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010719 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.458909+0000", 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9614999999999999e-05 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.479268+0000", 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020358885 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.479421+0000", 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015285299999999999 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3138 3.11 e102/17 3:880b1c25:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_83:head v 102'7, mlcod=91'5)", 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.493254587999999, 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024448279999999999, 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288557+0000", 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288560+0000", 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8169999999999999e-06 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291885+0000", 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033250419999999998 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291935+0000", 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.9709999999999997e-05 2024-04-26T12:41:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.291955+0000", 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9683000000000001e-05 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.292129+0000", 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000174432 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.292195+0000", 2024-04-26T12:41:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.5889000000000006e-05 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.312782+0000", 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020587215999999998 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313006+0000", 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022349100000000001 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3178 3.9 e102/31 3:92a5cdbd:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_123:head v 102'13, mlcod=102'11)", 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.048410465, 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023424759999999999, 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733401+0000", 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.733404+0000", 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1940000000000001e-06 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.804 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738411+0000", 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050070699999999998 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738447+0000", 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6380000000000001e-05 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738465+0000", 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8255999999999999e-05 2024-04-26T12:41:37.805 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738601+0000", 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013597899999999999 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.738647+0000", 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.5293000000000002e-05 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.806 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.756721+0000", 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018074446000000001 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.756826+0000", 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105142 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3210 3.1d e102/17 3:b88fb53e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_155:head v 102'16, mlcod=102'14)", 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:37.807 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.696142704, 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024571928999999999, 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085669+0000", 2024-04-26T12:41:37.808 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085673+0000", 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.36e-06 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091170+0000", 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054978630000000004 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.809 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091212+0000", 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2129000000000003e-05 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091238+0000", 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5720000000000001e-05 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091395+0000", 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015645200000000001 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.810 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.091437+0000", 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2199e-05 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110109+0000", 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018672040000000001 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110241+0000", 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013216599999999999 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.811 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3284 3.1b e103/17 3:db1037a6:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_219:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.937374254000002, 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022520861, 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.812 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844438+0000", 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844439+0000", 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.1769999999999999e-06 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850076+0000", 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056371140000000004 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850105+0000", 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8975999999999998e-05 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850124+0000", 2024-04-26T12:41:37.814 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8827000000000001e-05 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850266+0000", 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142516 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.850305+0000", 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8859000000000002e-05 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.866786+0000", 2024-04-26T12:41:37.815 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016480660000000001 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.866958+0000", 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017273200000000001 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3283 3.e e103/17 3:7042574b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_218:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.937175248999999, 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023100175000000001, 2024-04-26T12:41:37.816 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.817 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844637+0000", 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4700000000000001e-07 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847832+0000", 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031949299999999999 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847880+0000", 2024-04-26T12:41:37.818 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7806000000000003e-05 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.847906+0000", 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.6205999999999999e-05 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.848086+0000", 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017921899999999999 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.819 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.848154+0000", 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8485999999999994e-05 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867575+0000", 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019420823 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867737+0000", 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161958 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.820 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3285 3.f e103/41 3:f2e9bdba:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_220:head v 103'11, mlcod=102'9)", 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.926904706999998, 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021900076000000001, 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.821 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854907+0000", 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.854908+0000", 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1999999999999998e-07 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860748+0000", 2024-04-26T12:41:37.822 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0058394420000000002 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860782+0000", 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4162999999999998e-05 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860800+0000", 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7963000000000001e-05 2024-04-26T12:41:37.823 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.860972+0000", 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017237200000000001 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.861039+0000", 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7182999999999997e-05 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.824 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.876678+0000", 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015639304999999999 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.876807+0000", 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012872799999999999 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3287 3.e e103/17 3:71707d61:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_222:head v 103'12, mlcod=102'10)", 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.902789000999999, 2024-04-26T12:41:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024816290000000001, 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879023+0000", 2024-04-26T12:41:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879027+0000", 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0659999999999997e-06 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881632+0000", 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0026051999999999998 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881669+0000", 2024-04-26T12:41:37.827 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7345999999999998e-05 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881688+0000", 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.878e-05 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881893+0000", 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020426099999999999 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.828 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.881931+0000", 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8940000000000003e-05 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.903684+0000", 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021752187999999999 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.903839+0000", 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015550899999999999 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.829 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3288 3.34 e103/31 3:2f2ab73e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_223:head v 103'10, mlcod=102'8)", 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 27.893235754999999, 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022389650000000001, 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:37.830 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888576+0000", 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.888579+0000", 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5229999999999998e-06 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891518+0000", 2024-04-26T12:41:37.831 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.002939218 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891549+0000", 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0954000000000002e-05 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891570+0000", 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1229e-05 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.832 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891703+0000", 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013248099999999999 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.891756+0000", 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3542999999999999e-05 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.910882+0000", 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019125860000000001 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.833 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.910966+0000", 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.3842000000000001e-05 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3519 3.1d e104/17 3:bbcdc9e4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_454:head v 104'18, mlcod=102'16)", 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.762908973000002, 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024779148000000001, 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.834 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018903+0000", 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018904+0000", 2024-04-26T12:41:37.835 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0999999999999998e-07 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022336+0000", 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0034327490000000001 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022376+0000", 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9443000000000002e-05 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022400+0000", 2024-04-26T12:41:37.836 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4280000000000001e-05 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022546+0000", 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014610799999999999 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022600+0000", 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3483000000000003e-05 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.837 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.043590+0000", 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020990609 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.043682+0000", 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1766000000000002e-05 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3528 3.31 e104/17 3:8ff53833:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_463:head v 104'22, mlcod=103'20)", 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:37.838 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.676900251999999, 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026837514999999999, 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.104912+0000", 2024-04-26T12:41:37.839 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.105724+0000", 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00081230199999999999 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111099+0000", 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0053747309999999998 2024-04-26T12:41:37.840 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111142+0000", 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3396000000000003e-05 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111165+0000", 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3070000000000001e-05 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111347+0000", 2024-04-26T12:41:37.841 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018210500000000001 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.111419+0000", 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1493000000000001e-05 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.130996+0000", 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019577719 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.842 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.131749+0000", 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00075269900000000001 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3547 3.1d e104/17 3:bad5b40c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_482:head v 104'21, mlcod=104'19)", 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.483299741, 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030273893999999999, 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.843 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298512+0000", 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298515+0000", 2024-04-26T12:41:37.844 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.734e-06 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303081+0000", 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045658840000000001 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303132+0000", 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1053000000000001e-05 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.845 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303167+0000", 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5583000000000001e-05 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303397+0000", 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022938799999999999 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.303471+0000", 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4591999999999993e-05 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.846 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328651+0000", 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025179983999999999 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328786+0000", 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000134676 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3548 3.11 e104/17 3:8824d90c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_483:head v 104'15, mlcod=103'13)", 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:37.847 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 24.474658761000001, 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023247721999999998, 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307153+0000", 2024-04-26T12:41:37.848 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.307157+0000", 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4939999999999999e-06 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311400+0000", 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0042435040000000004 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311434+0000", 2024-04-26T12:41:37.849 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3507999999999998e-05 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311452+0000", 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8253999999999998e-05 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311600+0000", 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014853300000000001 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.850 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311640+0000", 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9585999999999997e-05 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.330239+0000", 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018598607999999999 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.330401+0000", 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016223499999999999 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.851 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3753 3.29 e111/17 3:957094bb:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_20:head v 111'11, mlcod=103'9)", 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:32.142073+0000", 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 5.6397387949999995, 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022934208000000001, 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.142073+0000", 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.852 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.142073+0000", 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.142074+0000", 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7599999999999997e-07 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.147776+0000", 2024-04-26T12:41:37.853 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005702787 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.147808+0000", 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1473999999999997e-05 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.147825+0000", 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7169000000000001e-05 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.854 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.147960+0000", 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013469900000000001 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.148003+0000", 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.299e-05 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.164938+0000", 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016934864000000001 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.855 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.165007+0000", 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9648999999999997e-05 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:4107 3.1a e115/31 3:5b1a58da:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_364:head v 115'18, mlcod=114'16)", 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:36.211145+0000", 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.5706663810000001, 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021799671, 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.856 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.211145+0000", 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.211145+0000", 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.211149+0000", 2024-04-26T12:41:37.857 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4699999999999998e-06 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.218264+0000", 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0071147149999999998 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.218298+0000", 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4765999999999999e-05 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.218316+0000", 2024-04-26T12:41:37.858 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7156999999999999e-05 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.218471+0000", 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015515200000000001 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.218539+0000", 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.8028999999999995e-05 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.859 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.232835+0000", 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014295976 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.232945+0000", 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000110406 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:4108 3.1d e115/17 3:bb73286d:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_365:head v 115'33, mlcod=115'31)", 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:36.225299+0000", 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.5565130200000001, 2024-04-26T12:41:37.860 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025360568, 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.225299+0000", 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.225299+0000", 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.225302+0000", 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7700000000000002e-06 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.228641+0000", 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0033393749999999999 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.228678+0000", 2024-04-26T12:41:37.862 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7234000000000003e-05 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.228697+0000", 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9233e-05 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.228861+0000", 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000164048 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.228907+0000", 2024-04-26T12:41:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6e-05 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.250521+0000", 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021613670000000001 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.250659+0000", 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000138238 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:4202 3.31 e116/17 3:8c960114:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_459:head v 116'24, mlcod=104'22)", 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:37.235985+0000", 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.54582691699999997, 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024428096, 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.235985+0000", 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.865 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.235985+0000", 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.235988+0000", 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7080000000000002e-06 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.240836+0000", 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048488280000000003 2024-04-26T12:41:37.866 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.240859+0000", 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.2829000000000001e-05 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.240873+0000", 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.3947999999999999e-05 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.241013+0000", 2024-04-26T12:41:37.867 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000140211 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.241053+0000", 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9159000000000002e-05 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.260172+0000", 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.019119139 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.868 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.260413+0000", 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024127400000000001 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:4207 3.13 e116/17 3:c963ab58:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_464:head v 116'17, mlcod=115'15)", 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:37.294069+0000", 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 0.48774315299999998, 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.032860546999999997, 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:37.869 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.294069+0000", 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.294069+0000", 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.294072+0000", 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.14e-06 2024-04-26T12:41:37.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.297001+0000", 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0029290660000000001 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.297043+0000", 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2466000000000003e-05 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.297062+0000", 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8870000000000001e-05 2024-04-26T12:41:37.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.297224+0000", 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000161478 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.297288+0000", 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4219000000000003e-05 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.326811+0000", 2024-04-26T12:41:37.872 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029523032000000001 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.326929+0000", 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118276 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:37.873 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:37.875 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T12:41:37.875 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:37.871+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:37.911 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:41:37.917 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:41:37.928 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-04-26T12:41:37.545190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4518120689,"num_objects":1290,"num_object_clones":0,"num_object_copies":2580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1290,"num_whiteouts":0,"num_read":3141,"num_read_kb":2832,"num_write":2373,"num_write_kb":4442890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3381,"ondisk_log_size":3381,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8675252,"kb_used_data":8405060,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":746299468,"statfs":{"total":773094113280,"available":764210655232,"internally_reserved":0,"allocated":8606781440,"data_stored":8602071434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.030023"},"pg_stats":[{"pgid":"3.3f","version":"104'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.533822+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:41:32.533822+0000","last_peered":"2024-04-26T12:41:32.533822+0000","last_clean":"2024-04-26T12:41:32.533822+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:41:32.533822+0000","last_undegraded":"2024-04-26T12:41:32.533822+0000","last_fullsized":"2024-04-26T12:41:32.533822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"108'5","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510293+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:41:32.510293+0000","last_peered":"2024-04-26T12:41:32.510293+0000","last_clean":"2024-04-26T12:41:32.510293+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:41:32.510293+0000","last_undegraded":"2024-04-26T12:41:32.510293+0000","last_fullsized":"2024-04-26T12:41:32.510293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"111'12","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493972+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:41:32.493972+0000","last_peered":"2024-04-26T12:41:32.493972+0000","last_clean":"2024-04-26T12:41:32.493972+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:41:32.493972+0000","last_undegraded":"2024-04-26T12:41:32.493972+0000","last_fullsized":"2024-04-26T12:41:32.493972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527900+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:41:32.527900+0000","last_peered":"2024-04-26T12:41:32.527900+0000","last_clean":"2024-04-26T12:41:32.527900+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:41:32.527900+0000","last_undegraded":"2024-04-26T12:41:32.527900+0000","last_fullsized":"2024-04-26T12:41:32.527900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'13","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552071+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:41:32.552071+0000","last_peered":"2024-04-26T12:41:32.552071+0000","last_clean":"2024-04-26T12:41:32.552071+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:41:32.552071+0000","last_undegraded":"2024-04-26T12:41:32.552071+0000","last_fullsized":"2024-04-26T12:41:32.552071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":170,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551501+0000","last_change":"2024-04-26T12:38:32.099160+0000","last_active":"2024-04-26T12:41:32.551501+0000","last_peered":"2024-04-26T12:41:32.551501+0000","last_clean":"2024-04-26T12:41:32.551501+0000","last_became_active":"2024-04-26T12:38:32.093033+0000","last_became_peered":"2024-04-26T12:38:32.093033+0000","last_unstale":"2024-04-26T12:41:32.551501+0000","last_undegraded":"2024-04-26T12:41:32.551501+0000","last_fullsized":"2024-04-26T12:41:32.551501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:22.221188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"112'23","reported_seq":222,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.512727+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:41:32.512727+0000","last_peered":"2024-04-26T12:41:32.512727+0000","last_clean":"2024-04-26T12:41:32.512727+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:41:32.512727+0000","last_undegraded":"2024-04-26T12:41:32.512727+0000","last_fullsized":"2024-04-26T12:41:32.512727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":193,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551321+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:41:32.551321+0000","last_peered":"2024-04-26T12:41:32.551321+0000","last_clean":"2024-04-26T12:41:32.551321+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:41:32.551321+0000","last_undegraded":"2024-04-26T12:41:32.551321+0000","last_fullsized":"2024-04-26T12:41:32.551321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"112'18","reported_seq":215,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.662493+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:41:32.662493+0000","last_peered":"2024-04-26T12:41:32.662493+0000","last_clean":"2024-04-26T12:41:32.662493+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:41:32.662493+0000","last_undegraded":"2024-04-26T12:41:32.662493+0000","last_fullsized":"2024-04-26T12:41:32.662493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563799+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:41:32.563799+0000","last_peered":"2024-04-26T12:41:32.563799+0000","last_clean":"2024-04-26T12:41:32.563799+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:41:32.563799+0000","last_undegraded":"2024-04-26T12:41:32.563799+0000","last_fullsized":"2024-04-26T12:41:32.563799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"112'16","reported_seq":166,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.576813+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:41:32.576813+0000","last_peered":"2024-04-26T12:41:32.576813+0000","last_clean":"2024-04-26T12:41:32.576813+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:41:32.576813+0000","last_undegraded":"2024-04-26T12:41:32.576813+0000","last_fullsized":"2024-04-26T12:41:32.576813+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":187,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552042+0000","last_change":"2024-04-26T12:38:32.092960+0000","last_active":"2024-04-26T12:41:32.552042+0000","last_peered":"2024-04-26T12:41:32.552042+0000","last_clean":"2024-04-26T12:41:32.552042+0000","last_became_active":"2024-04-26T12:38:32.092562+0000","last_became_peered":"2024-04-26T12:38:32.092562+0000","last_unstale":"2024-04-26T12:41:32.552042+0000","last_undegraded":"2024-04-26T12:41:32.552042+0000","last_fullsized":"2024-04-26T12:41:32.552042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:43.474569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"111'14","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528417+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:41:32.528417+0000","last_peered":"2024-04-26T12:41:32.528417+0000","last_clean":"2024-04-26T12:41:32.528417+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:41:32.528417+0000","last_undegraded":"2024-04-26T12:41:32.528417+0000","last_fullsized":"2024-04-26T12:41:32.528417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511315+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:41:32.511315+0000","last_peered":"2024-04-26T12:41:32.511315+0000","last_clean":"2024-04-26T12:41:32.511315+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:41:32.511315+0000","last_undegraded":"2024-04-26T12:41:32.511315+0000","last_fullsized":"2024-04-26T12:41:32.511315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"112'10","reported_seq":208,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494586+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:41:32.494586+0000","last_peered":"2024-04-26T12:41:32.494586+0000","last_clean":"2024-04-26T12:41:32.494586+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:41:32.494586+0000","last_undegraded":"2024-04-26T12:41:32.494586+0000","last_fullsized":"2024-04-26T12:41:32.494586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520741+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:41:32.520741+0000","last_peered":"2024-04-26T12:41:32.520741+0000","last_clean":"2024-04-26T12:41:32.520741+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:41:32.520741+0000","last_undegraded":"2024-04-26T12:41:32.520741+0000","last_fullsized":"2024-04-26T12:41:32.520741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":188,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550415+0000","last_change":"2024-04-26T12:38:32.098437+0000","last_active":"2024-04-26T12:41:32.550415+0000","last_peered":"2024-04-26T12:41:32.550415+0000","last_clean":"2024-04-26T12:41:32.550415+0000","last_became_active":"2024-04-26T12:38:32.093038+0000","last_became_peered":"2024-04-26T12:38:32.093038+0000","last_unstale":"2024-04-26T12:41:32.550415+0000","last_undegraded":"2024-04-26T12:41:32.550415+0000","last_fullsized":"2024-04-26T12:41:32.550415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:11.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"104'19","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.533842+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:41:32.533842+0000","last_peered":"2024-04-26T12:41:32.533842+0000","last_clean":"2024-04-26T12:41:32.533842+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:41:32.533842+0000","last_undegraded":"2024-04-26T12:41:32.533842+0000","last_fullsized":"2024-04-26T12:41:32.533842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"108'3","reported_seq":202,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528154+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:41:32.528154+0000","last_peered":"2024-04-26T12:41:32.528154+0000","last_clean":"2024-04-26T12:41:32.528154+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:41:32.528154+0000","last_undegraded":"2024-04-26T12:41:32.528154+0000","last_fullsized":"2024-04-26T12:41:32.528154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"112'26","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.630018+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:41:32.630018+0000","last_peered":"2024-04-26T12:41:32.630018+0000","last_clean":"2024-04-26T12:41:32.630018+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:41:32.630018+0000","last_undegraded":"2024-04-26T12:41:32.630018+0000","last_fullsized":"2024-04-26T12:41:32.630018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":195,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510579+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:41:32.510579+0000","last_peered":"2024-04-26T12:41:32.510579+0000","last_clean":"2024-04-26T12:41:32.510579+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:41:32.510579+0000","last_undegraded":"2024-04-26T12:41:32.510579+0000","last_fullsized":"2024-04-26T12:41:32.510579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"103'16","reported_seq":215,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564293+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:41:32.564293+0000","last_peered":"2024-04-26T12:41:32.564293+0000","last_clean":"2024-04-26T12:41:32.564293+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:41:32.564293+0000","last_undegraded":"2024-04-26T12:41:32.564293+0000","last_fullsized":"2024-04-26T12:41:32.564293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":226,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519304+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:41:32.519304+0000","last_peered":"2024-04-26T12:41:32.519304+0000","last_clean":"2024-04-26T12:41:32.519304+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:41:32.519304+0000","last_undegraded":"2024-04-26T12:41:32.519304+0000","last_fullsized":"2024-04-26T12:41:32.519304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"104'17","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563790+0000","last_change":"2024-04-26T12:38:32.097333+0000","last_active":"2024-04-26T12:41:32.563790+0000","last_peered":"2024-04-26T12:41:32.563790+0000","last_clean":"2024-04-26T12:41:32.563790+0000","last_became_active":"2024-04-26T12:38:32.097076+0000","last_became_peered":"2024-04-26T12:38:32.097076+0000","last_unstale":"2024-04-26T12:41:32.563790+0000","last_undegraded":"2024-04-26T12:41:32.563790+0000","last_fullsized":"2024-04-26T12:41:32.563790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:52.365241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":27,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":229,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520024+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:41:32.520024+0000","last_peered":"2024-04-26T12:41:32.520024+0000","last_clean":"2024-04-26T12:41:32.520024+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:41:32.520024+0000","last_undegraded":"2024-04-26T12:41:32.520024+0000","last_fullsized":"2024-04-26T12:41:32.520024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"104'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495093+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:41:32.495093+0000","last_peered":"2024-04-26T12:41:32.495093+0000","last_clean":"2024-04-26T12:41:32.495093+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:41:32.495093+0000","last_undegraded":"2024-04-26T12:41:32.495093+0000","last_fullsized":"2024-04-26T12:41:32.495093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":180,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494566+0000","last_change":"2024-04-26T12:38:32.098711+0000","last_active":"2024-04-26T12:41:32.494566+0000","last_peered":"2024-04-26T12:41:32.494566+0000","last_clean":"2024-04-26T12:41:32.494566+0000","last_became_active":"2024-04-26T12:38:32.097887+0000","last_became_peered":"2024-04-26T12:38:32.097887+0000","last_unstale":"2024-04-26T12:41:32.494566+0000","last_undegraded":"2024-04-26T12:41:32.494566+0000","last_fullsized":"2024-04-26T12:41:32.494566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:43.980582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"112'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551634+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:41:32.551634+0000","last_peered":"2024-04-26T12:41:32.551634+0000","last_clean":"2024-04-26T12:41:32.551634+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:41:32.551634+0000","last_undegraded":"2024-04-26T12:41:32.551634+0000","last_fullsized":"2024-04-26T12:41:32.551634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":175,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493752+0000","last_change":"2024-04-26T12:38:32.091108+0000","last_active":"2024-04-26T12:41:32.493752+0000","last_peered":"2024-04-26T12:41:32.493752+0000","last_clean":"2024-04-26T12:41:32.493752+0000","last_became_active":"2024-04-26T12:38:32.090800+0000","last_became_peered":"2024-04-26T12:38:32.090800+0000","last_unstale":"2024-04-26T12:41:32.493752+0000","last_undegraded":"2024-04-26T12:41:32.493752+0000","last_fullsized":"2024-04-26T12:41:32.493752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:54.159328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495982+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:41:32.495982+0000","last_peered":"2024-04-26T12:41:32.495982+0000","last_clean":"2024-04-26T12:41:32.495982+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:41:32.495982+0000","last_undegraded":"2024-04-26T12:41:32.495982+0000","last_fullsized":"2024-04-26T12:41:32.495982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"104'11","reported_seq":208,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528222+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:41:32.528222+0000","last_peered":"2024-04-26T12:41:32.528222+0000","last_clean":"2024-04-26T12:41:32.528222+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:41:32.528222+0000","last_undegraded":"2024-04-26T12:41:32.528222+0000","last_fullsized":"2024-04-26T12:41:32.528222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":191,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511003+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:41:32.511003+0000","last_peered":"2024-04-26T12:41:32.511003+0000","last_clean":"2024-04-26T12:41:32.511003+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:41:32.511003+0000","last_undegraded":"2024-04-26T12:41:32.511003+0000","last_fullsized":"2024-04-26T12:41:32.511003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"104'17","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552379+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:41:32.552379+0000","last_peered":"2024-04-26T12:41:32.552379+0000","last_clean":"2024-04-26T12:41:32.552379+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:41:32.552379+0000","last_undegraded":"2024-04-26T12:41:32.552379+0000","last_fullsized":"2024-04-26T12:41:32.552379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529603+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:41:32.529603+0000","last_peered":"2024-04-26T12:41:32.529603+0000","last_clean":"2024-04-26T12:41:32.529603+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:41:32.529603+0000","last_undegraded":"2024-04-26T12:41:32.529603+0000","last_fullsized":"2024-04-26T12:41:32.529603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"108'45","reported_seq":242,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510309+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:41:32.510309+0000","last_peered":"2024-04-26T12:41:32.510309+0000","last_clean":"2024-04-26T12:41:32.510309+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:41:32.510309+0000","last_undegraded":"2024-04-26T12:41:32.510309+0000","last_fullsized":"2024-04-26T12:41:32.510309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":90,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":195,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511211+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:41:32.511211+0000","last_peered":"2024-04-26T12:41:32.511211+0000","last_clean":"2024-04-26T12:41:32.511211+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:41:32.511211+0000","last_undegraded":"2024-04-26T12:41:32.511211+0000","last_fullsized":"2024-04-26T12:41:32.511211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"112'23","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551727+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:41:32.551727+0000","last_peered":"2024-04-26T12:41:32.551727+0000","last_clean":"2024-04-26T12:41:32.551727+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:41:32.551727+0000","last_undegraded":"2024-04-26T12:41:32.551727+0000","last_fullsized":"2024-04-26T12:41:32.551727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495793+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:41:32.495793+0000","last_peered":"2024-04-26T12:41:32.495793+0000","last_clean":"2024-04-26T12:41:32.495793+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:41:32.495793+0000","last_undegraded":"2024-04-26T12:41:32.495793+0000","last_fullsized":"2024-04-26T12:41:32.495793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":198,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520467+0000","last_change":"2024-04-26T12:38:32.099862+0000","last_active":"2024-04-26T12:41:32.520467+0000","last_peered":"2024-04-26T12:41:32.520467+0000","last_clean":"2024-04-26T12:41:32.520467+0000","last_became_active":"2024-04-26T12:38:32.098951+0000","last_became_peered":"2024-04-26T12:38:32.098951+0000","last_unstale":"2024-04-26T12:41:32.520467+0000","last_undegraded":"2024-04-26T12:41:32.520467+0000","last_fullsized":"2024-04-26T12:41:32.520467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:37.401523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552292+0000","last_change":"2024-04-26T12:38:32.100120+0000","last_active":"2024-04-26T12:41:32.552292+0000","last_peered":"2024-04-26T12:41:32.552292+0000","last_clean":"2024-04-26T12:41:32.552292+0000","last_became_active":"2024-04-26T12:38:32.099583+0000","last_became_peered":"2024-04-26T12:38:32.099583+0000","last_unstale":"2024-04-26T12:41:32.552292+0000","last_undegraded":"2024-04-26T12:41:32.552292+0000","last_fullsized":"2024-04-26T12:41:32.552292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:16.598403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":177,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551239+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:41:32.551239+0000","last_peered":"2024-04-26T12:41:32.551239+0000","last_clean":"2024-04-26T12:41:32.551239+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:41:32.551239+0000","last_undegraded":"2024-04-26T12:41:32.551239+0000","last_fullsized":"2024-04-26T12:41:32.551239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.553091+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:41:32.553091+0000","last_peered":"2024-04-26T12:41:32.553091+0000","last_clean":"2024-04-26T12:41:32.553091+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:41:32.553091+0000","last_undegraded":"2024-04-26T12:41:32.553091+0000","last_fullsized":"2024-04-26T12:41:32.553091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"104'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528694+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:41:32.528694+0000","last_peered":"2024-04-26T12:41:32.528694+0000","last_clean":"2024-04-26T12:41:32.528694+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:41:32.528694+0000","last_undegraded":"2024-04-26T12:41:32.528694+0000","last_fullsized":"2024-04-26T12:41:32.528694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496318+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:41:32.496318+0000","last_peered":"2024-04-26T12:41:32.496318+0000","last_clean":"2024-04-26T12:41:32.496318+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:41:32.496318+0000","last_undegraded":"2024-04-26T12:41:32.496318+0000","last_fullsized":"2024-04-26T12:41:32.496318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":201,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519778+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:41:32.519778+0000","last_peered":"2024-04-26T12:41:32.519778+0000","last_clean":"2024-04-26T12:41:32.519778+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:41:32.519778+0000","last_undegraded":"2024-04-26T12:41:32.519778+0000","last_fullsized":"2024-04-26T12:41:32.519778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"108'131","reported_seq":429,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529006+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:41:32.529006+0000","last_peered":"2024-04-26T12:41:32.529006+0000","last_clean":"2024-04-26T12:41:32.529006+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:41:32.529006+0000","last_undegraded":"2024-04-26T12:41:32.529006+0000","last_fullsized":"2024-04-26T12:41:32.529006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":180,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519142+0000","last_change":"2024-04-26T12:38:32.097189+0000","last_active":"2024-04-26T12:41:32.519142+0000","last_peered":"2024-04-26T12:41:32.519142+0000","last_clean":"2024-04-26T12:41:32.519142+0000","last_became_active":"2024-04-26T12:38:32.096313+0000","last_became_peered":"2024-04-26T12:38:32.096313+0000","last_unstale":"2024-04-26T12:41:32.519142+0000","last_undegraded":"2024-04-26T12:41:32.519142+0000","last_fullsized":"2024-04-26T12:41:32.519142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:26.879794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":202,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495894+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:41:32.495894+0000","last_peered":"2024-04-26T12:41:32.495894+0000","last_clean":"2024-04-26T12:41:32.495894+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:41:32.495894+0000","last_undegraded":"2024-04-26T12:41:32.495894+0000","last_fullsized":"2024-04-26T12:41:32.495894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'19","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563708+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:41:32.563708+0000","last_peered":"2024-04-26T12:41:32.563708+0000","last_clean":"2024-04-26T12:41:32.563708+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:41:32.563708+0000","last_undegraded":"2024-04-26T12:41:32.563708+0000","last_fullsized":"2024-04-26T12:41:32.563708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":191,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511246+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:41:32.511246+0000","last_peered":"2024-04-26T12:41:32.511246+0000","last_clean":"2024-04-26T12:41:32.511246+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:41:32.511246+0000","last_undegraded":"2024-04-26T12:41:32.511246+0000","last_fullsized":"2024-04-26T12:41:32.511246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"104'16","reported_seq":208,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529111+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:41:32.529111+0000","last_peered":"2024-04-26T12:41:32.529111+0000","last_clean":"2024-04-26T12:41:32.529111+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:41:32.529111+0000","last_undegraded":"2024-04-26T12:41:32.529111+0000","last_fullsized":"2024-04-26T12:41:32.529111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"108'131","reported_seq":352,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495421+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:41:32.495421+0000","last_peered":"2024-04-26T12:41:32.495421+0000","last_clean":"2024-04-26T12:41:32.495421+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:41:32.495421+0000","last_undegraded":"2024-04-26T12:41:32.495421+0000","last_fullsized":"2024-04-26T12:41:32.495421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510476+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:41:32.510476+0000","last_peered":"2024-04-26T12:41:32.510476+0000","last_clean":"2024-04-26T12:41:32.510476+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:41:32.510476+0000","last_undegraded":"2024-04-26T12:41:32.510476+0000","last_fullsized":"2024-04-26T12:41:32.510476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'19","reported_seq":169,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520353+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:41:32.520353+0000","last_peered":"2024-04-26T12:41:32.520353+0000","last_clean":"2024-04-26T12:41:32.520353+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:41:32.520353+0000","last_undegraded":"2024-04-26T12:41:32.520353+0000","last_fullsized":"2024-04-26T12:41:32.520353+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527347+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:41:32.527347+0000","last_peered":"2024-04-26T12:41:32.527347+0000","last_clean":"2024-04-26T12:41:32.527347+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:41:32.527347+0000","last_undegraded":"2024-04-26T12:41:32.527347+0000","last_fullsized":"2024-04-26T12:41:32.527347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"104'26","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510316+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:41:32.510316+0000","last_peered":"2024-04-26T12:41:32.510316+0000","last_clean":"2024-04-26T12:41:32.510316+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:41:32.510316+0000","last_undegraded":"2024-04-26T12:41:32.510316+0000","last_fullsized":"2024-04-26T12:41:32.510316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491905+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:41:32.491905+0000","last_peered":"2024-04-26T12:41:32.491905+0000","last_clean":"2024-04-26T12:41:32.491905+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:41:32.491905+0000","last_undegraded":"2024-04-26T12:41:32.491905+0000","last_fullsized":"2024-04-26T12:41:32.491905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510781+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:41:32.510781+0000","last_peered":"2024-04-26T12:41:32.510781+0000","last_clean":"2024-04-26T12:41:32.510781+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:41:32.510781+0000","last_undegraded":"2024-04-26T12:41:32.510781+0000","last_fullsized":"2024-04-26T12:41:32.510781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"108'7","reported_seq":197,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492259+0000","last_change":"2024-04-26T12:38:32.097378+0000","last_active":"2024-04-26T12:41:32.492259+0000","last_peered":"2024-04-26T12:41:32.492259+0000","last_clean":"2024-04-26T12:41:32.492259+0000","last_became_active":"2024-04-26T12:38:32.096994+0000","last_became_peered":"2024-04-26T12:38:32.096994+0000","last_unstale":"2024-04-26T12:41:32.492259+0000","last_undegraded":"2024-04-26T12:41:32.492259+0000","last_fullsized":"2024-04-26T12:41:32.492259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:26.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"111'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529467+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:41:32.529467+0000","last_peered":"2024-04-26T12:41:32.529467+0000","last_clean":"2024-04-26T12:41:32.529467+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:41:32.529467+0000","last_undegraded":"2024-04-26T12:41:32.529467+0000","last_fullsized":"2024-04-26T12:41:32.529467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.518465+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:41:32.518465+0000","last_peered":"2024-04-26T12:41:32.518465+0000","last_clean":"2024-04-26T12:41:32.518465+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:41:32.518465+0000","last_undegraded":"2024-04-26T12:41:32.518465+0000","last_fullsized":"2024-04-26T12:41:32.518465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"104'18","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495562+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:41:32.495562+0000","last_peered":"2024-04-26T12:41:32.495562+0000","last_clean":"2024-04-26T12:41:32.495562+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:41:32.495562+0000","last_undegraded":"2024-04-26T12:41:32.495562+0000","last_fullsized":"2024-04-26T12:41:32.495562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494829+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:41:32.494829+0000","last_peered":"2024-04-26T12:41:32.494829+0000","last_clean":"2024-04-26T12:41:32.494829+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:41:32.494829+0000","last_undegraded":"2024-04-26T12:41:32.494829+0000","last_fullsized":"2024-04-26T12:41:32.494829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":192,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.562897+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:41:32.562897+0000","last_peered":"2024-04-26T12:41:32.562897+0000","last_clean":"2024-04-26T12:41:32.562897+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:41:32.562897+0000","last_undegraded":"2024-04-26T12:41:32.562897+0000","last_fullsized":"2024-04-26T12:41:32.562897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.565158+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:41:32.565158+0000","last_peered":"2024-04-26T12:41:32.565158+0000","last_clean":"2024-04-26T12:41:32.565158+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:41:32.565158+0000","last_undegraded":"2024-04-26T12:41:32.565158+0000","last_fullsized":"2024-04-26T12:41:32.565158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"103'16","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529487+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:41:32.529487+0000","last_peered":"2024-04-26T12:41:32.529487+0000","last_clean":"2024-04-26T12:41:32.529487+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:41:32.529487+0000","last_undegraded":"2024-04-26T12:41:32.529487+0000","last_fullsized":"2024-04-26T12:41:32.529487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519580+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:41:32.519580+0000","last_peered":"2024-04-26T12:41:32.519580+0000","last_clean":"2024-04-26T12:41:32.519580+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:41:32.519580+0000","last_undegraded":"2024-04-26T12:41:32.519580+0000","last_fullsized":"2024-04-26T12:41:32.519580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"104'23","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527036+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:41:32.527036+0000","last_peered":"2024-04-26T12:41:32.527036+0000","last_clean":"2024-04-26T12:41:32.527036+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:41:32.527036+0000","last_undegraded":"2024-04-26T12:41:32.527036+0000","last_fullsized":"2024-04-26T12:41:32.527036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"108'131","reported_seq":379,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550294+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:41:32.550294+0000","last_peered":"2024-04-26T12:41:32.550294+0000","last_clean":"2024-04-26T12:41:32.550294+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:41:32.550294+0000","last_undegraded":"2024-04-26T12:41:32.550294+0000","last_fullsized":"2024-04-26T12:41:32.550294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":183,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552472+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:41:32.552472+0000","last_peered":"2024-04-26T12:41:32.552472+0000","last_clean":"2024-04-26T12:41:32.552472+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:41:32.552472+0000","last_undegraded":"2024-04-26T12:41:32.552472+0000","last_fullsized":"2024-04-26T12:41:32.552472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551694+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:41:32.551694+0000","last_peered":"2024-04-26T12:41:32.551694+0000","last_clean":"2024-04-26T12:41:32.551694+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:41:32.551694+0000","last_undegraded":"2024-04-26T12:41:32.551694+0000","last_fullsized":"2024-04-26T12:41:32.551694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"112'14","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511202+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:41:32.511202+0000","last_peered":"2024-04-26T12:41:32.511202+0000","last_clean":"2024-04-26T12:41:32.511202+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:41:32.511202+0000","last_undegraded":"2024-04-26T12:41:32.511202+0000","last_fullsized":"2024-04-26T12:41:32.511202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.518926+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:41:32.518926+0000","last_peered":"2024-04-26T12:41:32.518926+0000","last_clean":"2024-04-26T12:41:32.518926+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:41:32.518926+0000","last_undegraded":"2024-04-26T12:41:32.518926+0000","last_fullsized":"2024-04-26T12:41:32.518926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"104'27","reported_seq":223,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551077+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:41:32.551077+0000","last_peered":"2024-04-26T12:41:32.551077+0000","last_clean":"2024-04-26T12:41:32.551077+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:41:32.551077+0000","last_undegraded":"2024-04-26T12:41:32.551077+0000","last_fullsized":"2024-04-26T12:41:32.551077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.518333+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:41:32.518333+0000","last_peered":"2024-04-26T12:41:32.518333+0000","last_clean":"2024-04-26T12:41:32.518333+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:41:32.518333+0000","last_undegraded":"2024-04-26T12:41:32.518333+0000","last_fullsized":"2024-04-26T12:41:32.518333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'7","reported_seq":208,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493558+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:41:32.493558+0000","last_peered":"2024-04-26T12:41:32.493558+0000","last_clean":"2024-04-26T12:41:32.493558+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:41:32.493558+0000","last_undegraded":"2024-04-26T12:41:32.493558+0000","last_fullsized":"2024-04-26T12:41:32.493558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"108'3","reported_seq":180,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495882+0000","last_change":"2024-04-26T12:38:32.098058+0000","last_active":"2024-04-26T12:41:32.495882+0000","last_peered":"2024-04-26T12:41:32.495882+0000","last_clean":"2024-04-26T12:41:32.495882+0000","last_became_active":"2024-04-26T12:38:32.095643+0000","last_became_peered":"2024-04-26T12:38:32.095643+0000","last_unstale":"2024-04-26T12:41:32.495882+0000","last_undegraded":"2024-04-26T12:41:32.495882+0000","last_fullsized":"2024-04-26T12:41:32.495882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:56.628368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"111'18","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494989+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:41:32.494989+0000","last_peered":"2024-04-26T12:41:32.494989+0000","last_clean":"2024-04-26T12:41:32.494989+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:41:32.494989+0000","last_undegraded":"2024-04-26T12:41:32.494989+0000","last_fullsized":"2024-04-26T12:41:32.494989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519891+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:41:32.519891+0000","last_peered":"2024-04-26T12:41:32.519891+0000","last_clean":"2024-04-26T12:41:32.519891+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:41:32.519891+0000","last_undegraded":"2024-04-26T12:41:32.519891+0000","last_fullsized":"2024-04-26T12:41:32.519891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"104'18","reported_seq":215,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493779+0000","last_change":"2024-04-26T12:38:32.096426+0000","last_active":"2024-04-26T12:41:32.493779+0000","last_peered":"2024-04-26T12:41:32.493779+0000","last_clean":"2024-04-26T12:41:32.493779+0000","last_became_active":"2024-04-26T12:38:32.095992+0000","last_became_peered":"2024-04-26T12:38:32.095992+0000","last_unstale":"2024-04-26T12:41:32.493779+0000","last_undegraded":"2024-04-26T12:41:32.493779+0000","last_fullsized":"2024-04-26T12:41:32.493779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:27.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552187+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:41:32.552187+0000","last_peered":"2024-04-26T12:41:32.552187+0000","last_clean":"2024-04-26T12:41:32.552187+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:41:32.552187+0000","last_undegraded":"2024-04-26T12:41:32.552187+0000","last_fullsized":"2024-04-26T12:41:32.552187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":184,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493930+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:41:32.493930+0000","last_peered":"2024-04-26T12:41:32.493930+0000","last_clean":"2024-04-26T12:41:32.493930+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:41:32.493930+0000","last_undegraded":"2024-04-26T12:41:32.493930+0000","last_fullsized":"2024-04-26T12:41:32.493930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":196,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519951+0000","last_change":"2024-04-26T12:38:32.097968+0000","last_active":"2024-04-26T12:41:32.519951+0000","last_peered":"2024-04-26T12:41:32.519951+0000","last_clean":"2024-04-26T12:41:32.519951+0000","last_became_active":"2024-04-26T12:38:32.095619+0000","last_became_peered":"2024-04-26T12:38:32.095619+0000","last_unstale":"2024-04-26T12:41:32.519951+0000","last_undegraded":"2024-04-26T12:41:32.519951+0000","last_fullsized":"2024-04-26T12:41:32.519951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"112'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.565628+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:41:32.565628+0000","last_peered":"2024-04-26T12:41:32.565628+0000","last_clean":"2024-04-26T12:41:32.565628+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:41:32.565628+0000","last_undegraded":"2024-04-26T12:41:32.565628+0000","last_fullsized":"2024-04-26T12:41:32.565628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492991+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:41:32.492991+0000","last_peered":"2024-04-26T12:41:32.492991+0000","last_clean":"2024-04-26T12:41:32.492991+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:41:32.492991+0000","last_undegraded":"2024-04-26T12:41:32.492991+0000","last_fullsized":"2024-04-26T12:41:32.492991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"104'22","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520571+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:41:32.520571+0000","last_peered":"2024-04-26T12:41:32.520571+0000","last_clean":"2024-04-26T12:41:32.520571+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:41:32.520571+0000","last_undegraded":"2024-04-26T12:41:32.520571+0000","last_fullsized":"2024-04-26T12:41:32.520571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"108'131","reported_seq":367,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520250+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:41:32.520250+0000","last_peered":"2024-04-26T12:41:32.520250+0000","last_clean":"2024-04-26T12:41:32.520250+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:41:32.520250+0000","last_undegraded":"2024-04-26T12:41:32.520250+0000","last_fullsized":"2024-04-26T12:41:32.520250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492005+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:41:32.492005+0000","last_peered":"2024-04-26T12:41:32.492005+0000","last_clean":"2024-04-26T12:41:32.492005+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:41:32.492005+0000","last_undegraded":"2024-04-26T12:41:32.492005+0000","last_fullsized":"2024-04-26T12:41:32.492005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":198,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564183+0000","last_change":"2024-04-26T12:38:32.098436+0000","last_active":"2024-04-26T12:41:32.564183+0000","last_peered":"2024-04-26T12:41:32.564183+0000","last_clean":"2024-04-26T12:41:32.564183+0000","last_became_active":"2024-04-26T12:38:32.097675+0000","last_became_peered":"2024-04-26T12:38:32.097675+0000","last_unstale":"2024-04-26T12:41:32.564183+0000","last_undegraded":"2024-04-26T12:41:32.564183+0000","last_fullsized":"2024-04-26T12:41:32.564183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:10.967994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"111'23","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.518333+0000","last_change":"2024-04-26T12:38:32.091912+0000","last_active":"2024-04-26T12:41:32.518333+0000","last_peered":"2024-04-26T12:41:32.518333+0000","last_clean":"2024-04-26T12:41:32.518333+0000","last_became_active":"2024-04-26T12:38:32.091595+0000","last_became_peered":"2024-04-26T12:38:32.091595+0000","last_unstale":"2024-04-26T12:41:32.518333+0000","last_undegraded":"2024-04-26T12:41:32.518333+0000","last_fullsized":"2024-04-26T12:41:32.518333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:30.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":367,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511637+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:41:32.511637+0000","last_peered":"2024-04-26T12:41:32.511637+0000","last_clean":"2024-04-26T12:41:32.511637+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:41:32.511637+0000","last_undegraded":"2024-04-26T12:41:32.511637+0000","last_fullsized":"2024-04-26T12:41:32.511637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":201,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495522+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:41:32.495522+0000","last_peered":"2024-04-26T12:41:32.495522+0000","last_clean":"2024-04-26T12:41:32.495522+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:41:32.495522+0000","last_undegraded":"2024-04-26T12:41:32.495522+0000","last_fullsized":"2024-04-26T12:41:32.495522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"108'131","reported_seq":398,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563436+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:41:32.563436+0000","last_peered":"2024-04-26T12:41:32.563436+0000","last_clean":"2024-04-26T12:41:32.563436+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:41:32.563436+0000","last_undegraded":"2024-04-26T12:41:32.563436+0000","last_fullsized":"2024-04-26T12:41:32.563436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":176,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551402+0000","last_change":"2024-04-26T12:38:32.092303+0000","last_active":"2024-04-26T12:41:32.551402+0000","last_peered":"2024-04-26T12:41:32.551402+0000","last_clean":"2024-04-26T12:41:32.551402+0000","last_became_active":"2024-04-26T12:38:32.091872+0000","last_became_peered":"2024-04-26T12:38:32.091872+0000","last_unstale":"2024-04-26T12:41:32.551402+0000","last_undegraded":"2024-04-26T12:41:32.551402+0000","last_fullsized":"2024-04-26T12:41:32.551402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494497+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:41:32.494497+0000","last_peered":"2024-04-26T12:41:32.494497+0000","last_clean":"2024-04-26T12:41:32.494497+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:41:32.494497+0000","last_undegraded":"2024-04-26T12:41:32.494497+0000","last_fullsized":"2024-04-26T12:41:32.494497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"111'17","reported_seq":215,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494749+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:41:32.494749+0000","last_peered":"2024-04-26T12:41:32.494749+0000","last_clean":"2024-04-26T12:41:32.494749+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:41:32.494749+0000","last_undegraded":"2024-04-26T12:41:32.494749+0000","last_fullsized":"2024-04-26T12:41:32.494749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":172,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511373+0000","last_change":"2024-04-26T12:38:32.094763+0000","last_active":"2024-04-26T12:41:32.511373+0000","last_peered":"2024-04-26T12:41:32.511373+0000","last_clean":"2024-04-26T12:41:32.511373+0000","last_became_active":"2024-04-26T12:38:32.094384+0000","last_became_peered":"2024-04-26T12:38:32.094384+0000","last_unstale":"2024-04-26T12:41:32.511373+0000","last_undegraded":"2024-04-26T12:41:32.511373+0000","last_fullsized":"2024-04-26T12:41:32.511373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"104'25","reported_seq":223,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510917+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:41:32.510917+0000","last_peered":"2024-04-26T12:41:32.510917+0000","last_clean":"2024-04-26T12:41:32.510917+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:41:32.510917+0000","last_undegraded":"2024-04-26T12:41:32.510917+0000","last_fullsized":"2024-04-26T12:41:32.510917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563350+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:41:32.563350+0000","last_peered":"2024-04-26T12:41:32.563350+0000","last_clean":"2024-04-26T12:41:32.563350+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:41:32.563350+0000","last_undegraded":"2024-04-26T12:41:32.563350+0000","last_fullsized":"2024-04-26T12:41:32.563350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":178,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491235+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:41:32.491235+0000","last_peered":"2024-04-26T12:41:32.491235+0000","last_clean":"2024-04-26T12:41:32.491235+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:41:32.491235+0000","last_undegraded":"2024-04-26T12:41:32.491235+0000","last_fullsized":"2024-04-26T12:41:32.491235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":230,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563931+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:41:32.563931+0000","last_peered":"2024-04-26T12:41:32.563931+0000","last_clean":"2024-04-26T12:41:32.563931+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:41:32.563931+0000","last_undegraded":"2024-04-26T12:41:32.563931+0000","last_fullsized":"2024-04-26T12:41:32.563931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":353,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527329+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:41:32.527329+0000","last_peered":"2024-04-26T12:41:32.527329+0000","last_clean":"2024-04-26T12:41:32.527329+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:41:32.527329+0000","last_undegraded":"2024-04-26T12:41:32.527329+0000","last_fullsized":"2024-04-26T12:41:32.527329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":205,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511020+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:41:32.511020+0000","last_peered":"2024-04-26T12:41:32.511020+0000","last_clean":"2024-04-26T12:41:32.511020+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:41:32.511020+0000","last_undegraded":"2024-04-26T12:41:32.511020+0000","last_fullsized":"2024-04-26T12:41:32.511020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"111'27","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495409+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:41:32.495409+0000","last_peered":"2024-04-26T12:41:32.495409+0000","last_clean":"2024-04-26T12:41:32.495409+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:41:32.495409+0000","last_undegraded":"2024-04-26T12:41:32.495409+0000","last_fullsized":"2024-04-26T12:41:32.495409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528636+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:41:32.528636+0000","last_peered":"2024-04-26T12:41:32.528636+0000","last_clean":"2024-04-26T12:41:32.528636+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:41:32.528636+0000","last_undegraded":"2024-04-26T12:41:32.528636+0000","last_fullsized":"2024-04-26T12:41:32.528636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"104'35","reported_seq":236,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511724+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:41:32.511724+0000","last_peered":"2024-04-26T12:41:32.511724+0000","last_clean":"2024-04-26T12:41:32.511724+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:41:32.511724+0000","last_undegraded":"2024-04-26T12:41:32.511724+0000","last_fullsized":"2024-04-26T12:41:32.511724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552570+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:41:32.552570+0000","last_peered":"2024-04-26T12:41:32.552570+0000","last_clean":"2024-04-26T12:41:32.552570+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:41:32.552570+0000","last_undegraded":"2024-04-26T12:41:32.552570+0000","last_fullsized":"2024-04-26T12:41:32.552570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":178,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.562860+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:41:32.562860+0000","last_peered":"2024-04-26T12:41:32.562860+0000","last_clean":"2024-04-26T12:41:32.562860+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:41:32.562860+0000","last_undegraded":"2024-04-26T12:41:32.562860+0000","last_fullsized":"2024-04-26T12:41:32.562860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552904+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:41:32.552904+0000","last_peered":"2024-04-26T12:41:32.552904+0000","last_clean":"2024-04-26T12:41:32.552904+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:41:32.552904+0000","last_undegraded":"2024-04-26T12:41:32.552904+0000","last_fullsized":"2024-04-26T12:41:32.552904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":203,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526932+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:41:32.526932+0000","last_peered":"2024-04-26T12:41:32.526932+0000","last_clean":"2024-04-26T12:41:32.526932+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:41:32.526932+0000","last_undegraded":"2024-04-26T12:41:32.526932+0000","last_fullsized":"2024-04-26T12:41:32.526932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"112'16","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.615732+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:41:32.615732+0000","last_peered":"2024-04-26T12:41:32.615732+0000","last_clean":"2024-04-26T12:41:32.615732+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:41:32.615732+0000","last_undegraded":"2024-04-26T12:41:32.615732+0000","last_fullsized":"2024-04-26T12:41:32.615732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":191,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511789+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:41:32.511789+0000","last_peered":"2024-04-26T12:41:32.511789+0000","last_clean":"2024-04-26T12:41:32.511789+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:41:32.511789+0000","last_undegraded":"2024-04-26T12:41:32.511789+0000","last_fullsized":"2024-04-26T12:41:32.511789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"108'131","reported_seq":417,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491913+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:41:32.491913+0000","last_peered":"2024-04-26T12:41:32.491913+0000","last_clean":"2024-04-26T12:41:32.491913+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:41:32.491913+0000","last_undegraded":"2024-04-26T12:41:32.491913+0000","last_fullsized":"2024-04-26T12:41:32.491913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":173,"num_read_kb":158,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529045+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:41:32.529045+0000","last_peered":"2024-04-26T12:41:32.529045+0000","last_clean":"2024-04-26T12:41:32.529045+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:41:32.529045+0000","last_undegraded":"2024-04-26T12:41:32.529045+0000","last_fullsized":"2024-04-26T12:41:32.529045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"108'1","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492103+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:41:32.492103+0000","last_peered":"2024-04-26T12:41:32.492103+0000","last_clean":"2024-04-26T12:41:32.492103+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:41:32.492103+0000","last_undegraded":"2024-04-26T12:41:32.492103+0000","last_fullsized":"2024-04-26T12:41:32.492103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":223,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494665+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:41:32.494665+0000","last_peered":"2024-04-26T12:41:32.494665+0000","last_clean":"2024-04-26T12:41:32.494665+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:41:32.494665+0000","last_undegraded":"2024-04-26T12:41:32.494665+0000","last_fullsized":"2024-04-26T12:41:32.494665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519407+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:41:32.519407+0000","last_peered":"2024-04-26T12:41:32.519407+0000","last_clean":"2024-04-26T12:41:32.519407+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:41:32.519407+0000","last_undegraded":"2024-04-26T12:41:32.519407+0000","last_fullsized":"2024-04-26T12:41:32.519407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"104'25","reported_seq":224,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491694+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:41:32.491694+0000","last_peered":"2024-04-26T12:41:32.491694+0000","last_clean":"2024-04-26T12:41:32.491694+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:41:32.491694+0000","last_undegraded":"2024-04-26T12:41:32.491694+0000","last_fullsized":"2024-04-26T12:41:32.491694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":279,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520335+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:41:32.520335+0000","last_peered":"2024-04-26T12:41:32.520335+0000","last_clean":"2024-04-26T12:41:32.520335+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:41:32.520335+0000","last_undegraded":"2024-04-26T12:41:32.520335+0000","last_fullsized":"2024-04-26T12:41:32.520335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":130,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"91'17","reported_seq":247,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529326+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:41:32.529326+0000","last_peered":"2024-04-26T12:41:32.529326+0000","last_clean":"2024-04-26T12:41:32.529326+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:41:32.529326+0000","last_undegraded":"2024-04-26T12:41:32.529326+0000","last_fullsized":"2024-04-26T12:41:32.529326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551866+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:41:32.551866+0000","last_peered":"2024-04-26T12:41:32.551866+0000","last_clean":"2024-04-26T12:41:32.551866+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:41:32.551866+0000","last_undegraded":"2024-04-26T12:41:32.551866+0000","last_fullsized":"2024-04-26T12:41:32.551866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495239+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:41:32.495239+0000","last_peered":"2024-04-26T12:41:32.495239+0000","last_clean":"2024-04-26T12:41:32.495239+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:41:32.495239+0000","last_undegraded":"2024-04-26T12:41:32.495239+0000","last_fullsized":"2024-04-26T12:41:32.495239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493418+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:41:32.493418+0000","last_peered":"2024-04-26T12:41:32.493418+0000","last_clean":"2024-04-26T12:41:32.493418+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:41:32.493418+0000","last_undegraded":"2024-04-26T12:41:32.493418+0000","last_fullsized":"2024-04-26T12:41:32.493418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":205,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510763+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:41:32.510763+0000","last_peered":"2024-04-26T12:41:32.510763+0000","last_clean":"2024-04-26T12:41:32.510763+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:41:32.510763+0000","last_undegraded":"2024-04-26T12:41:32.510763+0000","last_fullsized":"2024-04-26T12:41:32.510763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"104'13","reported_seq":183,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551598+0000","last_change":"2024-04-26T12:38:32.099375+0000","last_active":"2024-04-26T12:41:32.551598+0000","last_peered":"2024-04-26T12:41:32.551598+0000","last_clean":"2024-04-26T12:41:32.551598+0000","last_became_active":"2024-04-26T12:38:32.098983+0000","last_became_peered":"2024-04-26T12:38:32.098983+0000","last_unstale":"2024-04-26T12:41:32.551598+0000","last_undegraded":"2024-04-26T12:41:32.551598+0000","last_fullsized":"2024-04-26T12:41:32.551598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.281648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551948+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:41:32.551948+0000","last_peered":"2024-04-26T12:41:32.551948+0000","last_clean":"2024-04-26T12:41:32.551948+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:41:32.551948+0000","last_undegraded":"2024-04-26T12:41:32.551948+0000","last_fullsized":"2024-04-26T12:41:32.551948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":205,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495808+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:41:32.495808+0000","last_peered":"2024-04-26T12:41:32.495808+0000","last_clean":"2024-04-26T12:41:32.495808+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:41:32.495808+0000","last_undegraded":"2024-04-26T12:41:32.495808+0000","last_fullsized":"2024-04-26T12:41:32.495808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563596+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:41:32.563596+0000","last_peered":"2024-04-26T12:41:32.563596+0000","last_clean":"2024-04-26T12:41:32.563596+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:41:32.563596+0000","last_undegraded":"2024-04-26T12:41:32.563596+0000","last_fullsized":"2024-04-26T12:41:32.563596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":185,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510142+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:41:32.510142+0000","last_peered":"2024-04-26T12:41:32.510142+0000","last_clean":"2024-04-26T12:41:32.510142+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:41:32.510142+0000","last_undegraded":"2024-04-26T12:41:32.510142+0000","last_fullsized":"2024-04-26T12:41:32.510142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":203,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492643+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:41:32.492643+0000","last_peered":"2024-04-26T12:41:32.492643+0000","last_clean":"2024-04-26T12:41:32.492643+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:41:32.492643+0000","last_undegraded":"2024-04-26T12:41:32.492643+0000","last_fullsized":"2024-04-26T12:41:32.492643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"104'19","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511289+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:41:32.511289+0000","last_peered":"2024-04-26T12:41:32.511289+0000","last_clean":"2024-04-26T12:41:32.511289+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:41:32.511289+0000","last_undegraded":"2024-04-26T12:41:32.511289+0000","last_fullsized":"2024-04-26T12:41:32.511289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493949+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:41:32.493949+0000","last_peered":"2024-04-26T12:41:32.493949+0000","last_clean":"2024-04-26T12:41:32.493949+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:41:32.493949+0000","last_undegraded":"2024-04-26T12:41:32.493949+0000","last_fullsized":"2024-04-26T12:41:32.493949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551416+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:41:32.551416+0000","last_peered":"2024-04-26T12:41:32.551416+0000","last_clean":"2024-04-26T12:41:32.551416+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:41:32.551416+0000","last_undegraded":"2024-04-26T12:41:32.551416+0000","last_fullsized":"2024-04-26T12:41:32.551416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"104'32","reported_seq":231,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550497+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:41:32.550497+0000","last_peered":"2024-04-26T12:41:32.550497+0000","last_clean":"2024-04-26T12:41:32.550497+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:41:32.550497+0000","last_undegraded":"2024-04-26T12:41:32.550497+0000","last_fullsized":"2024-04-26T12:41:32.550497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":172,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495038+0000","last_change":"2024-04-26T12:38:32.094008+0000","last_active":"2024-04-26T12:41:32.495038+0000","last_peered":"2024-04-26T12:41:32.495038+0000","last_clean":"2024-04-26T12:41:32.495038+0000","last_became_active":"2024-04-26T12:38:32.092362+0000","last_became_peered":"2024-04-26T12:38:32.092362+0000","last_unstale":"2024-04-26T12:41:32.495038+0000","last_undegraded":"2024-04-26T12:41:32.495038+0000","last_fullsized":"2024-04-26T12:41:32.495038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.395782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":177,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552200+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:41:32.552200+0000","last_peered":"2024-04-26T12:41:32.552200+0000","last_clean":"2024-04-26T12:41:32.552200+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:41:32.552200+0000","last_undegraded":"2024-04-26T12:41:32.552200+0000","last_fullsized":"2024-04-26T12:41:32.552200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":201,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551647+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:41:32.551647+0000","last_peered":"2024-04-26T12:41:32.551647+0000","last_clean":"2024-04-26T12:41:32.551647+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:41:32.551647+0000","last_undegraded":"2024-04-26T12:41:32.551647+0000","last_fullsized":"2024-04-26T12:41:32.551647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'19","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493572+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:41:32.493572+0000","last_peered":"2024-04-26T12:41:32.493572+0000","last_clean":"2024-04-26T12:41:32.493572+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:41:32.493572+0000","last_undegraded":"2024-04-26T12:41:32.493572+0000","last_fullsized":"2024-04-26T12:41:32.493572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":203,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529639+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:41:32.529639+0000","last_peered":"2024-04-26T12:41:32.529639+0000","last_clean":"2024-04-26T12:41:32.529639+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:41:32.529639+0000","last_undegraded":"2024-04-26T12:41:32.529639+0000","last_fullsized":"2024-04-26T12:41:32.529639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564494+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:41:32.564494+0000","last_peered":"2024-04-26T12:41:32.564494+0000","last_clean":"2024-04-26T12:41:32.564494+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:41:32.564494+0000","last_undegraded":"2024-04-26T12:41:32.564494+0000","last_fullsized":"2024-04-26T12:41:32.564494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":207,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491470+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:41:32.491470+0000","last_peered":"2024-04-26T12:41:32.491470+0000","last_clean":"2024-04-26T12:41:32.491470+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:41:32.491470+0000","last_undegraded":"2024-04-26T12:41:32.491470+0000","last_fullsized":"2024-04-26T12:41:32.491470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"108'131","reported_seq":353,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510335+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:41:32.510335+0000","last_peered":"2024-04-26T12:41:32.510335+0000","last_clean":"2024-04-26T12:41:32.510335+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:41:32.510335+0000","last_undegraded":"2024-04-26T12:41:32.510335+0000","last_fullsized":"2024-04-26T12:41:32.510335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496042+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:41:32.496042+0000","last_peered":"2024-04-26T12:41:32.496042+0000","last_clean":"2024-04-26T12:41:32.496042+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:41:32.496042+0000","last_undegraded":"2024-04-26T12:41:32.496042+0000","last_fullsized":"2024-04-26T12:41:32.496042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494363+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:41:32.494363+0000","last_peered":"2024-04-26T12:41:32.494363+0000","last_clean":"2024-04-26T12:41:32.494363+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:41:32.494363+0000","last_undegraded":"2024-04-26T12:41:32.494363+0000","last_fullsized":"2024-04-26T12:41:32.494363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"112'18","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495709+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:41:32.495709+0000","last_peered":"2024-04-26T12:41:32.495709+0000","last_clean":"2024-04-26T12:41:32.495709+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:41:32.495709+0000","last_undegraded":"2024-04-26T12:41:32.495709+0000","last_fullsized":"2024-04-26T12:41:32.495709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493992+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:41:32.493992+0000","last_peered":"2024-04-26T12:41:32.493992+0000","last_clean":"2024-04-26T12:41:32.493992+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:41:32.493992+0000","last_undegraded":"2024-04-26T12:41:32.493992+0000","last_fullsized":"2024-04-26T12:41:32.493992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494892+0000","last_change":"2024-04-26T12:38:32.094625+0000","last_active":"2024-04-26T12:41:32.494892+0000","last_peered":"2024-04-26T12:41:32.494892+0000","last_clean":"2024-04-26T12:41:32.494892+0000","last_became_active":"2024-04-26T12:38:32.093266+0000","last_became_peered":"2024-04-26T12:38:32.093266+0000","last_unstale":"2024-04-26T12:41:32.494892+0000","last_undegraded":"2024-04-26T12:41:32.494892+0000","last_fullsized":"2024-04-26T12:41:32.494892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:18:18.695479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495110+0000","last_change":"2024-04-26T12:38:32.097625+0000","last_active":"2024-04-26T12:41:32.495110+0000","last_peered":"2024-04-26T12:41:32.495110+0000","last_clean":"2024-04-26T12:41:32.495110+0000","last_became_active":"2024-04-26T12:38:32.097186+0000","last_became_peered":"2024-04-26T12:38:32.097186+0000","last_unstale":"2024-04-26T12:41:32.495110+0000","last_undegraded":"2024-04-26T12:41:32.495110+0000","last_fullsized":"2024-04-26T12:41:32.495110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:09.866995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"108'131","reported_seq":352,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.497030+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:41:32.497030+0000","last_peered":"2024-04-26T12:41:32.497030+0000","last_clean":"2024-04-26T12:41:32.497030+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:41:32.497030+0000","last_undegraded":"2024-04-26T12:41:32.497030+0000","last_fullsized":"2024-04-26T12:41:32.497030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":177,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550161+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:41:32.550161+0000","last_peered":"2024-04-26T12:41:32.550161+0000","last_clean":"2024-04-26T12:41:32.550161+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:41:32.550161+0000","last_undegraded":"2024-04-26T12:41:32.550161+0000","last_fullsized":"2024-04-26T12:41:32.550161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510537+0000","last_change":"2024-04-26T12:38:32.089371+0000","last_active":"2024-04-26T12:41:32.510537+0000","last_peered":"2024-04-26T12:41:32.510537+0000","last_clean":"2024-04-26T12:41:32.510537+0000","last_became_active":"2024-04-26T12:38:32.088665+0000","last_became_peered":"2024-04-26T12:38:32.088665+0000","last_unstale":"2024-04-26T12:41:32.510537+0000","last_undegraded":"2024-04-26T12:41:32.510537+0000","last_fullsized":"2024-04-26T12:41:32.510537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:48.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"111'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.553244+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:41:32.553244+0000","last_peered":"2024-04-26T12:41:32.553244+0000","last_clean":"2024-04-26T12:41:32.553244+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:41:32.553244+0000","last_undegraded":"2024-04-26T12:41:32.553244+0000","last_fullsized":"2024-04-26T12:41:32.553244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564270+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:41:32.564270+0000","last_peered":"2024-04-26T12:41:32.564270+0000","last_clean":"2024-04-26T12:41:32.564270+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:41:32.564270+0000","last_undegraded":"2024-04-26T12:41:32.564270+0000","last_fullsized":"2024-04-26T12:41:32.564270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494220+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:41:32.494220+0000","last_peered":"2024-04-26T12:41:32.494220+0000","last_clean":"2024-04-26T12:41:32.494220+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:41:32.494220+0000","last_undegraded":"2024-04-26T12:41:32.494220+0000","last_fullsized":"2024-04-26T12:41:32.494220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"104'40","reported_seq":242,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527595+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:41:32.527595+0000","last_peered":"2024-04-26T12:41:32.527595+0000","last_clean":"2024-04-26T12:41:32.527595+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:41:32.527595+0000","last_undegraded":"2024-04-26T12:41:32.527595+0000","last_fullsized":"2024-04-26T12:41:32.527595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495004+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:41:32.495004+0000","last_peered":"2024-04-26T12:41:32.495004+0000","last_clean":"2024-04-26T12:41:32.495004+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:41:32.495004+0000","last_undegraded":"2024-04-26T12:41:32.495004+0000","last_fullsized":"2024-04-26T12:41:32.495004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510874+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:41:32.510874+0000","last_peered":"2024-04-26T12:41:32.510874+0000","last_clean":"2024-04-26T12:41:32.510874+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:41:32.510874+0000","last_undegraded":"2024-04-26T12:41:32.510874+0000","last_fullsized":"2024-04-26T12:41:32.510874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":187,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550568+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:41:32.550568+0000","last_peered":"2024-04-26T12:41:32.550568+0000","last_clean":"2024-04-26T12:41:32.550568+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:41:32.550568+0000","last_undegraded":"2024-04-26T12:41:32.550568+0000","last_fullsized":"2024-04-26T12:41:32.550568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563808+0000","last_change":"2024-04-26T12:38:32.098082+0000","last_active":"2024-04-26T12:41:32.563808+0000","last_peered":"2024-04-26T12:41:32.563808+0000","last_clean":"2024-04-26T12:41:32.563808+0000","last_became_active":"2024-04-26T12:38:32.097658+0000","last_became_peered":"2024-04-26T12:38:32.097658+0000","last_unstale":"2024-04-26T12:41:32.563808+0000","last_undegraded":"2024-04-26T12:41:32.563808+0000","last_fullsized":"2024-04-26T12:41:32.563808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:15.092930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"112'13","reported_seq":183,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528867+0000","last_change":"2024-04-26T12:38:32.090992+0000","last_active":"2024-04-26T12:41:32.528867+0000","last_peered":"2024-04-26T12:41:32.528867+0000","last_clean":"2024-04-26T12:41:32.528867+0000","last_became_active":"2024-04-26T12:38:32.090197+0000","last_became_peered":"2024-04-26T12:38:32.090197+0000","last_unstale":"2024-04-26T12:41:32.528867+0000","last_undegraded":"2024-04-26T12:41:32.528867+0000","last_fullsized":"2024-04-26T12:41:32.528867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:51.388263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492761+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:41:32.492761+0000","last_peered":"2024-04-26T12:41:32.492761+0000","last_clean":"2024-04-26T12:41:32.492761+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:41:32.492761+0000","last_undegraded":"2024-04-26T12:41:32.492761+0000","last_fullsized":"2024-04-26T12:41:32.492761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"104'18","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494703+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:41:32.494703+0000","last_peered":"2024-04-26T12:41:32.494703+0000","last_clean":"2024-04-26T12:41:32.494703+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:41:32.494703+0000","last_undegraded":"2024-04-26T12:41:32.494703+0000","last_fullsized":"2024-04-26T12:41:32.494703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494083+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:41:32.494083+0000","last_peered":"2024-04-26T12:41:32.494083+0000","last_clean":"2024-04-26T12:41:32.494083+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:41:32.494083+0000","last_undegraded":"2024-04-26T12:41:32.494083+0000","last_fullsized":"2024-04-26T12:41:32.494083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":178,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495535+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:41:32.495535+0000","last_peered":"2024-04-26T12:41:32.495535+0000","last_clean":"2024-04-26T12:41:32.495535+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:41:32.495535+0000","last_undegraded":"2024-04-26T12:41:32.495535+0000","last_fullsized":"2024-04-26T12:41:32.495535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492549+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:41:32.492549+0000","last_peered":"2024-04-26T12:41:32.492549+0000","last_clean":"2024-04-26T12:41:32.492549+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:41:32.492549+0000","last_undegraded":"2024-04-26T12:41:32.492549+0000","last_fullsized":"2024-04-26T12:41:32.492549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"104'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529476+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:41:32.529476+0000","last_peered":"2024-04-26T12:41:32.529476+0000","last_clean":"2024-04-26T12:41:32.529476+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:41:32.529476+0000","last_undegraded":"2024-04-26T12:41:32.529476+0000","last_fullsized":"2024-04-26T12:41:32.529476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495188+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:41:32.495188+0000","last_peered":"2024-04-26T12:41:32.495188+0000","last_clean":"2024-04-26T12:41:32.495188+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:41:32.495188+0000","last_undegraded":"2024-04-26T12:41:32.495188+0000","last_fullsized":"2024-04-26T12:41:32.495188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"106'8","reported_seq":195,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550459+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:41:32.550459+0000","last_peered":"2024-04-26T12:41:32.550459+0000","last_clean":"2024-04-26T12:41:32.550459+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:41:32.550459+0000","last_undegraded":"2024-04-26T12:41:32.550459+0000","last_fullsized":"2024-04-26T12:41:32.550459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527645+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:41:32.527645+0000","last_peered":"2024-04-26T12:41:32.527645+0000","last_clean":"2024-04-26T12:41:32.527645+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:41:32.527645+0000","last_undegraded":"2024-04-26T12:41:32.527645+0000","last_fullsized":"2024-04-26T12:41:32.527645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":185,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550192+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:41:32.550192+0000","last_peered":"2024-04-26T12:41:32.550192+0000","last_clean":"2024-04-26T12:41:32.550192+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:41:32.550192+0000","last_undegraded":"2024-04-26T12:41:32.550192+0000","last_fullsized":"2024-04-26T12:41:32.550192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495500+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:41:32.495500+0000","last_peered":"2024-04-26T12:41:32.495500+0000","last_clean":"2024-04-26T12:41:32.495500+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:41:32.495500+0000","last_undegraded":"2024-04-26T12:41:32.495500+0000","last_fullsized":"2024-04-26T12:41:32.495500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"104'19","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511519+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:41:32.511519+0000","last_peered":"2024-04-26T12:41:32.511519+0000","last_clean":"2024-04-26T12:41:32.511519+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:41:32.511519+0000","last_undegraded":"2024-04-26T12:41:32.511519+0000","last_fullsized":"2024-04-26T12:41:32.511519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526541+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:41:32.526541+0000","last_peered":"2024-04-26T12:41:32.526541+0000","last_clean":"2024-04-26T12:41:32.526541+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:41:32.526541+0000","last_undegraded":"2024-04-26T12:41:32.526541+0000","last_fullsized":"2024-04-26T12:41:32.526541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"104'18","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495062+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:41:32.495062+0000","last_peered":"2024-04-26T12:41:32.495062+0000","last_clean":"2024-04-26T12:41:32.495062+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:41:32.495062+0000","last_undegraded":"2024-04-26T12:41:32.495062+0000","last_fullsized":"2024-04-26T12:41:32.495062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563932+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:41:32.563932+0000","last_peered":"2024-04-26T12:41:32.563932+0000","last_clean":"2024-04-26T12:41:32.563932+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:41:32.563932+0000","last_undegraded":"2024-04-26T12:41:32.563932+0000","last_fullsized":"2024-04-26T12:41:32.563932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510775+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:41:32.510775+0000","last_peered":"2024-04-26T12:41:32.510775+0000","last_clean":"2024-04-26T12:41:32.510775+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:41:32.510775+0000","last_undegraded":"2024-04-26T12:41:32.510775+0000","last_fullsized":"2024-04-26T12:41:32.510775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494850+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:41:32.494850+0000","last_peered":"2024-04-26T12:41:32.494850+0000","last_clean":"2024-04-26T12:41:32.494850+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:41:32.494850+0000","last_undegraded":"2024-04-26T12:41:32.494850+0000","last_fullsized":"2024-04-26T12:41:32.494850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'13","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552448+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:41:32.552448+0000","last_peered":"2024-04-26T12:41:32.552448+0000","last_clean":"2024-04-26T12:41:32.552448+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:41:32.552448+0000","last_undegraded":"2024-04-26T12:41:32.552448+0000","last_fullsized":"2024-04-26T12:41:32.552448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564169+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:41:32.564169+0000","last_peered":"2024-04-26T12:41:32.564169+0000","last_clean":"2024-04-26T12:41:32.564169+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:41:32.564169+0000","last_undegraded":"2024-04-26T12:41:32.564169+0000","last_fullsized":"2024-04-26T12:41:32.564169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"104'19","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527300+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:41:32.527300+0000","last_peered":"2024-04-26T12:41:32.527300+0000","last_clean":"2024-04-26T12:41:32.527300+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:41:32.527300+0000","last_undegraded":"2024-04-26T12:41:32.527300+0000","last_fullsized":"2024-04-26T12:41:32.527300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551226+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:41:32.551226+0000","last_peered":"2024-04-26T12:41:32.551226+0000","last_clean":"2024-04-26T12:41:32.551226+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:41:32.551226+0000","last_undegraded":"2024-04-26T12:41:32.551226+0000","last_fullsized":"2024-04-26T12:41:32.551226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":202,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564168+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:41:32.564168+0000","last_peered":"2024-04-26T12:41:32.564168+0000","last_clean":"2024-04-26T12:41:32.564168+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:41:32.564168+0000","last_undegraded":"2024-04-26T12:41:32.564168+0000","last_fullsized":"2024-04-26T12:41:32.564168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'11","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494640+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:41:32.494640+0000","last_peered":"2024-04-26T12:41:32.494640+0000","last_clean":"2024-04-26T12:41:32.494640+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:41:32.494640+0000","last_undegraded":"2024-04-26T12:41:32.494640+0000","last_fullsized":"2024-04-26T12:41:32.494640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552649+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:41:32.552649+0000","last_peered":"2024-04-26T12:41:32.552649+0000","last_clean":"2024-04-26T12:41:32.552649+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:41:32.552649+0000","last_undegraded":"2024-04-26T12:41:32.552649+0000","last_fullsized":"2024-04-26T12:41:32.552649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"104'26","reported_seq":223,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493941+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:41:32.493941+0000","last_peered":"2024-04-26T12:41:32.493941+0000","last_clean":"2024-04-26T12:41:32.493941+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:41:32.493941+0000","last_undegraded":"2024-04-26T12:41:32.493941+0000","last_fullsized":"2024-04-26T12:41:32.493941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":183,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510889+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:41:32.510889+0000","last_peered":"2024-04-26T12:41:32.510889+0000","last_clean":"2024-04-26T12:41:32.510889+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:41:32.510889+0000","last_undegraded":"2024-04-26T12:41:32.510889+0000","last_fullsized":"2024-04-26T12:41:32.510889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":178,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494831+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:41:32.494831+0000","last_peered":"2024-04-26T12:41:32.494831+0000","last_clean":"2024-04-26T12:41:32.494831+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:41:32.494831+0000","last_undegraded":"2024-04-26T12:41:32.494831+0000","last_fullsized":"2024-04-26T12:41:32.494831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":250,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552788+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:41:32.552788+0000","last_peered":"2024-04-26T12:41:32.552788+0000","last_clean":"2024-04-26T12:41:32.552788+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:41:32.552788+0000","last_undegraded":"2024-04-26T12:41:32.552788+0000","last_fullsized":"2024-04-26T12:41:32.552788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'21","reported_seq":219,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492371+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:41:32.492371+0000","last_peered":"2024-04-26T12:41:32.492371+0000","last_clean":"2024-04-26T12:41:32.492371+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:41:32.492371+0000","last_undegraded":"2024-04-26T12:41:32.492371+0000","last_fullsized":"2024-04-26T12:41:32.492371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563887+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:41:32.563887+0000","last_peered":"2024-04-26T12:41:32.563887+0000","last_clean":"2024-04-26T12:41:32.563887+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:41:32.563887+0000","last_undegraded":"2024-04-26T12:41:32.563887+0000","last_fullsized":"2024-04-26T12:41:32.563887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"104'22","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528457+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:41:32.528457+0000","last_peered":"2024-04-26T12:41:32.528457+0000","last_clean":"2024-04-26T12:41:32.528457+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:41:32.528457+0000","last_undegraded":"2024-04-26T12:41:32.528457+0000","last_fullsized":"2024-04-26T12:41:32.528457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494825+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:41:32.494825+0000","last_peered":"2024-04-26T12:41:32.494825+0000","last_clean":"2024-04-26T12:41:32.494825+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:41:32.494825+0000","last_undegraded":"2024-04-26T12:41:32.494825+0000","last_fullsized":"2024-04-26T12:41:32.494825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.562879+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:41:32.562879+0000","last_peered":"2024-04-26T12:41:32.562879+0000","last_clean":"2024-04-26T12:41:32.562879+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:41:32.562879+0000","last_undegraded":"2024-04-26T12:41:32.562879+0000","last_fullsized":"2024-04-26T12:41:32.562879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495762+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:41:32.495762+0000","last_peered":"2024-04-26T12:41:32.495762+0000","last_clean":"2024-04-26T12:41:32.495762+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:41:32.495762+0000","last_undegraded":"2024-04-26T12:41:32.495762+0000","last_fullsized":"2024-04-26T12:41:32.495762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'13","reported_seq":184,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.497001+0000","last_change":"2024-04-26T12:38:32.097004+0000","last_active":"2024-04-26T12:41:32.497001+0000","last_peered":"2024-04-26T12:41:32.497001+0000","last_clean":"2024-04-26T12:41:32.497001+0000","last_became_active":"2024-04-26T12:38:32.096196+0000","last_became_peered":"2024-04-26T12:38:32.096196+0000","last_unstale":"2024-04-26T12:41:32.497001+0000","last_undegraded":"2024-04-26T12:41:32.497001+0000","last_fullsized":"2024-04-26T12:41:32.497001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:00.173484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495640+0000","last_change":"2024-04-26T12:38:32.100356+0000","last_active":"2024-04-26T12:41:32.495640+0000","last_peered":"2024-04-26T12:41:32.495640+0000","last_clean":"2024-04-26T12:41:32.495640+0000","last_became_active":"2024-04-26T12:38:32.099529+0000","last_became_peered":"2024-04-26T12:38:32.099529+0000","last_unstale":"2024-04-26T12:41:32.495640+0000","last_undegraded":"2024-04-26T12:41:32.495640+0000","last_fullsized":"2024-04-26T12:41:32.495640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:32.397561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"104'18","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496216+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:41:32.496216+0000","last_peered":"2024-04-26T12:41:32.496216+0000","last_clean":"2024-04-26T12:41:32.496216+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:41:32.496216+0000","last_undegraded":"2024-04-26T12:41:32.496216+0000","last_fullsized":"2024-04-26T12:41:32.496216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493538+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:41:32.493538+0000","last_peered":"2024-04-26T12:41:32.493538+0000","last_clean":"2024-04-26T12:41:32.493538+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:41:32.493538+0000","last_undegraded":"2024-04-26T12:41:32.493538+0000","last_fullsized":"2024-04-26T12:41:32.493538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510312+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:41:32.510312+0000","last_peered":"2024-04-26T12:41:32.510312+0000","last_clean":"2024-04-26T12:41:32.510312+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:41:32.510312+0000","last_undegraded":"2024-04-26T12:41:32.510312+0000","last_fullsized":"2024-04-26T12:41:32.510312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520121+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:41:32.520121+0000","last_peered":"2024-04-26T12:41:32.520121+0000","last_clean":"2024-04-26T12:41:32.520121+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:41:32.520121+0000","last_undegraded":"2024-04-26T12:41:32.520121+0000","last_fullsized":"2024-04-26T12:41:32.520121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'19","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551273+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:41:32.551273+0000","last_peered":"2024-04-26T12:41:32.551273+0000","last_clean":"2024-04-26T12:41:32.551273+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:41:32.551273+0000","last_undegraded":"2024-04-26T12:41:32.551273+0000","last_fullsized":"2024-04-26T12:41:32.551273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494359+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:41:32.494359+0000","last_peered":"2024-04-26T12:41:32.494359+0000","last_clean":"2024-04-26T12:41:32.494359+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:41:32.494359+0000","last_undegraded":"2024-04-26T12:41:32.494359+0000","last_fullsized":"2024-04-26T12:41:32.494359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"68'11","reported_seq":205,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564659+0000","last_change":"2024-04-26T12:38:32.098589+0000","last_active":"2024-04-26T12:41:32.564659+0000","last_peered":"2024-04-26T12:41:32.564659+0000","last_clean":"2024-04-26T12:41:32.564659+0000","last_became_active":"2024-04-26T12:38:32.097940+0000","last_became_peered":"2024-04-26T12:38:32.097940+0000","last_unstale":"2024-04-26T12:41:32.564659+0000","last_undegraded":"2024-04-26T12:41:32.564659+0000","last_fullsized":"2024-04-26T12:41:32.564659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"108'131","reported_seq":355,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563333+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:41:32.563333+0000","last_peered":"2024-04-26T12:41:32.563333+0000","last_clean":"2024-04-26T12:41:32.563333+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:41:32.563333+0000","last_undegraded":"2024-04-26T12:41:32.563333+0000","last_fullsized":"2024-04-26T12:41:32.563333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"108'3","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526345+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:41:32.526345+0000","last_peered":"2024-04-26T12:41:32.526345+0000","last_clean":"2024-04-26T12:41:32.526345+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:41:32.526345+0000","last_undegraded":"2024-04-26T12:41:32.526345+0000","last_fullsized":"2024-04-26T12:41:32.526345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":200,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495675+0000","last_change":"2024-04-26T12:38:32.097299+0000","last_active":"2024-04-26T12:41:32.495675+0000","last_peered":"2024-04-26T12:41:32.495675+0000","last_clean":"2024-04-26T12:41:32.495675+0000","last_became_active":"2024-04-26T12:38:32.096485+0000","last_became_peered":"2024-04-26T12:38:32.096485+0000","last_unstale":"2024-04-26T12:41:32.495675+0000","last_undegraded":"2024-04-26T12:41:32.495675+0000","last_fullsized":"2024-04-26T12:41:32.495675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:18.433433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"111'18","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511007+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:41:32.511007+0000","last_peered":"2024-04-26T12:41:32.511007+0000","last_clean":"2024-04-26T12:41:32.511007+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:41:32.511007+0000","last_undegraded":"2024-04-26T12:41:32.511007+0000","last_fullsized":"2024-04-26T12:41:32.511007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527507+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:41:32.527507+0000","last_peered":"2024-04-26T12:41:32.527507+0000","last_clean":"2024-04-26T12:41:32.527507+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:41:32.527507+0000","last_undegraded":"2024-04-26T12:41:32.527507+0000","last_fullsized":"2024-04-26T12:41:32.527507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"104'23","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510469+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:41:32.510469+0000","last_peered":"2024-04-26T12:41:32.510469+0000","last_clean":"2024-04-26T12:41:32.510469+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:41:32.510469+0000","last_undegraded":"2024-04-26T12:41:32.510469+0000","last_fullsized":"2024-04-26T12:41:32.510469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550302+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:41:32.550302+0000","last_peered":"2024-04-26T12:41:32.550302+0000","last_clean":"2024-04-26T12:41:32.550302+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:41:32.550302+0000","last_undegraded":"2024-04-26T12:41:32.550302+0000","last_fullsized":"2024-04-26T12:41:32.550302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":177,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.533969+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:41:32.533969+0000","last_peered":"2024-04-26T12:41:32.533969+0000","last_clean":"2024-04-26T12:41:32.533969+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:41:32.533969+0000","last_undegraded":"2024-04-26T12:41:32.533969+0000","last_fullsized":"2024-04-26T12:41:32.533969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"108'9","reported_seq":192,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495227+0000","last_change":"2024-04-26T12:38:32.097693+0000","last_active":"2024-04-26T12:41:32.495227+0000","last_peered":"2024-04-26T12:41:32.495227+0000","last_clean":"2024-04-26T12:41:32.495227+0000","last_became_active":"2024-04-26T12:38:32.096141+0000","last_became_peered":"2024-04-26T12:38:32.096141+0000","last_unstale":"2024-04-26T12:41:32.495227+0000","last_undegraded":"2024-04-26T12:41:32.495227+0000","last_fullsized":"2024-04-26T12:41:32.495227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.450059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"112'26","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550423+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:41:32.550423+0000","last_peered":"2024-04-26T12:41:32.550423+0000","last_clean":"2024-04-26T12:41:32.550423+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:41:32.550423+0000","last_undegraded":"2024-04-26T12:41:32.550423+0000","last_fullsized":"2024-04-26T12:41:32.550423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":191,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510771+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:41:32.510771+0000","last_peered":"2024-04-26T12:41:32.510771+0000","last_clean":"2024-04-26T12:41:32.510771+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:41:32.510771+0000","last_undegraded":"2024-04-26T12:41:32.510771+0000","last_fullsized":"2024-04-26T12:41:32.510771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"104'17","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550362+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:41:32.550362+0000","last_peered":"2024-04-26T12:41:32.550362+0000","last_clean":"2024-04-26T12:41:32.550362+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:41:32.550362+0000","last_undegraded":"2024-04-26T12:41:32.550362+0000","last_fullsized":"2024-04-26T12:41:32.550362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563343+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:41:32.563343+0000","last_peered":"2024-04-26T12:41:32.563343+0000","last_clean":"2024-04-26T12:41:32.563343+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:41:32.563343+0000","last_undegraded":"2024-04-26T12:41:32.563343+0000","last_fullsized":"2024-04-26T12:41:32.563343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495645+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:41:32.495645+0000","last_peered":"2024-04-26T12:41:32.495645+0000","last_clean":"2024-04-26T12:41:32.495645+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:41:32.495645+0000","last_undegraded":"2024-04-26T12:41:32.495645+0000","last_fullsized":"2024-04-26T12:41:32.495645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495784+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:41:32.495784+0000","last_peered":"2024-04-26T12:41:32.495784+0000","last_clean":"2024-04-26T12:41:32.495784+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:41:32.495784+0000","last_undegraded":"2024-04-26T12:41:32.495784+0000","last_fullsized":"2024-04-26T12:41:32.495784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'20","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496056+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:41:32.496056+0000","last_peered":"2024-04-26T12:41:32.496056+0000","last_clean":"2024-04-26T12:41:32.496056+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:41:32.496056+0000","last_undegraded":"2024-04-26T12:41:32.496056+0000","last_fullsized":"2024-04-26T12:41:32.496056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563108+0000","last_change":"2024-04-26T12:38:32.098077+0000","last_active":"2024-04-26T12:41:32.563108+0000","last_peered":"2024-04-26T12:41:32.563108+0000","last_clean":"2024-04-26T12:41:32.563108+0000","last_became_active":"2024-04-26T12:38:32.097608+0000","last_became_peered":"2024-04-26T12:38:32.097608+0000","last_unstale":"2024-04-26T12:41:32.563108+0000","last_undegraded":"2024-04-26T12:41:32.563108+0000","last_fullsized":"2024-04-26T12:41:32.563108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:52.163433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"104'13","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496966+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:41:32.496966+0000","last_peered":"2024-04-26T12:41:32.496966+0000","last_clean":"2024-04-26T12:41:32.496966+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:41:32.496966+0000","last_undegraded":"2024-04-26T12:41:32.496966+0000","last_fullsized":"2024-04-26T12:41:32.496966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":172,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563717+0000","last_change":"2024-04-26T12:38:32.097869+0000","last_active":"2024-04-26T12:41:32.563717+0000","last_peered":"2024-04-26T12:41:32.563717+0000","last_clean":"2024-04-26T12:41:32.563717+0000","last_became_active":"2024-04-26T12:38:32.097545+0000","last_became_peered":"2024-04-26T12:38:32.097545+0000","last_unstale":"2024-04-26T12:41:32.563717+0000","last_undegraded":"2024-04-26T12:41:32.563717+0000","last_fullsized":"2024-04-26T12:41:32.563717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:00.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526948+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:41:32.526948+0000","last_peered":"2024-04-26T12:41:32.526948+0000","last_clean":"2024-04-26T12:41:32.526948+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:41:32.526948+0000","last_undegraded":"2024-04-26T12:41:32.526948+0000","last_fullsized":"2024-04-26T12:41:32.526948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563182+0000","last_change":"2024-04-26T12:38:32.098742+0000","last_active":"2024-04-26T12:41:32.563182+0000","last_peered":"2024-04-26T12:41:32.563182+0000","last_clean":"2024-04-26T12:41:32.563182+0000","last_became_active":"2024-04-26T12:38:32.098197+0000","last_became_peered":"2024-04-26T12:38:32.098197+0000","last_unstale":"2024-04-26T12:41:32.563182+0000","last_undegraded":"2024-04-26T12:41:32.563182+0000","last_fullsized":"2024-04-26T12:41:32.563182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.480181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"112'19","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.568144+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:41:32.568144+0000","last_peered":"2024-04-26T12:41:32.568144+0000","last_clean":"2024-04-26T12:41:32.568144+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:41:32.568144+0000","last_undegraded":"2024-04-26T12:41:32.568144+0000","last_fullsized":"2024-04-26T12:41:32.568144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":279,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491736+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:41:32.491736+0000","last_peered":"2024-04-26T12:41:32.491736+0000","last_clean":"2024-04-26T12:41:32.491736+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:41:32.491736+0000","last_undegraded":"2024-04-26T12:41:32.491736+0000","last_fullsized":"2024-04-26T12:41:32.491736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":130,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"104'16","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510503+0000","last_change":"2024-04-26T12:38:32.089759+0000","last_active":"2024-04-26T12:41:32.510503+0000","last_peered":"2024-04-26T12:41:32.510503+0000","last_clean":"2024-04-26T12:41:32.510503+0000","last_became_active":"2024-04-26T12:38:32.088214+0000","last_became_peered":"2024-04-26T12:38:32.088214+0000","last_unstale":"2024-04-26T12:41:32.510503+0000","last_undegraded":"2024-04-26T12:41:32.510503+0000","last_fullsized":"2024-04-26T12:41:32.510503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:38.656355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551175+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:41:32.551175+0000","last_peered":"2024-04-26T12:41:32.551175+0000","last_clean":"2024-04-26T12:41:32.551175+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:41:32.551175+0000","last_undegraded":"2024-04-26T12:41:32.551175+0000","last_fullsized":"2024-04-26T12:41:32.551175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":176,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551855+0000","last_change":"2024-04-26T12:38:32.098228+0000","last_active":"2024-04-26T12:41:32.551855+0000","last_peered":"2024-04-26T12:41:32.551855+0000","last_clean":"2024-04-26T12:41:32.551855+0000","last_became_active":"2024-04-26T12:38:32.092404+0000","last_became_peered":"2024-04-26T12:38:32.092404+0000","last_unstale":"2024-04-26T12:41:32.551855+0000","last_undegraded":"2024-04-26T12:41:32.551855+0000","last_fullsized":"2024-04-26T12:41:32.551855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"108'7","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494318+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:41:32.494318+0000","last_peered":"2024-04-26T12:41:32.494318+0000","last_clean":"2024-04-26T12:41:32.494318+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:41:32.494318+0000","last_undegraded":"2024-04-26T12:41:32.494318+0000","last_fullsized":"2024-04-26T12:41:32.494318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"104'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563415+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:41:32.563415+0000","last_peered":"2024-04-26T12:41:32.563415+0000","last_clean":"2024-04-26T12:41:32.563415+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:41:32.563415+0000","last_undegraded":"2024-04-26T12:41:32.563415+0000","last_fullsized":"2024-04-26T12:41:32.563415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":243,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493869+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:41:32.493869+0000","last_peered":"2024-04-26T12:41:32.493869+0000","last_clean":"2024-04-26T12:41:32.493869+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:41:32.493869+0000","last_undegraded":"2024-04-26T12:41:32.493869+0000","last_fullsized":"2024-04-26T12:41:32.493869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"112'21","reported_seq":224,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.673658+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:41:32.673658+0000","last_peered":"2024-04-26T12:41:32.673658+0000","last_clean":"2024-04-26T12:41:32.673658+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:41:32.673658+0000","last_undegraded":"2024-04-26T12:41:32.673658+0000","last_fullsized":"2024-04-26T12:41:32.673658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511035+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:41:32.511035+0000","last_peered":"2024-04-26T12:41:32.511035+0000","last_clean":"2024-04-26T12:41:32.511035+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:41:32.511035+0000","last_undegraded":"2024-04-26T12:41:32.511035+0000","last_fullsized":"2024-04-26T12:41:32.511035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'20","reported_seq":219,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510688+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:41:32.510688+0000","last_peered":"2024-04-26T12:41:32.510688+0000","last_clean":"2024-04-26T12:41:32.510688+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:41:32.510688+0000","last_undegraded":"2024-04-26T12:41:32.510688+0000","last_fullsized":"2024-04-26T12:41:32.510688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"108'3","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493798+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:41:32.493798+0000","last_peered":"2024-04-26T12:41:32.493798+0000","last_clean":"2024-04-26T12:41:32.493798+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:41:32.493798+0000","last_undegraded":"2024-04-26T12:41:32.493798+0000","last_fullsized":"2024-04-26T12:41:32.493798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"104'23","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551367+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:41:32.551367+0000","last_peered":"2024-04-26T12:41:32.551367+0000","last_clean":"2024-04-26T12:41:32.551367+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:41:32.551367+0000","last_undegraded":"2024-04-26T12:41:32.551367+0000","last_fullsized":"2024-04-26T12:41:32.551367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495437+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:41:32.495437+0000","last_peered":"2024-04-26T12:41:32.495437+0000","last_clean":"2024-04-26T12:41:32.495437+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:41:32.495437+0000","last_undegraded":"2024-04-26T12:41:32.495437+0000","last_fullsized":"2024-04-26T12:41:32.495437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"112'14","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496297+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:41:32.496297+0000","last_peered":"2024-04-26T12:41:32.496297+0000","last_clean":"2024-04-26T12:41:32.496297+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:41:32.496297+0000","last_undegraded":"2024-04-26T12:41:32.496297+0000","last_fullsized":"2024-04-26T12:41:32.496297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564885+0000","last_change":"2024-04-26T12:38:32.099762+0000","last_active":"2024-04-26T12:41:32.564885+0000","last_peered":"2024-04-26T12:41:32.564885+0000","last_clean":"2024-04-26T12:41:32.564885+0000","last_became_active":"2024-04-26T12:38:32.099061+0000","last_became_peered":"2024-04-26T12:38:32.099061+0000","last_unstale":"2024-04-26T12:41:32.564885+0000","last_undegraded":"2024-04-26T12:41:32.564885+0000","last_fullsized":"2024-04-26T12:41:32.564885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:17.530530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"111'14","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494726+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:41:32.494726+0000","last_peered":"2024-04-26T12:41:32.494726+0000","last_clean":"2024-04-26T12:41:32.494726+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:41:32.494726+0000","last_undegraded":"2024-04-26T12:41:32.494726+0000","last_fullsized":"2024-04-26T12:41:32.494726+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":199,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495345+0000","last_change":"2024-04-26T12:38:58.795730+0000","last_active":"2024-04-26T12:41:32.495345+0000","last_peered":"2024-04-26T12:41:32.495345+0000","last_clean":"2024-04-26T12:41:32.495345+0000","last_became_active":"2024-04-26T12:38:58.795097+0000","last_became_peered":"2024-04-26T12:38:58.795097+0000","last_unstale":"2024-04-26T12:41:32.495345+0000","last_undegraded":"2024-04-26T12:41:32.495345+0000","last_fullsized":"2024-04-26T12:41:32.495345+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.166788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"112'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564756+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:41:32.564756+0000","last_peered":"2024-04-26T12:41:32.564756+0000","last_clean":"2024-04-26T12:41:32.564756+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:41:32.564756+0000","last_undegraded":"2024-04-26T12:41:32.564756+0000","last_fullsized":"2024-04-26T12:41:32.564756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"108'11","reported_seq":237,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.565233+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:41:32.565233+0000","last_peered":"2024-04-26T12:41:32.565233+0000","last_clean":"2024-04-26T12:41:32.565233+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:41:32.565233+0000","last_undegraded":"2024-04-26T12:41:32.565233+0000","last_fullsized":"2024-04-26T12:41:32.565233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":219,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495982+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:41:32.495982+0000","last_peered":"2024-04-26T12:41:32.495982+0000","last_clean":"2024-04-26T12:41:32.495982+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:41:32.495982+0000","last_undegraded":"2024-04-26T12:41:32.495982+0000","last_fullsized":"2024-04-26T12:41:32.495982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":228,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552338+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:41:32.552338+0000","last_peered":"2024-04-26T12:41:32.552338+0000","last_clean":"2024-04-26T12:41:32.552338+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:41:32.552338+0000","last_undegraded":"2024-04-26T12:41:32.552338+0000","last_fullsized":"2024-04-26T12:41:32.552338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"112'20","reported_seq":219,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510666+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:41:32.510666+0000","last_peered":"2024-04-26T12:41:32.510666+0000","last_clean":"2024-04-26T12:41:32.510666+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:41:32.510666+0000","last_undegraded":"2024-04-26T12:41:32.510666+0000","last_fullsized":"2024-04-26T12:41:32.510666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520370+0000","last_change":"2024-04-26T12:38:32.101184+0000","last_active":"2024-04-26T12:41:32.520370+0000","last_peered":"2024-04-26T12:41:32.520370+0000","last_clean":"2024-04-26T12:41:32.520370+0000","last_became_active":"2024-04-26T12:38:32.100885+0000","last_became_peered":"2024-04-26T12:38:32.100885+0000","last_unstale":"2024-04-26T12:41:32.520370+0000","last_undegraded":"2024-04-26T12:41:32.520370+0000","last_fullsized":"2024-04-26T12:41:32.520370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:14.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"112'12","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496036+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:41:32.496036+0000","last_peered":"2024-04-26T12:41:32.496036+0000","last_clean":"2024-04-26T12:41:32.496036+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:41:32.496036+0000","last_undegraded":"2024-04-26T12:41:32.496036+0000","last_fullsized":"2024-04-26T12:41:32.496036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"108'3","reported_seq":203,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520048+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:41:32.520048+0000","last_peered":"2024-04-26T12:41:32.520048+0000","last_clean":"2024-04-26T12:41:32.520048+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:41:32.520048+0000","last_undegraded":"2024-04-26T12:41:32.520048+0000","last_fullsized":"2024-04-26T12:41:32.520048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"104'14","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510642+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:41:32.510642+0000","last_peered":"2024-04-26T12:41:32.510642+0000","last_clean":"2024-04-26T12:41:32.510642+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:41:32.510642+0000","last_undegraded":"2024-04-26T12:41:32.510642+0000","last_fullsized":"2024-04-26T12:41:32.510642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"108'7","reported_seq":197,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563547+0000","last_change":"2024-04-26T12:38:32.097249+0000","last_active":"2024-04-26T12:41:32.563547+0000","last_peered":"2024-04-26T12:41:32.563547+0000","last_clean":"2024-04-26T12:41:32.563547+0000","last_became_active":"2024-04-26T12:38:32.096972+0000","last_became_peered":"2024-04-26T12:38:32.096972+0000","last_unstale":"2024-04-26T12:41:32.563547+0000","last_undegraded":"2024-04-26T12:41:32.563547+0000","last_fullsized":"2024-04-26T12:41:32.563547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:06.018406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"104'16","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551459+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:41:32.551459+0000","last_peered":"2024-04-26T12:41:32.551459+0000","last_clean":"2024-04-26T12:41:32.551459+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:41:32.551459+0000","last_undegraded":"2024-04-26T12:41:32.551459+0000","last_fullsized":"2024-04-26T12:41:32.551459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527862+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:41:32.527862+0000","last_peered":"2024-04-26T12:41:32.527862+0000","last_clean":"2024-04-26T12:41:32.527862+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:41:32.527862+0000","last_undegraded":"2024-04-26T12:41:32.527862+0000","last_fullsized":"2024-04-26T12:41:32.527862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'11","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564035+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:41:32.564035+0000","last_peered":"2024-04-26T12:41:32.564035+0000","last_clean":"2024-04-26T12:41:32.564035+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:41:32.564035+0000","last_undegraded":"2024-04-26T12:41:32.564035+0000","last_fullsized":"2024-04-26T12:41:32.564035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551141+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:41:32.551141+0000","last_peered":"2024-04-26T12:41:32.551141+0000","last_clean":"2024-04-26T12:41:32.551141+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:41:32.551141+0000","last_undegraded":"2024-04-26T12:41:32.551141+0000","last_fullsized":"2024-04-26T12:41:32.551141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'19","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529640+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:41:32.529640+0000","last_peered":"2024-04-26T12:41:32.529640+0000","last_clean":"2024-04-26T12:41:32.529640+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:41:32.529640+0000","last_undegraded":"2024-04-26T12:41:32.529640+0000","last_fullsized":"2024-04-26T12:41:32.529640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495175+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:41:32.495175+0000","last_peered":"2024-04-26T12:41:32.495175+0000","last_clean":"2024-04-26T12:41:32.495175+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:41:32.495175+0000","last_undegraded":"2024-04-26T12:41:32.495175+0000","last_fullsized":"2024-04-26T12:41:32.495175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"104'12","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520478+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:41:32.520478+0000","last_peered":"2024-04-26T12:41:32.520478+0000","last_clean":"2024-04-26T12:41:32.520478+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:41:32.520478+0000","last_undegraded":"2024-04-26T12:41:32.520478+0000","last_fullsized":"2024-04-26T12:41:32.520478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526805+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:41:32.526805+0000","last_peered":"2024-04-26T12:41:32.526805+0000","last_clean":"2024-04-26T12:41:32.526805+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:41:32.526805+0000","last_undegraded":"2024-04-26T12:41:32.526805+0000","last_fullsized":"2024-04-26T12:41:32.526805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'11","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511853+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:41:32.511853+0000","last_peered":"2024-04-26T12:41:32.511853+0000","last_clean":"2024-04-26T12:41:32.511853+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:41:32.511853+0000","last_undegraded":"2024-04-26T12:41:32.511853+0000","last_fullsized":"2024-04-26T12:41:32.511853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"104'15","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510504+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:41:32.510504+0000","last_peered":"2024-04-26T12:41:32.510504+0000","last_clean":"2024-04-26T12:41:32.510504+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:41:32.510504+0000","last_undegraded":"2024-04-26T12:41:32.510504+0000","last_fullsized":"2024-04-26T12:41:32.510504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":202,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552268+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:41:32.552268+0000","last_peered":"2024-04-26T12:41:32.552268+0000","last_clean":"2024-04-26T12:41:32.552268+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:41:32.552268+0000","last_undegraded":"2024-04-26T12:41:32.552268+0000","last_fullsized":"2024-04-26T12:41:32.552268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"104'22","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492147+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:41:32.492147+0000","last_peered":"2024-04-26T12:41:32.492147+0000","last_clean":"2024-04-26T12:41:32.492147+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:41:32.492147+0000","last_undegraded":"2024-04-26T12:41:32.492147+0000","last_fullsized":"2024-04-26T12:41:32.492147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"108'1","reported_seq":196,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511424+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:41:32.511424+0000","last_peered":"2024-04-26T12:41:32.511424+0000","last_clean":"2024-04-26T12:41:32.511424+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:41:32.511424+0000","last_undegraded":"2024-04-26T12:41:32.511424+0000","last_fullsized":"2024-04-26T12:41:32.511424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1005,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":350,"num_read_kb":330,"num_write":289,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1048,"ondisk_log_size":1048,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":262295,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":839,"num_read_kb":601,"num_write":457,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":786432,"data_stored":476758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":719,"ondisk_log_size":719,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":434,"num_read_kb":434,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1374,"num_read_kb":1346,"num_write":295,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4517265408,"num_objects":1079,"num_object_clones":0,"num_object_copies":2158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1079,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":1163,"num_write_kb":4440064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9042919424,"data_stored":9042919424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1093,"ondisk_log_size":1093,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1159576,"kb_used_data":1128392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93212264,"statfs":{"total":96636764160,"available":95449358336,"internally_reserved":0,"allocated":1155473408,"data_stored":1154869107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775924,"kb_used_data":744744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93595916,"statfs":{"total":96636764160,"available":95842217984,"internally_reserved":0,"allocated":762617856,"data_stored":762050985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1318760,"kb_used_data":1287576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93053080,"statfs":{"total":96636764160,"available":95286353920,"internally_reserved":0,"allocated":1318477824,"data_stored":1317849848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1287932,"kb_used_data":1252652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93083908,"statfs":{"total":96636764160,"available":95317921792,"internally_reserved":0,"allocated":1282715648,"data_stored":1282152038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1343372,"kb_used_data":1308032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93028468,"statfs":{"total":96636764160,"available":95261151232,"internally_reserved":0,"allocated":1339424768,"data_stored":1338827348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":782128,"kb_used_data":746788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93589712,"statfs":{"total":96636764160,"available":95835865088,"internally_reserved":0,"allocated":764710912,"data_stored":764148329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":819164,"kb_used_data":783820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93552676,"statfs":{"total":96636764160,"available":95797940224,"internally_reserved":0,"allocated":802631680,"data_stored":802024313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1188396,"kb_used_data":1153056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93183444,"statfs":{"total":96636764160,"available":95419846656,"internally_reserved":0,"allocated":1180729344,"data_stored":1180149466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1262485504,"data_stored":1262485504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":801112064,"data_stored":801112064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":826277888,"data_stored":826277888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1409286144,"data_stored":1409286144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1306525696,"data_stored":1306525696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1421869056,"data_stored":1421869056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":807403520,"data_stored":807403520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1207959552,"data_stored":1207959552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":175679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":60224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:41:37.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:41:37.973 INFO:tasks.workunit.client.0.smithi016.stdout:user qa_user deleted 2024-04-26T12:41:37.973 INFO:tasks.workunit.client.0.smithi016.stdout:bucket delete succeeded 2024-04-26T12:41:37.975 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:37.971+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:37.977 INFO:tasks.workunit.client.0.smithi016.stdout:OK 2024-04-26T12:41:37.977 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T12:41:37.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T12:41:38.029 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-04-26T12:41:38.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T12:41:38.050 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:38.051 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:38.051 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:41:38.051 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:38.064 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T12:41:38.120 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:41:38.121+0000 7fe61e797640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25120) UID: 0 2024-04-26T12:41:38.178 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-04-26T12:41:38.175+0000 7f63271ed640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25347) UID: 0 2024-04-26T12:41:38.229 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T12:41:38.232 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:38.232 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:38.232 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:41:38.232 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:41:38.232 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:38.246 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T12:41:38.269 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:41:38.275 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:41:38.285 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-04-26T12:41:37.545190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4518120689,"num_objects":1290,"num_object_clones":0,"num_object_copies":2580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1290,"num_whiteouts":0,"num_read":3141,"num_read_kb":2832,"num_write":2373,"num_write_kb":4442890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3381,"ondisk_log_size":3381,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8675252,"kb_used_data":8405060,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":746299468,"statfs":{"total":773094113280,"available":764210655232,"internally_reserved":0,"allocated":8606781440,"data_stored":8602071434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.030023"},"pg_stats":[{"pgid":"3.3f","version":"104'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.533822+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:41:32.533822+0000","last_peered":"2024-04-26T12:41:32.533822+0000","last_clean":"2024-04-26T12:41:32.533822+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:41:32.533822+0000","last_undegraded":"2024-04-26T12:41:32.533822+0000","last_fullsized":"2024-04-26T12:41:32.533822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"108'5","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510293+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:41:32.510293+0000","last_peered":"2024-04-26T12:41:32.510293+0000","last_clean":"2024-04-26T12:41:32.510293+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:41:32.510293+0000","last_undegraded":"2024-04-26T12:41:32.510293+0000","last_fullsized":"2024-04-26T12:41:32.510293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"111'12","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493972+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:41:32.493972+0000","last_peered":"2024-04-26T12:41:32.493972+0000","last_clean":"2024-04-26T12:41:32.493972+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:41:32.493972+0000","last_undegraded":"2024-04-26T12:41:32.493972+0000","last_fullsized":"2024-04-26T12:41:32.493972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527900+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:41:32.527900+0000","last_peered":"2024-04-26T12:41:32.527900+0000","last_clean":"2024-04-26T12:41:32.527900+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:41:32.527900+0000","last_undegraded":"2024-04-26T12:41:32.527900+0000","last_fullsized":"2024-04-26T12:41:32.527900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"111'13","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552071+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:41:32.552071+0000","last_peered":"2024-04-26T12:41:32.552071+0000","last_clean":"2024-04-26T12:41:32.552071+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:41:32.552071+0000","last_undegraded":"2024-04-26T12:41:32.552071+0000","last_fullsized":"2024-04-26T12:41:32.552071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":170,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551501+0000","last_change":"2024-04-26T12:38:32.099160+0000","last_active":"2024-04-26T12:41:32.551501+0000","last_peered":"2024-04-26T12:41:32.551501+0000","last_clean":"2024-04-26T12:41:32.551501+0000","last_became_active":"2024-04-26T12:38:32.093033+0000","last_became_peered":"2024-04-26T12:38:32.093033+0000","last_unstale":"2024-04-26T12:41:32.551501+0000","last_undegraded":"2024-04-26T12:41:32.551501+0000","last_fullsized":"2024-04-26T12:41:32.551501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:22.221188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"112'23","reported_seq":222,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.512727+0000","last_change":"2024-04-26T12:38:10.445181+0000","last_active":"2024-04-26T12:41:32.512727+0000","last_peered":"2024-04-26T12:41:32.512727+0000","last_clean":"2024-04-26T12:41:32.512727+0000","last_became_active":"2024-04-26T12:38:10.444435+0000","last_became_peered":"2024-04-26T12:38:10.444435+0000","last_unstale":"2024-04-26T12:41:32.512727+0000","last_undegraded":"2024-04-26T12:41:32.512727+0000","last_fullsized":"2024-04-26T12:41:32.512727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":193,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551321+0000","last_change":"2024-04-26T12:38:12.447085+0000","last_active":"2024-04-26T12:41:32.551321+0000","last_peered":"2024-04-26T12:41:32.551321+0000","last_clean":"2024-04-26T12:41:32.551321+0000","last_became_active":"2024-04-26T12:38:12.446469+0000","last_became_peered":"2024-04-26T12:38:12.446469+0000","last_unstale":"2024-04-26T12:41:32.551321+0000","last_undegraded":"2024-04-26T12:41:32.551321+0000","last_fullsized":"2024-04-26T12:41:32.551321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"112'18","reported_seq":215,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.662493+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:41:32.662493+0000","last_peered":"2024-04-26T12:41:32.662493+0000","last_clean":"2024-04-26T12:41:32.662493+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:41:32.662493+0000","last_undegraded":"2024-04-26T12:41:32.662493+0000","last_fullsized":"2024-04-26T12:41:32.662493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563799+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:41:32.563799+0000","last_peered":"2024-04-26T12:41:32.563799+0000","last_clean":"2024-04-26T12:41:32.563799+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:41:32.563799+0000","last_undegraded":"2024-04-26T12:41:32.563799+0000","last_fullsized":"2024-04-26T12:41:32.563799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"112'16","reported_seq":166,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.576813+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:41:32.576813+0000","last_peered":"2024-04-26T12:41:32.576813+0000","last_clean":"2024-04-26T12:41:32.576813+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:41:32.576813+0000","last_undegraded":"2024-04-26T12:41:32.576813+0000","last_fullsized":"2024-04-26T12:41:32.576813+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":187,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552042+0000","last_change":"2024-04-26T12:38:32.092960+0000","last_active":"2024-04-26T12:41:32.552042+0000","last_peered":"2024-04-26T12:41:32.552042+0000","last_clean":"2024-04-26T12:41:32.552042+0000","last_became_active":"2024-04-26T12:38:32.092562+0000","last_became_peered":"2024-04-26T12:38:32.092562+0000","last_unstale":"2024-04-26T12:41:32.552042+0000","last_undegraded":"2024-04-26T12:41:32.552042+0000","last_fullsized":"2024-04-26T12:41:32.552042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:43.474569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"111'14","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528417+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:41:32.528417+0000","last_peered":"2024-04-26T12:41:32.528417+0000","last_clean":"2024-04-26T12:41:32.528417+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:41:32.528417+0000","last_undegraded":"2024-04-26T12:41:32.528417+0000","last_fullsized":"2024-04-26T12:41:32.528417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511315+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:41:32.511315+0000","last_peered":"2024-04-26T12:41:32.511315+0000","last_clean":"2024-04-26T12:41:32.511315+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:41:32.511315+0000","last_undegraded":"2024-04-26T12:41:32.511315+0000","last_fullsized":"2024-04-26T12:41:32.511315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"112'10","reported_seq":208,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494586+0000","last_change":"2024-04-26T12:38:10.436849+0000","last_active":"2024-04-26T12:41:32.494586+0000","last_peered":"2024-04-26T12:41:32.494586+0000","last_clean":"2024-04-26T12:41:32.494586+0000","last_became_active":"2024-04-26T12:38:10.435593+0000","last_became_peered":"2024-04-26T12:38:10.435593+0000","last_unstale":"2024-04-26T12:41:32.494586+0000","last_undegraded":"2024-04-26T12:41:32.494586+0000","last_fullsized":"2024-04-26T12:41:32.494586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520741+0000","last_change":"2024-04-26T12:38:12.444944+0000","last_active":"2024-04-26T12:41:32.520741+0000","last_peered":"2024-04-26T12:41:32.520741+0000","last_clean":"2024-04-26T12:41:32.520741+0000","last_became_active":"2024-04-26T12:38:12.444415+0000","last_became_peered":"2024-04-26T12:38:12.444415+0000","last_unstale":"2024-04-26T12:41:32.520741+0000","last_undegraded":"2024-04-26T12:41:32.520741+0000","last_fullsized":"2024-04-26T12:41:32.520741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:06.559276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":188,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550415+0000","last_change":"2024-04-26T12:38:32.098437+0000","last_active":"2024-04-26T12:41:32.550415+0000","last_peered":"2024-04-26T12:41:32.550415+0000","last_clean":"2024-04-26T12:41:32.550415+0000","last_became_active":"2024-04-26T12:38:32.093038+0000","last_became_peered":"2024-04-26T12:38:32.093038+0000","last_unstale":"2024-04-26T12:41:32.550415+0000","last_undegraded":"2024-04-26T12:41:32.550415+0000","last_fullsized":"2024-04-26T12:41:32.550415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:11.007956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"104'19","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.533842+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:41:32.533842+0000","last_peered":"2024-04-26T12:41:32.533842+0000","last_clean":"2024-04-26T12:41:32.533842+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:41:32.533842+0000","last_undegraded":"2024-04-26T12:41:32.533842+0000","last_fullsized":"2024-04-26T12:41:32.533842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"108'3","reported_seq":202,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528154+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:41:32.528154+0000","last_peered":"2024-04-26T12:41:32.528154+0000","last_clean":"2024-04-26T12:41:32.528154+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:41:32.528154+0000","last_undegraded":"2024-04-26T12:41:32.528154+0000","last_fullsized":"2024-04-26T12:41:32.528154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"112'26","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.630018+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:41:32.630018+0000","last_peered":"2024-04-26T12:41:32.630018+0000","last_clean":"2024-04-26T12:41:32.630018+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:41:32.630018+0000","last_undegraded":"2024-04-26T12:41:32.630018+0000","last_fullsized":"2024-04-26T12:41:32.630018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":195,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510579+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:41:32.510579+0000","last_peered":"2024-04-26T12:41:32.510579+0000","last_clean":"2024-04-26T12:41:32.510579+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:41:32.510579+0000","last_undegraded":"2024-04-26T12:41:32.510579+0000","last_fullsized":"2024-04-26T12:41:32.510579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"103'16","reported_seq":215,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564293+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:41:32.564293+0000","last_peered":"2024-04-26T12:41:32.564293+0000","last_clean":"2024-04-26T12:41:32.564293+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:41:32.564293+0000","last_undegraded":"2024-04-26T12:41:32.564293+0000","last_fullsized":"2024-04-26T12:41:32.564293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":226,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519304+0000","last_change":"2024-04-26T12:38:12.441878+0000","last_active":"2024-04-26T12:41:32.519304+0000","last_peered":"2024-04-26T12:41:32.519304+0000","last_clean":"2024-04-26T12:41:32.519304+0000","last_became_active":"2024-04-26T12:38:12.441558+0000","last_became_peered":"2024-04-26T12:38:12.441558+0000","last_unstale":"2024-04-26T12:41:32.519304+0000","last_undegraded":"2024-04-26T12:41:32.519304+0000","last_fullsized":"2024-04-26T12:41:32.519304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:07.374814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"104'17","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563790+0000","last_change":"2024-04-26T12:38:32.097333+0000","last_active":"2024-04-26T12:41:32.563790+0000","last_peered":"2024-04-26T12:41:32.563790+0000","last_clean":"2024-04-26T12:41:32.563790+0000","last_became_active":"2024-04-26T12:38:32.097076+0000","last_became_peered":"2024-04-26T12:38:32.097076+0000","last_unstale":"2024-04-26T12:41:32.563790+0000","last_undegraded":"2024-04-26T12:41:32.563790+0000","last_fullsized":"2024-04-26T12:41:32.563790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:52.365241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":27,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":229,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520024+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:41:32.520024+0000","last_peered":"2024-04-26T12:41:32.520024+0000","last_clean":"2024-04-26T12:41:32.520024+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:41:32.520024+0000","last_undegraded":"2024-04-26T12:41:32.520024+0000","last_fullsized":"2024-04-26T12:41:32.520024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"104'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495093+0000","last_change":"2024-04-26T12:38:10.452580+0000","last_active":"2024-04-26T12:41:32.495093+0000","last_peered":"2024-04-26T12:41:32.495093+0000","last_clean":"2024-04-26T12:41:32.495093+0000","last_became_active":"2024-04-26T12:38:10.452004+0000","last_became_peered":"2024-04-26T12:38:10.452004+0000","last_unstale":"2024-04-26T12:41:32.495093+0000","last_undegraded":"2024-04-26T12:41:32.495093+0000","last_fullsized":"2024-04-26T12:41:32.495093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":180,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494566+0000","last_change":"2024-04-26T12:38:32.098711+0000","last_active":"2024-04-26T12:41:32.494566+0000","last_peered":"2024-04-26T12:41:32.494566+0000","last_clean":"2024-04-26T12:41:32.494566+0000","last_became_active":"2024-04-26T12:38:32.097887+0000","last_became_peered":"2024-04-26T12:38:32.097887+0000","last_unstale":"2024-04-26T12:41:32.494566+0000","last_undegraded":"2024-04-26T12:41:32.494566+0000","last_fullsized":"2024-04-26T12:41:32.494566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:43.980582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"112'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551634+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:41:32.551634+0000","last_peered":"2024-04-26T12:41:32.551634+0000","last_clean":"2024-04-26T12:41:32.551634+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:41:32.551634+0000","last_undegraded":"2024-04-26T12:41:32.551634+0000","last_fullsized":"2024-04-26T12:41:32.551634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":175,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493752+0000","last_change":"2024-04-26T12:38:32.091108+0000","last_active":"2024-04-26T12:41:32.493752+0000","last_peered":"2024-04-26T12:41:32.493752+0000","last_clean":"2024-04-26T12:41:32.493752+0000","last_became_active":"2024-04-26T12:38:32.090800+0000","last_became_peered":"2024-04-26T12:38:32.090800+0000","last_unstale":"2024-04-26T12:41:32.493752+0000","last_undegraded":"2024-04-26T12:41:32.493752+0000","last_fullsized":"2024-04-26T12:41:32.493752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:54.159328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495982+0000","last_change":"2024-04-26T12:38:12.453988+0000","last_active":"2024-04-26T12:41:32.495982+0000","last_peered":"2024-04-26T12:41:32.495982+0000","last_clean":"2024-04-26T12:41:32.495982+0000","last_became_active":"2024-04-26T12:38:12.453738+0000","last_became_peered":"2024-04-26T12:38:12.453738+0000","last_unstale":"2024-04-26T12:41:32.495982+0000","last_undegraded":"2024-04-26T12:41:32.495982+0000","last_fullsized":"2024-04-26T12:41:32.495982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"104'11","reported_seq":208,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528222+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:41:32.528222+0000","last_peered":"2024-04-26T12:41:32.528222+0000","last_clean":"2024-04-26T12:41:32.528222+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:41:32.528222+0000","last_undegraded":"2024-04-26T12:41:32.528222+0000","last_fullsized":"2024-04-26T12:41:32.528222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":191,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511003+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:41:32.511003+0000","last_peered":"2024-04-26T12:41:32.511003+0000","last_clean":"2024-04-26T12:41:32.511003+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:41:32.511003+0000","last_undegraded":"2024-04-26T12:41:32.511003+0000","last_fullsized":"2024-04-26T12:41:32.511003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"104'17","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552379+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:41:32.552379+0000","last_peered":"2024-04-26T12:41:32.552379+0000","last_clean":"2024-04-26T12:41:32.552379+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:41:32.552379+0000","last_undegraded":"2024-04-26T12:41:32.552379+0000","last_fullsized":"2024-04-26T12:41:32.552379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529603+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:41:32.529603+0000","last_peered":"2024-04-26T12:41:32.529603+0000","last_clean":"2024-04-26T12:41:32.529603+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:41:32.529603+0000","last_undegraded":"2024-04-26T12:41:32.529603+0000","last_fullsized":"2024-04-26T12:41:32.529603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"108'45","reported_seq":242,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510309+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:41:32.510309+0000","last_peered":"2024-04-26T12:41:32.510309+0000","last_clean":"2024-04-26T12:41:32.510309+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:41:32.510309+0000","last_undegraded":"2024-04-26T12:41:32.510309+0000","last_fullsized":"2024-04-26T12:41:32.510309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":90,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":195,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511211+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:41:32.511211+0000","last_peered":"2024-04-26T12:41:32.511211+0000","last_clean":"2024-04-26T12:41:32.511211+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:41:32.511211+0000","last_undegraded":"2024-04-26T12:41:32.511211+0000","last_fullsized":"2024-04-26T12:41:32.511211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"112'23","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551727+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:41:32.551727+0000","last_peered":"2024-04-26T12:41:32.551727+0000","last_clean":"2024-04-26T12:41:32.551727+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:41:32.551727+0000","last_undegraded":"2024-04-26T12:41:32.551727+0000","last_fullsized":"2024-04-26T12:41:32.551727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495793+0000","last_change":"2024-04-26T12:38:14.452286+0000","last_active":"2024-04-26T12:41:32.495793+0000","last_peered":"2024-04-26T12:41:32.495793+0000","last_clean":"2024-04-26T12:41:32.495793+0000","last_became_active":"2024-04-26T12:38:14.451830+0000","last_became_peered":"2024-04-26T12:38:14.451830+0000","last_unstale":"2024-04-26T12:41:32.495793+0000","last_undegraded":"2024-04-26T12:41:32.495793+0000","last_fullsized":"2024-04-26T12:41:32.495793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":198,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520467+0000","last_change":"2024-04-26T12:38:32.099862+0000","last_active":"2024-04-26T12:41:32.520467+0000","last_peered":"2024-04-26T12:41:32.520467+0000","last_clean":"2024-04-26T12:41:32.520467+0000","last_became_active":"2024-04-26T12:38:32.098951+0000","last_became_peered":"2024-04-26T12:38:32.098951+0000","last_unstale":"2024-04-26T12:41:32.520467+0000","last_undegraded":"2024-04-26T12:41:32.520467+0000","last_fullsized":"2024-04-26T12:41:32.520467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:37.401523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552292+0000","last_change":"2024-04-26T12:38:32.100120+0000","last_active":"2024-04-26T12:41:32.552292+0000","last_peered":"2024-04-26T12:41:32.552292+0000","last_clean":"2024-04-26T12:41:32.552292+0000","last_became_active":"2024-04-26T12:38:32.099583+0000","last_became_peered":"2024-04-26T12:38:32.099583+0000","last_unstale":"2024-04-26T12:41:32.552292+0000","last_undegraded":"2024-04-26T12:41:32.552292+0000","last_fullsized":"2024-04-26T12:41:32.552292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:16.598403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":177,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551239+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:41:32.551239+0000","last_peered":"2024-04-26T12:41:32.551239+0000","last_clean":"2024-04-26T12:41:32.551239+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:41:32.551239+0000","last_undegraded":"2024-04-26T12:41:32.551239+0000","last_fullsized":"2024-04-26T12:41:32.551239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.553091+0000","last_change":"2024-04-26T12:38:12.447147+0000","last_active":"2024-04-26T12:41:32.553091+0000","last_peered":"2024-04-26T12:41:32.553091+0000","last_clean":"2024-04-26T12:41:32.553091+0000","last_became_active":"2024-04-26T12:38:12.446613+0000","last_became_peered":"2024-04-26T12:38:12.446613+0000","last_unstale":"2024-04-26T12:41:32.553091+0000","last_undegraded":"2024-04-26T12:41:32.553091+0000","last_fullsized":"2024-04-26T12:41:32.553091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"104'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528694+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:41:32.528694+0000","last_peered":"2024-04-26T12:41:32.528694+0000","last_clean":"2024-04-26T12:41:32.528694+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:41:32.528694+0000","last_undegraded":"2024-04-26T12:41:32.528694+0000","last_fullsized":"2024-04-26T12:41:32.528694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496318+0000","last_change":"2024-04-26T12:38:14.439270+0000","last_active":"2024-04-26T12:41:32.496318+0000","last_peered":"2024-04-26T12:41:32.496318+0000","last_clean":"2024-04-26T12:41:32.496318+0000","last_became_active":"2024-04-26T12:38:14.438717+0000","last_became_peered":"2024-04-26T12:38:14.438717+0000","last_unstale":"2024-04-26T12:41:32.496318+0000","last_undegraded":"2024-04-26T12:41:32.496318+0000","last_fullsized":"2024-04-26T12:41:32.496318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:36.801658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":201,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519778+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:41:32.519778+0000","last_peered":"2024-04-26T12:41:32.519778+0000","last_clean":"2024-04-26T12:41:32.519778+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:41:32.519778+0000","last_undegraded":"2024-04-26T12:41:32.519778+0000","last_fullsized":"2024-04-26T12:41:32.519778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"108'131","reported_seq":429,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529006+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:41:32.529006+0000","last_peered":"2024-04-26T12:41:32.529006+0000","last_clean":"2024-04-26T12:41:32.529006+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:41:32.529006+0000","last_undegraded":"2024-04-26T12:41:32.529006+0000","last_fullsized":"2024-04-26T12:41:32.529006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":180,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519142+0000","last_change":"2024-04-26T12:38:32.097189+0000","last_active":"2024-04-26T12:41:32.519142+0000","last_peered":"2024-04-26T12:41:32.519142+0000","last_clean":"2024-04-26T12:41:32.519142+0000","last_became_active":"2024-04-26T12:38:32.096313+0000","last_became_peered":"2024-04-26T12:38:32.096313+0000","last_unstale":"2024-04-26T12:41:32.519142+0000","last_undegraded":"2024-04-26T12:41:32.519142+0000","last_fullsized":"2024-04-26T12:41:32.519142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:26.879794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":202,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495894+0000","last_change":"2024-04-26T12:38:12.464249+0000","last_active":"2024-04-26T12:41:32.495894+0000","last_peered":"2024-04-26T12:41:32.495894+0000","last_clean":"2024-04-26T12:41:32.495894+0000","last_became_active":"2024-04-26T12:38:12.463878+0000","last_became_peered":"2024-04-26T12:38:12.463878+0000","last_unstale":"2024-04-26T12:41:32.495894+0000","last_undegraded":"2024-04-26T12:41:32.495894+0000","last_fullsized":"2024-04-26T12:41:32.495894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"111'19","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563708+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:41:32.563708+0000","last_peered":"2024-04-26T12:41:32.563708+0000","last_clean":"2024-04-26T12:41:32.563708+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:41:32.563708+0000","last_undegraded":"2024-04-26T12:41:32.563708+0000","last_fullsized":"2024-04-26T12:41:32.563708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":191,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511246+0000","last_change":"2024-04-26T12:38:14.453154+0000","last_active":"2024-04-26T12:41:32.511246+0000","last_peered":"2024-04-26T12:41:32.511246+0000","last_clean":"2024-04-26T12:41:32.511246+0000","last_became_active":"2024-04-26T12:38:14.451739+0000","last_became_peered":"2024-04-26T12:38:14.451739+0000","last_unstale":"2024-04-26T12:41:32.511246+0000","last_undegraded":"2024-04-26T12:41:32.511246+0000","last_fullsized":"2024-04-26T12:41:32.511246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:00.847209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"104'16","reported_seq":208,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529111+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:41:32.529111+0000","last_peered":"2024-04-26T12:41:32.529111+0000","last_clean":"2024-04-26T12:41:32.529111+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:41:32.529111+0000","last_undegraded":"2024-04-26T12:41:32.529111+0000","last_fullsized":"2024-04-26T12:41:32.529111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"108'131","reported_seq":352,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495421+0000","last_change":"2024-04-26T12:38:18.477057+0000","last_active":"2024-04-26T12:41:32.495421+0000","last_peered":"2024-04-26T12:41:32.495421+0000","last_clean":"2024-04-26T12:41:32.495421+0000","last_became_active":"2024-04-26T12:38:18.476420+0000","last_became_peered":"2024-04-26T12:38:18.476420+0000","last_unstale":"2024-04-26T12:41:32.495421+0000","last_undegraded":"2024-04-26T12:41:32.495421+0000","last_fullsized":"2024-04-26T12:41:32.495421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:11.990212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510476+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:41:32.510476+0000","last_peered":"2024-04-26T12:41:32.510476+0000","last_clean":"2024-04-26T12:41:32.510476+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:41:32.510476+0000","last_undegraded":"2024-04-26T12:41:32.510476+0000","last_fullsized":"2024-04-26T12:41:32.510476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"111'19","reported_seq":169,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520353+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:41:32.520353+0000","last_peered":"2024-04-26T12:41:32.520353+0000","last_clean":"2024-04-26T12:41:32.520353+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:41:32.520353+0000","last_undegraded":"2024-04-26T12:41:32.520353+0000","last_fullsized":"2024-04-26T12:41:32.520353+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527347+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:41:32.527347+0000","last_peered":"2024-04-26T12:41:32.527347+0000","last_clean":"2024-04-26T12:41:32.527347+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:41:32.527347+0000","last_undegraded":"2024-04-26T12:41:32.527347+0000","last_fullsized":"2024-04-26T12:41:32.527347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"104'26","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510316+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:41:32.510316+0000","last_peered":"2024-04-26T12:41:32.510316+0000","last_clean":"2024-04-26T12:41:32.510316+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:41:32.510316+0000","last_undegraded":"2024-04-26T12:41:32.510316+0000","last_fullsized":"2024-04-26T12:41:32.510316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491905+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:41:32.491905+0000","last_peered":"2024-04-26T12:41:32.491905+0000","last_clean":"2024-04-26T12:41:32.491905+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:41:32.491905+0000","last_undegraded":"2024-04-26T12:41:32.491905+0000","last_fullsized":"2024-04-26T12:41:32.491905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510781+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:41:32.510781+0000","last_peered":"2024-04-26T12:41:32.510781+0000","last_clean":"2024-04-26T12:41:32.510781+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:41:32.510781+0000","last_undegraded":"2024-04-26T12:41:32.510781+0000","last_fullsized":"2024-04-26T12:41:32.510781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"108'7","reported_seq":197,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492259+0000","last_change":"2024-04-26T12:38:32.097378+0000","last_active":"2024-04-26T12:41:32.492259+0000","last_peered":"2024-04-26T12:41:32.492259+0000","last_clean":"2024-04-26T12:41:32.492259+0000","last_became_active":"2024-04-26T12:38:32.096994+0000","last_became_peered":"2024-04-26T12:38:32.096994+0000","last_unstale":"2024-04-26T12:41:32.492259+0000","last_undegraded":"2024-04-26T12:41:32.492259+0000","last_fullsized":"2024-04-26T12:41:32.492259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:26.563760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"111'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529467+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:41:32.529467+0000","last_peered":"2024-04-26T12:41:32.529467+0000","last_clean":"2024-04-26T12:41:32.529467+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:41:32.529467+0000","last_undegraded":"2024-04-26T12:41:32.529467+0000","last_fullsized":"2024-04-26T12:41:32.529467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.518465+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:41:32.518465+0000","last_peered":"2024-04-26T12:41:32.518465+0000","last_clean":"2024-04-26T12:41:32.518465+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:41:32.518465+0000","last_undegraded":"2024-04-26T12:41:32.518465+0000","last_fullsized":"2024-04-26T12:41:32.518465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"104'18","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495562+0000","last_change":"2024-04-26T12:38:16.462044+0000","last_active":"2024-04-26T12:41:32.495562+0000","last_peered":"2024-04-26T12:41:32.495562+0000","last_clean":"2024-04-26T12:41:32.495562+0000","last_became_active":"2024-04-26T12:38:16.460128+0000","last_became_peered":"2024-04-26T12:38:16.460128+0000","last_unstale":"2024-04-26T12:41:32.495562+0000","last_undegraded":"2024-04-26T12:41:32.495562+0000","last_fullsized":"2024-04-26T12:41:32.495562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494829+0000","last_change":"2024-04-26T12:38:18.473226+0000","last_active":"2024-04-26T12:41:32.494829+0000","last_peered":"2024-04-26T12:41:32.494829+0000","last_clean":"2024-04-26T12:41:32.494829+0000","last_became_active":"2024-04-26T12:38:18.472362+0000","last_became_peered":"2024-04-26T12:38:18.472362+0000","last_unstale":"2024-04-26T12:41:32.494829+0000","last_undegraded":"2024-04-26T12:41:32.494829+0000","last_fullsized":"2024-04-26T12:41:32.494829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:15.624588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":192,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.562897+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:41:32.562897+0000","last_peered":"2024-04-26T12:41:32.562897+0000","last_clean":"2024-04-26T12:41:32.562897+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:41:32.562897+0000","last_undegraded":"2024-04-26T12:41:32.562897+0000","last_fullsized":"2024-04-26T12:41:32.562897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.565158+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:41:32.565158+0000","last_peered":"2024-04-26T12:41:32.565158+0000","last_clean":"2024-04-26T12:41:32.565158+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:41:32.565158+0000","last_undegraded":"2024-04-26T12:41:32.565158+0000","last_fullsized":"2024-04-26T12:41:32.565158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"103'16","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529487+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:41:32.529487+0000","last_peered":"2024-04-26T12:41:32.529487+0000","last_clean":"2024-04-26T12:41:32.529487+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:41:32.529487+0000","last_undegraded":"2024-04-26T12:41:32.529487+0000","last_fullsized":"2024-04-26T12:41:32.529487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519580+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:41:32.519580+0000","last_peered":"2024-04-26T12:41:32.519580+0000","last_clean":"2024-04-26T12:41:32.519580+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:41:32.519580+0000","last_undegraded":"2024-04-26T12:41:32.519580+0000","last_fullsized":"2024-04-26T12:41:32.519580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"104'23","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527036+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:41:32.527036+0000","last_peered":"2024-04-26T12:41:32.527036+0000","last_clean":"2024-04-26T12:41:32.527036+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:41:32.527036+0000","last_undegraded":"2024-04-26T12:41:32.527036+0000","last_fullsized":"2024-04-26T12:41:32.527036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"108'131","reported_seq":379,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550294+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:41:32.550294+0000","last_peered":"2024-04-26T12:41:32.550294+0000","last_clean":"2024-04-26T12:41:32.550294+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:41:32.550294+0000","last_undegraded":"2024-04-26T12:41:32.550294+0000","last_fullsized":"2024-04-26T12:41:32.550294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":183,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552472+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:41:32.552472+0000","last_peered":"2024-04-26T12:41:32.552472+0000","last_clean":"2024-04-26T12:41:32.552472+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:41:32.552472+0000","last_undegraded":"2024-04-26T12:41:32.552472+0000","last_fullsized":"2024-04-26T12:41:32.552472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551694+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:41:32.551694+0000","last_peered":"2024-04-26T12:41:32.551694+0000","last_clean":"2024-04-26T12:41:32.551694+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:41:32.551694+0000","last_undegraded":"2024-04-26T12:41:32.551694+0000","last_fullsized":"2024-04-26T12:41:32.551694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"112'14","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511202+0000","last_change":"2024-04-26T12:38:10.446350+0000","last_active":"2024-04-26T12:41:32.511202+0000","last_peered":"2024-04-26T12:41:32.511202+0000","last_clean":"2024-04-26T12:41:32.511202+0000","last_became_active":"2024-04-26T12:38:10.445502+0000","last_became_peered":"2024-04-26T12:38:10.445502+0000","last_unstale":"2024-04-26T12:41:32.511202+0000","last_undegraded":"2024-04-26T12:41:32.511202+0000","last_fullsized":"2024-04-26T12:41:32.511202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.518926+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:41:32.518926+0000","last_peered":"2024-04-26T12:41:32.518926+0000","last_clean":"2024-04-26T12:41:32.518926+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:41:32.518926+0000","last_undegraded":"2024-04-26T12:41:32.518926+0000","last_fullsized":"2024-04-26T12:41:32.518926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"104'27","reported_seq":223,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551077+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:41:32.551077+0000","last_peered":"2024-04-26T12:41:32.551077+0000","last_clean":"2024-04-26T12:41:32.551077+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:41:32.551077+0000","last_undegraded":"2024-04-26T12:41:32.551077+0000","last_fullsized":"2024-04-26T12:41:32.551077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.518333+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:41:32.518333+0000","last_peered":"2024-04-26T12:41:32.518333+0000","last_clean":"2024-04-26T12:41:32.518333+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:41:32.518333+0000","last_undegraded":"2024-04-26T12:41:32.518333+0000","last_fullsized":"2024-04-26T12:41:32.518333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'7","reported_seq":208,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493558+0000","last_change":"2024-04-26T12:38:20.512634+0000","last_active":"2024-04-26T12:41:32.493558+0000","last_peered":"2024-04-26T12:41:32.493558+0000","last_clean":"2024-04-26T12:41:32.493558+0000","last_became_active":"2024-04-26T12:38:20.511995+0000","last_became_peered":"2024-04-26T12:38:20.511995+0000","last_unstale":"2024-04-26T12:41:32.493558+0000","last_undegraded":"2024-04-26T12:41:32.493558+0000","last_fullsized":"2024-04-26T12:41:32.493558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:43.347406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"108'3","reported_seq":180,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495882+0000","last_change":"2024-04-26T12:38:32.098058+0000","last_active":"2024-04-26T12:41:32.495882+0000","last_peered":"2024-04-26T12:41:32.495882+0000","last_clean":"2024-04-26T12:41:32.495882+0000","last_became_active":"2024-04-26T12:38:32.095643+0000","last_became_peered":"2024-04-26T12:38:32.095643+0000","last_unstale":"2024-04-26T12:41:32.495882+0000","last_undegraded":"2024-04-26T12:41:32.495882+0000","last_fullsized":"2024-04-26T12:41:32.495882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:37:56.628368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"111'18","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494989+0000","last_change":"2024-04-26T12:38:10.441544+0000","last_active":"2024-04-26T12:41:32.494989+0000","last_peered":"2024-04-26T12:41:32.494989+0000","last_clean":"2024-04-26T12:41:32.494989+0000","last_became_active":"2024-04-26T12:38:10.440770+0000","last_became_peered":"2024-04-26T12:38:10.440770+0000","last_unstale":"2024-04-26T12:41:32.494989+0000","last_undegraded":"2024-04-26T12:41:32.494989+0000","last_fullsized":"2024-04-26T12:41:32.494989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519891+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:41:32.519891+0000","last_peered":"2024-04-26T12:41:32.519891+0000","last_clean":"2024-04-26T12:41:32.519891+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:41:32.519891+0000","last_undegraded":"2024-04-26T12:41:32.519891+0000","last_fullsized":"2024-04-26T12:41:32.519891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"104'18","reported_seq":215,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493779+0000","last_change":"2024-04-26T12:38:32.096426+0000","last_active":"2024-04-26T12:41:32.493779+0000","last_peered":"2024-04-26T12:41:32.493779+0000","last_clean":"2024-04-26T12:41:32.493779+0000","last_became_active":"2024-04-26T12:38:32.095992+0000","last_became_peered":"2024-04-26T12:38:32.095992+0000","last_unstale":"2024-04-26T12:41:32.493779+0000","last_undegraded":"2024-04-26T12:41:32.493779+0000","last_fullsized":"2024-04-26T12:41:32.493779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:27.380211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552187+0000","last_change":"2024-04-26T12:38:18.496992+0000","last_active":"2024-04-26T12:41:32.552187+0000","last_peered":"2024-04-26T12:41:32.552187+0000","last_clean":"2024-04-26T12:41:32.552187+0000","last_became_active":"2024-04-26T12:38:18.496312+0000","last_became_peered":"2024-04-26T12:38:18.496312+0000","last_unstale":"2024-04-26T12:41:32.552187+0000","last_undegraded":"2024-04-26T12:41:32.552187+0000","last_fullsized":"2024-04-26T12:41:32.552187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.216703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":184,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493930+0000","last_change":"2024-04-26T12:38:20.521018+0000","last_active":"2024-04-26T12:41:32.493930+0000","last_peered":"2024-04-26T12:41:32.493930+0000","last_clean":"2024-04-26T12:41:32.493930+0000","last_became_active":"2024-04-26T12:38:20.516374+0000","last_became_peered":"2024-04-26T12:38:20.516374+0000","last_unstale":"2024-04-26T12:41:32.493930+0000","last_undegraded":"2024-04-26T12:41:32.493930+0000","last_fullsized":"2024-04-26T12:41:32.493930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:56.928093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":196,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519951+0000","last_change":"2024-04-26T12:38:32.097968+0000","last_active":"2024-04-26T12:41:32.519951+0000","last_peered":"2024-04-26T12:41:32.519951+0000","last_clean":"2024-04-26T12:41:32.519951+0000","last_became_active":"2024-04-26T12:38:32.095619+0000","last_became_peered":"2024-04-26T12:38:32.095619+0000","last_unstale":"2024-04-26T12:41:32.519951+0000","last_undegraded":"2024-04-26T12:41:32.519951+0000","last_fullsized":"2024-04-26T12:41:32.519951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"112'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.565628+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:41:32.565628+0000","last_peered":"2024-04-26T12:41:32.565628+0000","last_clean":"2024-04-26T12:41:32.565628+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:41:32.565628+0000","last_undegraded":"2024-04-26T12:41:32.565628+0000","last_fullsized":"2024-04-26T12:41:32.565628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492991+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:41:32.492991+0000","last_peered":"2024-04-26T12:41:32.492991+0000","last_clean":"2024-04-26T12:41:32.492991+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:41:32.492991+0000","last_undegraded":"2024-04-26T12:41:32.492991+0000","last_fullsized":"2024-04-26T12:41:32.492991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"104'22","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520571+0000","last_change":"2024-04-26T12:38:16.458770+0000","last_active":"2024-04-26T12:41:32.520571+0000","last_peered":"2024-04-26T12:41:32.520571+0000","last_clean":"2024-04-26T12:41:32.520571+0000","last_became_active":"2024-04-26T12:38:16.457974+0000","last_became_peered":"2024-04-26T12:38:16.457974+0000","last_unstale":"2024-04-26T12:41:32.520571+0000","last_undegraded":"2024-04-26T12:41:32.520571+0000","last_fullsized":"2024-04-26T12:41:32.520571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:25:00.552491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"108'131","reported_seq":367,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520250+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:41:32.520250+0000","last_peered":"2024-04-26T12:41:32.520250+0000","last_clean":"2024-04-26T12:41:32.520250+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:41:32.520250+0000","last_undegraded":"2024-04-26T12:41:32.520250+0000","last_fullsized":"2024-04-26T12:41:32.520250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492005+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:41:32.492005+0000","last_peered":"2024-04-26T12:41:32.492005+0000","last_clean":"2024-04-26T12:41:32.492005+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:41:32.492005+0000","last_undegraded":"2024-04-26T12:41:32.492005+0000","last_fullsized":"2024-04-26T12:41:32.492005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":198,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564183+0000","last_change":"2024-04-26T12:38:32.098436+0000","last_active":"2024-04-26T12:41:32.564183+0000","last_peered":"2024-04-26T12:41:32.564183+0000","last_clean":"2024-04-26T12:41:32.564183+0000","last_became_active":"2024-04-26T12:38:32.097675+0000","last_became_peered":"2024-04-26T12:38:32.097675+0000","last_unstale":"2024-04-26T12:41:32.564183+0000","last_undegraded":"2024-04-26T12:41:32.564183+0000","last_fullsized":"2024-04-26T12:41:32.564183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:10.967994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"111'23","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.518333+0000","last_change":"2024-04-26T12:38:32.091912+0000","last_active":"2024-04-26T12:41:32.518333+0000","last_peered":"2024-04-26T12:41:32.518333+0000","last_clean":"2024-04-26T12:41:32.518333+0000","last_became_active":"2024-04-26T12:38:32.091595+0000","last_became_peered":"2024-04-26T12:38:32.091595+0000","last_unstale":"2024-04-26T12:41:32.518333+0000","last_undegraded":"2024-04-26T12:41:32.518333+0000","last_fullsized":"2024-04-26T12:41:32.518333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:30.012503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":367,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511637+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:41:32.511637+0000","last_peered":"2024-04-26T12:41:32.511637+0000","last_clean":"2024-04-26T12:41:32.511637+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:41:32.511637+0000","last_undegraded":"2024-04-26T12:41:32.511637+0000","last_fullsized":"2024-04-26T12:41:32.511637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":174,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":201,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495522+0000","last_change":"2024-04-26T12:38:16.529624+0000","last_active":"2024-04-26T12:41:32.495522+0000","last_peered":"2024-04-26T12:41:32.495522+0000","last_clean":"2024-04-26T12:41:32.495522+0000","last_became_active":"2024-04-26T12:38:16.528834+0000","last_became_peered":"2024-04-26T12:38:16.528834+0000","last_unstale":"2024-04-26T12:41:32.495522+0000","last_undegraded":"2024-04-26T12:41:32.495522+0000","last_fullsized":"2024-04-26T12:41:32.495522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"108'131","reported_seq":398,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563436+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:41:32.563436+0000","last_peered":"2024-04-26T12:41:32.563436+0000","last_clean":"2024-04-26T12:41:32.563436+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:41:32.563436+0000","last_undegraded":"2024-04-26T12:41:32.563436+0000","last_fullsized":"2024-04-26T12:41:32.563436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":176,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551402+0000","last_change":"2024-04-26T12:38:32.092303+0000","last_active":"2024-04-26T12:41:32.551402+0000","last_peered":"2024-04-26T12:41:32.551402+0000","last_clean":"2024-04-26T12:41:32.551402+0000","last_became_active":"2024-04-26T12:38:32.091872+0000","last_became_peered":"2024-04-26T12:38:32.091872+0000","last_unstale":"2024-04-26T12:41:32.551402+0000","last_undegraded":"2024-04-26T12:41:32.551402+0000","last_fullsized":"2024-04-26T12:41:32.551402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494497+0000","last_change":"2024-04-26T12:38:12.453591+0000","last_active":"2024-04-26T12:41:32.494497+0000","last_peered":"2024-04-26T12:41:32.494497+0000","last_clean":"2024-04-26T12:41:32.494497+0000","last_became_active":"2024-04-26T12:38:12.453109+0000","last_became_peered":"2024-04-26T12:38:12.453109+0000","last_unstale":"2024-04-26T12:41:32.494497+0000","last_undegraded":"2024-04-26T12:41:32.494497+0000","last_fullsized":"2024-04-26T12:41:32.494497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"111'17","reported_seq":215,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494749+0000","last_change":"2024-04-26T12:38:10.432674+0000","last_active":"2024-04-26T12:41:32.494749+0000","last_peered":"2024-04-26T12:41:32.494749+0000","last_clean":"2024-04-26T12:41:32.494749+0000","last_became_active":"2024-04-26T12:38:10.431888+0000","last_became_peered":"2024-04-26T12:38:10.431888+0000","last_unstale":"2024-04-26T12:41:32.494749+0000","last_undegraded":"2024-04-26T12:41:32.494749+0000","last_fullsized":"2024-04-26T12:41:32.494749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":172,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511373+0000","last_change":"2024-04-26T12:38:32.094763+0000","last_active":"2024-04-26T12:41:32.511373+0000","last_peered":"2024-04-26T12:41:32.511373+0000","last_clean":"2024-04-26T12:41:32.511373+0000","last_became_active":"2024-04-26T12:38:32.094384+0000","last_became_peered":"2024-04-26T12:38:32.094384+0000","last_unstale":"2024-04-26T12:41:32.511373+0000","last_undegraded":"2024-04-26T12:41:32.511373+0000","last_fullsized":"2024-04-26T12:41:32.511373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.331969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"104'25","reported_seq":223,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510917+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:41:32.510917+0000","last_peered":"2024-04-26T12:41:32.510917+0000","last_clean":"2024-04-26T12:41:32.510917+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:41:32.510917+0000","last_undegraded":"2024-04-26T12:41:32.510917+0000","last_fullsized":"2024-04-26T12:41:32.510917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563350+0000","last_change":"2024-04-26T12:38:18.485107+0000","last_active":"2024-04-26T12:41:32.563350+0000","last_peered":"2024-04-26T12:41:32.563350+0000","last_clean":"2024-04-26T12:41:32.563350+0000","last_became_active":"2024-04-26T12:38:18.483235+0000","last_became_peered":"2024-04-26T12:38:18.483235+0000","last_unstale":"2024-04-26T12:41:32.563350+0000","last_undegraded":"2024-04-26T12:41:32.563350+0000","last_fullsized":"2024-04-26T12:41:32.563350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:39.418895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":178,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491235+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:41:32.491235+0000","last_peered":"2024-04-26T12:41:32.491235+0000","last_clean":"2024-04-26T12:41:32.491235+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:41:32.491235+0000","last_undegraded":"2024-04-26T12:41:32.491235+0000","last_fullsized":"2024-04-26T12:41:32.491235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":230,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563931+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:41:32.563931+0000","last_peered":"2024-04-26T12:41:32.563931+0000","last_clean":"2024-04-26T12:41:32.563931+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:41:32.563931+0000","last_undegraded":"2024-04-26T12:41:32.563931+0000","last_fullsized":"2024-04-26T12:41:32.563931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":353,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527329+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:41:32.527329+0000","last_peered":"2024-04-26T12:41:32.527329+0000","last_clean":"2024-04-26T12:41:32.527329+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:41:32.527329+0000","last_undegraded":"2024-04-26T12:41:32.527329+0000","last_fullsized":"2024-04-26T12:41:32.527329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":205,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511020+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:41:32.511020+0000","last_peered":"2024-04-26T12:41:32.511020+0000","last_clean":"2024-04-26T12:41:32.511020+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:41:32.511020+0000","last_undegraded":"2024-04-26T12:41:32.511020+0000","last_fullsized":"2024-04-26T12:41:32.511020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"111'27","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495409+0000","last_change":"2024-04-26T12:38:10.443654+0000","last_active":"2024-04-26T12:41:32.495409+0000","last_peered":"2024-04-26T12:41:32.495409+0000","last_clean":"2024-04-26T12:41:32.495409+0000","last_became_active":"2024-04-26T12:38:10.439344+0000","last_became_peered":"2024-04-26T12:38:10.439344+0000","last_unstale":"2024-04-26T12:41:32.495409+0000","last_undegraded":"2024-04-26T12:41:32.495409+0000","last_fullsized":"2024-04-26T12:41:32.495409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528636+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:41:32.528636+0000","last_peered":"2024-04-26T12:41:32.528636+0000","last_clean":"2024-04-26T12:41:32.528636+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:41:32.528636+0000","last_undegraded":"2024-04-26T12:41:32.528636+0000","last_fullsized":"2024-04-26T12:41:32.528636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"104'35","reported_seq":236,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511724+0000","last_change":"2024-04-26T12:38:16.468624+0000","last_active":"2024-04-26T12:41:32.511724+0000","last_peered":"2024-04-26T12:41:32.511724+0000","last_clean":"2024-04-26T12:41:32.511724+0000","last_became_active":"2024-04-26T12:38:16.467912+0000","last_became_peered":"2024-04-26T12:38:16.467912+0000","last_unstale":"2024-04-26T12:41:32.511724+0000","last_undegraded":"2024-04-26T12:41:32.511724+0000","last_fullsized":"2024-04-26T12:41:32.511724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61968,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552570+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:41:32.552570+0000","last_peered":"2024-04-26T12:41:32.552570+0000","last_clean":"2024-04-26T12:41:32.552570+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:41:32.552570+0000","last_undegraded":"2024-04-26T12:41:32.552570+0000","last_fullsized":"2024-04-26T12:41:32.552570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":178,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.562860+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:41:32.562860+0000","last_peered":"2024-04-26T12:41:32.562860+0000","last_clean":"2024-04-26T12:41:32.562860+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:41:32.562860+0000","last_undegraded":"2024-04-26T12:41:32.562860+0000","last_fullsized":"2024-04-26T12:41:32.562860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552904+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:41:32.552904+0000","last_peered":"2024-04-26T12:41:32.552904+0000","last_clean":"2024-04-26T12:41:32.552904+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:41:32.552904+0000","last_undegraded":"2024-04-26T12:41:32.552904+0000","last_fullsized":"2024-04-26T12:41:32.552904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":203,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526932+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:41:32.526932+0000","last_peered":"2024-04-26T12:41:32.526932+0000","last_clean":"2024-04-26T12:41:32.526932+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:41:32.526932+0000","last_undegraded":"2024-04-26T12:41:32.526932+0000","last_fullsized":"2024-04-26T12:41:32.526932+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"112'16","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.615732+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:41:32.615732+0000","last_peered":"2024-04-26T12:41:32.615732+0000","last_clean":"2024-04-26T12:41:32.615732+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:41:32.615732+0000","last_undegraded":"2024-04-26T12:41:32.615732+0000","last_fullsized":"2024-04-26T12:41:32.615732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":191,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511789+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:41:32.511789+0000","last_peered":"2024-04-26T12:41:32.511789+0000","last_clean":"2024-04-26T12:41:32.511789+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:41:32.511789+0000","last_undegraded":"2024-04-26T12:41:32.511789+0000","last_fullsized":"2024-04-26T12:41:32.511789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"108'131","reported_seq":417,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491913+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:41:32.491913+0000","last_peered":"2024-04-26T12:41:32.491913+0000","last_clean":"2024-04-26T12:41:32.491913+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:41:32.491913+0000","last_undegraded":"2024-04-26T12:41:32.491913+0000","last_fullsized":"2024-04-26T12:41:32.491913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":173,"num_read_kb":158,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529045+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:41:32.529045+0000","last_peered":"2024-04-26T12:41:32.529045+0000","last_clean":"2024-04-26T12:41:32.529045+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:41:32.529045+0000","last_undegraded":"2024-04-26T12:41:32.529045+0000","last_fullsized":"2024-04-26T12:41:32.529045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"108'1","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492103+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:41:32.492103+0000","last_peered":"2024-04-26T12:41:32.492103+0000","last_clean":"2024-04-26T12:41:32.492103+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:41:32.492103+0000","last_undegraded":"2024-04-26T12:41:32.492103+0000","last_fullsized":"2024-04-26T12:41:32.492103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":223,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494665+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:41:32.494665+0000","last_peered":"2024-04-26T12:41:32.494665+0000","last_clean":"2024-04-26T12:41:32.494665+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:41:32.494665+0000","last_undegraded":"2024-04-26T12:41:32.494665+0000","last_fullsized":"2024-04-26T12:41:32.494665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.519407+0000","last_change":"2024-04-26T12:38:04.379828+0000","last_active":"2024-04-26T12:41:32.519407+0000","last_peered":"2024-04-26T12:41:32.519407+0000","last_clean":"2024-04-26T12:41:32.519407+0000","last_became_active":"2024-04-26T12:38:04.379417+0000","last_became_peered":"2024-04-26T12:38:04.379417+0000","last_unstale":"2024-04-26T12:41:32.519407+0000","last_undegraded":"2024-04-26T12:41:32.519407+0000","last_fullsized":"2024-04-26T12:41:32.519407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"104'25","reported_seq":224,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491694+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:41:32.491694+0000","last_peered":"2024-04-26T12:41:32.491694+0000","last_clean":"2024-04-26T12:41:32.491694+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:41:32.491694+0000","last_undegraded":"2024-04-26T12:41:32.491694+0000","last_fullsized":"2024-04-26T12:41:32.491694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":35,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":279,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520335+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:41:32.520335+0000","last_peered":"2024-04-26T12:41:32.520335+0000","last_clean":"2024-04-26T12:41:32.520335+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:41:32.520335+0000","last_undegraded":"2024-04-26T12:41:32.520335+0000","last_fullsized":"2024-04-26T12:41:32.520335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":130,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"91'17","reported_seq":247,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529326+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:41:32.529326+0000","last_peered":"2024-04-26T12:41:32.529326+0000","last_clean":"2024-04-26T12:41:32.529326+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:41:32.529326+0000","last_undegraded":"2024-04-26T12:41:32.529326+0000","last_fullsized":"2024-04-26T12:41:32.529326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551866+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:41:32.551866+0000","last_peered":"2024-04-26T12:41:32.551866+0000","last_clean":"2024-04-26T12:41:32.551866+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:41:32.551866+0000","last_undegraded":"2024-04-26T12:41:32.551866+0000","last_fullsized":"2024-04-26T12:41:32.551866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495239+0000","last_change":"2024-04-26T12:38:20.524257+0000","last_active":"2024-04-26T12:41:32.495239+0000","last_peered":"2024-04-26T12:41:32.495239+0000","last_clean":"2024-04-26T12:41:32.495239+0000","last_became_active":"2024-04-26T12:38:20.523355+0000","last_became_peered":"2024-04-26T12:38:20.523355+0000","last_unstale":"2024-04-26T12:41:32.495239+0000","last_undegraded":"2024-04-26T12:41:32.495239+0000","last_fullsized":"2024-04-26T12:41:32.495239+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.537213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493418+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:41:32.493418+0000","last_peered":"2024-04-26T12:41:32.493418+0000","last_clean":"2024-04-26T12:41:32.493418+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:41:32.493418+0000","last_undegraded":"2024-04-26T12:41:32.493418+0000","last_fullsized":"2024-04-26T12:41:32.493418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":205,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510763+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:41:32.510763+0000","last_peered":"2024-04-26T12:41:32.510763+0000","last_clean":"2024-04-26T12:41:32.510763+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:41:32.510763+0000","last_undegraded":"2024-04-26T12:41:32.510763+0000","last_fullsized":"2024-04-26T12:41:32.510763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"104'13","reported_seq":183,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551598+0000","last_change":"2024-04-26T12:38:32.099375+0000","last_active":"2024-04-26T12:41:32.551598+0000","last_peered":"2024-04-26T12:41:32.551598+0000","last_clean":"2024-04-26T12:41:32.551598+0000","last_became_active":"2024-04-26T12:38:32.098983+0000","last_became_peered":"2024-04-26T12:38:32.098983+0000","last_unstale":"2024-04-26T12:41:32.551598+0000","last_undegraded":"2024-04-26T12:41:32.551598+0000","last_fullsized":"2024-04-26T12:41:32.551598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:19.281648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551948+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:41:32.551948+0000","last_peered":"2024-04-26T12:41:32.551948+0000","last_clean":"2024-04-26T12:41:32.551948+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:41:32.551948+0000","last_undegraded":"2024-04-26T12:41:32.551948+0000","last_fullsized":"2024-04-26T12:41:32.551948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":205,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495808+0000","last_change":"2024-04-26T12:38:16.456038+0000","last_active":"2024-04-26T12:41:32.495808+0000","last_peered":"2024-04-26T12:41:32.495808+0000","last_clean":"2024-04-26T12:41:32.495808+0000","last_became_active":"2024-04-26T12:38:16.455145+0000","last_became_peered":"2024-04-26T12:38:16.455145+0000","last_unstale":"2024-04-26T12:41:32.495808+0000","last_undegraded":"2024-04-26T12:41:32.495808+0000","last_fullsized":"2024-04-26T12:41:32.495808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:47.494528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563596+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:41:32.563596+0000","last_peered":"2024-04-26T12:41:32.563596+0000","last_clean":"2024-04-26T12:41:32.563596+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:41:32.563596+0000","last_undegraded":"2024-04-26T12:41:32.563596+0000","last_fullsized":"2024-04-26T12:41:32.563596+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":185,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510142+0000","last_change":"2024-04-26T12:38:20.516137+0000","last_active":"2024-04-26T12:41:32.510142+0000","last_peered":"2024-04-26T12:41:32.510142+0000","last_clean":"2024-04-26T12:41:32.510142+0000","last_became_active":"2024-04-26T12:38:20.515399+0000","last_became_peered":"2024-04-26T12:38:20.515399+0000","last_unstale":"2024-04-26T12:41:32.510142+0000","last_undegraded":"2024-04-26T12:41:32.510142+0000","last_fullsized":"2024-04-26T12:41:32.510142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:14.021137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":203,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492643+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:41:32.492643+0000","last_peered":"2024-04-26T12:41:32.492643+0000","last_clean":"2024-04-26T12:41:32.492643+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:41:32.492643+0000","last_undegraded":"2024-04-26T12:41:32.492643+0000","last_fullsized":"2024-04-26T12:41:32.492643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"104'19","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511289+0000","last_change":"2024-04-26T12:38:10.445784+0000","last_active":"2024-04-26T12:41:32.511289+0000","last_peered":"2024-04-26T12:41:32.511289+0000","last_clean":"2024-04-26T12:41:32.511289+0000","last_became_active":"2024-04-26T12:38:10.444891+0000","last_became_peered":"2024-04-26T12:38:10.444891+0000","last_unstale":"2024-04-26T12:41:32.511289+0000","last_undegraded":"2024-04-26T12:41:32.511289+0000","last_fullsized":"2024-04-26T12:41:32.511289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493949+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:41:32.493949+0000","last_peered":"2024-04-26T12:41:32.493949+0000","last_clean":"2024-04-26T12:41:32.493949+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:41:32.493949+0000","last_undegraded":"2024-04-26T12:41:32.493949+0000","last_fullsized":"2024-04-26T12:41:32.493949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551416+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:41:32.551416+0000","last_peered":"2024-04-26T12:41:32.551416+0000","last_clean":"2024-04-26T12:41:32.551416+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:41:32.551416+0000","last_undegraded":"2024-04-26T12:41:32.551416+0000","last_fullsized":"2024-04-26T12:41:32.551416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"104'32","reported_seq":231,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550497+0000","last_change":"2024-04-26T12:38:16.482357+0000","last_active":"2024-04-26T12:41:32.550497+0000","last_peered":"2024-04-26T12:41:32.550497+0000","last_clean":"2024-04-26T12:41:32.550497+0000","last_became_active":"2024-04-26T12:38:16.481496+0000","last_became_peered":"2024-04-26T12:38:16.481496+0000","last_unstale":"2024-04-26T12:41:32.550497+0000","last_undegraded":"2024-04-26T12:41:32.550497+0000","last_fullsized":"2024-04-26T12:41:32.550497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":172,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495038+0000","last_change":"2024-04-26T12:38:32.094008+0000","last_active":"2024-04-26T12:41:32.495038+0000","last_peered":"2024-04-26T12:41:32.495038+0000","last_clean":"2024-04-26T12:41:32.495038+0000","last_became_active":"2024-04-26T12:38:32.092362+0000","last_became_peered":"2024-04-26T12:38:32.092362+0000","last_unstale":"2024-04-26T12:41:32.495038+0000","last_undegraded":"2024-04-26T12:41:32.495038+0000","last_fullsized":"2024-04-26T12:41:32.495038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:59.395782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":177,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552200+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:41:32.552200+0000","last_peered":"2024-04-26T12:41:32.552200+0000","last_clean":"2024-04-26T12:41:32.552200+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:41:32.552200+0000","last_undegraded":"2024-04-26T12:41:32.552200+0000","last_fullsized":"2024-04-26T12:41:32.552200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":201,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551647+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:41:32.551647+0000","last_peered":"2024-04-26T12:41:32.551647+0000","last_clean":"2024-04-26T12:41:32.551647+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:41:32.551647+0000","last_undegraded":"2024-04-26T12:41:32.551647+0000","last_fullsized":"2024-04-26T12:41:32.551647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"111'19","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493572+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:41:32.493572+0000","last_peered":"2024-04-26T12:41:32.493572+0000","last_clean":"2024-04-26T12:41:32.493572+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:41:32.493572+0000","last_undegraded":"2024-04-26T12:41:32.493572+0000","last_fullsized":"2024-04-26T12:41:32.493572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":203,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529639+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:41:32.529639+0000","last_peered":"2024-04-26T12:41:32.529639+0000","last_clean":"2024-04-26T12:41:32.529639+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:41:32.529639+0000","last_undegraded":"2024-04-26T12:41:32.529639+0000","last_fullsized":"2024-04-26T12:41:32.529639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564494+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:41:32.564494+0000","last_peered":"2024-04-26T12:41:32.564494+0000","last_clean":"2024-04-26T12:41:32.564494+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:41:32.564494+0000","last_undegraded":"2024-04-26T12:41:32.564494+0000","last_fullsized":"2024-04-26T12:41:32.564494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":207,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491470+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:41:32.491470+0000","last_peered":"2024-04-26T12:41:32.491470+0000","last_clean":"2024-04-26T12:41:32.491470+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:41:32.491470+0000","last_undegraded":"2024-04-26T12:41:32.491470+0000","last_fullsized":"2024-04-26T12:41:32.491470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"108'131","reported_seq":353,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510335+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:41:32.510335+0000","last_peered":"2024-04-26T12:41:32.510335+0000","last_clean":"2024-04-26T12:41:32.510335+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:41:32.510335+0000","last_undegraded":"2024-04-26T12:41:32.510335+0000","last_fullsized":"2024-04-26T12:41:32.510335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496042+0000","last_change":"2024-04-26T12:38:20.712111+0000","last_active":"2024-04-26T12:41:32.496042+0000","last_peered":"2024-04-26T12:41:32.496042+0000","last_clean":"2024-04-26T12:41:32.496042+0000","last_became_active":"2024-04-26T12:38:20.710548+0000","last_became_peered":"2024-04-26T12:38:20.710548+0000","last_unstale":"2024-04-26T12:41:32.496042+0000","last_undegraded":"2024-04-26T12:41:32.496042+0000","last_fullsized":"2024-04-26T12:41:32.496042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:19.070600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494363+0000","last_change":"2024-04-26T12:38:12.463038+0000","last_active":"2024-04-26T12:41:32.494363+0000","last_peered":"2024-04-26T12:41:32.494363+0000","last_clean":"2024-04-26T12:41:32.494363+0000","last_became_active":"2024-04-26T12:38:12.462597+0000","last_became_peered":"2024-04-26T12:38:12.462597+0000","last_unstale":"2024-04-26T12:41:32.494363+0000","last_undegraded":"2024-04-26T12:41:32.494363+0000","last_fullsized":"2024-04-26T12:41:32.494363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"112'18","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495709+0000","last_change":"2024-04-26T12:38:10.467904+0000","last_active":"2024-04-26T12:41:32.495709+0000","last_peered":"2024-04-26T12:41:32.495709+0000","last_clean":"2024-04-26T12:41:32.495709+0000","last_became_active":"2024-04-26T12:38:10.467447+0000","last_became_peered":"2024-04-26T12:38:10.467447+0000","last_unstale":"2024-04-26T12:41:32.495709+0000","last_undegraded":"2024-04-26T12:41:32.495709+0000","last_fullsized":"2024-04-26T12:41:32.495709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493992+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:41:32.493992+0000","last_peered":"2024-04-26T12:41:32.493992+0000","last_clean":"2024-04-26T12:41:32.493992+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:41:32.493992+0000","last_undegraded":"2024-04-26T12:41:32.493992+0000","last_fullsized":"2024-04-26T12:41:32.493992+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494892+0000","last_change":"2024-04-26T12:38:32.094625+0000","last_active":"2024-04-26T12:41:32.494892+0000","last_peered":"2024-04-26T12:41:32.494892+0000","last_clean":"2024-04-26T12:41:32.494892+0000","last_became_active":"2024-04-26T12:38:32.093266+0000","last_became_peered":"2024-04-26T12:38:32.093266+0000","last_unstale":"2024-04-26T12:41:32.494892+0000","last_undegraded":"2024-04-26T12:41:32.494892+0000","last_fullsized":"2024-04-26T12:41:32.494892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:18:18.695479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495110+0000","last_change":"2024-04-26T12:38:32.097625+0000","last_active":"2024-04-26T12:41:32.495110+0000","last_peered":"2024-04-26T12:41:32.495110+0000","last_clean":"2024-04-26T12:41:32.495110+0000","last_became_active":"2024-04-26T12:38:32.097186+0000","last_became_peered":"2024-04-26T12:38:32.097186+0000","last_unstale":"2024-04-26T12:41:32.495110+0000","last_undegraded":"2024-04-26T12:41:32.495110+0000","last_fullsized":"2024-04-26T12:41:32.495110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:09.866995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"108'131","reported_seq":352,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.497030+0000","last_change":"2024-04-26T12:38:18.469233+0000","last_active":"2024-04-26T12:41:32.497030+0000","last_peered":"2024-04-26T12:41:32.497030+0000","last_clean":"2024-04-26T12:41:32.497030+0000","last_became_active":"2024-04-26T12:38:18.468591+0000","last_became_peered":"2024-04-26T12:38:18.468591+0000","last_unstale":"2024-04-26T12:41:32.497030+0000","last_undegraded":"2024-04-26T12:41:32.497030+0000","last_fullsized":"2024-04-26T12:41:32.497030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:18.998001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":177,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550161+0000","last_change":"2024-04-26T12:38:20.519265+0000","last_active":"2024-04-26T12:41:32.550161+0000","last_peered":"2024-04-26T12:41:32.550161+0000","last_clean":"2024-04-26T12:41:32.550161+0000","last_became_active":"2024-04-26T12:38:20.518470+0000","last_became_peered":"2024-04-26T12:38:20.518470+0000","last_unstale":"2024-04-26T12:41:32.550161+0000","last_undegraded":"2024-04-26T12:41:32.550161+0000","last_fullsized":"2024-04-26T12:41:32.550161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510537+0000","last_change":"2024-04-26T12:38:32.089371+0000","last_active":"2024-04-26T12:41:32.510537+0000","last_peered":"2024-04-26T12:41:32.510537+0000","last_clean":"2024-04-26T12:41:32.510537+0000","last_became_active":"2024-04-26T12:38:32.088665+0000","last_became_peered":"2024-04-26T12:38:32.088665+0000","last_unstale":"2024-04-26T12:41:32.510537+0000","last_undegraded":"2024-04-26T12:41:32.510537+0000","last_fullsized":"2024-04-26T12:41:32.510537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:48.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"111'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.553244+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:41:32.553244+0000","last_peered":"2024-04-26T12:41:32.553244+0000","last_clean":"2024-04-26T12:41:32.553244+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:41:32.553244+0000","last_undegraded":"2024-04-26T12:41:32.553244+0000","last_fullsized":"2024-04-26T12:41:32.553244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564270+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:41:32.564270+0000","last_peered":"2024-04-26T12:41:32.564270+0000","last_clean":"2024-04-26T12:41:32.564270+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:41:32.564270+0000","last_undegraded":"2024-04-26T12:41:32.564270+0000","last_fullsized":"2024-04-26T12:41:32.564270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494220+0000","last_change":"2024-04-26T12:38:14.445252+0000","last_active":"2024-04-26T12:41:32.494220+0000","last_peered":"2024-04-26T12:41:32.494220+0000","last_clean":"2024-04-26T12:41:32.494220+0000","last_became_active":"2024-04-26T12:38:14.444677+0000","last_became_peered":"2024-04-26T12:38:14.444677+0000","last_unstale":"2024-04-26T12:41:32.494220+0000","last_undegraded":"2024-04-26T12:41:32.494220+0000","last_fullsized":"2024-04-26T12:41:32.494220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:53.850296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"104'40","reported_seq":242,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527595+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:41:32.527595+0000","last_peered":"2024-04-26T12:41:32.527595+0000","last_clean":"2024-04-26T12:41:32.527595+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:41:32.527595+0000","last_undegraded":"2024-04-26T12:41:32.527595+0000","last_fullsized":"2024-04-26T12:41:32.527595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495004+0000","last_change":"2024-04-26T12:38:18.495704+0000","last_active":"2024-04-26T12:41:32.495004+0000","last_peered":"2024-04-26T12:41:32.495004+0000","last_clean":"2024-04-26T12:41:32.495004+0000","last_became_active":"2024-04-26T12:38:18.494526+0000","last_became_peered":"2024-04-26T12:38:18.494526+0000","last_unstale":"2024-04-26T12:41:32.495004+0000","last_undegraded":"2024-04-26T12:41:32.495004+0000","last_fullsized":"2024-04-26T12:41:32.495004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:45.808675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510874+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:41:32.510874+0000","last_peered":"2024-04-26T12:41:32.510874+0000","last_clean":"2024-04-26T12:41:32.510874+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:41:32.510874+0000","last_undegraded":"2024-04-26T12:41:32.510874+0000","last_fullsized":"2024-04-26T12:41:32.510874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":187,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550568+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:41:32.550568+0000","last_peered":"2024-04-26T12:41:32.550568+0000","last_clean":"2024-04-26T12:41:32.550568+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:41:32.550568+0000","last_undegraded":"2024-04-26T12:41:32.550568+0000","last_fullsized":"2024-04-26T12:41:32.550568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563808+0000","last_change":"2024-04-26T12:38:32.098082+0000","last_active":"2024-04-26T12:41:32.563808+0000","last_peered":"2024-04-26T12:41:32.563808+0000","last_clean":"2024-04-26T12:41:32.563808+0000","last_became_active":"2024-04-26T12:38:32.097658+0000","last_became_peered":"2024-04-26T12:38:32.097658+0000","last_unstale":"2024-04-26T12:41:32.563808+0000","last_undegraded":"2024-04-26T12:41:32.563808+0000","last_fullsized":"2024-04-26T12:41:32.563808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:15.092930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"112'13","reported_seq":183,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528867+0000","last_change":"2024-04-26T12:38:32.090992+0000","last_active":"2024-04-26T12:41:32.528867+0000","last_peered":"2024-04-26T12:41:32.528867+0000","last_clean":"2024-04-26T12:41:32.528867+0000","last_became_active":"2024-04-26T12:38:32.090197+0000","last_became_peered":"2024-04-26T12:38:32.090197+0000","last_unstale":"2024-04-26T12:41:32.528867+0000","last_undegraded":"2024-04-26T12:41:32.528867+0000","last_fullsized":"2024-04-26T12:41:32.528867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:34:51.388263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492761+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:41:32.492761+0000","last_peered":"2024-04-26T12:41:32.492761+0000","last_clean":"2024-04-26T12:41:32.492761+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:41:32.492761+0000","last_undegraded":"2024-04-26T12:41:32.492761+0000","last_fullsized":"2024-04-26T12:41:32.492761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"104'18","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494703+0000","last_change":"2024-04-26T12:38:16.475876+0000","last_active":"2024-04-26T12:41:32.494703+0000","last_peered":"2024-04-26T12:41:32.494703+0000","last_clean":"2024-04-26T12:41:32.494703+0000","last_became_active":"2024-04-26T12:38:16.475087+0000","last_became_peered":"2024-04-26T12:38:16.475087+0000","last_unstale":"2024-04-26T12:41:32.494703+0000","last_undegraded":"2024-04-26T12:41:32.494703+0000","last_fullsized":"2024-04-26T12:41:32.494703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494083+0000","last_change":"2024-04-26T12:38:18.473170+0000","last_active":"2024-04-26T12:41:32.494083+0000","last_peered":"2024-04-26T12:41:32.494083+0000","last_clean":"2024-04-26T12:41:32.494083+0000","last_became_active":"2024-04-26T12:38:18.472310+0000","last_became_peered":"2024-04-26T12:38:18.472310+0000","last_unstale":"2024-04-26T12:41:32.494083+0000","last_undegraded":"2024-04-26T12:41:32.494083+0000","last_fullsized":"2024-04-26T12:41:32.494083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:50.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":178,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495535+0000","last_change":"2024-04-26T12:38:20.520951+0000","last_active":"2024-04-26T12:41:32.495535+0000","last_peered":"2024-04-26T12:41:32.495535+0000","last_clean":"2024-04-26T12:41:32.495535+0000","last_became_active":"2024-04-26T12:38:20.514827+0000","last_became_peered":"2024-04-26T12:38:20.514827+0000","last_unstale":"2024-04-26T12:41:32.495535+0000","last_undegraded":"2024-04-26T12:41:32.495535+0000","last_fullsized":"2024-04-26T12:41:32.495535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:36.387063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492549+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:41:32.492549+0000","last_peered":"2024-04-26T12:41:32.492549+0000","last_clean":"2024-04-26T12:41:32.492549+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:41:32.492549+0000","last_undegraded":"2024-04-26T12:41:32.492549+0000","last_fullsized":"2024-04-26T12:41:32.492549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"104'15","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529476+0000","last_change":"2024-04-26T12:38:10.473509+0000","last_active":"2024-04-26T12:41:32.529476+0000","last_peered":"2024-04-26T12:41:32.529476+0000","last_clean":"2024-04-26T12:41:32.529476+0000","last_became_active":"2024-04-26T12:38:10.471750+0000","last_became_peered":"2024-04-26T12:38:10.471750+0000","last_unstale":"2024-04-26T12:41:32.529476+0000","last_undegraded":"2024-04-26T12:41:32.529476+0000","last_fullsized":"2024-04-26T12:41:32.529476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495188+0000","last_change":"2024-04-26T12:38:14.451079+0000","last_active":"2024-04-26T12:41:32.495188+0000","last_peered":"2024-04-26T12:41:32.495188+0000","last_clean":"2024-04-26T12:41:32.495188+0000","last_became_active":"2024-04-26T12:38:14.450677+0000","last_became_peered":"2024-04-26T12:38:14.450677+0000","last_unstale":"2024-04-26T12:41:32.495188+0000","last_undegraded":"2024-04-26T12:41:32.495188+0000","last_fullsized":"2024-04-26T12:41:32.495188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"106'8","reported_seq":195,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550459+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:41:32.550459+0000","last_peered":"2024-04-26T12:41:32.550459+0000","last_clean":"2024-04-26T12:41:32.550459+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:41:32.550459+0000","last_undegraded":"2024-04-26T12:41:32.550459+0000","last_fullsized":"2024-04-26T12:41:32.550459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527645+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:41:32.527645+0000","last_peered":"2024-04-26T12:41:32.527645+0000","last_clean":"2024-04-26T12:41:32.527645+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:41:32.527645+0000","last_undegraded":"2024-04-26T12:41:32.527645+0000","last_fullsized":"2024-04-26T12:41:32.527645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":185,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550192+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:41:32.550192+0000","last_peered":"2024-04-26T12:41:32.550192+0000","last_clean":"2024-04-26T12:41:32.550192+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:41:32.550192+0000","last_undegraded":"2024-04-26T12:41:32.550192+0000","last_fullsized":"2024-04-26T12:41:32.550192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495500+0000","last_change":"2024-04-26T12:38:12.463828+0000","last_active":"2024-04-26T12:41:32.495500+0000","last_peered":"2024-04-26T12:41:32.495500+0000","last_clean":"2024-04-26T12:41:32.495500+0000","last_became_active":"2024-04-26T12:38:12.463293+0000","last_became_peered":"2024-04-26T12:38:12.463293+0000","last_unstale":"2024-04-26T12:41:32.495500+0000","last_undegraded":"2024-04-26T12:41:32.495500+0000","last_fullsized":"2024-04-26T12:41:32.495500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"104'19","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511519+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:41:32.511519+0000","last_peered":"2024-04-26T12:41:32.511519+0000","last_clean":"2024-04-26T12:41:32.511519+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:41:32.511519+0000","last_undegraded":"2024-04-26T12:41:32.511519+0000","last_fullsized":"2024-04-26T12:41:32.511519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526541+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:41:32.526541+0000","last_peered":"2024-04-26T12:41:32.526541+0000","last_clean":"2024-04-26T12:41:32.526541+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:41:32.526541+0000","last_undegraded":"2024-04-26T12:41:32.526541+0000","last_fullsized":"2024-04-26T12:41:32.526541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"104'18","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495062+0000","last_change":"2024-04-26T12:38:16.479059+0000","last_active":"2024-04-26T12:41:32.495062+0000","last_peered":"2024-04-26T12:41:32.495062+0000","last_clean":"2024-04-26T12:41:32.495062+0000","last_became_active":"2024-04-26T12:38:16.477181+0000","last_became_peered":"2024-04-26T12:38:16.477181+0000","last_unstale":"2024-04-26T12:41:32.495062+0000","last_undegraded":"2024-04-26T12:41:32.495062+0000","last_fullsized":"2024-04-26T12:41:32.495062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:21.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563932+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:41:32.563932+0000","last_peered":"2024-04-26T12:41:32.563932+0000","last_clean":"2024-04-26T12:41:32.563932+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:41:32.563932+0000","last_undegraded":"2024-04-26T12:41:32.563932+0000","last_fullsized":"2024-04-26T12:41:32.563932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510775+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:41:32.510775+0000","last_peered":"2024-04-26T12:41:32.510775+0000","last_clean":"2024-04-26T12:41:32.510775+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:41:32.510775+0000","last_undegraded":"2024-04-26T12:41:32.510775+0000","last_fullsized":"2024-04-26T12:41:32.510775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494850+0000","last_change":"2024-04-26T12:38:12.444884+0000","last_active":"2024-04-26T12:41:32.494850+0000","last_peered":"2024-04-26T12:41:32.494850+0000","last_clean":"2024-04-26T12:41:32.494850+0000","last_became_active":"2024-04-26T12:38:12.444289+0000","last_became_peered":"2024-04-26T12:38:12.444289+0000","last_unstale":"2024-04-26T12:41:32.494850+0000","last_undegraded":"2024-04-26T12:41:32.494850+0000","last_fullsized":"2024-04-26T12:41:32.494850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'13","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552448+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:41:32.552448+0000","last_peered":"2024-04-26T12:41:32.552448+0000","last_clean":"2024-04-26T12:41:32.552448+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:41:32.552448+0000","last_undegraded":"2024-04-26T12:41:32.552448+0000","last_fullsized":"2024-04-26T12:41:32.552448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564169+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:41:32.564169+0000","last_peered":"2024-04-26T12:41:32.564169+0000","last_clean":"2024-04-26T12:41:32.564169+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:41:32.564169+0000","last_undegraded":"2024-04-26T12:41:32.564169+0000","last_fullsized":"2024-04-26T12:41:32.564169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"104'19","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527300+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:41:32.527300+0000","last_peered":"2024-04-26T12:41:32.527300+0000","last_clean":"2024-04-26T12:41:32.527300+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:41:32.527300+0000","last_undegraded":"2024-04-26T12:41:32.527300+0000","last_fullsized":"2024-04-26T12:41:32.527300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551226+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:41:32.551226+0000","last_peered":"2024-04-26T12:41:32.551226+0000","last_clean":"2024-04-26T12:41:32.551226+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:41:32.551226+0000","last_undegraded":"2024-04-26T12:41:32.551226+0000","last_fullsized":"2024-04-26T12:41:32.551226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":202,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564168+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:41:32.564168+0000","last_peered":"2024-04-26T12:41:32.564168+0000","last_clean":"2024-04-26T12:41:32.564168+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:41:32.564168+0000","last_undegraded":"2024-04-26T12:41:32.564168+0000","last_fullsized":"2024-04-26T12:41:32.564168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"111'11","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494640+0000","last_change":"2024-04-26T12:38:10.448498+0000","last_active":"2024-04-26T12:41:32.494640+0000","last_peered":"2024-04-26T12:41:32.494640+0000","last_clean":"2024-04-26T12:41:32.494640+0000","last_became_active":"2024-04-26T12:38:10.446752+0000","last_became_peered":"2024-04-26T12:38:10.446752+0000","last_unstale":"2024-04-26T12:41:32.494640+0000","last_undegraded":"2024-04-26T12:41:32.494640+0000","last_fullsized":"2024-04-26T12:41:32.494640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552649+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:41:32.552649+0000","last_peered":"2024-04-26T12:41:32.552649+0000","last_clean":"2024-04-26T12:41:32.552649+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:41:32.552649+0000","last_undegraded":"2024-04-26T12:41:32.552649+0000","last_fullsized":"2024-04-26T12:41:32.552649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"104'26","reported_seq":223,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493941+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:41:32.493941+0000","last_peered":"2024-04-26T12:41:32.493941+0000","last_clean":"2024-04-26T12:41:32.493941+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:41:32.493941+0000","last_undegraded":"2024-04-26T12:41:32.493941+0000","last_fullsized":"2024-04-26T12:41:32.493941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":183,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510889+0000","last_change":"2024-04-26T12:38:18.488747+0000","last_active":"2024-04-26T12:41:32.510889+0000","last_peered":"2024-04-26T12:41:32.510889+0000","last_clean":"2024-04-26T12:41:32.510889+0000","last_became_active":"2024-04-26T12:38:18.488002+0000","last_became_peered":"2024-04-26T12:38:18.488002+0000","last_unstale":"2024-04-26T12:41:32.510889+0000","last_undegraded":"2024-04-26T12:41:32.510889+0000","last_fullsized":"2024-04-26T12:41:32.510889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":178,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494831+0000","last_change":"2024-04-26T12:38:20.712928+0000","last_active":"2024-04-26T12:41:32.494831+0000","last_peered":"2024-04-26T12:41:32.494831+0000","last_clean":"2024-04-26T12:41:32.494831+0000","last_became_active":"2024-04-26T12:38:20.712115+0000","last_became_peered":"2024-04-26T12:38:20.712115+0000","last_unstale":"2024-04-26T12:41:32.494831+0000","last_undegraded":"2024-04-26T12:41:32.494831+0000","last_fullsized":"2024-04-26T12:41:32.494831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:42.704652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":250,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552788+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:41:32.552788+0000","last_peered":"2024-04-26T12:41:32.552788+0000","last_clean":"2024-04-26T12:41:32.552788+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:41:32.552788+0000","last_undegraded":"2024-04-26T12:41:32.552788+0000","last_fullsized":"2024-04-26T12:41:32.552788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"111'21","reported_seq":219,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492371+0000","last_change":"2024-04-26T12:38:10.441910+0000","last_active":"2024-04-26T12:41:32.492371+0000","last_peered":"2024-04-26T12:41:32.492371+0000","last_clean":"2024-04-26T12:41:32.492371+0000","last_became_active":"2024-04-26T12:38:10.441097+0000","last_became_peered":"2024-04-26T12:38:10.441097+0000","last_unstale":"2024-04-26T12:41:32.492371+0000","last_undegraded":"2024-04-26T12:41:32.492371+0000","last_fullsized":"2024-04-26T12:41:32.492371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563887+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:41:32.563887+0000","last_peered":"2024-04-26T12:41:32.563887+0000","last_clean":"2024-04-26T12:41:32.563887+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:41:32.563887+0000","last_undegraded":"2024-04-26T12:41:32.563887+0000","last_fullsized":"2024-04-26T12:41:32.563887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"104'22","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.528457+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:41:32.528457+0000","last_peered":"2024-04-26T12:41:32.528457+0000","last_clean":"2024-04-26T12:41:32.528457+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:41:32.528457+0000","last_undegraded":"2024-04-26T12:41:32.528457+0000","last_fullsized":"2024-04-26T12:41:32.528457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494825+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:41:32.494825+0000","last_peered":"2024-04-26T12:41:32.494825+0000","last_clean":"2024-04-26T12:41:32.494825+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:41:32.494825+0000","last_undegraded":"2024-04-26T12:41:32.494825+0000","last_fullsized":"2024-04-26T12:41:32.494825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.562879+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:41:32.562879+0000","last_peered":"2024-04-26T12:41:32.562879+0000","last_clean":"2024-04-26T12:41:32.562879+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:41:32.562879+0000","last_undegraded":"2024-04-26T12:41:32.562879+0000","last_fullsized":"2024-04-26T12:41:32.562879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495762+0000","last_change":"2024-04-26T12:38:12.449173+0000","last_active":"2024-04-26T12:41:32.495762+0000","last_peered":"2024-04-26T12:41:32.495762+0000","last_clean":"2024-04-26T12:41:32.495762+0000","last_became_active":"2024-04-26T12:38:12.448867+0000","last_became_peered":"2024-04-26T12:38:12.448867+0000","last_unstale":"2024-04-26T12:41:32.495762+0000","last_undegraded":"2024-04-26T12:41:32.495762+0000","last_fullsized":"2024-04-26T12:41:32.495762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"111'13","reported_seq":184,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.497001+0000","last_change":"2024-04-26T12:38:32.097004+0000","last_active":"2024-04-26T12:41:32.497001+0000","last_peered":"2024-04-26T12:41:32.497001+0000","last_clean":"2024-04-26T12:41:32.497001+0000","last_became_active":"2024-04-26T12:38:32.096196+0000","last_became_peered":"2024-04-26T12:38:32.096196+0000","last_unstale":"2024-04-26T12:41:32.497001+0000","last_undegraded":"2024-04-26T12:41:32.497001+0000","last_fullsized":"2024-04-26T12:41:32.497001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:00.173484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495640+0000","last_change":"2024-04-26T12:38:32.100356+0000","last_active":"2024-04-26T12:41:32.495640+0000","last_peered":"2024-04-26T12:41:32.495640+0000","last_clean":"2024-04-26T12:41:32.495640+0000","last_became_active":"2024-04-26T12:38:32.099529+0000","last_became_peered":"2024-04-26T12:38:32.099529+0000","last_unstale":"2024-04-26T12:41:32.495640+0000","last_undegraded":"2024-04-26T12:41:32.495640+0000","last_fullsized":"2024-04-26T12:41:32.495640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:32.397561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"104'18","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496216+0000","last_change":"2024-04-26T12:38:16.529229+0000","last_active":"2024-04-26T12:41:32.496216+0000","last_peered":"2024-04-26T12:41:32.496216+0000","last_clean":"2024-04-26T12:41:32.496216+0000","last_became_active":"2024-04-26T12:38:16.528329+0000","last_became_peered":"2024-04-26T12:38:16.528329+0000","last_unstale":"2024-04-26T12:41:32.496216+0000","last_undegraded":"2024-04-26T12:41:32.496216+0000","last_fullsized":"2024-04-26T12:41:32.496216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:47.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493538+0000","last_change":"2024-04-26T12:38:18.496742+0000","last_active":"2024-04-26T12:41:32.493538+0000","last_peered":"2024-04-26T12:41:32.493538+0000","last_clean":"2024-04-26T12:41:32.493538+0000","last_became_active":"2024-04-26T12:38:18.495953+0000","last_became_peered":"2024-04-26T12:38:18.495953+0000","last_unstale":"2024-04-26T12:41:32.493538+0000","last_undegraded":"2024-04-26T12:41:32.493538+0000","last_fullsized":"2024-04-26T12:41:32.493538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:41.741028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510312+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:41:32.510312+0000","last_peered":"2024-04-26T12:41:32.510312+0000","last_clean":"2024-04-26T12:41:32.510312+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:41:32.510312+0000","last_undegraded":"2024-04-26T12:41:32.510312+0000","last_fullsized":"2024-04-26T12:41:32.510312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":194,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520121+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:41:32.520121+0000","last_peered":"2024-04-26T12:41:32.520121+0000","last_clean":"2024-04-26T12:41:32.520121+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:41:32.520121+0000","last_undegraded":"2024-04-26T12:41:32.520121+0000","last_fullsized":"2024-04-26T12:41:32.520121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"111'19","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551273+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:41:32.551273+0000","last_peered":"2024-04-26T12:41:32.551273+0000","last_clean":"2024-04-26T12:41:32.551273+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:41:32.551273+0000","last_undegraded":"2024-04-26T12:41:32.551273+0000","last_fullsized":"2024-04-26T12:41:32.551273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494359+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:41:32.494359+0000","last_peered":"2024-04-26T12:41:32.494359+0000","last_clean":"2024-04-26T12:41:32.494359+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:41:32.494359+0000","last_undegraded":"2024-04-26T12:41:32.494359+0000","last_fullsized":"2024-04-26T12:41:32.494359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"68'11","reported_seq":205,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564659+0000","last_change":"2024-04-26T12:38:32.098589+0000","last_active":"2024-04-26T12:41:32.564659+0000","last_peered":"2024-04-26T12:41:32.564659+0000","last_clean":"2024-04-26T12:41:32.564659+0000","last_became_active":"2024-04-26T12:38:32.097940+0000","last_became_peered":"2024-04-26T12:38:32.097940+0000","last_unstale":"2024-04-26T12:41:32.564659+0000","last_undegraded":"2024-04-26T12:41:32.564659+0000","last_fullsized":"2024-04-26T12:41:32.564659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.299109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"108'131","reported_seq":355,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563333+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:41:32.563333+0000","last_peered":"2024-04-26T12:41:32.563333+0000","last_clean":"2024-04-26T12:41:32.563333+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:41:32.563333+0000","last_undegraded":"2024-04-26T12:41:32.563333+0000","last_fullsized":"2024-04-26T12:41:32.563333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"108'3","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526345+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:41:32.526345+0000","last_peered":"2024-04-26T12:41:32.526345+0000","last_clean":"2024-04-26T12:41:32.526345+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:41:32.526345+0000","last_undegraded":"2024-04-26T12:41:32.526345+0000","last_fullsized":"2024-04-26T12:41:32.526345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":200,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495675+0000","last_change":"2024-04-26T12:38:32.097299+0000","last_active":"2024-04-26T12:41:32.495675+0000","last_peered":"2024-04-26T12:41:32.495675+0000","last_clean":"2024-04-26T12:41:32.495675+0000","last_became_active":"2024-04-26T12:38:32.096485+0000","last_became_peered":"2024-04-26T12:38:32.096485+0000","last_unstale":"2024-04-26T12:41:32.495675+0000","last_undegraded":"2024-04-26T12:41:32.495675+0000","last_fullsized":"2024-04-26T12:41:32.495675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:18.433433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"111'18","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511007+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:41:32.511007+0000","last_peered":"2024-04-26T12:41:32.511007+0000","last_clean":"2024-04-26T12:41:32.511007+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:41:32.511007+0000","last_undegraded":"2024-04-26T12:41:32.511007+0000","last_fullsized":"2024-04-26T12:41:32.511007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":189,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527507+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:41:32.527507+0000","last_peered":"2024-04-26T12:41:32.527507+0000","last_clean":"2024-04-26T12:41:32.527507+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:41:32.527507+0000","last_undegraded":"2024-04-26T12:41:32.527507+0000","last_fullsized":"2024-04-26T12:41:32.527507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"104'23","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510469+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:41:32.510469+0000","last_peered":"2024-04-26T12:41:32.510469+0000","last_clean":"2024-04-26T12:41:32.510469+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:41:32.510469+0000","last_undegraded":"2024-04-26T12:41:32.510469+0000","last_fullsized":"2024-04-26T12:41:32.510469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550302+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:41:32.550302+0000","last_peered":"2024-04-26T12:41:32.550302+0000","last_clean":"2024-04-26T12:41:32.550302+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:41:32.550302+0000","last_undegraded":"2024-04-26T12:41:32.550302+0000","last_fullsized":"2024-04-26T12:41:32.550302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":177,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.533969+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:41:32.533969+0000","last_peered":"2024-04-26T12:41:32.533969+0000","last_clean":"2024-04-26T12:41:32.533969+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:41:32.533969+0000","last_undegraded":"2024-04-26T12:41:32.533969+0000","last_fullsized":"2024-04-26T12:41:32.533969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"108'9","reported_seq":192,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495227+0000","last_change":"2024-04-26T12:38:32.097693+0000","last_active":"2024-04-26T12:41:32.495227+0000","last_peered":"2024-04-26T12:41:32.495227+0000","last_clean":"2024-04-26T12:41:32.495227+0000","last_became_active":"2024-04-26T12:38:32.096141+0000","last_became_peered":"2024-04-26T12:38:32.096141+0000","last_unstale":"2024-04-26T12:41:32.495227+0000","last_undegraded":"2024-04-26T12:41:32.495227+0000","last_fullsized":"2024-04-26T12:41:32.495227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:49.450059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"112'26","reported_seq":225,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550423+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:41:32.550423+0000","last_peered":"2024-04-26T12:41:32.550423+0000","last_clean":"2024-04-26T12:41:32.550423+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:41:32.550423+0000","last_undegraded":"2024-04-26T12:41:32.550423+0000","last_fullsized":"2024-04-26T12:41:32.550423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":191,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510771+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:41:32.510771+0000","last_peered":"2024-04-26T12:41:32.510771+0000","last_clean":"2024-04-26T12:41:32.510771+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:41:32.510771+0000","last_undegraded":"2024-04-26T12:41:32.510771+0000","last_fullsized":"2024-04-26T12:41:32.510771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"104'17","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.550362+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:41:32.550362+0000","last_peered":"2024-04-26T12:41:32.550362+0000","last_clean":"2024-04-26T12:41:32.550362+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:41:32.550362+0000","last_undegraded":"2024-04-26T12:41:32.550362+0000","last_fullsized":"2024-04-26T12:41:32.550362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563343+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:41:32.563343+0000","last_peered":"2024-04-26T12:41:32.563343+0000","last_clean":"2024-04-26T12:41:32.563343+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:41:32.563343+0000","last_undegraded":"2024-04-26T12:41:32.563343+0000","last_fullsized":"2024-04-26T12:41:32.563343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":182,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495645+0000","last_change":"2024-04-26T12:38:20.713634+0000","last_active":"2024-04-26T12:41:32.495645+0000","last_peered":"2024-04-26T12:41:32.495645+0000","last_clean":"2024-04-26T12:41:32.495645+0000","last_became_active":"2024-04-26T12:38:20.712837+0000","last_became_peered":"2024-04-26T12:38:20.712837+0000","last_unstale":"2024-04-26T12:41:32.495645+0000","last_undegraded":"2024-04-26T12:41:32.495645+0000","last_fullsized":"2024-04-26T12:41:32.495645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495784+0000","last_change":"2024-04-26T12:38:12.453569+0000","last_active":"2024-04-26T12:41:32.495784+0000","last_peered":"2024-04-26T12:41:32.495784+0000","last_clean":"2024-04-26T12:41:32.495784+0000","last_became_active":"2024-04-26T12:38:12.453187+0000","last_became_peered":"2024-04-26T12:38:12.453187+0000","last_unstale":"2024-04-26T12:41:32.495784+0000","last_undegraded":"2024-04-26T12:41:32.495784+0000","last_fullsized":"2024-04-26T12:41:32.495784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"111'20","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496056+0000","last_change":"2024-04-26T12:38:10.451413+0000","last_active":"2024-04-26T12:41:32.496056+0000","last_peered":"2024-04-26T12:41:32.496056+0000","last_clean":"2024-04-26T12:41:32.496056+0000","last_became_active":"2024-04-26T12:38:10.450713+0000","last_became_peered":"2024-04-26T12:38:10.450713+0000","last_unstale":"2024-04-26T12:41:32.496056+0000","last_undegraded":"2024-04-26T12:41:32.496056+0000","last_fullsized":"2024-04-26T12:41:32.496056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563108+0000","last_change":"2024-04-26T12:38:32.098077+0000","last_active":"2024-04-26T12:41:32.563108+0000","last_peered":"2024-04-26T12:41:32.563108+0000","last_clean":"2024-04-26T12:41:32.563108+0000","last_became_active":"2024-04-26T12:38:32.097608+0000","last_became_peered":"2024-04-26T12:38:32.097608+0000","last_unstale":"2024-04-26T12:41:32.563108+0000","last_undegraded":"2024-04-26T12:41:32.563108+0000","last_fullsized":"2024-04-26T12:41:32.563108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:52.163433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"104'13","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496966+0000","last_change":"2024-04-26T12:38:16.463732+0000","last_active":"2024-04-26T12:41:32.496966+0000","last_peered":"2024-04-26T12:41:32.496966+0000","last_clean":"2024-04-26T12:41:32.496966+0000","last_became_active":"2024-04-26T12:38:16.461038+0000","last_became_peered":"2024-04-26T12:38:16.461038+0000","last_unstale":"2024-04-26T12:41:32.496966+0000","last_undegraded":"2024-04-26T12:41:32.496966+0000","last_fullsized":"2024-04-26T12:41:32.496966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":172,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563717+0000","last_change":"2024-04-26T12:38:32.097869+0000","last_active":"2024-04-26T12:41:32.563717+0000","last_peered":"2024-04-26T12:41:32.563717+0000","last_clean":"2024-04-26T12:41:32.563717+0000","last_became_active":"2024-04-26T12:38:32.097545+0000","last_became_peered":"2024-04-26T12:38:32.097545+0000","last_unstale":"2024-04-26T12:41:32.563717+0000","last_undegraded":"2024-04-26T12:41:32.563717+0000","last_fullsized":"2024-04-26T12:41:32.563717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:00.124541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526948+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:41:32.526948+0000","last_peered":"2024-04-26T12:41:32.526948+0000","last_clean":"2024-04-26T12:41:32.526948+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:41:32.526948+0000","last_undegraded":"2024-04-26T12:41:32.526948+0000","last_fullsized":"2024-04-26T12:41:32.526948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":218,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563182+0000","last_change":"2024-04-26T12:38:32.098742+0000","last_active":"2024-04-26T12:41:32.563182+0000","last_peered":"2024-04-26T12:41:32.563182+0000","last_clean":"2024-04-26T12:41:32.563182+0000","last_became_active":"2024-04-26T12:38:32.098197+0000","last_became_peered":"2024-04-26T12:38:32.098197+0000","last_unstale":"2024-04-26T12:41:32.563182+0000","last_undegraded":"2024-04-26T12:41:32.563182+0000","last_fullsized":"2024-04-26T12:41:32.563182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.480181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"112'19","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.568144+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:41:32.568144+0000","last_peered":"2024-04-26T12:41:32.568144+0000","last_clean":"2024-04-26T12:41:32.568144+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:41:32.568144+0000","last_undegraded":"2024-04-26T12:41:32.568144+0000","last_fullsized":"2024-04-26T12:41:32.568144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":279,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.491736+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:41:32.491736+0000","last_peered":"2024-04-26T12:41:32.491736+0000","last_clean":"2024-04-26T12:41:32.491736+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:41:32.491736+0000","last_undegraded":"2024-04-26T12:41:32.491736+0000","last_fullsized":"2024-04-26T12:41:32.491736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":130,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"104'16","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510503+0000","last_change":"2024-04-26T12:38:32.089759+0000","last_active":"2024-04-26T12:41:32.510503+0000","last_peered":"2024-04-26T12:41:32.510503+0000","last_clean":"2024-04-26T12:41:32.510503+0000","last_became_active":"2024-04-26T12:38:32.088214+0000","last_became_peered":"2024-04-26T12:38:32.088214+0000","last_unstale":"2024-04-26T12:41:32.510503+0000","last_undegraded":"2024-04-26T12:41:32.510503+0000","last_fullsized":"2024-04-26T12:41:32.510503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:38.656355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":181,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551175+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:41:32.551175+0000","last_peered":"2024-04-26T12:41:32.551175+0000","last_clean":"2024-04-26T12:41:32.551175+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:41:32.551175+0000","last_undegraded":"2024-04-26T12:41:32.551175+0000","last_fullsized":"2024-04-26T12:41:32.551175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":176,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551855+0000","last_change":"2024-04-26T12:38:32.098228+0000","last_active":"2024-04-26T12:41:32.551855+0000","last_peered":"2024-04-26T12:41:32.551855+0000","last_clean":"2024-04-26T12:41:32.551855+0000","last_became_active":"2024-04-26T12:38:32.092404+0000","last_became_peered":"2024-04-26T12:38:32.092404+0000","last_unstale":"2024-04-26T12:41:32.551855+0000","last_undegraded":"2024-04-26T12:41:32.551855+0000","last_fullsized":"2024-04-26T12:41:32.551855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:25.672148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"108'7","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494318+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:41:32.494318+0000","last_peered":"2024-04-26T12:41:32.494318+0000","last_clean":"2024-04-26T12:41:32.494318+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:41:32.494318+0000","last_undegraded":"2024-04-26T12:41:32.494318+0000","last_fullsized":"2024-04-26T12:41:32.494318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"104'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563415+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:41:32.563415+0000","last_peered":"2024-04-26T12:41:32.563415+0000","last_clean":"2024-04-26T12:41:32.563415+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:41:32.563415+0000","last_undegraded":"2024-04-26T12:41:32.563415+0000","last_fullsized":"2024-04-26T12:41:32.563415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":243,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493869+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:41:32.493869+0000","last_peered":"2024-04-26T12:41:32.493869+0000","last_clean":"2024-04-26T12:41:32.493869+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:41:32.493869+0000","last_undegraded":"2024-04-26T12:41:32.493869+0000","last_fullsized":"2024-04-26T12:41:32.493869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"112'21","reported_seq":224,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.673658+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:41:32.673658+0000","last_peered":"2024-04-26T12:41:32.673658+0000","last_clean":"2024-04-26T12:41:32.673658+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:41:32.673658+0000","last_undegraded":"2024-04-26T12:41:32.673658+0000","last_fullsized":"2024-04-26T12:41:32.673658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511035+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:41:32.511035+0000","last_peered":"2024-04-26T12:41:32.511035+0000","last_clean":"2024-04-26T12:41:32.511035+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:41:32.511035+0000","last_undegraded":"2024-04-26T12:41:32.511035+0000","last_fullsized":"2024-04-26T12:41:32.511035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"111'20","reported_seq":219,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510688+0000","last_change":"2024-04-26T12:38:10.447796+0000","last_active":"2024-04-26T12:41:32.510688+0000","last_peered":"2024-04-26T12:41:32.510688+0000","last_clean":"2024-04-26T12:41:32.510688+0000","last_became_active":"2024-04-26T12:38:10.446942+0000","last_became_peered":"2024-04-26T12:38:10.446942+0000","last_unstale":"2024-04-26T12:41:32.510688+0000","last_undegraded":"2024-04-26T12:41:32.510688+0000","last_fullsized":"2024-04-26T12:41:32.510688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"108'3","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.493798+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:41:32.493798+0000","last_peered":"2024-04-26T12:41:32.493798+0000","last_clean":"2024-04-26T12:41:32.493798+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:41:32.493798+0000","last_undegraded":"2024-04-26T12:41:32.493798+0000","last_fullsized":"2024-04-26T12:41:32.493798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"104'23","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551367+0000","last_change":"2024-04-26T12:38:10.458821+0000","last_active":"2024-04-26T12:41:32.551367+0000","last_peered":"2024-04-26T12:41:32.551367+0000","last_clean":"2024-04-26T12:41:32.551367+0000","last_became_active":"2024-04-26T12:38:10.454609+0000","last_became_peered":"2024-04-26T12:38:10.454609+0000","last_unstale":"2024-04-26T12:41:32.551367+0000","last_undegraded":"2024-04-26T12:41:32.551367+0000","last_fullsized":"2024-04-26T12:41:32.551367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495437+0000","last_change":"2024-04-26T12:38:12.465000+0000","last_active":"2024-04-26T12:41:32.495437+0000","last_peered":"2024-04-26T12:41:32.495437+0000","last_clean":"2024-04-26T12:41:32.495437+0000","last_became_active":"2024-04-26T12:38:12.464389+0000","last_became_peered":"2024-04-26T12:38:12.464389+0000","last_unstale":"2024-04-26T12:41:32.495437+0000","last_undegraded":"2024-04-26T12:41:32.495437+0000","last_fullsized":"2024-04-26T12:41:32.495437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"112'14","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496297+0000","last_change":"2024-04-26T12:38:10.448880+0000","last_active":"2024-04-26T12:41:32.496297+0000","last_peered":"2024-04-26T12:41:32.496297+0000","last_clean":"2024-04-26T12:41:32.496297+0000","last_became_active":"2024-04-26T12:38:10.448444+0000","last_became_peered":"2024-04-26T12:38:10.448444+0000","last_unstale":"2024-04-26T12:41:32.496297+0000","last_undegraded":"2024-04-26T12:41:32.496297+0000","last_fullsized":"2024-04-26T12:41:32.496297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":171,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564885+0000","last_change":"2024-04-26T12:38:32.099762+0000","last_active":"2024-04-26T12:41:32.564885+0000","last_peered":"2024-04-26T12:41:32.564885+0000","last_clean":"2024-04-26T12:41:32.564885+0000","last_became_active":"2024-04-26T12:38:32.099061+0000","last_became_peered":"2024-04-26T12:38:32.099061+0000","last_unstale":"2024-04-26T12:41:32.564885+0000","last_undegraded":"2024-04-26T12:41:32.564885+0000","last_fullsized":"2024-04-26T12:41:32.564885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:17.530530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"111'14","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.494726+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:41:32.494726+0000","last_peered":"2024-04-26T12:41:32.494726+0000","last_clean":"2024-04-26T12:41:32.494726+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:41:32.494726+0000","last_undegraded":"2024-04-26T12:41:32.494726+0000","last_fullsized":"2024-04-26T12:41:32.494726+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":199,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495345+0000","last_change":"2024-04-26T12:38:58.795730+0000","last_active":"2024-04-26T12:41:32.495345+0000","last_peered":"2024-04-26T12:41:32.495345+0000","last_clean":"2024-04-26T12:41:32.495345+0000","last_became_active":"2024-04-26T12:38:58.795097+0000","last_became_peered":"2024-04-26T12:38:58.795097+0000","last_unstale":"2024-04-26T12:41:32.495345+0000","last_undegraded":"2024-04-26T12:41:32.495345+0000","last_fullsized":"2024-04-26T12:41:32.495345+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.166788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"112'16","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564756+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:41:32.564756+0000","last_peered":"2024-04-26T12:41:32.564756+0000","last_clean":"2024-04-26T12:41:32.564756+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:41:32.564756+0000","last_undegraded":"2024-04-26T12:41:32.564756+0000","last_fullsized":"2024-04-26T12:41:32.564756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"108'11","reported_seq":237,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.565233+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:41:32.565233+0000","last_peered":"2024-04-26T12:41:32.565233+0000","last_clean":"2024-04-26T12:41:32.565233+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:41:32.565233+0000","last_undegraded":"2024-04-26T12:41:32.565233+0000","last_fullsized":"2024-04-26T12:41:32.565233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"111'21","reported_seq":219,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495982+0000","last_change":"2024-04-26T12:38:10.438206+0000","last_active":"2024-04-26T12:41:32.495982+0000","last_peered":"2024-04-26T12:41:32.495982+0000","last_clean":"2024-04-26T12:41:32.495982+0000","last_became_active":"2024-04-26T12:38:10.437723+0000","last_became_peered":"2024-04-26T12:38:10.437723+0000","last_unstale":"2024-04-26T12:41:32.495982+0000","last_undegraded":"2024-04-26T12:41:32.495982+0000","last_fullsized":"2024-04-26T12:41:32.495982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":228,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552338+0000","last_change":"2024-04-26T12:38:12.450114+0000","last_active":"2024-04-26T12:41:32.552338+0000","last_peered":"2024-04-26T12:41:32.552338+0000","last_clean":"2024-04-26T12:41:32.552338+0000","last_became_active":"2024-04-26T12:38:12.449849+0000","last_became_peered":"2024-04-26T12:38:12.449849+0000","last_unstale":"2024-04-26T12:41:32.552338+0000","last_undegraded":"2024-04-26T12:41:32.552338+0000","last_fullsized":"2024-04-26T12:41:32.552338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:19.870517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"112'20","reported_seq":219,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510666+0000","last_change":"2024-04-26T12:38:10.436396+0000","last_active":"2024-04-26T12:41:32.510666+0000","last_peered":"2024-04-26T12:41:32.510666+0000","last_clean":"2024-04-26T12:41:32.510666+0000","last_became_active":"2024-04-26T12:38:10.435587+0000","last_became_peered":"2024-04-26T12:38:10.435587+0000","last_unstale":"2024-04-26T12:41:32.510666+0000","last_undegraded":"2024-04-26T12:41:32.510666+0000","last_fullsized":"2024-04-26T12:41:32.510666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520370+0000","last_change":"2024-04-26T12:38:32.101184+0000","last_active":"2024-04-26T12:41:32.520370+0000","last_peered":"2024-04-26T12:41:32.520370+0000","last_clean":"2024-04-26T12:41:32.520370+0000","last_became_active":"2024-04-26T12:38:32.100885+0000","last_became_peered":"2024-04-26T12:38:32.100885+0000","last_unstale":"2024-04-26T12:41:32.520370+0000","last_undegraded":"2024-04-26T12:41:32.520370+0000","last_fullsized":"2024-04-26T12:41:32.520370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:14.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"112'12","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.496036+0000","last_change":"2024-04-26T12:38:10.438217+0000","last_active":"2024-04-26T12:41:32.496036+0000","last_peered":"2024-04-26T12:41:32.496036+0000","last_clean":"2024-04-26T12:41:32.496036+0000","last_became_active":"2024-04-26T12:38:10.437805+0000","last_became_peered":"2024-04-26T12:38:10.437805+0000","last_unstale":"2024-04-26T12:41:32.496036+0000","last_undegraded":"2024-04-26T12:41:32.496036+0000","last_fullsized":"2024-04-26T12:41:32.496036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"108'3","reported_seq":203,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520048+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:41:32.520048+0000","last_peered":"2024-04-26T12:41:32.520048+0000","last_clean":"2024-04-26T12:41:32.520048+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:41:32.520048+0000","last_undegraded":"2024-04-26T12:41:32.520048+0000","last_fullsized":"2024-04-26T12:41:32.520048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"104'14","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510642+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:41:32.510642+0000","last_peered":"2024-04-26T12:41:32.510642+0000","last_clean":"2024-04-26T12:41:32.510642+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:41:32.510642+0000","last_undegraded":"2024-04-26T12:41:32.510642+0000","last_fullsized":"2024-04-26T12:41:32.510642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"108'7","reported_seq":197,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.563547+0000","last_change":"2024-04-26T12:38:32.097249+0000","last_active":"2024-04-26T12:41:32.563547+0000","last_peered":"2024-04-26T12:41:32.563547+0000","last_clean":"2024-04-26T12:41:32.563547+0000","last_became_active":"2024-04-26T12:38:32.096972+0000","last_became_peered":"2024-04-26T12:38:32.096972+0000","last_unstale":"2024-04-26T12:41:32.563547+0000","last_undegraded":"2024-04-26T12:41:32.563547+0000","last_fullsized":"2024-04-26T12:41:32.563547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:06.018406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"104'16","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551459+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:41:32.551459+0000","last_peered":"2024-04-26T12:41:32.551459+0000","last_clean":"2024-04-26T12:41:32.551459+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:41:32.551459+0000","last_undegraded":"2024-04-26T12:41:32.551459+0000","last_fullsized":"2024-04-26T12:41:32.551459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.527862+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:41:32.527862+0000","last_peered":"2024-04-26T12:41:32.527862+0000","last_clean":"2024-04-26T12:41:32.527862+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:41:32.527862+0000","last_undegraded":"2024-04-26T12:41:32.527862+0000","last_fullsized":"2024-04-26T12:41:32.527862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"111'11","reported_seq":209,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.564035+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:41:32.564035+0000","last_peered":"2024-04-26T12:41:32.564035+0000","last_clean":"2024-04-26T12:41:32.564035+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:41:32.564035+0000","last_undegraded":"2024-04-26T12:41:32.564035+0000","last_fullsized":"2024-04-26T12:41:32.564035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":217,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.551141+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:41:32.551141+0000","last_peered":"2024-04-26T12:41:32.551141+0000","last_clean":"2024-04-26T12:41:32.551141+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:41:32.551141+0000","last_undegraded":"2024-04-26T12:41:32.551141+0000","last_fullsized":"2024-04-26T12:41:32.551141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"111'19","reported_seq":216,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.529640+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:41:32.529640+0000","last_peered":"2024-04-26T12:41:32.529640+0000","last_clean":"2024-04-26T12:41:32.529640+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:41:32.529640+0000","last_undegraded":"2024-04-26T12:41:32.529640+0000","last_fullsized":"2024-04-26T12:41:32.529640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":212,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.495175+0000","last_change":"2024-04-26T12:38:12.449540+0000","last_active":"2024-04-26T12:41:32.495175+0000","last_peered":"2024-04-26T12:41:32.495175+0000","last_clean":"2024-04-26T12:41:32.495175+0000","last_became_active":"2024-04-26T12:38:12.449211+0000","last_became_peered":"2024-04-26T12:38:12.449211+0000","last_unstale":"2024-04-26T12:41:32.495175+0000","last_undegraded":"2024-04-26T12:41:32.495175+0000","last_fullsized":"2024-04-26T12:41:32.495175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"104'12","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.520478+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:41:32.520478+0000","last_peered":"2024-04-26T12:41:32.520478+0000","last_clean":"2024-04-26T12:41:32.520478+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:41:32.520478+0000","last_undegraded":"2024-04-26T12:41:32.520478+0000","last_fullsized":"2024-04-26T12:41:32.520478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":211,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.526805+0000","last_change":"2024-04-26T12:38:12.463017+0000","last_active":"2024-04-26T12:41:32.526805+0000","last_peered":"2024-04-26T12:41:32.526805+0000","last_clean":"2024-04-26T12:41:32.526805+0000","last_became_active":"2024-04-26T12:38:12.462320+0000","last_became_peered":"2024-04-26T12:38:12.462320+0000","last_unstale":"2024-04-26T12:41:32.526805+0000","last_undegraded":"2024-04-26T12:41:32.526805+0000","last_fullsized":"2024-04-26T12:41:32.526805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"111'11","reported_seq":210,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511853+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:41:32.511853+0000","last_peered":"2024-04-26T12:41:32.511853+0000","last_clean":"2024-04-26T12:41:32.511853+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:41:32.511853+0000","last_undegraded":"2024-04-26T12:41:32.511853+0000","last_fullsized":"2024-04-26T12:41:32.511853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"104'15","reported_seq":214,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.510504+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:41:32.510504+0000","last_peered":"2024-04-26T12:41:32.510504+0000","last_clean":"2024-04-26T12:41:32.510504+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:41:32.510504+0000","last_undegraded":"2024-04-26T12:41:32.510504+0000","last_fullsized":"2024-04-26T12:41:32.510504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":202,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.552268+0000","last_change":"2024-04-26T12:38:12.450245+0000","last_active":"2024-04-26T12:41:32.552268+0000","last_peered":"2024-04-26T12:41:32.552268+0000","last_clean":"2024-04-26T12:41:32.552268+0000","last_became_active":"2024-04-26T12:38:12.449980+0000","last_became_peered":"2024-04-26T12:38:12.449980+0000","last_unstale":"2024-04-26T12:41:32.552268+0000","last_undegraded":"2024-04-26T12:41:32.552268+0000","last_fullsized":"2024-04-26T12:41:32.552268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"104'22","reported_seq":220,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.492147+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:41:32.492147+0000","last_peered":"2024-04-26T12:41:32.492147+0000","last_clean":"2024-04-26T12:41:32.492147+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:41:32.492147+0000","last_undegraded":"2024-04-26T12:41:32.492147+0000","last_fullsized":"2024-04-26T12:41:32.492147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"108'1","reported_seq":196,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-04-26T12:41:32.511424+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:41:32.511424+0000","last_peered":"2024-04-26T12:41:32.511424+0000","last_clean":"2024-04-26T12:41:32.511424+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:41:32.511424+0000","last_undegraded":"2024-04-26T12:41:32.511424+0000","last_fullsized":"2024-04-26T12:41:32.511424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1005,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":350,"num_read_kb":330,"num_write":289,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1048,"ondisk_log_size":1048,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":262295,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":839,"num_read_kb":601,"num_write":457,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":786432,"data_stored":476758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":719,"ondisk_log_size":719,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":434,"num_read_kb":434,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1374,"num_read_kb":1346,"num_write":295,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4517265408,"num_objects":1079,"num_object_clones":0,"num_object_copies":2158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1079,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":1163,"num_write_kb":4440064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9042919424,"data_stored":9042919424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1093,"ondisk_log_size":1093,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1159576,"kb_used_data":1128392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93212264,"statfs":{"total":96636764160,"available":95449358336,"internally_reserved":0,"allocated":1155473408,"data_stored":1154869107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":775924,"kb_used_data":744744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93595916,"statfs":{"total":96636764160,"available":95842217984,"internally_reserved":0,"allocated":762617856,"data_stored":762050985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1318760,"kb_used_data":1287576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93053080,"statfs":{"total":96636764160,"available":95286353920,"internally_reserved":0,"allocated":1318477824,"data_stored":1317849848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1287932,"kb_used_data":1252652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93083908,"statfs":{"total":96636764160,"available":95317921792,"internally_reserved":0,"allocated":1282715648,"data_stored":1282152038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1343372,"kb_used_data":1308032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93028468,"statfs":{"total":96636764160,"available":95261151232,"internally_reserved":0,"allocated":1339424768,"data_stored":1338827348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":782128,"kb_used_data":746788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93589712,"statfs":{"total":96636764160,"available":95835865088,"internally_reserved":0,"allocated":764710912,"data_stored":764148329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":819164,"kb_used_data":783820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93552676,"statfs":{"total":96636764160,"available":95797940224,"internally_reserved":0,"allocated":802631680,"data_stored":802024313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1188396,"kb_used_data":1153056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93183444,"statfs":{"total":96636764160,"available":95419846656,"internally_reserved":0,"allocated":1180729344,"data_stored":1180149466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1262485504,"data_stored":1262485504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":801112064,"data_stored":801112064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":826277888,"data_stored":826277888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1409286144,"data_stored":1409286144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1306525696,"data_stored":1306525696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1421869056,"data_stored":1421869056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":807403520,"data_stored":807403520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1207959552,"data_stored":1207959552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":175679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":60224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:41:38.295 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:41:38.295 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T12:41:38.295 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-26T12:41:38.295 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T12:41:38.295 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:41:38.296 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-04-26T12:41:38.287+0000 7f4c2b393640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25345) UID: 0 2024-04-26T12:41:38.363 DEBUG:teuthology.parallel:result is None 2024-04-26T12:41:38.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T12:41:38.371 INFO:teuthology.orchestra.run.smithi016.stdout:osd.0: {} 2024-04-26T12:41:38.371 INFO:teuthology.orchestra.run.smithi016.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T12:41:38.379 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-04-26T12:41:38.375+0000 7f6b73cc5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25341) UID: 0 2024-04-26T12:41:38.380 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T12:41:38.380 DEBUG:teuthology.orchestra.run.smithi016:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-26T12:41:38.387 INFO:teuthology.orchestra.run.smithi016.stdout:osd.1: {} 2024-04-26T12:41:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T12:41:38.398 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T12:41:38.398 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T12:41:38.407 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T12:41:38.407 INFO:teuthology.orchestra.run.smithi016.stdout:osd.2: {} 2024-04-26T12:41:38.407 INFO:teuthology.orchestra.run.smithi016.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T12:41:38.425 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:38.425 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:41:38.425 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:41:38.425 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:1601 3.1d 3:b9a54043:::d749f084-3851-4e95-9492-490675b43f90.4382.4__shadow_.IsNX4B5iysmV3yW1zPSf6wDlWTK3mjj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 98.703324104999993, 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028382847999999999, 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 1601 2024-04-26T12:41:38.426 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720718+0000", 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.427 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.720720+0000", 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3300000000000001e-06 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726577+0000", 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.005857307 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726616+0000", 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9224999999999998e-05 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.428 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726640+0000", 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3873e-05 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.726810+0000", 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016950799999999999 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727033+0000", 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022316600000000001 2024-04-26T12:41:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.727242+0000", 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020876 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748847+0000", 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021605347 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.748917+0000", 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9413999999999996e-05 2024-04-26T12:41:38.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749020+0000", 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103383 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:39:59.749100+0000", 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0535000000000001e-05 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.431 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2399 3.1d 3:bb5c5962:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 86.184854118999993, 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029752193999999999, 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2399 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.432 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239188+0000", 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.239192+0000", 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1829999999999996e-06 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.433 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243681+0000", 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0044893629999999997 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243722+0000", 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0639000000000002e-05 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243743+0000", 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0760000000000001e-05 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.434 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.243882+0000", 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013962600000000001 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244142+0000", 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025946699999999999 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.244378+0000", 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000236839 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.435 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.254731+0000", 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010353004000000001 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268598+0000", 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013866431 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268779+0000", 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018066499999999999 2024-04-26T12:41:38.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:12.268940+0000", 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016121700000000001 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3081 3.22 3:47037847:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:07.665410+0000", 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 30.758631212000001, 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.034387288000000002, 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.437 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3081 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.665410+0000", 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.438 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.665410+0000", 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.665427+0000", 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.6534000000000001e-05 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673049+0000", 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0076223590000000004 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.439 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673082+0000", 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2243000000000003e-05 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673099+0000", 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7396000000000001e-05 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673225+0000", 2024-04-26T12:41:38.440 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012571699999999999 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673512+0000", 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000287597 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.673733+0000", 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022041199999999999 2024-04-26T12:41:38.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.683145+0000", 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0094119479999999998 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.699468+0000", 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.016323502 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.699689+0000", 2024-04-26T12:41:38.442 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022083500000000001 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:07.699798+0000", 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108745 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3118 3.1d 3:bb40c566:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.063626+0000", 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 30.360415774, 2024-04-26T12:41:38.443 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028291525000000001, 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3118 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.063626+0000", 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.063626+0000", 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.063629+0000", 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4970000000000001e-06 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069064+0000", 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054349799999999998 2024-04-26T12:41:38.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069097+0000", 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2696e-05 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069121+0000", 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4292999999999999e-05 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069300+0000", 2024-04-26T12:41:38.446 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017843899999999999 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.069726+0000", 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042598199999999999 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.070138+0000", 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041179999999999998 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.447 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.082195+0000", 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012057538 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091723+0000", 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0095282519999999992 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091841+0000", 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000117142 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.448 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.091917+0000", 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6905999999999999e-05 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3129 3.28 3:16dc108e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.186217+0000", 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 30.237824478, 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.033383336, 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.449 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3129 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.186217+0000", 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.450 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.186217+0000", 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.186220+0000", 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1599999999999998e-06 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.192933+0000", 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0067123169999999998 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.451 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.192969+0000", 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6295999999999999e-05 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.192987+0000", 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8127000000000001e-05 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.193141+0000", 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015373200000000001 2024-04-26T12:41:38.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.193407+0000", 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026666 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.193640+0000", 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023205799999999999 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.214512+0000", 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020872386999999999 2024-04-26T12:41:38.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.219289+0000", 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047768819999999997 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.219471+0000", 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018253200000000001 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.219601+0000", 2024-04-26T12:41:38.454 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000129185 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3137 3.1f e102/17 3:fb1ca43b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_82:head v 102'10, mlcod=91'8)", 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.277816+0000", 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 30.146225545, 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.035425446999999999, 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.455 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.277816+0000", 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.277816+0000", 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.277818+0000", 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9630000000000001e-06 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.456 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287142+0000", 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0093239800000000008 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287202+0000", 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.9973000000000003e-05 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287227+0000", 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5318999999999999e-05 2024-04-26T12:41:38.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287457+0000", 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000229695 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287525+0000", 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.7472999999999996e-05 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313147+0000", 2024-04-26T12:41:38.458 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025621992 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313242+0000", 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.5051999999999997e-05 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3210 3.1d 3:b88fb53e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.079372+0000", 2024-04-26T12:41:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.344670022999999, 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.031525428000000001, 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3210 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.079372+0000", 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.079372+0000", 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.079376+0000", 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8970000000000001e-06 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.084609+0000", 2024-04-26T12:41:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0052335740000000004 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.084651+0000", 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1987000000000003e-05 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.084672+0000", 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.109e-05 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.084895+0000", 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000223088 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085203+0000", 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00030810700000000001 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.085439+0000", 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023521100000000001 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.463 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.098041+0000", 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012602593 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110680+0000", 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012638883 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110819+0000", 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013931499999999999 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.464 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.110897+0000", 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.7682999999999995e-05 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3286 3.2a 3:56bfcbf9:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.863244+0000", 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 28.560797322999999, 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.051172150999999999, 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.465 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3286 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.863244+0000", 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.466 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.863244+0000", 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.863249+0000", 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.527e-06 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.867973+0000", 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047243789999999999 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.467 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868015+0000", 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2123999999999999e-05 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868040+0000", 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4513000000000001e-05 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868204+0000", 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000164155 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.468 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op must wait for map", 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868224+0000", 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.035e-05 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.874287+0000", 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0060624670000000002 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.874661+0000", 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037397 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.469 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.875046+0000", 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038517 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.887902+0000", 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012856037000000001 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.914170+0000", 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026268282 2024-04-26T12:41:38.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.914310+0000", 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013964700000000001 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.914417+0000", 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010653 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3513 3.16 3:687ce27e:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_448:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:12.954538+0000", 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.469504063999999, 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030555254, 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3513 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.954538+0000", 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.954538+0000", 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.954543+0000", 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.3970000000000002e-06 2024-04-26T12:41:38.473 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.958906+0000", 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043632100000000002 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.958942+0000", 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5355999999999998e-05 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.958957+0000", 2024-04-26T12:41:38.474 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.5733e-05 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.959102+0000", 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014497199999999999 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.959506+0000", 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00040344699999999997 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.959847+0000", 2024-04-26T12:41:38.475 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00034168000000000002 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.983905+0000", 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024057490000000001 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.984831+0000", 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00092625800000000001 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.476 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.985004+0000", 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017273500000000001 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.985093+0000", 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.8975999999999996e-05 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3514 3.16 3:6a1f3cb9:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_449:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:12.963454+0000", 2024-04-26T12:41:38.477 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.460587253, 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.033068530999999998, 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3514 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.963454+0000", 2024-04-26T12:41:38.478 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.963454+0000", 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.963459+0000", 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2470000000000002e-06 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.479 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.967825+0000", 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043663759999999999 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.967868+0000", 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3339e-05 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.967896+0000", 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7426000000000001e-05 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.480 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.971470+0000", 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0035737970000000001 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.971760+0000", 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028998499999999998 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.972043+0000", 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028382400000000001 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.481 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.993145+0000", 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021101208 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.996364+0000", 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003219183 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.996457+0000", 2024-04-26T12:41:38.482 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2743000000000003e-05 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.996523+0000", 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.6402999999999994e-05 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3519 3.1d 3:bbcdc9e4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_454:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.013121+0000", 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.410921102, 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.031095858000000001, 2024-04-26T12:41:38.483 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3519 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.013121+0000", 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.484 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.013121+0000", 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.013123+0000", 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3369999999999998e-06 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.017897+0000", 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047737439999999999 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.485 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.017931+0000", 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3890000000000002e-05 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.017948+0000", 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7499999999999998e-05 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.486 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018083+0000", 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000135112 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018350+0000", 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026652099999999998 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.018582+0000", 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000232251 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.487 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.039842+0000", 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021259937 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.044039+0000", 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004196768 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.044136+0000", 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6978999999999994e-05 2024-04-26T12:41:38.488 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.044216+0000", 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0819e-05 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3520 3.1d 3:ba0cfaa4:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_455:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.022168+0000", 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.40187401, 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029300574999999999, 2024-04-26T12:41:38.489 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3520 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022168+0000", 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.490 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022168+0000", 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.022180+0000", 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.2656999999999999e-05 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.028839+0000", 2024-04-26T12:41:38.491 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0066590879999999996 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.028873+0000", 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3176000000000002e-05 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.028890+0000", 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7427000000000001e-05 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.492 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029031+0000", 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014076200000000001 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029293+0000", 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026173400000000001 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.029520+0000", 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000227975 2024-04-26T12:41:38.493 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.042155+0000", 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012634506 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.051267+0000", 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091124680000000003 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.051360+0000", 2024-04-26T12:41:38.494 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.2643000000000001e-05 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.051468+0000", 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000108139 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3545 3.16 3:6beecf10:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_480:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.274191+0000", 2024-04-26T12:41:38.495 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.149850506, 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.037917102000000001, 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3545 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.274191+0000", 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.496 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.274191+0000", 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.274195+0000", 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4769999999999999e-06 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.278727+0000", 2024-04-26T12:41:38.497 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045322979999999997 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.278768+0000", 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1016000000000002e-05 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.278788+0000", 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0193000000000001e-05 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.498 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.278995+0000", 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020664199999999999 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.279394+0000", 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00039876199999999999 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.279814+0000", 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042025999999999999 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.499 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.296990+0000", 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.017176554 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311817+0000", 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.014826293000000001 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311990+0000", 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017318100000000001 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.500 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.312108+0000", 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011842599999999999 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3546 3.16 3:6af70b60:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_481:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.283056+0000", 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.140985251, 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.041315967000000002, 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.501 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3546 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.283056+0000", 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.502 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.283056+0000", 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.283059+0000", 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.0259999999999999e-06 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289374+0000", 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0063144450000000001 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289418+0000", 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4536999999999997e-05 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289437+0000", 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8783e-05 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289630+0000", 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019282500000000001 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.504 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.289884+0000", 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025413699999999998 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.290142+0000", 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000258125 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.301595+0000", 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011452512999999999 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.505 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.324197+0000", 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022601678 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.324293+0000", 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6056000000000003e-05 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.324372+0000", 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9841999999999999e-05 2024-04-26T12:41:38.506 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3547 3.1d 3:bad5b40c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_482:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.292404+0000", 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.131637220999998, 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.036950670999999997, 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.507 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3547 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.292404+0000", 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.292404+0000", 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.508 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.292407+0000", 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9569999999999998e-06 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297044+0000", 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0046362189999999996 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297076+0000", 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.2227000000000002e-05 2024-04-26T12:41:38.509 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297094+0000", 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7770000000000001e-05 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297235+0000", 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00014136899999999999 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.510 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.297706+0000", 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047141799999999998 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.298278+0000", 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00057111200000000003 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.328020+0000", 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029742630999999999 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.511 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.329148+0000", 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011282740000000001 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.329248+0000", 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.9421999999999998e-05 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.329355+0000", 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000107272 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.512 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3736 3.38 e111/17 3:1fe78b8d:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_3:head v 111'9, mlcod=102'7)", 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:31.951990+0000", 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 6.4720518160000005, 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029512449999999999, 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.951990+0000", 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.513 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.951990+0000", 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.951991+0000", 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0999999999999997e-07 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960355+0000", 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0083645170000000001 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.514 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960392+0000", 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6915999999999997e-05 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960415+0000", 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3366999999999998e-05 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960525+0000", 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109589 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.515 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.960564+0000", 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8455999999999999e-05 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.981411+0000", 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.020847626000000001 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:31.981502+0000", 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.1168999999999994e-05 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.516 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3742 3.22 3:4525b8bb:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:32.019996+0000", 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 6.4040460320000001, 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028617633999999999, 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3742 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.517 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.019996+0000", 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.019996+0000", 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.020000+0000", 2024-04-26T12:41:38.518 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.89e-06 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028199+0000", 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0081995179999999994 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028243+0000", 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.4175999999999999e-05 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028269+0000", 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.5846e-05 2024-04-26T12:41:38.519 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028427+0000", 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015762600000000001 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028675+0000", 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024873899999999999 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 3", 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.028922+0000", 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024609799999999999 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.520 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.042779+0000", 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013857395999999999 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.048457+0000", 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056778139999999998 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.048543+0000", 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.5935999999999998e-05 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.521 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.048613+0000", 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0594999999999997e-05 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3764 3.1c 3:38e3bac5:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:32.269675+0000", 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 6.1543664409999996, 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028612426, 2024-04-26T12:41:38.522 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3764 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.269675+0000", 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.269675+0000", 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.269678+0000", 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9229999999999998e-06 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.278797+0000", 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091184830000000001 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.524 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.278839+0000", 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1875999999999997e-05 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.278859+0000", 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0356999999999998e-05 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.278967+0000", 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010832600000000001 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.525 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.279104+0000", 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000137257 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.279234+0000", 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012919799999999999 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.289471+0000", 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010236871999999999 2024-04-26T12:41:38.526 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.298156+0000", 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0086852790000000006 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.298231+0000", 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.4807000000000004e-05 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:32.298288+0000", 2024-04-26T12:41:38.527 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.7048e-05 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3851 3.2a 3:556a628d:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:33.271516+0000", 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 5.1525256610000003, 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.044733719999999998, 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.528 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3851 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.271516+0000", 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.271516+0000", 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.271520+0000", 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5360000000000001e-06 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.277808+0000", 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0062885700000000003 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.277842+0000", 2024-04-26T12:41:38.530 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4326000000000003e-05 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.277860+0000", 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7229000000000001e-05 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.277997+0000", 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013753600000000001 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.278170+0000", 2024-04-26T12:41:38.531 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017277300000000001 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 7", 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.278323+0000", 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015280400000000001 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.291932+0000", 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013608956 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.532 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.315967+0000", 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024035385999999999 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.316131+0000", 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000163819 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.316250+0000", 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000118785 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.533 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:4108 3.1d 3:bb73286d:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_365:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:36.218906+0000", 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 2.2051352259999999, 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.032335928, 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 4108 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.534 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.218906+0000", 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.218906+0000", 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.218910+0000", 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6430000000000001e-06 2024-04-26T12:41:38.535 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.223858+0000", 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0049480920000000003 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.223902+0000", 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3479999999999997e-05 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.223922+0000", 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0679999999999999e-05 2024-04-26T12:41:38.536 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.224104+0000", 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018170799999999999 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.224554+0000", 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045034600000000001 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.225024+0000", 2024-04-26T12:41:38.537 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000469636 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.249641+0000", 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024616764999999999 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.251023+0000", 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0013825300000000001 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.538 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.251120+0000", 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.6935999999999995e-05 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:36.251242+0000", 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012211200000000001 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.539 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:38.540 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T12:41:38.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T12:41:38.719 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:38.719 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:38.719 INFO:teuthology.orchestra.run.smithi131.stdout: "num_ops": 0 2024-04-26T12:41:38.719 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:38.733 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T12:41:38.856 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:38.856 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [], 2024-04-26T12:41:38.856 INFO:teuthology.orchestra.run.smithi131.stdout: "complaint_time": 30, 2024-04-26T12:41:38.856 INFO:teuthology.orchestra.run.smithi131.stdout: "num_blocked_ops": 0 2024-04-26T12:41:38.857 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:38.871 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T12:41:38.992 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: "size": 20, 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 600, 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: "ops": [ 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2351 3.14 3:29c2819e:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.267860982000002, 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.029175587999999999, 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:38.993 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2351 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.994 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723111+0000", 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.723115+0000", 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8500000000000004e-06 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727939+0000", 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048243670000000004 2024-04-26T12:41:38.995 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.727979+0000", 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0326e-05 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728003+0000", 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.4193e-05 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728157+0000", 2024-04-26T12:41:38.996 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015328 2024-04-26T12:41:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728534+0000", 2024-04-26T12:41:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037701500000000002 2024-04-26T12:41:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:38.997 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.728958+0000", 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042402 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.742778+0000", 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013820426 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752106+0000", 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0093279780000000007 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.998 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752210+0000", 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000103854 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.752286+0000", 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6279000000000006e-05 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:38.999 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2354 3.3f 3:fc3b92ee:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.231763943000004, 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028337384, 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2354 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.000 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759208+0000", 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.759211+0000", 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5260000000000002e-06 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.001 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762648+0000", 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003436854 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762685+0000", 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7004e-05 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762709+0000", 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3482999999999999e-05 2024-04-26T12:41:39.002 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.762871+0000", 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016273399999999999 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763073+0000", 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00020189599999999999 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.763271+0000", 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000197412 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.003 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.775210+0000", 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011939171 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787276+0000", 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012066464000000001 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787428+0000", 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000151383 2024-04-26T12:41:39.004 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.787545+0000", 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000117457 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:2373 3.13 3:c8f43ecc:::d749f084-3851-4e95-9492-490675b43f90.4382.9__shadow_.9HKfFDqdMkdfeZy8bR1MkOgEI2mf2Qp_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 87.028776707000006, 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030808384000000001, 2024-04-26T12:41:39.005 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 2373 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.006 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962195+0000", 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.962198+0000", 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1200000000000002e-06 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966728+0000", 2024-04-26T12:41:39.007 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045301170000000002 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966768+0000", 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9619000000000001e-05 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966787+0000", 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8933999999999999e-05 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.966954+0000", 2024-04-26T12:41:39.008 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016689600000000001 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967341+0000", 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00038776099999999998 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.967720+0000", 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037867100000000002 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.009 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.980012+0000", 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012291717000000001 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992693+0000", 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012681192000000001 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.992861+0000", 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016807000000000001 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.010 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:40:11.993003+0000", 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000142287 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3138 3.11 3:880b1c25:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.281006+0000", 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 30.709965525000001, 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.032667918999999997, 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.011 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3138 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.281006+0000", 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.012 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.281006+0000", 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.281011+0000", 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3529999999999997e-06 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287197+0000", 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0061868380000000001 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.013 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287253+0000", 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.5245999999999999e-05 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287276+0000", 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.3629999999999999e-05 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287457+0000", 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018072800000000001 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.014 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.287869+0000", 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00041246700000000002 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.288296+0000", 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00042683899999999998 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.312982+0000", 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.024685885000000001 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.015 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313359+0000", 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037720899999999999 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313544+0000", 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018507500000000001 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.313674+0000", 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00012964899999999999 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.016 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3142 3.3f 3:fe253693:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:08.324734+0000", 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 30.666237966000001, 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028644552, 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3142 2024-04-26T12:41:39.017 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.324734+0000", 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.324734+0000", 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.018 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.324738+0000", 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1400000000000002e-06 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.329338+0000", 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0045999680000000003 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.329377+0000", 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8832999999999999e-05 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.019 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.329396+0000", 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9593e-05 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.329529+0000", 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013253200000000001 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.329806+0000", 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00027680100000000002 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.020 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.330043+0000", 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023746100000000001 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.353103+0000", 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023059399000000001 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.353208+0000", 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000105559 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.021 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.353302+0000", 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 9.3496000000000001e-05 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:08.353378+0000", 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.6769999999999999e-05 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.022 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3232 3.3f 3:fdf7dd6a:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.362811+0000", 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.628161037000002, 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.035546713000000001, 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3232 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.362811+0000", 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.362811+0000", 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.362814+0000", 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.45e-06 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.024 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.367535+0000", 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0047209469999999996 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.367605+0000", 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.0224999999999999e-05 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.367628+0000", 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.281e-05 2024-04-26T12:41:39.025 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.367794+0000", 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000166038 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.368078+0000", 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00028394200000000003 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.368301+0000", 2024-04-26T12:41:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00022253099999999999 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.379634+0000", 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011333394 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.398108+0000", 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018474072000000001 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.027 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.398231+0000", 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000122395 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.398357+0000", 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000126909 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3234 3.d 3:b165548c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.385488+0000", 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.605483760999999, 2024-04-26T12:41:39.028 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030083001000000002, 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3234 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.385488+0000", 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.029 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.385488+0000", 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.385491+0000", 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4470000000000002e-06 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.391010+0000", 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055181090000000002 2024-04-26T12:41:39.030 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.391053+0000", 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3460000000000001e-05 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.391074+0000", 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1053e-05 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.391245+0000", 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017072499999999999 2024-04-26T12:41:39.031 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.391488+0000", 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000243188 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.391743+0000", 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025488000000000003 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.401881+0000", 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.01013816 2024-04-26T12:41:39.032 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.415271+0000", 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.013389824999999999 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.415446+0000", 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017514900000000001 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.033 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.415571+0000", 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000125005 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3283 3.e 3:7042574b:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_218:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.832944+0000", 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.158027465, 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.035517023000000002, 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.034 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3283 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.832944+0000", 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.832944+0000", 2024-04-26T12:41:39.035 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.832949+0000", 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6090000000000003e-06 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.837951+0000", 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050017109999999998 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.036 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.837987+0000", 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.6683000000000001e-05 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.838006+0000", 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8657000000000001e-05 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.838176+0000", 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000170268 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op must wait for map", 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.838187+0000", 2024-04-26T12:41:39.037 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.0993e-05 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.843781+0000", 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0055942980000000002 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844094+0000", 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00031247000000000002 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.038 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.844329+0000", 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023462099999999999 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.856116+0000", 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011787628 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868253+0000", 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.012137136999999999 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868389+0000", 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013578900000000001 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.868461+0000", 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.2158999999999998e-05 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.040 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3287 3.e 3:71707d61:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.873145+0000", 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.117827174999999, 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.031757579000000001, 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3287 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.041 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.873145+0000", 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.873145+0000", 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.873148+0000", 2024-04-26T12:41:39.042 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8879999999999999e-06 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.877986+0000", 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0048372040000000003 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.878021+0000", 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5763000000000003e-05 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.043 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.878040+0000", 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8950999999999999e-05 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.878192+0000", 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000151247 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.878449+0000", 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025713400000000001 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.044 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.878682+0000", 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00023305099999999999 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.904240+0000", 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.025558299 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.904712+0000", 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00047165400000000001 2024-04-26T12:41:39.045 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.904827+0000", 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00011475499999999999 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.904902+0000", 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.5632999999999999e-05 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.046 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3286 3.2a e103/17 3:56bfcbf9:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_221:head v 103'10, mlcod=73'8)", 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.875401+0000", 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.115570527999999, 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.038443392, 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.875401+0000", 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.047 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.875401+0000", 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.875402+0000", 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.6600000000000005e-07 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879342+0000", 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.003939929 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.048 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879375+0000", 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.3306000000000003e-05 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879397+0000", 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.1245000000000001e-05 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879583+0000", 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000186357 2024-04-26T12:41:39.049 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.879655+0000", 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.1876000000000001e-05 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.913723+0000", 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.034068448000000001 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.913845+0000", 2024-04-26T12:41:39.050 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000121365 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3294 3.11 3:8835a794:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:09.949681+0000", 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 29.041291234999999, 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028756978999999998, 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.051 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3294 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.949681+0000", 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.949681+0000", 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.052 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.949684+0000", 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.924e-06 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.955315+0000", 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0056308900000000004 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.955356+0000", 2024-04-26T12:41:39.053 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.0679999999999997e-05 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.955376+0000", 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0115999999999998e-05 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.955534+0000", 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015760500000000001 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.054 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.955790+0000", 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025619500000000002 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.956047+0000", 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025669000000000001 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.966384+0000", 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010337852 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.055 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.978106+0000", 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011721247000000001 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.978285+0000", 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000179125 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:09.978437+0000", 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015265499999999999 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.056 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3495 3.11 3:8abf2b90:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_430:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:12.752176+0000", 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 26.238795488000001, 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.028672955, 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3495 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.057 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.752176+0000", 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.752176+0000", 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.058 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.752180+0000", 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.9639999999999997e-06 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.759388+0000", 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0072073370000000003 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.759443+0000", 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.5342e-05 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.059 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.759472+0000", 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.9374e-05 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.759672+0000", 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019932399999999999 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.760106+0000", 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000434666 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.060 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.760357+0000", 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00025086500000000002 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.771533+0000", 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011176076 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.780667+0000", 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0091335349999999999 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.061 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.780768+0000", 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010170600000000001 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.780849+0000", 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 8.0766000000000006e-05 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3504 3.14 3:2a60a1fc:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_439:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-04-26T12:41:39.062 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:12.858140+0000", 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 26.132831282000001, 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.031460038000000003, 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3504 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.063 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.858140+0000", 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.858140+0000", 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.858145+0000", 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.6870000000000002e-06 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.064 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.862481+0000", 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0043355060000000003 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.862528+0000", 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.7026e-05 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.862548+0000", 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9853000000000001e-05 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.065 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.862716+0000", 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016797200000000001 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.863091+0000", 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00037512 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.863521+0000", 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00043012900000000001 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.066 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.874268+0000", 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.010747331000000001 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.889427+0000", 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.015158466000000001 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.889536+0000", 2024-04-26T12:41:39.067 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000109712 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:12.889601+0000", 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.4236e-05 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3545 3.16 e104/17 3:6beecf10:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_480:head v 104'18, mlcod=104'16)", 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.280056+0000", 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.710915998000001, 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.031404959000000003, 2024-04-26T12:41:39.068 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.280056+0000", 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.280056+0000", 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.069 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.280058+0000", 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.7300000000000001e-06 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.283216+0000", 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0031579709999999999 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.283385+0000", 2024-04-26T12:41:39.070 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000168782 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.284305+0000", 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00091993800000000003 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.284468+0000", 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00016257500000000001 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.071 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.284511+0000", 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3343000000000002e-05 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311289+0000", 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.026778065 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.311461+0000", 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00017155499999999999 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.072 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3546 3.16 e104/17 3:6af70b60:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_481:head v 104'19, mlcod=104'16)", 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.290337+0000", 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.700635135999999, 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.033551948999999998, 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.073 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.290337+0000", 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.290337+0000", 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.290340+0000", 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1259999999999998e-06 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.074 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.299603+0000", 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.009263271 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.299638+0000", 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.5296000000000002e-05 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.299656+0000", 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.7883000000000001e-05 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.075 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.299813+0000", 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015647600000000001 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.299882+0000", 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.9041999999999994e-05 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.323732+0000", 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023850192999999999 2024-04-26T12:41:39.076 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.323889+0000", 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015666200000000001 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3548 3.11 3:8824d90c:::d749f084-3851-4e95-9492-490675b43f90.4382.11__shadow_.p5hJ5Jp0g2qL0XnKgJ_ACCeCT1ZHaoc_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:13.301644+0000", 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 25.689327820999999, 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.030425772, 2024-04-26T12:41:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3548 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.301644+0000", 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.078 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.301644+0000", 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.301649+0000", 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 5.1059999999999999e-06 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.306185+0000", 2024-04-26T12:41:39.079 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.004535748 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.306228+0000", 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.3420000000000001e-05 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.306249+0000", 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.0913000000000001e-05 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.306408+0000", 2024-04-26T12:41:39.080 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00015909499999999999 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.306676+0000", 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00026829099999999998 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.306917+0000", 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00024070100000000001 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.330687+0000", 2024-04-26T12:41:39.081 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.023770224 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.331825+0000", 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0011378530000000001 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.331926+0000", 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00010028500000000001 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.082 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:13.332070+0000", 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000144136 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_repop(client.4382.0:3851 3.2a e112/17 3:556a628d:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_118:head v 112'16, mlcod=104'14)", 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:33.278509+0000", 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 5.7124631629999998, 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.033075998000000002, 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.083 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.278509+0000", 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.278509+0000", 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.278512+0000", 2024-04-26T12:41:39.084 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1030000000000002e-06 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.283535+0000", 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0050232080000000004 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.283572+0000", 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.7373000000000003e-05 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.283591+0000", 2024-04-26T12:41:39.085 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8842999999999999e-05 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.283754+0000", 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000162898 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.283818+0000", 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 6.3910000000000003e-05 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.086 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.311451+0000", 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.027633156999999998 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.311585+0000", 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013350600000000001 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3852 3.37 3:ee037349:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:33.283720+0000", 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 5.707251887, 2024-04-26T12:41:39.087 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.032614068000000003, 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3852 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.088 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.283720+0000", 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.283720+0000", 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.283723+0000", 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 2.8870000000000001e-06 2024-04-26T12:41:39.089 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.289130+0000", 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0054076430000000002 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.289165+0000", 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.4476e-05 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.090 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.289183+0000", 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8393000000000002e-05 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.289371+0000", 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000188009 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.289827+0000", 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045582199999999999 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.091 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 5", 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.290279+0000", 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00045226899999999999 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.312807+0000", 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.022527858000000001 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.316081+0000", 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0032741789999999999 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.092 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.316220+0000", 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013837300000000001 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.316334+0000", 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000114159 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:3870 3.3f 3:fcb83ff2:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-26T12:41:39.093 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:33.468619+0000", 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 5.5223527460000001, 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.031347676999999997, 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 3870 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.094 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.468619+0000", 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.468619+0000", 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.468622+0000", 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.1e-06 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.095 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.472615+0000", 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00399256 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.472653+0000", 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 3.8652999999999997e-05 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.472672+0000", 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.8904000000000001e-05 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.096 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.472787+0000", 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000115092 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.472985+0000", 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00019819099999999999 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 6", 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.473160+0000", 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000174041 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.097 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.481135+0000", 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0079759329999999993 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.499647+0000", 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.018511849 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.499830+0000", 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00018304500000000001 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.098 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:33.499967+0000", 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013630900000000001 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: "description": "osd_op(client.4382.0:4207 3.13 3:c963ab58:::d749f084-3851-4e95-9492-490675b43f90.4382.12__shadow_.EBAWN1sAHNDwqyTrHCAXfWFcv7kJcVL_464:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116)", 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: "initiated_at": "2024-04-26T12:41:37.286187+0000", 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: "age": 1.7047845700000002, 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.041151490999999998, 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: "continuous": false, 2024-04-26T12:41:39.099 INFO:teuthology.orchestra.run.smithi131.stdout: "type_data": { 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "client_info": { 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "client": "client.4382", 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "client_addr": "172.21.15.16:0/25623827", 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "tid": 4207 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "events": [ 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "initiated", 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.286187+0000", 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "header_read", 2024-04-26T12:41:39.100 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.286187+0000", 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "throttled", 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.286191+0000", 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.1160000000000001e-06 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "all_read", 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.293427+0000", 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.0072362069999999997 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.101 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "dispatched", 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.293470+0000", 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 4.2613e-05 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "queued_for_pg", 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.293489+0000", 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 1.9123999999999999e-05 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "reached_pg", 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.293603+0000", 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000113688 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "started", 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.293759+0000", 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000155921 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "waiting for subops from 4", 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.293891+0000", 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.00013247899999999999 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "op_commit", 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.305229+0000", 2024-04-26T12:41:39.103 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.011338035999999999 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "sub_op_commit_rec", 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.327154+0000", 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.021925006 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "commit_sent", 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.327259+0000", 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 0.000104485 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: "event": "done", 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: "time": "2024-04-26T12:41:37.327339+0000", 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: "duration": 7.9815999999999996e-05 2024-04-26T12:41:39.104 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.105 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.105 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.105 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-26T12:41:39.105 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-04-26T12:41:39.105 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-26T12:41:39.563 INFO:teuthology.orchestra.run.smithi016.stderr:noscrub is unset 2024-04-26T12:41:39.600 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T12:41:40.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-26T12:41:40.566 INFO:teuthology.orchestra.run.smithi016.stderr:nodeep-scrub is unset 2024-04-26T12:41:43.354 INFO:teuthology.orchestra.run.smithi016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-26T12:41:43.381 INFO:teuthology.orchestra.run.smithi016.stdout:osd.4: {} 2024-04-26T12:41:43.382 INFO:teuthology.orchestra.run.smithi016.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T12:41:43.405 INFO:teuthology.orchestra.run.smithi016.stdout:osd.5: {} 2024-04-26T12:41:43.405 INFO:teuthology.orchestra.run.smithi016.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T12:41:43.427 INFO:teuthology.orchestra.run.smithi016.stdout:osd.6: {} 2024-04-26T12:41:43.427 INFO:teuthology.orchestra.run.smithi016.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T12:41:43.448 INFO:teuthology.orchestra.run.smithi016.stdout:osd.7: {} 2024-04-26T12:41:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T12:41:43.453 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T12:41:43.454 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T12:41:44.398 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T12:41:46.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-26T12:42:14.399 INFO:tasks.thrashosds.thrasher:reviving osd 2024-04-26T12:42:14.399 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2024-04-26T12:42:14.399 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T12:42:14.400 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T12:42:14.403 INFO:tasks.ceph.osd.3:Started 2024-04-26T12:42:14.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:42:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:no valid command found; 10 closest matches: 2024-04-26T12:42:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:0 2024-04-26T12:42:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:1 2024-04-26T12:42:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:2 2024-04-26T12:42:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:abort 2024-04-26T12:42:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:assert 2024-04-26T12:42:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:config diff 2024-04-26T12:42:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:config diff get 2024-04-26T12:42:14.530 INFO:teuthology.orchestra.run.smithi016.stderr:config get 2024-04-26T12:42:14.531 INFO:teuthology.orchestra.run.smithi016.stderr:config help [] 2024-04-26T12:42:14.531 INFO:teuthology.orchestra.run.smithi016.stderr:config set ... 2024-04-26T12:42:14.531 INFO:teuthology.orchestra.run.smithi016.stderr:admin_socket: invalid command 2024-04-26T12:42:14.533 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:42:14.533 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-04-26T12:42:15.022 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:42:15.021+0000 7f525b68d7c0 -1 Falling back to public interface 2024-04-26T12:42:19.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:42:19.603 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:42:19.601+0000 7f525b68d7c0 -1 osd.3 117 log_to_monitors true 2024-04-26T12:42:19.658 INFO:teuthology.orchestra.run.smithi016.stderr:no valid command found; 10 closest matches: 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:0 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:1 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:2 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:abort 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:assert 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:bluefs debug_inject_read_zeros 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:bluefs files list 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:bluefs stats 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:bluestore allocator dump block 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:bluestore allocator fragmentation block 2024-04-26T12:42:19.659 INFO:teuthology.orchestra.run.smithi016.stderr:admin_socket: invalid command 2024-04-26T12:42:19.661 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T12:42:19.662 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-04-26T12:42:19.920 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-26T12:42:19.921+0000 7f524f45a640 -1 osd.3 121 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T12:42:24.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T12:42:24.800 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:42:24.801 INFO:teuthology.orchestra.run.smithi016.stdout: "ops": [], 2024-04-26T12:42:24.801 INFO:teuthology.orchestra.run.smithi016.stdout: "num_ops": 0 2024-04-26T12:42:24.801 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:42:24.815 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T12:42:24.950 INFO:teuthology.orchestra.run.smithi016.stdout:mon.a: {} 2024-04-26T12:42:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:42:24.964 INFO:teuthology.orchestra.run.smithi016.stdout:mon.b: {} 2024-04-26T12:42:24.964 INFO:teuthology.orchestra.run.smithi016.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:42:24.973 INFO:teuthology.orchestra.run.smithi016.stdout:mon.c: {} 2024-04-26T12:42:24.974 INFO:teuthology.orchestra.run.smithi016.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T12:42:24.991 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T12:42:25.883 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T12:42:25.911 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T12:42:26.907 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T12:42:26.931 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T12:42:27.906 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T12:42:27.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T12:42:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T12:42:28.940 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T12:42:29.928 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T12:42:29.958 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T12:42:30.948 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T12:42:30.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-26T12:42:31.953 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.4 to 1 (10000) 2024-04-26T12:42:31.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-04-26T12:42:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-26T12:42:33.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-26T12:42:33.984 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.5 to 1 (10000) 2024-04-26T12:42:34.014 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-04-26T12:42:34.979 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-26T12:42:35.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-26T12:42:36.004 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.6 to 1 (10000) 2024-04-26T12:42:36.032 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-26T12:42:37.020 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-26T12:42:37.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-26T12:42:38.025 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.7 to 1 (10000) 2024-04-26T12:42:38.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-04-26T12:42:39.045 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-26T12:42:39.073 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-26T12:42:40.058 INFO:teuthology.orchestra.run.smithi016.stderr:reweighted osd.3 to 1 (10000) 2024-04-26T12:42:40.092 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-26T12:42:41.073 INFO:teuthology.orchestra.run.smithi016.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-26T12:42:41.100 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T12:42:41.100 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T12:42:41.100 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T12:42:41.100 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T12:42:41.100 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T12:42:41.101 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:42:41.415 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:42:41.415 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":139,"fsid":"4374a7a0-1dca-4b47-945f-16be0ea888cb","created":"2024-04-26T12:37:51.731809+0000","modified":"2024-04-26T12:42:41.059776+0000","last_up_change":"2024-04-26T12:42:20.880303+0000","last_in_change":"2024-04-26T12:37:54.098182+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:38:02.737185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:38:02.884644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-26T12:38:09.255239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-26T12:38:10.811482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-26T12:38:12.713614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-26T12:38:14.612453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-26T12:38:16.519071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-26T12:38:18.667939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90a13ba3-26fb-4d53-bc0e-3583fa4cb8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6809","nonce":389368420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6811","nonce":389368420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6815","nonce":389368420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6813","nonce":389368420}]},"public_addr":"172.21.15.16:6809/389368420","cluster_addr":"172.21.15.16:6811/389368420","heartbeat_back_addr":"172.21.15.16:6815/389368420","heartbeat_front_addr":"172.21.15.16:6813/389368420","state":["exists","up"]},{"osd":1,"uuid":"60315ae7-75f7-42f0-ab6b-f0fe033f1b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6801","nonce":1763484355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6803","nonce":1763484355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6807","nonce":1763484355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6805","nonce":1763484355}]},"public_addr":"172.21.15.16:6801/1763484355","cluster_addr":"172.21.15.16:6803/1763484355","heartbeat_back_addr":"172.21.15.16:6807/1763484355","heartbeat_front_addr":"172.21.15.16:6805/1763484355","state":["exists","up"]},{"osd":2,"uuid":"e28bef44-fbf9-4f45-b0da-c32cf691116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6825","nonce":732776315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6827","nonce":732776315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6831","nonce":732776315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6829","nonce":732776315}]},"public_addr":"172.21.15.16:6825/732776315","cluster_addr":"172.21.15.16:6827/732776315","heartbeat_back_addr":"172.21.15.16:6831/732776315","heartbeat_front_addr":"172.21.15.16:6829/732776315","state":["exists","up"]},{"osd":3,"uuid":"70916512-1197-4640-9b97-8347d50bf4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":117,"up_from":122,"up_thru":122,"down_at":118,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6817","nonce":3161207406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6819","nonce":3161207406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6823","nonce":3161207406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6821","nonce":3161207406}]},"public_addr":"172.21.15.16:6817/3161207406","cluster_addr":"172.21.15.16:6819/3161207406","heartbeat_back_addr":"172.21.15.16:6823/3161207406","heartbeat_front_addr":"172.21.15.16:6821/3161207406","state":["exists","up"]},{"osd":4,"uuid":"15c55012-eac6-4672-b905-d5cc0bf1979c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6801","nonce":4277454900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6803","nonce":4277454900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6807","nonce":4277454900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6805","nonce":4277454900}]},"public_addr":"172.21.15.131:6801/4277454900","cluster_addr":"172.21.15.131:6803/4277454900","heartbeat_back_addr":"172.21.15.131:6807/4277454900","heartbeat_front_addr":"172.21.15.131:6805/4277454900","state":["exists","up"]},{"osd":5,"uuid":"7d4bbd49-33e4-43b2-a28b-891d83bf482a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6809","nonce":1890605084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6811","nonce":1890605084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6815","nonce":1890605084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6813","nonce":1890605084}]},"public_addr":"172.21.15.131:6809/1890605084","cluster_addr":"172.21.15.131:6811/1890605084","heartbeat_back_addr":"172.21.15.131:6815/1890605084","heartbeat_front_addr":"172.21.15.131:6813/1890605084","state":["exists","up"]},{"osd":6,"uuid":"3f455889-5a74-491d-b799-9703cfeed14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6825","nonce":2862642741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6827","nonce":2862642741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6831","nonce":2862642741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6829","nonce":2862642741}]},"public_addr":"172.21.15.131:6825/2862642741","cluster_addr":"172.21.15.131:6827/2862642741","heartbeat_back_addr":"172.21.15.131:6831/2862642741","heartbeat_front_addr":"172.21.15.131:6829/2862642741","state":["exists","up"]},{"osd":7,"uuid":"22f42260-a14c-4667-95d6-b6392596f262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6817","nonce":2576109125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6819","nonce":2576109125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6823","nonce":2576109125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6821","nonce":2576109125}]},"public_addr":"172.21.15.131:6817/2576109125","cluster_addr":"172.21.15.131:6819/2576109125","heartbeat_back_addr":"172.21.15.131:6823/2576109125","heartbeat_front_addr":"172.21.15.131:6821/2576109125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.696345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.654165+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.655130+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.669673+0000","dead_epoch":118},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.496810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.595760+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.713008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.560060+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:42:41.435 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T12:42:41.435 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:42:41.740 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:42:41.740 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":139,"fsid":"4374a7a0-1dca-4b47-945f-16be0ea888cb","created":"2024-04-26T12:37:51.731809+0000","modified":"2024-04-26T12:42:41.059776+0000","last_up_change":"2024-04-26T12:42:20.880303+0000","last_in_change":"2024-04-26T12:37:54.098182+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:38:02.737185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:38:02.884644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-26T12:38:09.255239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-26T12:38:10.811482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-26T12:38:12.713614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-26T12:38:14.612453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-26T12:38:16.519071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-26T12:38:18.667939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90a13ba3-26fb-4d53-bc0e-3583fa4cb8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6809","nonce":389368420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6811","nonce":389368420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6815","nonce":389368420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6813","nonce":389368420}]},"public_addr":"172.21.15.16:6809/389368420","cluster_addr":"172.21.15.16:6811/389368420","heartbeat_back_addr":"172.21.15.16:6815/389368420","heartbeat_front_addr":"172.21.15.16:6813/389368420","state":["exists","up"]},{"osd":1,"uuid":"60315ae7-75f7-42f0-ab6b-f0fe033f1b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6801","nonce":1763484355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6803","nonce":1763484355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6807","nonce":1763484355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6805","nonce":1763484355}]},"public_addr":"172.21.15.16:6801/1763484355","cluster_addr":"172.21.15.16:6803/1763484355","heartbeat_back_addr":"172.21.15.16:6807/1763484355","heartbeat_front_addr":"172.21.15.16:6805/1763484355","state":["exists","up"]},{"osd":2,"uuid":"e28bef44-fbf9-4f45-b0da-c32cf691116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6825","nonce":732776315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6827","nonce":732776315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6831","nonce":732776315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6829","nonce":732776315}]},"public_addr":"172.21.15.16:6825/732776315","cluster_addr":"172.21.15.16:6827/732776315","heartbeat_back_addr":"172.21.15.16:6831/732776315","heartbeat_front_addr":"172.21.15.16:6829/732776315","state":["exists","up"]},{"osd":3,"uuid":"70916512-1197-4640-9b97-8347d50bf4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":117,"up_from":122,"up_thru":122,"down_at":118,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6817","nonce":3161207406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6819","nonce":3161207406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6823","nonce":3161207406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6821","nonce":3161207406}]},"public_addr":"172.21.15.16:6817/3161207406","cluster_addr":"172.21.15.16:6819/3161207406","heartbeat_back_addr":"172.21.15.16:6823/3161207406","heartbeat_front_addr":"172.21.15.16:6821/3161207406","state":["exists","up"]},{"osd":4,"uuid":"15c55012-eac6-4672-b905-d5cc0bf1979c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6801","nonce":4277454900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6803","nonce":4277454900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6807","nonce":4277454900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6805","nonce":4277454900}]},"public_addr":"172.21.15.131:6801/4277454900","cluster_addr":"172.21.15.131:6803/4277454900","heartbeat_back_addr":"172.21.15.131:6807/4277454900","heartbeat_front_addr":"172.21.15.131:6805/4277454900","state":["exists","up"]},{"osd":5,"uuid":"7d4bbd49-33e4-43b2-a28b-891d83bf482a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6809","nonce":1890605084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6811","nonce":1890605084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6815","nonce":1890605084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6813","nonce":1890605084}]},"public_addr":"172.21.15.131:6809/1890605084","cluster_addr":"172.21.15.131:6811/1890605084","heartbeat_back_addr":"172.21.15.131:6815/1890605084","heartbeat_front_addr":"172.21.15.131:6813/1890605084","state":["exists","up"]},{"osd":6,"uuid":"3f455889-5a74-491d-b799-9703cfeed14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6825","nonce":2862642741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6827","nonce":2862642741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6831","nonce":2862642741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6829","nonce":2862642741}]},"public_addr":"172.21.15.131:6825/2862642741","cluster_addr":"172.21.15.131:6827/2862642741","heartbeat_back_addr":"172.21.15.131:6831/2862642741","heartbeat_front_addr":"172.21.15.131:6829/2862642741","state":["exists","up"]},{"osd":7,"uuid":"22f42260-a14c-4667-95d6-b6392596f262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6817","nonce":2576109125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6819","nonce":2576109125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6823","nonce":2576109125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6821","nonce":2576109125}]},"public_addr":"172.21.15.131:6817/2576109125","cluster_addr":"172.21.15.131:6819/2576109125","heartbeat_back_addr":"172.21.15.131:6823/2576109125","heartbeat_front_addr":"172.21.15.131:6821/2576109125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.696345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.654165+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.655130+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.669673+0000","dead_epoch":118},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.496810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.595760+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.713008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.560060+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:42:41.762 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T12:42:41.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T12:42:41.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T12:42:41.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T12:42:41.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T12:42:41.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T12:42:41.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T12:42:41.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T12:42:42.040 INFO:teuthology.orchestra.run.smithi016.stdout:55834574908 2024-04-26T12:42:42.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T12:42:42.049 INFO:teuthology.orchestra.run.smithi016.stdout:55834574907 2024-04-26T12:42:42.050 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:42:42.051 INFO:teuthology.orchestra.run.smithi016.stdout:55834574908 2024-04-26T12:42:42.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T12:42:42.054 INFO:teuthology.orchestra.run.smithi016.stdout:55834574908 2024-04-26T12:42:42.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:42:42.057 INFO:teuthology.orchestra.run.smithi016.stdout:55834574907 2024-04-26T12:42:42.058 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T12:42:42.061 INFO:teuthology.orchestra.run.smithi016.stdout:55834574907 2024-04-26T12:42:42.061 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:42:42.064 INFO:teuthology.orchestra.run.smithi016.stdout:523986010118 2024-04-26T12:42:42.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:42:42.068 INFO:teuthology.orchestra.run.smithi016.stdout:55834574906 2024-04-26T12:42:42.068 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T12:42:42.535 INFO:teuthology.orchestra.run.smithi016.stdout:55834574907 2024-04-26T12:42:42.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574907 for osd.5 2024-04-26T12:42:42.580 INFO:teuthology.orchestra.run.smithi016.stdout:55834574907 2024-04-26T12:42:42.596 INFO:teuthology.orchestra.run.smithi016.stdout:55834574906 2024-04-26T12:42:42.597 INFO:teuthology.orchestra.run.smithi016.stdout:55834574907 2024-04-26T12:42:42.602 INFO:teuthology.orchestra.run.smithi016.stdout:55834574906 2024-04-26T12:42:42.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574907 for osd.6 2024-04-26T12:42:42.619 INFO:teuthology.orchestra.run.smithi016.stdout:55834574906 2024-04-26T12:42:42.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574906 for osd.4 2024-04-26T12:42:42.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574907 for osd.0 2024-04-26T12:42:42.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574906 for osd.1 2024-04-26T12:42:42.634 INFO:teuthology.orchestra.run.smithi016.stdout:523986010117 2024-04-26T12:42:42.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574906 for osd.2 2024-04-26T12:42:42.643 INFO:teuthology.orchestra.run.smithi016.stdout:55834574905 2024-04-26T12:42:42.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 523986010118 got 523986010117 for osd.3 2024-04-26T12:42:42.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574905 for osd.7 2024-04-26T12:42:43.562 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T12:42:43.608 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T12:42:43.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T12:42:43.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T12:42:43.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T12:42:43.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T12:42:43.654 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T12:42:43.661 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T12:42:44.064 INFO:teuthology.orchestra.run.smithi016.stdout:55834574908 2024-04-26T12:42:44.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574908 for osd.5 2024-04-26T12:42:44.089 DEBUG:teuthology.parallel:result is None 2024-04-26T12:42:44.142 INFO:teuthology.orchestra.run.smithi016.stdout:55834574908 2024-04-26T12:42:44.144 INFO:teuthology.orchestra.run.smithi016.stdout:55834574907 2024-04-26T12:42:44.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574907 for osd.4 2024-04-26T12:42:44.165 DEBUG:teuthology.parallel:result is None 2024-04-26T12:42:44.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574908 for osd.6 2024-04-26T12:42:44.173 DEBUG:teuthology.parallel:result is None 2024-04-26T12:42:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:55834574908 2024-04-26T12:42:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:55834574907 2024-04-26T12:42:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:523986010118 2024-04-26T12:42:44.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574908 for osd.0 2024-04-26T12:42:44.207 DEBUG:teuthology.parallel:result is None 2024-04-26T12:42:44.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574907 for osd.1 2024-04-26T12:42:44.218 DEBUG:teuthology.parallel:result is None 2024-04-26T12:42:44.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 523986010118 got 523986010118 for osd.3 2024-04-26T12:42:44.221 DEBUG:teuthology.parallel:result is None 2024-04-26T12:42:44.227 INFO:teuthology.orchestra.run.smithi016.stdout:55834574907 2024-04-26T12:42:44.231 INFO:teuthology.orchestra.run.smithi016.stdout:55834574906 2024-04-26T12:42:44.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574907 for osd.2 2024-04-26T12:42:44.247 DEBUG:teuthology.parallel:result is None 2024-04-26T12:42:44.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574906 for osd.7 2024-04-26T12:42:44.250 DEBUG:teuthology.parallel:result is None 2024-04-26T12:42:44.250 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T12:42:44.250 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:42:44.617 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:42:44.623 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:42:44.634 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-26T12:42:42.781336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819921,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3100,"num_read_kb":2786,"num_write":2843,"num_write_kb":6187910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3893,"ondisk_log_size":3893,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595028,"kb_used_data":12319584,"kb_used_omap":17,"kb_used_meta":275310,"kb_avail":742379692,"statfs":{"total":773094113280,"available":760196804608,"internally_reserved":0,"allocated":12615254016,"data_stored":12609620734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17874,"internal_metadata":281917998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.752305"},"pg_stats":[{"pgid":"3.3f","version":"116'21","reported_seq":269,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.277859+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:42:40.277859+0000","last_peered":"2024-04-26T12:42:40.277859+0000","last_clean":"2024-04-26T12:42:40.277859+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:42:40.277859+0000","last_undegraded":"2024-04-26T12:42:40.277859+0000","last_fullsized":"2024-04-26T12:42:40.277859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"117'6","reported_seq":272,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.270016+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:42:40.270016+0000","last_peered":"2024-04-26T12:42:40.270016+0000","last_clean":"2024-04-26T12:42:40.270016+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:42:40.270016+0000","last_undegraded":"2024-04-26T12:42:40.270016+0000","last_fullsized":"2024-04-26T12:42:40.270016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'16","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409799+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:42:41.409799+0000","last_peered":"2024-04-26T12:42:41.409799+0000","last_clean":"2024-04-26T12:42:41.409799+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:42:41.409799+0000","last_undegraded":"2024-04-26T12:42:41.409799+0000","last_fullsized":"2024-04-26T12:42:41.409799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":259,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273465+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:42:40.273465+0000","last_peered":"2024-04-26T12:42:40.273465+0000","last_clean":"2024-04-26T12:42:40.273465+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:42:40.273465+0000","last_undegraded":"2024-04-26T12:42:40.273465+0000","last_fullsized":"2024-04-26T12:42:40.273465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069713+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:42:41.069713+0000","last_peered":"2024-04-26T12:42:41.069713+0000","last_clean":"2024-04-26T12:42:41.069713+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:42:41.069713+0000","last_undegraded":"2024-04-26T12:42:41.069713+0000","last_fullsized":"2024-04-26T12:42:41.069713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066786+0000","last_change":"2024-04-26T12:42:34.019445+0000","last_active":"2024-04-26T12:42:41.066786+0000","last_peered":"2024-04-26T12:42:41.066786+0000","last_clean":"2024-04-26T12:42:41.066786+0000","last_became_active":"2024-04-26T12:42:34.016025+0000","last_became_peered":"2024-04-26T12:42:34.016025+0000","last_unstale":"2024-04-26T12:42:41.066786+0000","last_undegraded":"2024-04-26T12:42:41.066786+0000","last_fullsized":"2024-04-26T12:42:41.066786+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:55.436710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'31","reported_seq":290,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.272619+0000","last_change":"2024-04-26T12:42:21.947248+0000","last_active":"2024-04-26T12:42:40.272619+0000","last_peered":"2024-04-26T12:42:40.272619+0000","last_clean":"2024-04-26T12:42:40.272619+0000","last_became_active":"2024-04-26T12:42:21.946477+0000","last_became_peered":"2024-04-26T12:42:21.946477+0000","last_unstale":"2024-04-26T12:42:40.272619+0000","last_undegraded":"2024-04-26T12:42:40.272619+0000","last_fullsized":"2024-04-26T12:42:40.272619+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.347007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069100+0000","last_change":"2024-04-26T12:42:21.958105+0000","last_active":"2024-04-26T12:42:41.069100+0000","last_peered":"2024-04-26T12:42:41.069100+0000","last_clean":"2024-04-26T12:42:41.069100+0000","last_became_active":"2024-04-26T12:42:21.956507+0000","last_became_peered":"2024-04-26T12:42:21.956507+0000","last_unstale":"2024-04-26T12:42:41.069100+0000","last_undegraded":"2024-04-26T12:42:41.069100+0000","last_fullsized":"2024-04-26T12:42:41.069100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'25","reported_seq":272,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.275069+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:42:40.275069+0000","last_peered":"2024-04-26T12:42:40.275069+0000","last_clean":"2024-04-26T12:42:40.275069+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:42:40.275069+0000","last_undegraded":"2024-04-26T12:42:40.275069+0000","last_fullsized":"2024-04-26T12:42:40.275069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":261,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.279949+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:42:40.279949+0000","last_peered":"2024-04-26T12:42:40.279949+0000","last_clean":"2024-04-26T12:42:40.279949+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:42:40.279949+0000","last_undegraded":"2024-04-26T12:42:40.279949+0000","last_fullsized":"2024-04-26T12:42:40.279949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'25","reported_seq":228,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975912+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:42:41.975912+0000","last_peered":"2024-04-26T12:42:41.975912+0000","last_clean":"2024-04-26T12:42:41.975912+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:42:41.975912+0000","last_undegraded":"2024-04-26T12:42:41.975912+0000","last_fullsized":"2024-04-26T12:42:41.975912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":122,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066858+0000","last_change":"2024-04-26T12:42:34.007918+0000","last_active":"2024-04-26T12:42:41.066858+0000","last_peered":"2024-04-26T12:42:41.066858+0000","last_clean":"2024-04-26T12:42:41.066858+0000","last_became_active":"2024-04-26T12:42:34.006179+0000","last_became_peered":"2024-04-26T12:42:34.006179+0000","last_unstale":"2024-04-26T12:42:41.066858+0000","last_undegraded":"2024-04-26T12:42:41.066858+0000","last_fullsized":"2024-04-26T12:42:41.066858+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:13.173789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'22","reported_seq":269,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273710+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:42:40.273710+0000","last_peered":"2024-04-26T12:42:40.273710+0000","last_clean":"2024-04-26T12:42:40.273710+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:42:40.273710+0000","last_undegraded":"2024-04-26T12:42:40.273710+0000","last_fullsized":"2024-04-26T12:42:40.273710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":264,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.278681+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:42:40.278681+0000","last_peered":"2024-04-26T12:42:40.278681+0000","last_clean":"2024-04-26T12:42:40.278681+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:42:40.278681+0000","last_undegraded":"2024-04-26T12:42:40.278681+0000","last_fullsized":"2024-04-26T12:42:40.278681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"117'13","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067810+0000","last_change":"2024-04-26T12:42:21.952625+0000","last_active":"2024-04-26T12:42:41.067810+0000","last_peered":"2024-04-26T12:42:41.067810+0000","last_clean":"2024-04-26T12:42:41.067810+0000","last_became_active":"2024-04-26T12:42:21.948971+0000","last_became_peered":"2024-04-26T12:42:21.948971+0000","last_unstale":"2024-04-26T12:42:41.067810+0000","last_undegraded":"2024-04-26T12:42:41.067810+0000","last_fullsized":"2024-04-26T12:42:41.067810+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:55.735297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977969+0000","last_change":"2024-04-26T12:42:21.965782+0000","last_active":"2024-04-26T12:42:41.977969+0000","last_peered":"2024-04-26T12:42:41.977969+0000","last_clean":"2024-04-26T12:42:41.977969+0000","last_became_active":"2024-04-26T12:42:21.964820+0000","last_became_peered":"2024-04-26T12:42:21.964820+0000","last_unstale":"2024-04-26T12:42:41.977969+0000","last_undegraded":"2024-04-26T12:42:41.977969+0000","last_fullsized":"2024-04-26T12:42:41.977969+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:07.092768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":168,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066034+0000","last_change":"2024-04-26T12:42:34.005982+0000","last_active":"2024-04-26T12:42:41.066034+0000","last_peered":"2024-04-26T12:42:41.066034+0000","last_clean":"2024-04-26T12:42:41.066034+0000","last_became_active":"2024-04-26T12:42:34.003575+0000","last_became_peered":"2024-04-26T12:42:34.003575+0000","last_unstale":"2024-04-26T12:42:41.066034+0000","last_undegraded":"2024-04-26T12:42:41.066034+0000","last_fullsized":"2024-04-26T12:42:41.066034+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:19.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'25","reported_seq":272,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.277956+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:42:40.277956+0000","last_peered":"2024-04-26T12:42:40.277956+0000","last_clean":"2024-04-26T12:42:40.277956+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:42:40.277956+0000","last_undegraded":"2024-04-26T12:42:40.277956+0000","last_fullsized":"2024-04-26T12:42:40.277956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"117'4","reported_seq":259,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273561+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:42:40.273561+0000","last_peered":"2024-04-26T12:42:40.273561+0000","last_clean":"2024-04-26T12:42:40.273561+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:42:40.273561+0000","last_undegraded":"2024-04-26T12:42:40.273561+0000","last_fullsized":"2024-04-26T12:42:40.273561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"115'35","reported_seq":284,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.278841+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:42:40.278841+0000","last_peered":"2024-04-26T12:42:40.278841+0000","last_clean":"2024-04-26T12:42:40.278841+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:42:40.278841+0000","last_undegraded":"2024-04-26T12:42:40.278841+0000","last_fullsized":"2024-04-26T12:42:40.278841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":45,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":247,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.270962+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:42:40.270962+0000","last_peered":"2024-04-26T12:42:40.270962+0000","last_clean":"2024-04-26T12:42:40.270962+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:42:40.270962+0000","last_undegraded":"2024-04-26T12:42:40.270962+0000","last_fullsized":"2024-04-26T12:42:40.270962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'28","reported_seq":277,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.279087+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:42:40.279087+0000","last_peered":"2024-04-26T12:42:40.279087+0000","last_clean":"2024-04-26T12:42:40.279087+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:42:40.279087+0000","last_undegraded":"2024-04-26T12:42:40.279087+0000","last_fullsized":"2024-04-26T12:42:40.279087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976530+0000","last_change":"2024-04-26T12:42:21.957465+0000","last_active":"2024-04-26T12:42:41.976530+0000","last_peered":"2024-04-26T12:42:41.976530+0000","last_clean":"2024-04-26T12:42:41.976530+0000","last_became_active":"2024-04-26T12:42:21.956566+0000","last_became_peered":"2024-04-26T12:42:21.956566+0000","last_unstale":"2024-04-26T12:42:41.976530+0000","last_undegraded":"2024-04-26T12:42:41.976530+0000","last_fullsized":"2024-04-26T12:42:41.976530+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:30.300637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"115'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066651+0000","last_change":"2024-04-26T12:42:34.024102+0000","last_active":"2024-04-26T12:42:41.066651+0000","last_peered":"2024-04-26T12:42:41.066651+0000","last_clean":"2024-04-26T12:42:41.066651+0000","last_became_active":"2024-04-26T12:42:34.022426+0000","last_became_peered":"2024-04-26T12:42:34.022426+0000","last_unstale":"2024-04-26T12:42:41.066651+0000","last_undegraded":"2024-04-26T12:42:41.066651+0000","last_fullsized":"2024-04-26T12:42:41.066651+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:21.509191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976221+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:42:41.976221+0000","last_peered":"2024-04-26T12:42:41.976221+0000","last_clean":"2024-04-26T12:42:41.976221+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:42:41.976221+0000","last_undegraded":"2024-04-26T12:42:41.976221+0000","last_fullsized":"2024-04-26T12:42:41.976221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'21","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070281+0000","last_change":"2024-04-26T12:42:21.946507+0000","last_active":"2024-04-26T12:42:41.070281+0000","last_peered":"2024-04-26T12:42:41.070281+0000","last_clean":"2024-04-26T12:42:41.070281+0000","last_became_active":"2024-04-26T12:42:21.932303+0000","last_became_peered":"2024-04-26T12:42:21.932303+0000","last_unstale":"2024-04-26T12:42:41.070281+0000","last_undegraded":"2024-04-26T12:42:41.070281+0000","last_fullsized":"2024-04-26T12:42:41.070281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:48.132898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":113,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066875+0000","last_change":"2024-04-26T12:42:34.027080+0000","last_active":"2024-04-26T12:42:41.066875+0000","last_peered":"2024-04-26T12:42:41.066875+0000","last_clean":"2024-04-26T12:42:41.066875+0000","last_became_active":"2024-04-26T12:42:34.025281+0000","last_became_peered":"2024-04-26T12:42:34.025281+0000","last_unstale":"2024-04-26T12:42:41.066875+0000","last_undegraded":"2024-04-26T12:42:41.066875+0000","last_fullsized":"2024-04-26T12:42:41.066875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:16.292958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"115'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069550+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:42:41.069550+0000","last_peered":"2024-04-26T12:42:41.069550+0000","last_clean":"2024-04-26T12:42:41.069550+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:42:41.069550+0000","last_undegraded":"2024-04-26T12:42:41.069550+0000","last_fullsized":"2024-04-26T12:42:41.069550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065496+0000","last_change":"2024-04-26T12:42:34.014303+0000","last_active":"2024-04-26T12:42:41.065496+0000","last_peered":"2024-04-26T12:42:41.065496+0000","last_clean":"2024-04-26T12:42:41.065496+0000","last_became_active":"2024-04-26T12:42:34.013263+0000","last_became_peered":"2024-04-26T12:42:34.013263+0000","last_unstale":"2024-04-26T12:42:41.065496+0000","last_undegraded":"2024-04-26T12:42:41.065496+0000","last_fullsized":"2024-04-26T12:42:41.065496+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:35.131864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072787+0000","last_change":"2024-04-26T12:42:21.967042+0000","last_active":"2024-04-26T12:42:41.072787+0000","last_peered":"2024-04-26T12:42:41.072787+0000","last_clean":"2024-04-26T12:42:41.072787+0000","last_became_active":"2024-04-26T12:42:21.961909+0000","last_became_peered":"2024-04-26T12:42:21.961909+0000","last_unstale":"2024-04-26T12:42:41.072787+0000","last_undegraded":"2024-04-26T12:42:41.072787+0000","last_fullsized":"2024-04-26T12:42:41.072787+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:33.810933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'18","reported_seq":265,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.275222+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:42:40.275222+0000","last_peered":"2024-04-26T12:42:40.275222+0000","last_clean":"2024-04-26T12:42:40.275222+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:42:40.275222+0000","last_undegraded":"2024-04-26T12:42:40.275222+0000","last_fullsized":"2024-04-26T12:42:40.275222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":243,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.275688+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:42:40.275688+0000","last_peered":"2024-04-26T12:42:40.275688+0000","last_clean":"2024-04-26T12:42:40.275688+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:42:40.275688+0000","last_undegraded":"2024-04-26T12:42:40.275688+0000","last_fullsized":"2024-04-26T12:42:40.275688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070613+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:42:41.070613+0000","last_peered":"2024-04-26T12:42:41.070613+0000","last_clean":"2024-04-26T12:42:41.070613+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:42:41.070613+0000","last_undegraded":"2024-04-26T12:42:41.070613+0000","last_fullsized":"2024-04-26T12:42:41.070613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.276413+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:42:40.276413+0000","last_peered":"2024-04-26T12:42:40.276413+0000","last_clean":"2024-04-26T12:42:40.276413+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:42:40.276413+0000","last_undegraded":"2024-04-26T12:42:40.276413+0000","last_fullsized":"2024-04-26T12:42:40.276413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"117'48","reported_seq":298,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.274080+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:42:40.274080+0000","last_peered":"2024-04-26T12:42:40.274080+0000","last_clean":"2024-04-26T12:42:40.274080+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:42:40.274080+0000","last_undegraded":"2024-04-26T12:42:40.274080+0000","last_fullsized":"2024-04-26T12:42:40.274080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":247,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.276788+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:42:40.276788+0000","last_peered":"2024-04-26T12:42:40.276788+0000","last_clean":"2024-04-26T12:42:40.276788+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:42:40.276788+0000","last_undegraded":"2024-04-26T12:42:40.276788+0000","last_fullsized":"2024-04-26T12:42:40.276788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'34","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069854+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:42:41.069854+0000","last_peered":"2024-04-26T12:42:41.069854+0000","last_clean":"2024-04-26T12:42:41.069854+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:42:41.069854+0000","last_undegraded":"2024-04-26T12:42:41.069854+0000","last_fullsized":"2024-04-26T12:42:41.069854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074395+0000","last_change":"2024-04-26T12:42:21.970469+0000","last_active":"2024-04-26T12:42:41.074395+0000","last_peered":"2024-04-26T12:42:41.074395+0000","last_clean":"2024-04-26T12:42:41.074395+0000","last_became_active":"2024-04-26T12:42:21.968825+0000","last_became_peered":"2024-04-26T12:42:21.968825+0000","last_unstale":"2024-04-26T12:42:41.074395+0000","last_undegraded":"2024-04-26T12:42:41.074395+0000","last_fullsized":"2024-04-26T12:42:41.074395+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:54.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":55,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066772+0000","last_change":"2024-04-26T12:42:34.021039+0000","last_active":"2024-04-26T12:42:41.066772+0000","last_peered":"2024-04-26T12:42:41.066772+0000","last_clean":"2024-04-26T12:42:41.066772+0000","last_became_active":"2024-04-26T12:42:34.018809+0000","last_became_peered":"2024-04-26T12:42:34.018809+0000","last_unstale":"2024-04-26T12:42:41.066772+0000","last_undegraded":"2024-04-26T12:42:41.066772+0000","last_fullsized":"2024-04-26T12:42:41.066772+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066660+0000","last_change":"2024-04-26T12:42:34.007481+0000","last_active":"2024-04-26T12:42:41.066660+0000","last_peered":"2024-04-26T12:42:41.066660+0000","last_clean":"2024-04-26T12:42:41.066660+0000","last_became_active":"2024-04-26T12:42:34.004534+0000","last_became_peered":"2024-04-26T12:42:34.004534+0000","last_unstale":"2024-04-26T12:42:41.066660+0000","last_undegraded":"2024-04-26T12:42:41.066660+0000","last_fullsized":"2024-04-26T12:42:41.066660+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:33.240125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068768+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:42:41.068768+0000","last_peered":"2024-04-26T12:42:41.068768+0000","last_clean":"2024-04-26T12:42:41.068768+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:42:41.068768+0000","last_undegraded":"2024-04-26T12:42:41.068768+0000","last_fullsized":"2024-04-26T12:42:41.068768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072461+0000","last_change":"2024-04-26T12:42:21.937320+0000","last_active":"2024-04-26T12:42:41.072461+0000","last_peered":"2024-04-26T12:42:41.072461+0000","last_clean":"2024-04-26T12:42:41.072461+0000","last_became_active":"2024-04-26T12:42:21.936393+0000","last_became_peered":"2024-04-26T12:42:21.936393+0000","last_unstale":"2024-04-26T12:42:41.072461+0000","last_undegraded":"2024-04-26T12:42:41.072461+0000","last_fullsized":"2024-04-26T12:42:41.072461+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:21.787788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"115'21","reported_seq":268,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273809+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:42:40.273809+0000","last_peered":"2024-04-26T12:42:40.273809+0000","last_clean":"2024-04-26T12:42:40.273809+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:42:40.273809+0000","last_undegraded":"2024-04-26T12:42:40.273809+0000","last_fullsized":"2024-04-26T12:42:40.273809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074226+0000","last_change":"2024-04-26T12:42:21.961567+0000","last_active":"2024-04-26T12:42:41.074226+0000","last_peered":"2024-04-26T12:42:41.074226+0000","last_clean":"2024-04-26T12:42:41.074226+0000","last_became_active":"2024-04-26T12:42:21.957657+0000","last_became_peered":"2024-04-26T12:42:21.957657+0000","last_unstale":"2024-04-26T12:42:41.074226+0000","last_undegraded":"2024-04-26T12:42:41.074226+0000","last_fullsized":"2024-04-26T12:42:41.074226+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:50.723405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975984+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:42:41.975984+0000","last_peered":"2024-04-26T12:42:41.975984+0000","last_clean":"2024-04-26T12:42:41.975984+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:42:41.975984+0000","last_undegraded":"2024-04-26T12:42:41.975984+0000","last_fullsized":"2024-04-26T12:42:41.975984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"117'134","reported_seq":496,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.275738+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:42:40.275738+0000","last_peered":"2024-04-26T12:42:40.275738+0000","last_clean":"2024-04-26T12:42:40.275738+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:42:40.275738+0000","last_undegraded":"2024-04-26T12:42:40.275738+0000","last_fullsized":"2024-04-26T12:42:40.275738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066020+0000","last_change":"2024-04-26T12:42:34.015888+0000","last_active":"2024-04-26T12:42:41.066020+0000","last_peered":"2024-04-26T12:42:41.066020+0000","last_clean":"2024-04-26T12:42:41.066020+0000","last_became_active":"2024-04-26T12:42:34.015101+0000","last_became_peered":"2024-04-26T12:42:34.015101+0000","last_unstale":"2024-04-26T12:42:41.066020+0000","last_undegraded":"2024-04-26T12:42:41.066020+0000","last_fullsized":"2024-04-26T12:42:41.066020+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:23.606728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074777+0000","last_change":"2024-04-26T12:42:21.971692+0000","last_active":"2024-04-26T12:42:41.074777+0000","last_peered":"2024-04-26T12:42:41.074777+0000","last_clean":"2024-04-26T12:42:41.074777+0000","last_became_active":"2024-04-26T12:42:21.970815+0000","last_became_peered":"2024-04-26T12:42:21.970815+0000","last_unstale":"2024-04-26T12:42:41.074777+0000","last_undegraded":"2024-04-26T12:42:41.074777+0000","last_fullsized":"2024-04-26T12:42:41.074777+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:03.033305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'28","reported_seq":277,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.272186+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:42:40.272186+0000","last_peered":"2024-04-26T12:42:40.272186+0000","last_clean":"2024-04-26T12:42:40.272186+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:42:40.272186+0000","last_undegraded":"2024-04-26T12:42:40.272186+0000","last_fullsized":"2024-04-26T12:42:40.272186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":250,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.278542+0000","last_change":"2024-04-26T12:42:21.926752+0000","last_active":"2024-04-26T12:42:40.278542+0000","last_peered":"2024-04-26T12:42:40.278542+0000","last_clean":"2024-04-26T12:42:40.278542+0000","last_became_active":"2024-04-26T12:42:21.926086+0000","last_became_peered":"2024-04-26T12:42:21.926086+0000","last_unstale":"2024-04-26T12:42:40.278542+0000","last_undegraded":"2024-04-26T12:42:40.278542+0000","last_fullsized":"2024-04-26T12:42:40.278542+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.645084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"117'17","reported_seq":259,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.276357+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:42:40.276357+0000","last_peered":"2024-04-26T12:42:40.276357+0000","last_clean":"2024-04-26T12:42:40.276357+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:42:40.276357+0000","last_undegraded":"2024-04-26T12:42:40.276357+0000","last_fullsized":"2024-04-26T12:42:40.276357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"123'136","reported_seq":412,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073796+0000","last_change":"2024-04-26T12:42:21.973003+0000","last_active":"2024-04-26T12:42:41.073796+0000","last_peered":"2024-04-26T12:42:41.073796+0000","last_clean":"2024-04-26T12:42:41.073796+0000","last_became_active":"2024-04-26T12:42:21.972298+0000","last_became_peered":"2024-04-26T12:42:21.972298+0000","last_unstale":"2024-04-26T12:42:41.073796+0000","last_undegraded":"2024-04-26T12:42:41.073796+0000","last_fullsized":"2024-04-26T12:42:41.073796+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:09.716281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":257,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.270477+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:42:40.270477+0000","last_peered":"2024-04-26T12:42:40.270477+0000","last_clean":"2024-04-26T12:42:40.270477+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:42:40.270477+0000","last_undegraded":"2024-04-26T12:42:40.270477+0000","last_fullsized":"2024-04-26T12:42:40.270477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"115'24","reported_seq":227,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977649+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:42:41.977649+0000","last_peered":"2024-04-26T12:42:41.977649+0000","last_clean":"2024-04-26T12:42:41.977649+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:42:41.977649+0000","last_undegraded":"2024-04-26T12:42:41.977649+0000","last_fullsized":"2024-04-26T12:42:41.977649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":240,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273193+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:42:40.273193+0000","last_peered":"2024-04-26T12:42:40.273193+0000","last_clean":"2024-04-26T12:42:40.273193+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:42:40.273193+0000","last_undegraded":"2024-04-26T12:42:40.273193+0000","last_fullsized":"2024-04-26T12:42:40.273193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"117'27","reported_seq":279,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.270254+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:42:40.270254+0000","last_peered":"2024-04-26T12:42:40.270254+0000","last_clean":"2024-04-26T12:42:40.270254+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:42:40.270254+0000","last_undegraded":"2024-04-26T12:42:40.270254+0000","last_fullsized":"2024-04-26T12:42:40.270254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408696+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:42:41.408696+0000","last_peered":"2024-04-26T12:42:41.408696+0000","last_clean":"2024-04-26T12:42:41.408696+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:42:41.408696+0000","last_undegraded":"2024-04-26T12:42:41.408696+0000","last_fullsized":"2024-04-26T12:42:41.408696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":232,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271986+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:42:40.271986+0000","last_peered":"2024-04-26T12:42:40.271986+0000","last_clean":"2024-04-26T12:42:40.271986+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:42:40.271986+0000","last_undegraded":"2024-04-26T12:42:40.271986+0000","last_fullsized":"2024-04-26T12:42:40.271986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065995+0000","last_change":"2024-04-26T12:42:34.029770+0000","last_active":"2024-04-26T12:42:41.065995+0000","last_peered":"2024-04-26T12:42:41.065995+0000","last_clean":"2024-04-26T12:42:41.065995+0000","last_became_active":"2024-04-26T12:42:34.027515+0000","last_became_peered":"2024-04-26T12:42:34.027515+0000","last_unstale":"2024-04-26T12:42:41.065995+0000","last_undegraded":"2024-04-26T12:42:41.065995+0000","last_fullsized":"2024-04-26T12:42:41.065995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:24.498714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'20","reported_seq":268,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.277450+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:42:40.277450+0000","last_peered":"2024-04-26T12:42:40.277450+0000","last_clean":"2024-04-26T12:42:40.277450+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:42:40.277450+0000","last_undegraded":"2024-04-26T12:42:40.277450+0000","last_fullsized":"2024-04-26T12:42:40.277450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975908+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:42:41.975908+0000","last_peered":"2024-04-26T12:42:41.975908+0000","last_clean":"2024-04-26T12:42:41.975908+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:42:41.975908+0000","last_undegraded":"2024-04-26T12:42:41.975908+0000","last_fullsized":"2024-04-26T12:42:41.975908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"117'19","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068371+0000","last_change":"2024-04-26T12:42:21.974974+0000","last_active":"2024-04-26T12:42:41.068371+0000","last_peered":"2024-04-26T12:42:41.068371+0000","last_clean":"2024-04-26T12:42:41.068371+0000","last_became_active":"2024-04-26T12:42:21.968492+0000","last_became_peered":"2024-04-26T12:42:21.968492+0000","last_unstale":"2024-04-26T12:42:41.068371+0000","last_undegraded":"2024-04-26T12:42:41.068371+0000","last_fullsized":"2024-04-26T12:42:41.068371+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:59.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068594+0000","last_change":"2024-04-26T12:42:21.943962+0000","last_active":"2024-04-26T12:42:41.068594+0000","last_peered":"2024-04-26T12:42:41.068594+0000","last_clean":"2024-04-26T12:42:41.068594+0000","last_became_active":"2024-04-26T12:42:21.942925+0000","last_became_peered":"2024-04-26T12:42:21.942925+0000","last_unstale":"2024-04-26T12:42:41.068594+0000","last_undegraded":"2024-04-26T12:42:41.068594+0000","last_fullsized":"2024-04-26T12:42:41.068594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:17.453438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":243,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.277266+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:42:40.277266+0000","last_peered":"2024-04-26T12:42:40.277266+0000","last_clean":"2024-04-26T12:42:40.277266+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:42:40.277266+0000","last_undegraded":"2024-04-26T12:42:40.277266+0000","last_fullsized":"2024-04-26T12:42:40.277266+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":263,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.276022+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:42:40.276022+0000","last_peered":"2024-04-26T12:42:40.276022+0000","last_clean":"2024-04-26T12:42:40.276022+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:42:40.276022+0000","last_undegraded":"2024-04-26T12:42:40.276022+0000","last_fullsized":"2024-04-26T12:42:40.276022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"114'19","reported_seq":267,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.277828+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:42:40.277828+0000","last_peered":"2024-04-26T12:42:40.277828+0000","last_clean":"2024-04-26T12:42:40.277828+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:42:40.277828+0000","last_undegraded":"2024-04-26T12:42:40.277828+0000","last_fullsized":"2024-04-26T12:42:40.277828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976759+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:42:41.976759+0000","last_peered":"2024-04-26T12:42:41.976759+0000","last_clean":"2024-04-26T12:42:41.976759+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:42:41.976759+0000","last_undegraded":"2024-04-26T12:42:41.976759+0000","last_fullsized":"2024-04-26T12:42:41.976759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"117'24","reported_seq":270,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271986+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:42:40.271986+0000","last_peered":"2024-04-26T12:42:40.271986+0000","last_clean":"2024-04-26T12:42:40.271986+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:42:40.271986+0000","last_undegraded":"2024-04-26T12:42:40.271986+0000","last_fullsized":"2024-04-26T12:42:40.271986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"117'134","reported_seq":453,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070071+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:42:41.070071+0000","last_peered":"2024-04-26T12:42:41.070071+0000","last_clean":"2024-04-26T12:42:41.070071+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:42:41.070071+0000","last_undegraded":"2024-04-26T12:42:41.070071+0000","last_fullsized":"2024-04-26T12:42:41.070071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071038+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:42:41.071038+0000","last_peered":"2024-04-26T12:42:41.071038+0000","last_clean":"2024-04-26T12:42:41.071038+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:42:41.071038+0000","last_undegraded":"2024-04-26T12:42:41.071038+0000","last_fullsized":"2024-04-26T12:42:41.071038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072483+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:42:41.072483+0000","last_peered":"2024-04-26T12:42:41.072483+0000","last_clean":"2024-04-26T12:42:41.072483+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:42:41.072483+0000","last_undegraded":"2024-04-26T12:42:41.072483+0000","last_fullsized":"2024-04-26T12:42:41.072483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'18","reported_seq":277,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273435+0000","last_change":"2024-04-26T12:42:21.959737+0000","last_active":"2024-04-26T12:42:40.273435+0000","last_peered":"2024-04-26T12:42:40.273435+0000","last_clean":"2024-04-26T12:42:40.273435+0000","last_became_active":"2024-04-26T12:42:21.959122+0000","last_became_peered":"2024-04-26T12:42:21.959122+0000","last_unstale":"2024-04-26T12:42:40.273435+0000","last_undegraded":"2024-04-26T12:42:40.273435+0000","last_fullsized":"2024-04-26T12:42:40.273435+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:53.425209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976180+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:42:41.976180+0000","last_peered":"2024-04-26T12:42:41.976180+0000","last_clean":"2024-04-26T12:42:41.976180+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:42:41.976180+0000","last_undegraded":"2024-04-26T12:42:41.976180+0000","last_fullsized":"2024-04-26T12:42:41.976180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"117'29","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070847+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:42:41.070847+0000","last_peered":"2024-04-26T12:42:41.070847+0000","last_clean":"2024-04-26T12:42:41.070847+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:42:41.070847+0000","last_undegraded":"2024-04-26T12:42:41.070847+0000","last_fullsized":"2024-04-26T12:42:41.070847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975732+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:42:41.975732+0000","last_peered":"2024-04-26T12:42:41.975732+0000","last_clean":"2024-04-26T12:42:41.975732+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:42:41.975732+0000","last_undegraded":"2024-04-26T12:42:41.975732+0000","last_fullsized":"2024-04-26T12:42:41.975732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'7","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409967+0000","last_change":"2024-04-26T12:42:21.935665+0000","last_active":"2024-04-26T12:42:41.409967+0000","last_peered":"2024-04-26T12:42:41.409967+0000","last_clean":"2024-04-26T12:42:41.409967+0000","last_became_active":"2024-04-26T12:42:21.934686+0000","last_became_peered":"2024-04-26T12:42:21.934686+0000","last_unstale":"2024-04-26T12:42:41.409967+0000","last_undegraded":"2024-04-26T12:42:41.409967+0000","last_fullsized":"2024-04-26T12:42:41.409967+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:39.070102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"117'4","reported_seq":230,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067873+0000","last_change":"2024-04-26T12:42:34.032506+0000","last_active":"2024-04-26T12:42:41.067873+0000","last_peered":"2024-04-26T12:42:41.067873+0000","last_clean":"2024-04-26T12:42:41.067873+0000","last_became_active":"2024-04-26T12:42:34.031776+0000","last_became_peered":"2024-04-26T12:42:34.031776+0000","last_unstale":"2024-04-26T12:42:41.067873+0000","last_undegraded":"2024-04-26T12:42:41.067873+0000","last_fullsized":"2024-04-26T12:42:41.067873+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:40.297834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'26","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069641+0000","last_change":"2024-04-26T12:42:21.974477+0000","last_active":"2024-04-26T12:42:41.069641+0000","last_peered":"2024-04-26T12:42:41.069641+0000","last_clean":"2024-04-26T12:42:41.069641+0000","last_became_active":"2024-04-26T12:42:21.967072+0000","last_became_peered":"2024-04-26T12:42:21.967072+0000","last_unstale":"2024-04-26T12:42:41.069641+0000","last_undegraded":"2024-04-26T12:42:41.069641+0000","last_fullsized":"2024-04-26T12:42:41.069641+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.202160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976283+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:42:41.976283+0000","last_peered":"2024-04-26T12:42:41.976283+0000","last_clean":"2024-04-26T12:42:41.976283+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:42:41.976283+0000","last_undegraded":"2024-04-26T12:42:41.976283+0000","last_fullsized":"2024-04-26T12:42:41.976283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"117'19","reported_seq":65,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066738+0000","last_change":"2024-04-26T12:42:34.028589+0000","last_active":"2024-04-26T12:42:41.066738+0000","last_peered":"2024-04-26T12:42:41.066738+0000","last_clean":"2024-04-26T12:42:41.066738+0000","last_became_active":"2024-04-26T12:42:34.027524+0000","last_became_peered":"2024-04-26T12:42:34.027524+0000","last_unstale":"2024-04-26T12:42:41.066738+0000","last_undegraded":"2024-04-26T12:42:41.066738+0000","last_fullsized":"2024-04-26T12:42:41.066738+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:11.088686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069873+0000","last_change":"2024-04-26T12:42:21.938337+0000","last_active":"2024-04-26T12:42:41.069873+0000","last_peered":"2024-04-26T12:42:41.069873+0000","last_clean":"2024-04-26T12:42:41.069873+0000","last_became_active":"2024-04-26T12:42:21.937057+0000","last_became_peered":"2024-04-26T12:42:21.937057+0000","last_unstale":"2024-04-26T12:42:41.069873+0000","last_undegraded":"2024-04-26T12:42:41.069873+0000","last_fullsized":"2024-04-26T12:42:41.069873+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:16.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072835+0000","last_change":"2024-04-26T12:42:21.957634+0000","last_active":"2024-04-26T12:42:41.072835+0000","last_peered":"2024-04-26T12:42:41.072835+0000","last_clean":"2024-04-26T12:42:41.072835+0000","last_became_active":"2024-04-26T12:42:21.948878+0000","last_became_peered":"2024-04-26T12:42:21.948878+0000","last_unstale":"2024-04-26T12:42:41.072835+0000","last_undegraded":"2024-04-26T12:42:41.072835+0000","last_fullsized":"2024-04-26T12:42:41.072835+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:38.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067852+0000","last_change":"2024-04-26T12:42:34.019680+0000","last_active":"2024-04-26T12:42:41.067852+0000","last_peered":"2024-04-26T12:42:41.067852+0000","last_clean":"2024-04-26T12:42:41.067852+0000","last_became_active":"2024-04-26T12:42:34.018540+0000","last_became_peered":"2024-04-26T12:42:34.018540+0000","last_unstale":"2024-04-26T12:42:41.067852+0000","last_undegraded":"2024-04-26T12:42:41.067852+0000","last_fullsized":"2024-04-26T12:42:41.067852+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:44.798659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'20","reported_seq":269,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.276576+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:42:40.276576+0000","last_peered":"2024-04-26T12:42:40.276576+0000","last_clean":"2024-04-26T12:42:40.276576+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:42:40.276576+0000","last_undegraded":"2024-04-26T12:42:40.276576+0000","last_fullsized":"2024-04-26T12:42:40.276576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408746+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:42:41.408746+0000","last_peered":"2024-04-26T12:42:41.408746+0000","last_clean":"2024-04-26T12:42:41.408746+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:42:41.408746+0000","last_undegraded":"2024-04-26T12:42:41.408746+0000","last_fullsized":"2024-04-26T12:42:41.408746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"117'23","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977811+0000","last_change":"2024-04-26T12:42:21.959840+0000","last_active":"2024-04-26T12:42:41.977811+0000","last_peered":"2024-04-26T12:42:41.977811+0000","last_clean":"2024-04-26T12:42:41.977811+0000","last_became_active":"2024-04-26T12:42:21.958977+0000","last_became_peered":"2024-04-26T12:42:21.958977+0000","last_unstale":"2024-04-26T12:42:41.977811+0000","last_undegraded":"2024-04-26T12:42:41.977811+0000","last_fullsized":"2024-04-26T12:42:41.977811+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:54.837056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"117'134","reported_seq":437,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976564+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:42:41.976564+0000","last_peered":"2024-04-26T12:42:41.976564+0000","last_clean":"2024-04-26T12:42:41.976564+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:42:41.976564+0000","last_undegraded":"2024-04-26T12:42:41.976564+0000","last_fullsized":"2024-04-26T12:42:41.976564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408500+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:42:41.408500+0000","last_peered":"2024-04-26T12:42:41.408500+0000","last_clean":"2024-04-26T12:42:41.408500+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:42:41.408500+0000","last_undegraded":"2024-04-26T12:42:41.408500+0000","last_fullsized":"2024-04-26T12:42:41.408500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":180,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068000+0000","last_change":"2024-04-26T12:42:34.026595+0000","last_active":"2024-04-26T12:42:41.068000+0000","last_peered":"2024-04-26T12:42:41.068000+0000","last_clean":"2024-04-26T12:42:41.068000+0000","last_became_active":"2024-04-26T12:42:34.025094+0000","last_became_peered":"2024-04-26T12:42:34.025094+0000","last_unstale":"2024-04-26T12:42:41.068000+0000","last_undegraded":"2024-04-26T12:42:41.068000+0000","last_fullsized":"2024-04-26T12:42:41.068000+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:15.877357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"117'35","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066995+0000","last_change":"2024-04-26T12:42:34.021002+0000","last_active":"2024-04-26T12:42:41.066995+0000","last_peered":"2024-04-26T12:42:41.066995+0000","last_clean":"2024-04-26T12:42:41.066995+0000","last_became_active":"2024-04-26T12:42:34.019821+0000","last_became_peered":"2024-04-26T12:42:34.019821+0000","last_unstale":"2024-04-26T12:42:41.066995+0000","last_undegraded":"2024-04-26T12:42:41.066995+0000","last_fullsized":"2024-04-26T12:42:41.066995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:02.705267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":423,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.279015+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:42:40.279015+0000","last_peered":"2024-04-26T12:42:40.279015+0000","last_clean":"2024-04-26T12:42:40.279015+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:42:40.279015+0000","last_undegraded":"2024-04-26T12:42:40.279015+0000","last_fullsized":"2024-04-26T12:42:40.279015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073443+0000","last_change":"2024-04-26T12:42:21.962837+0000","last_active":"2024-04-26T12:42:41.073443+0000","last_peered":"2024-04-26T12:42:41.073443+0000","last_clean":"2024-04-26T12:42:41.073443+0000","last_became_active":"2024-04-26T12:42:21.952480+0000","last_became_peered":"2024-04-26T12:42:21.952480+0000","last_unstale":"2024-04-26T12:42:41.073443+0000","last_undegraded":"2024-04-26T12:42:41.073443+0000","last_fullsized":"2024-04-26T12:42:41.073443+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:55.807987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"117'134","reported_seq":467,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.277897+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:42:40.277897+0000","last_peered":"2024-04-26T12:42:40.277897+0000","last_clean":"2024-04-26T12:42:40.277897+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:42:40.277897+0000","last_undegraded":"2024-04-26T12:42:40.277897+0000","last_fullsized":"2024-04-26T12:42:40.277897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066666+0000","last_change":"2024-04-26T12:42:34.020098+0000","last_active":"2024-04-26T12:42:41.066666+0000","last_peered":"2024-04-26T12:42:41.066666+0000","last_clean":"2024-04-26T12:42:41.066666+0000","last_became_active":"2024-04-26T12:42:34.015095+0000","last_became_peered":"2024-04-26T12:42:34.015095+0000","last_unstale":"2024-04-26T12:42:41.066666+0000","last_undegraded":"2024-04-26T12:42:41.066666+0000","last_fullsized":"2024-04-26T12:42:41.066666+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:05.746648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410186+0000","last_change":"2024-04-26T12:42:21.953982+0000","last_active":"2024-04-26T12:42:41.410186+0000","last_peered":"2024-04-26T12:42:41.410186+0000","last_clean":"2024-04-26T12:42:41.410186+0000","last_became_active":"2024-04-26T12:42:21.953253+0000","last_became_peered":"2024-04-26T12:42:21.953253+0000","last_unstale":"2024-04-26T12:42:41.410186+0000","last_undegraded":"2024-04-26T12:42:41.410186+0000","last_fullsized":"2024-04-26T12:42:41.410186+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:24.067594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"115'20","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067138+0000","last_change":"2024-04-26T12:42:21.949610+0000","last_active":"2024-04-26T12:42:41.067138+0000","last_peered":"2024-04-26T12:42:41.067138+0000","last_clean":"2024-04-26T12:42:41.067138+0000","last_became_active":"2024-04-26T12:42:21.940512+0000","last_became_peered":"2024-04-26T12:42:21.940512+0000","last_unstale":"2024-04-26T12:42:41.067138+0000","last_undegraded":"2024-04-26T12:42:41.067138+0000","last_fullsized":"2024-04-26T12:42:41.067138+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:19.966458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067393+0000","last_change":"2024-04-26T12:42:34.007412+0000","last_active":"2024-04-26T12:42:41.067393+0000","last_peered":"2024-04-26T12:42:41.067393+0000","last_clean":"2024-04-26T12:42:41.067393+0000","last_became_active":"2024-04-26T12:42:34.005897+0000","last_became_peered":"2024-04-26T12:42:34.005897+0000","last_unstale":"2024-04-26T12:42:41.067393+0000","last_undegraded":"2024-04-26T12:42:41.067393+0000","last_fullsized":"2024-04-26T12:42:41.067393+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:22.483984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"117'26","reported_seq":276,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.275308+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:42:40.275308+0000","last_peered":"2024-04-26T12:42:40.275308+0000","last_clean":"2024-04-26T12:42:40.275308+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:42:40.275308+0000","last_undegraded":"2024-04-26T12:42:40.275308+0000","last_fullsized":"2024-04-26T12:42:40.275308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":239,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.279411+0000","last_change":"2024-04-26T12:42:21.947536+0000","last_active":"2024-04-26T12:42:40.279411+0000","last_peered":"2024-04-26T12:42:40.279411+0000","last_clean":"2024-04-26T12:42:40.279411+0000","last_became_active":"2024-04-26T12:42:21.946663+0000","last_became_peered":"2024-04-26T12:42:21.946663+0000","last_unstale":"2024-04-26T12:42:40.279411+0000","last_undegraded":"2024-04-26T12:42:40.279411+0000","last_fullsized":"2024-04-26T12:42:40.279411+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:31.336436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":232,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408441+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:42:41.408441+0000","last_peered":"2024-04-26T12:42:41.408441+0000","last_clean":"2024-04-26T12:42:41.408441+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:42:41.408441+0000","last_undegraded":"2024-04-26T12:42:41.408441+0000","last_fullsized":"2024-04-26T12:42:41.408441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":281,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.278694+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:42:40.278694+0000","last_peered":"2024-04-26T12:42:40.278694+0000","last_clean":"2024-04-26T12:42:40.278694+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:42:40.278694+0000","last_undegraded":"2024-04-26T12:42:40.278694+0000","last_fullsized":"2024-04-26T12:42:40.278694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":404,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.272255+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:42:40.272255+0000","last_peered":"2024-04-26T12:42:40.272255+0000","last_clean":"2024-04-26T12:42:40.272255+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:42:40.272255+0000","last_undegraded":"2024-04-26T12:42:40.272255+0000","last_fullsized":"2024-04-26T12:42:40.272255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":258,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271641+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:42:40.271641+0000","last_peered":"2024-04-26T12:42:40.271641+0000","last_clean":"2024-04-26T12:42:40.271641+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:42:40.271641+0000","last_undegraded":"2024-04-26T12:42:40.271641+0000","last_fullsized":"2024-04-26T12:42:40.271641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"117'33","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067725+0000","last_change":"2024-04-26T12:42:21.931544+0000","last_active":"2024-04-26T12:42:41.067725+0000","last_peered":"2024-04-26T12:42:41.067725+0000","last_clean":"2024-04-26T12:42:41.067725+0000","last_became_active":"2024-04-26T12:42:21.929093+0000","last_became_peered":"2024-04-26T12:42:21.929093+0000","last_unstale":"2024-04-26T12:42:41.067725+0000","last_undegraded":"2024-04-26T12:42:41.067725+0000","last_fullsized":"2024-04-26T12:42:41.067725+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:06.052469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":240,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.275630+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:42:40.275630+0000","last_peered":"2024-04-26T12:42:40.275630+0000","last_clean":"2024-04-26T12:42:40.275630+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:42:40.275630+0000","last_undegraded":"2024-04-26T12:42:40.275630+0000","last_fullsized":"2024-04-26T12:42:40.275630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"117'39","reported_seq":300,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.279455+0000","last_change":"2024-04-26T12:42:21.932409+0000","last_active":"2024-04-26T12:42:40.279455+0000","last_peered":"2024-04-26T12:42:40.279455+0000","last_clean":"2024-04-26T12:42:40.279455+0000","last_became_active":"2024-04-26T12:42:21.931114+0000","last_became_peered":"2024-04-26T12:42:21.931114+0000","last_unstale":"2024-04-26T12:42:40.279455+0000","last_undegraded":"2024-04-26T12:42:40.279455+0000","last_fullsized":"2024-04-26T12:42:40.279455+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:31.083567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182602,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071191+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:42:41.071191+0000","last_peered":"2024-04-26T12:42:41.071191+0000","last_clean":"2024-04-26T12:42:41.071191+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:42:41.071191+0000","last_undegraded":"2024-04-26T12:42:41.071191+0000","last_fullsized":"2024-04-26T12:42:41.071191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":229,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.272721+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:42:40.272721+0000","last_peered":"2024-04-26T12:42:40.272721+0000","last_clean":"2024-04-26T12:42:40.272721+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:42:40.272721+0000","last_undegraded":"2024-04-26T12:42:40.272721+0000","last_fullsized":"2024-04-26T12:42:40.272721+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071947+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:42:41.071947+0000","last_peered":"2024-04-26T12:42:41.071947+0000","last_clean":"2024-04-26T12:42:41.071947+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:42:41.071947+0000","last_undegraded":"2024-04-26T12:42:41.071947+0000","last_fullsized":"2024-04-26T12:42:41.071947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":254,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271569+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:42:40.271569+0000","last_peered":"2024-04-26T12:42:40.271569+0000","last_clean":"2024-04-26T12:42:40.271569+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:42:40.271569+0000","last_undegraded":"2024-04-26T12:42:40.271569+0000","last_fullsized":"2024-04-26T12:42:40.271569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"115'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071136+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:42:41.071136+0000","last_peered":"2024-04-26T12:42:41.071136+0000","last_clean":"2024-04-26T12:42:41.071136+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:42:41.071136+0000","last_undegraded":"2024-04-26T12:42:41.071136+0000","last_fullsized":"2024-04-26T12:42:41.071136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":244,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.279725+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:42:40.279725+0000","last_peered":"2024-04-26T12:42:40.279725+0000","last_clean":"2024-04-26T12:42:40.279725+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:42:40.279725+0000","last_undegraded":"2024-04-26T12:42:40.279725+0000","last_fullsized":"2024-04-26T12:42:40.279725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"117'136","reported_seq":491,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408423+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:42:41.408423+0000","last_peered":"2024-04-26T12:42:41.408423+0000","last_clean":"2024-04-26T12:42:41.408423+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:42:41.408423+0000","last_undegraded":"2024-04-26T12:42:41.408423+0000","last_fullsized":"2024-04-26T12:42:41.408423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":232,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.276103+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:42:40.276103+0000","last_peered":"2024-04-26T12:42:40.276103+0000","last_clean":"2024-04-26T12:42:40.276103+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:42:40.276103+0000","last_undegraded":"2024-04-26T12:42:40.276103+0000","last_fullsized":"2024-04-26T12:42:40.276103+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"117'2","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408015+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:42:41.408015+0000","last_peered":"2024-04-26T12:42:41.408015+0000","last_clean":"2024-04-26T12:42:41.408015+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:42:41.408015+0000","last_undegraded":"2024-04-26T12:42:41.408015+0000","last_fullsized":"2024-04-26T12:42:41.408015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410330+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:42:41.410330+0000","last_peered":"2024-04-26T12:42:41.410330+0000","last_clean":"2024-04-26T12:42:41.410330+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:42:41.410330+0000","last_undegraded":"2024-04-26T12:42:41.410330+0000","last_fullsized":"2024-04-26T12:42:41.410330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977561+0000","last_change":"2024-04-26T12:42:21.939098+0000","last_active":"2024-04-26T12:42:41.977561+0000","last_peered":"2024-04-26T12:42:41.977561+0000","last_clean":"2024-04-26T12:42:41.977561+0000","last_became_active":"2024-04-26T12:42:21.938117+0000","last_became_peered":"2024-04-26T12:42:21.938117+0000","last_unstale":"2024-04-26T12:42:41.977561+0000","last_undegraded":"2024-04-26T12:42:41.977561+0000","last_fullsized":"2024-04-26T12:42:41.977561+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:15.636096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'34","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408092+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:42:41.408092+0000","last_peered":"2024-04-26T12:42:41.408092+0000","last_clean":"2024-04-26T12:42:41.408092+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:42:41.408092+0000","last_undegraded":"2024-04-26T12:42:41.408092+0000","last_fullsized":"2024-04-26T12:42:41.408092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":44,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":335,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976702+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:42:41.976702+0000","last_peered":"2024-04-26T12:42:41.976702+0000","last_clean":"2024-04-26T12:42:41.976702+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:42:41.976702+0000","last_undegraded":"2024-04-26T12:42:41.976702+0000","last_fullsized":"2024-04-26T12:42:41.976702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"91'17","reported_seq":312,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.276900+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:42:40.276900+0000","last_peered":"2024-04-26T12:42:40.276900+0000","last_clean":"2024-04-26T12:42:40.276900+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:42:40.276900+0000","last_undegraded":"2024-04-26T12:42:40.276900+0000","last_fullsized":"2024-04-26T12:42:40.276900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069911+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:42:41.069911+0000","last_peered":"2024-04-26T12:42:41.069911+0000","last_clean":"2024-04-26T12:42:41.069911+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:42:41.069911+0000","last_undegraded":"2024-04-26T12:42:41.069911+0000","last_fullsized":"2024-04-26T12:42:41.069911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070589+0000","last_change":"2024-04-26T12:42:21.942734+0000","last_active":"2024-04-26T12:42:41.070589+0000","last_peered":"2024-04-26T12:42:41.070589+0000","last_clean":"2024-04-26T12:42:41.070589+0000","last_became_active":"2024-04-26T12:42:21.928602+0000","last_became_peered":"2024-04-26T12:42:21.928602+0000","last_unstale":"2024-04-26T12:42:41.070589+0000","last_undegraded":"2024-04-26T12:42:41.070589+0000","last_fullsized":"2024-04-26T12:42:41.070589+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:45.167813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409089+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:42:41.409089+0000","last_peered":"2024-04-26T12:42:41.409089+0000","last_clean":"2024-04-26T12:42:41.409089+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:42:41.409089+0000","last_undegraded":"2024-04-26T12:42:41.409089+0000","last_fullsized":"2024-04-26T12:42:41.409089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":258,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271426+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:42:40.271426+0000","last_peered":"2024-04-26T12:42:40.271426+0000","last_clean":"2024-04-26T12:42:40.271426+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:42:40.271426+0000","last_undegraded":"2024-04-26T12:42:40.271426+0000","last_fullsized":"2024-04-26T12:42:40.271426+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'18","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067370+0000","last_change":"2024-04-26T12:42:34.006811+0000","last_active":"2024-04-26T12:42:41.067370+0000","last_peered":"2024-04-26T12:42:41.067370+0000","last_clean":"2024-04-26T12:42:41.067370+0000","last_became_active":"2024-04-26T12:42:34.004041+0000","last_became_peered":"2024-04-26T12:42:34.004041+0000","last_unstale":"2024-04-26T12:42:41.067370+0000","last_undegraded":"2024-04-26T12:42:41.067370+0000","last_fullsized":"2024-04-26T12:42:41.067370+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:08.613547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069460+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:42:41.069460+0000","last_peered":"2024-04-26T12:42:41.069460+0000","last_clean":"2024-04-26T12:42:41.069460+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:42:41.069460+0000","last_undegraded":"2024-04-26T12:42:41.069460+0000","last_fullsized":"2024-04-26T12:42:41.069460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073574+0000","last_change":"2024-04-26T12:42:21.946073+0000","last_active":"2024-04-26T12:42:41.073574+0000","last_peered":"2024-04-26T12:42:41.073574+0000","last_clean":"2024-04-26T12:42:41.073574+0000","last_became_active":"2024-04-26T12:42:21.942937+0000","last_became_peered":"2024-04-26T12:42:21.942937+0000","last_unstale":"2024-04-26T12:42:41.073574+0000","last_undegraded":"2024-04-26T12:42:41.073574+0000","last_fullsized":"2024-04-26T12:42:41.073574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:30.907752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":233,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.280568+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:42:40.280568+0000","last_peered":"2024-04-26T12:42:40.280568+0000","last_clean":"2024-04-26T12:42:40.280568+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:42:40.280568+0000","last_undegraded":"2024-04-26T12:42:40.280568+0000","last_fullsized":"2024-04-26T12:42:40.280568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":245,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.269839+0000","last_change":"2024-04-26T12:42:21.942893+0000","last_active":"2024-04-26T12:42:40.269839+0000","last_peered":"2024-04-26T12:42:40.269839+0000","last_clean":"2024-04-26T12:42:40.269839+0000","last_became_active":"2024-04-26T12:42:21.941954+0000","last_became_peered":"2024-04-26T12:42:21.941954+0000","last_unstale":"2024-04-26T12:42:40.269839+0000","last_undegraded":"2024-04-26T12:42:40.269839+0000","last_fullsized":"2024-04-26T12:42:40.269839+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408457+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:42:41.408457+0000","last_peered":"2024-04-26T12:42:41.408457+0000","last_clean":"2024-04-26T12:42:41.408457+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:42:41.408457+0000","last_undegraded":"2024-04-26T12:42:41.408457+0000","last_fullsized":"2024-04-26T12:42:41.408457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'26","reported_seq":285,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.277306+0000","last_change":"2024-04-26T12:42:21.924370+0000","last_active":"2024-04-26T12:42:40.277306+0000","last_peered":"2024-04-26T12:42:40.277306+0000","last_clean":"2024-04-26T12:42:40.277306+0000","last_became_active":"2024-04-26T12:42:21.923345+0000","last_became_peered":"2024-04-26T12:42:21.923345+0000","last_unstale":"2024-04-26T12:42:40.277306+0000","last_undegraded":"2024-04-26T12:42:40.277306+0000","last_fullsized":"2024-04-26T12:42:40.277306+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:11.162289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409328+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:42:41.409328+0000","last_peered":"2024-04-26T12:42:41.409328+0000","last_clean":"2024-04-26T12:42:41.409328+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:42:41.409328+0000","last_undegraded":"2024-04-26T12:42:41.409328+0000","last_fullsized":"2024-04-26T12:42:41.409328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071121+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:42:41.071121+0000","last_peered":"2024-04-26T12:42:41.071121+0000","last_clean":"2024-04-26T12:42:41.071121+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:42:41.071121+0000","last_undegraded":"2024-04-26T12:42:41.071121+0000","last_fullsized":"2024-04-26T12:42:41.071121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"117'34","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071421+0000","last_change":"2024-04-26T12:42:21.957374+0000","last_active":"2024-04-26T12:42:41.071421+0000","last_peered":"2024-04-26T12:42:41.071421+0000","last_clean":"2024-04-26T12:42:41.071421+0000","last_became_active":"2024-04-26T12:42:21.956451+0000","last_became_peered":"2024-04-26T12:42:21.956451+0000","last_unstale":"2024-04-26T12:42:41.071421+0000","last_undegraded":"2024-04-26T12:42:41.071421+0000","last_fullsized":"2024-04-26T12:42:41.071421+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:20.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":204,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065521+0000","last_change":"2024-04-26T12:42:34.015627+0000","last_active":"2024-04-26T12:42:41.065521+0000","last_peered":"2024-04-26T12:42:41.065521+0000","last_clean":"2024-04-26T12:42:41.065521+0000","last_became_active":"2024-04-26T12:42:34.014949+0000","last_became_peered":"2024-04-26T12:42:34.014949+0000","last_unstale":"2024-04-26T12:42:41.065521+0000","last_undegraded":"2024-04-26T12:42:41.065521+0000","last_fullsized":"2024-04-26T12:42:41.065521+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:46.390226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070165+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:42:41.070165+0000","last_peered":"2024-04-26T12:42:41.070165+0000","last_clean":"2024-04-26T12:42:41.070165+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:42:41.070165+0000","last_undegraded":"2024-04-26T12:42:41.070165+0000","last_fullsized":"2024-04-26T12:42:41.070165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072305+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:42:41.072305+0000","last_peered":"2024-04-26T12:42:41.072305+0000","last_clean":"2024-04-26T12:42:41.072305+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:42:41.072305+0000","last_undegraded":"2024-04-26T12:42:41.072305+0000","last_fullsized":"2024-04-26T12:42:41.072305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'31","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409224+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:42:41.409224+0000","last_peered":"2024-04-26T12:42:41.409224+0000","last_clean":"2024-04-26T12:42:41.409224+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:42:41.409224+0000","last_undegraded":"2024-04-26T12:42:41.409224+0000","last_fullsized":"2024-04-26T12:42:41.409224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":254,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.278409+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:42:40.278409+0000","last_peered":"2024-04-26T12:42:40.278409+0000","last_clean":"2024-04-26T12:42:40.278409+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:42:40.278409+0000","last_undegraded":"2024-04-26T12:42:40.278409+0000","last_fullsized":"2024-04-26T12:42:40.278409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":241,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.275226+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:42:40.275226+0000","last_peered":"2024-04-26T12:42:40.275226+0000","last_clean":"2024-04-26T12:42:40.275226+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:42:40.275226+0000","last_undegraded":"2024-04-26T12:42:40.275226+0000","last_fullsized":"2024-04-26T12:42:40.275226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408014+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:42:41.408014+0000","last_peered":"2024-04-26T12:42:41.408014+0000","last_clean":"2024-04-26T12:42:41.408014+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:42:41.408014+0000","last_undegraded":"2024-04-26T12:42:41.408014+0000","last_fullsized":"2024-04-26T12:42:41.408014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"117'134","reported_seq":423,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.270164+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:42:40.270164+0000","last_peered":"2024-04-26T12:42:40.270164+0000","last_clean":"2024-04-26T12:42:40.270164+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:42:40.270164+0000","last_undegraded":"2024-04-26T12:42:40.270164+0000","last_fullsized":"2024-04-26T12:42:40.270164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073784+0000","last_change":"2024-04-26T12:42:21.962241+0000","last_active":"2024-04-26T12:42:41.073784+0000","last_peered":"2024-04-26T12:42:41.073784+0000","last_clean":"2024-04-26T12:42:41.073784+0000","last_became_active":"2024-04-26T12:42:21.960618+0000","last_became_peered":"2024-04-26T12:42:21.960618+0000","last_unstale":"2024-04-26T12:42:41.073784+0000","last_undegraded":"2024-04-26T12:42:41.073784+0000","last_fullsized":"2024-04-26T12:42:41.073784+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:39.076778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067522+0000","last_change":"2024-04-26T12:42:21.965811+0000","last_active":"2024-04-26T12:42:41.067522+0000","last_peered":"2024-04-26T12:42:41.067522+0000","last_clean":"2024-04-26T12:42:41.067522+0000","last_became_active":"2024-04-26T12:42:21.960998+0000","last_became_peered":"2024-04-26T12:42:21.960998+0000","last_unstale":"2024-04-26T12:42:41.067522+0000","last_undegraded":"2024-04-26T12:42:41.067522+0000","last_fullsized":"2024-04-26T12:42:41.067522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.081118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"116'27","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074564+0000","last_change":"2024-04-26T12:42:21.971344+0000","last_active":"2024-04-26T12:42:41.074564+0000","last_peered":"2024-04-26T12:42:41.074564+0000","last_clean":"2024-04-26T12:42:41.074564+0000","last_became_active":"2024-04-26T12:42:21.968901+0000","last_became_peered":"2024-04-26T12:42:21.968901+0000","last_unstale":"2024-04-26T12:42:41.074564+0000","last_undegraded":"2024-04-26T12:42:41.074564+0000","last_fullsized":"2024-04-26T12:42:41.074564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:04.596971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409908+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:42:41.409908+0000","last_peered":"2024-04-26T12:42:41.409908+0000","last_clean":"2024-04-26T12:42:41.409908+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:42:41.409908+0000","last_undegraded":"2024-04-26T12:42:41.409908+0000","last_fullsized":"2024-04-26T12:42:41.409908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065795+0000","last_change":"2024-04-26T12:42:34.016582+0000","last_active":"2024-04-26T12:42:41.065795+0000","last_peered":"2024-04-26T12:42:41.065795+0000","last_clean":"2024-04-26T12:42:41.065795+0000","last_became_active":"2024-04-26T12:42:34.015774+0000","last_became_peered":"2024-04-26T12:42:34.015774+0000","last_unstale":"2024-04-26T12:42:41.065795+0000","last_undegraded":"2024-04-26T12:42:41.065795+0000","last_fullsized":"2024-04-26T12:42:41.065795+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:09.670527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":71,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067390+0000","last_change":"2024-04-26T12:42:34.031336+0000","last_active":"2024-04-26T12:42:41.067390+0000","last_peered":"2024-04-26T12:42:41.067390+0000","last_clean":"2024-04-26T12:42:41.067390+0000","last_became_active":"2024-04-26T12:42:34.029037+0000","last_became_peered":"2024-04-26T12:42:34.029037+0000","last_unstale":"2024-04-26T12:42:41.067390+0000","last_undegraded":"2024-04-26T12:42:41.067390+0000","last_fullsized":"2024-04-26T12:42:41.067390+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:10.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"123'136","reported_seq":412,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068106+0000","last_change":"2024-04-26T12:42:21.972386+0000","last_active":"2024-04-26T12:42:41.068106+0000","last_peered":"2024-04-26T12:42:41.068106+0000","last_clean":"2024-04-26T12:42:41.068106+0000","last_became_active":"2024-04-26T12:42:21.962332+0000","last_became_peered":"2024-04-26T12:42:21.962332+0000","last_unstale":"2024-04-26T12:42:41.068106+0000","last_undegraded":"2024-04-26T12:42:41.068106+0000","last_fullsized":"2024-04-26T12:42:41.068106+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:50.916736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071272+0000","last_change":"2024-04-26T12:42:21.957370+0000","last_active":"2024-04-26T12:42:41.071272+0000","last_peered":"2024-04-26T12:42:41.071272+0000","last_clean":"2024-04-26T12:42:41.071272+0000","last_became_active":"2024-04-26T12:42:21.956715+0000","last_became_peered":"2024-04-26T12:42:21.956715+0000","last_unstale":"2024-04-26T12:42:41.071272+0000","last_undegraded":"2024-04-26T12:42:41.071272+0000","last_fullsized":"2024-04-26T12:42:41.071272+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:22.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066049+0000","last_change":"2024-04-26T12:42:34.013472+0000","last_active":"2024-04-26T12:42:41.066049+0000","last_peered":"2024-04-26T12:42:41.066049+0000","last_clean":"2024-04-26T12:42:41.066049+0000","last_became_active":"2024-04-26T12:42:34.010800+0000","last_became_peered":"2024-04-26T12:42:34.010800+0000","last_unstale":"2024-04-26T12:42:41.066049+0000","last_undegraded":"2024-04-26T12:42:41.066049+0000","last_fullsized":"2024-04-26T12:42:41.066049+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:43.861494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"117'24","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072776+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:42:41.072776+0000","last_peered":"2024-04-26T12:42:41.072776+0000","last_clean":"2024-04-26T12:42:41.072776+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:42:41.072776+0000","last_undegraded":"2024-04-26T12:42:41.072776+0000","last_fullsized":"2024-04-26T12:42:41.072776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":255,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.281366+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:42:40.281366+0000","last_peered":"2024-04-26T12:42:40.281366+0000","last_clean":"2024-04-26T12:42:40.281366+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:42:40.281366+0000","last_undegraded":"2024-04-26T12:42:40.281366+0000","last_fullsized":"2024-04-26T12:42:40.281366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068515+0000","last_change":"2024-04-26T12:42:21.941484+0000","last_active":"2024-04-26T12:42:41.068515+0000","last_peered":"2024-04-26T12:42:41.068515+0000","last_clean":"2024-04-26T12:42:41.068515+0000","last_became_active":"2024-04-26T12:42:21.926472+0000","last_became_peered":"2024-04-26T12:42:21.926472+0000","last_unstale":"2024-04-26T12:42:41.068515+0000","last_undegraded":"2024-04-26T12:42:41.068515+0000","last_fullsized":"2024-04-26T12:42:41.068515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.214353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"117'43","reported_seq":296,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.274575+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:42:40.274575+0000","last_peered":"2024-04-26T12:42:40.274575+0000","last_clean":"2024-04-26T12:42:40.274575+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:42:40.274575+0000","last_undegraded":"2024-04-26T12:42:40.274575+0000","last_fullsized":"2024-04-26T12:42:40.274575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068343+0000","last_change":"2024-04-26T12:42:21.919160+0000","last_active":"2024-04-26T12:42:41.068343+0000","last_peered":"2024-04-26T12:42:41.068343+0000","last_clean":"2024-04-26T12:42:41.068343+0000","last_became_active":"2024-04-26T12:42:21.918031+0000","last_became_peered":"2024-04-26T12:42:21.918031+0000","last_unstale":"2024-04-26T12:42:41.068343+0000","last_undegraded":"2024-04-26T12:42:41.068343+0000","last_fullsized":"2024-04-26T12:42:41.068343+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:35.941555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.270251+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:42:40.270251+0000","last_peered":"2024-04-26T12:42:40.270251+0000","last_clean":"2024-04-26T12:42:40.270251+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:42:40.270251+0000","last_undegraded":"2024-04-26T12:42:40.270251+0000","last_fullsized":"2024-04-26T12:42:40.270251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069566+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:42:41.069566+0000","last_peered":"2024-04-26T12:42:41.069566+0000","last_clean":"2024-04-26T12:42:41.069566+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:42:41.069566+0000","last_undegraded":"2024-04-26T12:42:41.069566+0000","last_fullsized":"2024-04-26T12:42:41.069566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":186,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066912+0000","last_change":"2024-04-26T12:42:34.023953+0000","last_active":"2024-04-26T12:42:41.066912+0000","last_peered":"2024-04-26T12:42:41.066912+0000","last_clean":"2024-04-26T12:42:41.066912+0000","last_became_active":"2024-04-26T12:42:34.022792+0000","last_became_peered":"2024-04-26T12:42:34.022792+0000","last_unstale":"2024-04-26T12:42:41.066912+0000","last_undegraded":"2024-04-26T12:42:41.066912+0000","last_fullsized":"2024-04-26T12:42:41.066912+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:16.851419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066522+0000","last_change":"2024-04-26T12:42:34.012055+0000","last_active":"2024-04-26T12:42:41.066522+0000","last_peered":"2024-04-26T12:42:41.066522+0000","last_clean":"2024-04-26T12:42:41.066522+0000","last_became_active":"2024-04-26T12:42:34.008295+0000","last_became_peered":"2024-04-26T12:42:34.008295+0000","last_unstale":"2024-04-26T12:42:41.066522+0000","last_undegraded":"2024-04-26T12:42:41.066522+0000","last_fullsized":"2024-04-26T12:42:41.066522+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:59.626034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408588+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:42:41.408588+0000","last_peered":"2024-04-26T12:42:41.408588+0000","last_clean":"2024-04-26T12:42:41.408588+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:42:41.408588+0000","last_undegraded":"2024-04-26T12:42:41.408588+0000","last_fullsized":"2024-04-26T12:42:41.408588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070334+0000","last_change":"2024-04-26T12:42:21.967112+0000","last_active":"2024-04-26T12:42:41.070334+0000","last_peered":"2024-04-26T12:42:41.070334+0000","last_clean":"2024-04-26T12:42:41.070334+0000","last_became_active":"2024-04-26T12:42:21.964467+0000","last_became_peered":"2024-04-26T12:42:21.964467+0000","last_unstale":"2024-04-26T12:42:41.070334+0000","last_undegraded":"2024-04-26T12:42:41.070334+0000","last_fullsized":"2024-04-26T12:42:41.070334+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:41.170576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072547+0000","last_change":"2024-04-26T12:42:21.964141+0000","last_active":"2024-04-26T12:42:41.072547+0000","last_peered":"2024-04-26T12:42:41.072547+0000","last_clean":"2024-04-26T12:42:41.072547+0000","last_became_active":"2024-04-26T12:42:21.959360+0000","last_became_peered":"2024-04-26T12:42:21.959360+0000","last_unstale":"2024-04-26T12:42:41.072547+0000","last_undegraded":"2024-04-26T12:42:41.072547+0000","last_fullsized":"2024-04-26T12:42:41.072547+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:57.964968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074053+0000","last_change":"2024-04-26T12:42:21.970393+0000","last_active":"2024-04-26T12:42:41.074053+0000","last_peered":"2024-04-26T12:42:41.074053+0000","last_clean":"2024-04-26T12:42:41.074053+0000","last_became_active":"2024-04-26T12:42:21.968658+0000","last_became_peered":"2024-04-26T12:42:21.968658+0000","last_unstale":"2024-04-26T12:42:41.074053+0000","last_undegraded":"2024-04-26T12:42:41.074053+0000","last_fullsized":"2024-04-26T12:42:41.074053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:45.400045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408339+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:42:41.408339+0000","last_peered":"2024-04-26T12:42:41.408339+0000","last_clean":"2024-04-26T12:42:41.408339+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:42:41.408339+0000","last_undegraded":"2024-04-26T12:42:41.408339+0000","last_fullsized":"2024-04-26T12:42:41.408339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"117'23","reported_seq":277,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.277442+0000","last_change":"2024-04-26T12:42:21.956317+0000","last_active":"2024-04-26T12:42:40.277442+0000","last_peered":"2024-04-26T12:42:40.277442+0000","last_clean":"2024-04-26T12:42:40.277442+0000","last_became_active":"2024-04-26T12:42:21.955428+0000","last_became_peered":"2024-04-26T12:42:21.955428+0000","last_unstale":"2024-04-26T12:42:40.277442+0000","last_undegraded":"2024-04-26T12:42:40.277442+0000","last_fullsized":"2024-04-26T12:42:40.277442+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:50.243608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067590+0000","last_change":"2024-04-26T12:42:21.973314+0000","last_active":"2024-04-26T12:42:41.067590+0000","last_peered":"2024-04-26T12:42:41.067590+0000","last_clean":"2024-04-26T12:42:41.067590+0000","last_became_active":"2024-04-26T12:42:21.964554+0000","last_became_peered":"2024-04-26T12:42:21.964554+0000","last_unstale":"2024-04-26T12:42:41.067590+0000","last_undegraded":"2024-04-26T12:42:41.067590+0000","last_fullsized":"2024-04-26T12:42:41.067590+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:20.524995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"120'9","reported_seq":250,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070910+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:42:41.070910+0000","last_peered":"2024-04-26T12:42:41.070910+0000","last_clean":"2024-04-26T12:42:41.070910+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:42:41.070910+0000","last_undegraded":"2024-04-26T12:42:41.070910+0000","last_fullsized":"2024-04-26T12:42:41.070910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273325+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:42:40.273325+0000","last_peered":"2024-04-26T12:42:40.273325+0000","last_clean":"2024-04-26T12:42:40.273325+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:42:40.273325+0000","last_undegraded":"2024-04-26T12:42:40.273325+0000","last_fullsized":"2024-04-26T12:42:40.273325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069199+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:42:41.069199+0000","last_peered":"2024-04-26T12:42:41.069199+0000","last_clean":"2024-04-26T12:42:41.069199+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:42:41.069199+0000","last_undegraded":"2024-04-26T12:42:41.069199+0000","last_fullsized":"2024-04-26T12:42:41.069199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069067+0000","last_change":"2024-04-26T12:42:21.967538+0000","last_active":"2024-04-26T12:42:41.069067+0000","last_peered":"2024-04-26T12:42:41.069067+0000","last_clean":"2024-04-26T12:42:41.069067+0000","last_became_active":"2024-04-26T12:42:21.965760+0000","last_became_peered":"2024-04-26T12:42:21.965760+0000","last_unstale":"2024-04-26T12:42:41.069067+0000","last_undegraded":"2024-04-26T12:42:41.069067+0000","last_fullsized":"2024-04-26T12:42:41.069067+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:34.724137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'27","reported_seq":278,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.279095+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:42:40.279095+0000","last_peered":"2024-04-26T12:42:40.279095+0000","last_clean":"2024-04-26T12:42:40.279095+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:42:40.279095+0000","last_undegraded":"2024-04-26T12:42:40.279095+0000","last_fullsized":"2024-04-26T12:42:40.279095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":239,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.270396+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:42:40.270396+0000","last_peered":"2024-04-26T12:42:40.270396+0000","last_clean":"2024-04-26T12:42:40.270396+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:42:40.270396+0000","last_undegraded":"2024-04-26T12:42:40.270396+0000","last_fullsized":"2024-04-26T12:42:40.270396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069367+0000","last_change":"2024-04-26T12:42:21.974557+0000","last_active":"2024-04-26T12:42:41.069367+0000","last_peered":"2024-04-26T12:42:41.069367+0000","last_clean":"2024-04-26T12:42:41.069367+0000","last_became_active":"2024-04-26T12:42:21.967735+0000","last_became_peered":"2024-04-26T12:42:21.967735+0000","last_unstale":"2024-04-26T12:42:41.069367+0000","last_undegraded":"2024-04-26T12:42:41.069367+0000","last_fullsized":"2024-04-26T12:42:41.069367+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:01.266925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":232,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.275021+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:42:40.275021+0000","last_peered":"2024-04-26T12:42:40.275021+0000","last_clean":"2024-04-26T12:42:40.275021+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:42:40.275021+0000","last_undegraded":"2024-04-26T12:42:40.275021+0000","last_fullsized":"2024-04-26T12:42:40.275021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271730+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:42:40.271730+0000","last_peered":"2024-04-26T12:42:40.271730+0000","last_clean":"2024-04-26T12:42:40.271730+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:42:40.271730+0000","last_undegraded":"2024-04-26T12:42:40.271730+0000","last_fullsized":"2024-04-26T12:42:40.271730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068104+0000","last_change":"2024-04-26T12:42:21.946016+0000","last_active":"2024-04-26T12:42:41.068104+0000","last_peered":"2024-04-26T12:42:41.068104+0000","last_clean":"2024-04-26T12:42:41.068104+0000","last_became_active":"2024-04-26T12:42:21.927785+0000","last_became_peered":"2024-04-26T12:42:21.927785+0000","last_unstale":"2024-04-26T12:42:41.068104+0000","last_undegraded":"2024-04-26T12:42:41.068104+0000","last_fullsized":"2024-04-26T12:42:41.068104+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:08.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'20","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072117+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:42:41.072117+0000","last_peered":"2024-04-26T12:42:41.072117+0000","last_clean":"2024-04-26T12:42:41.072117+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:42:41.072117+0000","last_undegraded":"2024-04-26T12:42:41.072117+0000","last_fullsized":"2024-04-26T12:42:41.072117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":240,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273955+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:42:40.273955+0000","last_peered":"2024-04-26T12:42:40.273955+0000","last_clean":"2024-04-26T12:42:40.273955+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:42:40.273955+0000","last_undegraded":"2024-04-26T12:42:40.273955+0000","last_fullsized":"2024-04-26T12:42:40.273955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"117'20","reported_seq":262,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273550+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:42:40.273550+0000","last_peered":"2024-04-26T12:42:40.273550+0000","last_clean":"2024-04-26T12:42:40.273550+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:42:40.273550+0000","last_undegraded":"2024-04-26T12:42:40.273550+0000","last_fullsized":"2024-04-26T12:42:40.273550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068567+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:42:41.068567+0000","last_peered":"2024-04-26T12:42:41.068567+0000","last_clean":"2024-04-26T12:42:41.068567+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:42:41.068567+0000","last_undegraded":"2024-04-26T12:42:41.068567+0000","last_fullsized":"2024-04-26T12:42:41.068567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":253,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.281087+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:42:40.281087+0000","last_peered":"2024-04-26T12:42:40.281087+0000","last_clean":"2024-04-26T12:42:40.281087+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:42:40.281087+0000","last_undegraded":"2024-04-26T12:42:40.281087+0000","last_fullsized":"2024-04-26T12:42:40.281087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'15","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067129+0000","last_change":"2024-04-26T12:42:21.967299+0000","last_active":"2024-04-26T12:42:41.067129+0000","last_peered":"2024-04-26T12:42:41.067129+0000","last_clean":"2024-04-26T12:42:41.067129+0000","last_became_active":"2024-04-26T12:42:21.964241+0000","last_became_peered":"2024-04-26T12:42:21.964241+0000","last_unstale":"2024-04-26T12:42:41.067129+0000","last_undegraded":"2024-04-26T12:42:41.067129+0000","last_fullsized":"2024-04-26T12:42:41.067129+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:24.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071446+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:42:41.071446+0000","last_peered":"2024-04-26T12:42:41.071446+0000","last_clean":"2024-04-26T12:42:41.071446+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:42:41.071446+0000","last_undegraded":"2024-04-26T12:42:41.071446+0000","last_fullsized":"2024-04-26T12:42:41.071446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"117'28","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409065+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:42:41.409065+0000","last_peered":"2024-04-26T12:42:41.409065+0000","last_clean":"2024-04-26T12:42:41.409065+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:42:41.409065+0000","last_undegraded":"2024-04-26T12:42:41.409065+0000","last_fullsized":"2024-04-26T12:42:41.409065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":242,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.272227+0000","last_change":"2024-04-26T12:42:21.947268+0000","last_active":"2024-04-26T12:42:40.272227+0000","last_peered":"2024-04-26T12:42:40.272227+0000","last_clean":"2024-04-26T12:42:40.272227+0000","last_became_active":"2024-04-26T12:42:21.946664+0000","last_became_peered":"2024-04-26T12:42:21.946664+0000","last_unstale":"2024-04-26T12:42:40.272227+0000","last_undegraded":"2024-04-26T12:42:40.272227+0000","last_fullsized":"2024-04-26T12:42:40.272227+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:21.575803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067833+0000","last_change":"2024-04-26T12:42:21.973393+0000","last_active":"2024-04-26T12:42:41.067833+0000","last_peered":"2024-04-26T12:42:41.067833+0000","last_clean":"2024-04-26T12:42:41.067833+0000","last_became_active":"2024-04-26T12:42:21.963727+0000","last_became_peered":"2024-04-26T12:42:21.963727+0000","last_unstale":"2024-04-26T12:42:41.067833+0000","last_undegraded":"2024-04-26T12:42:41.067833+0000","last_fullsized":"2024-04-26T12:42:41.067833+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:52.960136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072465+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:42:41.072465+0000","last_peered":"2024-04-26T12:42:41.072465+0000","last_clean":"2024-04-26T12:42:41.072465+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:42:41.072465+0000","last_undegraded":"2024-04-26T12:42:41.072465+0000","last_fullsized":"2024-04-26T12:42:41.072465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'32","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408983+0000","last_change":"2024-04-26T12:42:21.934786+0000","last_active":"2024-04-26T12:42:41.408983+0000","last_peered":"2024-04-26T12:42:41.408983+0000","last_clean":"2024-04-26T12:42:41.408983+0000","last_became_active":"2024-04-26T12:42:21.933941+0000","last_became_peered":"2024-04-26T12:42:21.933941+0000","last_unstale":"2024-04-26T12:42:41.408983+0000","last_undegraded":"2024-04-26T12:42:41.408983+0000","last_fullsized":"2024-04-26T12:42:41.408983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:56.359990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":241,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.280734+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:42:40.280734+0000","last_peered":"2024-04-26T12:42:40.280734+0000","last_clean":"2024-04-26T12:42:40.280734+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:42:40.280734+0000","last_undegraded":"2024-04-26T12:42:40.280734+0000","last_fullsized":"2024-04-26T12:42:40.280734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"117'23","reported_seq":268,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.275484+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:42:40.275484+0000","last_peered":"2024-04-26T12:42:40.275484+0000","last_clean":"2024-04-26T12:42:40.275484+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:42:40.275484+0000","last_undegraded":"2024-04-26T12:42:40.275484+0000","last_fullsized":"2024-04-26T12:42:40.275484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409160+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:42:41.409160+0000","last_peered":"2024-04-26T12:42:41.409160+0000","last_clean":"2024-04-26T12:42:41.409160+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:42:41.409160+0000","last_undegraded":"2024-04-26T12:42:41.409160+0000","last_fullsized":"2024-04-26T12:42:41.409160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":232,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.274577+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:42:40.274577+0000","last_peered":"2024-04-26T12:42:40.274577+0000","last_clean":"2024-04-26T12:42:40.274577+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:42:40.274577+0000","last_undegraded":"2024-04-26T12:42:40.274577+0000","last_fullsized":"2024-04-26T12:42:40.274577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072909+0000","last_change":"2024-04-26T12:42:21.925516+0000","last_active":"2024-04-26T12:42:41.072909+0000","last_peered":"2024-04-26T12:42:41.072909+0000","last_clean":"2024-04-26T12:42:41.072909+0000","last_became_active":"2024-04-26T12:42:21.924628+0000","last_became_peered":"2024-04-26T12:42:21.924628+0000","last_unstale":"2024-04-26T12:42:41.072909+0000","last_undegraded":"2024-04-26T12:42:41.072909+0000","last_fullsized":"2024-04-26T12:42:41.072909+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.079347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'21","reported_seq":223,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068512+0000","last_change":"2024-04-26T12:42:34.034805+0000","last_active":"2024-04-26T12:42:41.068512+0000","last_peered":"2024-04-26T12:42:41.068512+0000","last_clean":"2024-04-26T12:42:41.068512+0000","last_became_active":"2024-04-26T12:42:34.034029+0000","last_became_peered":"2024-04-26T12:42:34.034029+0000","last_unstale":"2024-04-26T12:42:41.068512+0000","last_undegraded":"2024-04-26T12:42:41.068512+0000","last_fullsized":"2024-04-26T12:42:41.068512+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:41.159253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068554+0000","last_change":"2024-04-26T12:42:34.032136+0000","last_active":"2024-04-26T12:42:41.068554+0000","last_peered":"2024-04-26T12:42:41.068554+0000","last_clean":"2024-04-26T12:42:41.068554+0000","last_became_active":"2024-04-26T12:42:34.031261+0000","last_became_peered":"2024-04-26T12:42:34.031261+0000","last_unstale":"2024-04-26T12:42:41.068554+0000","last_undegraded":"2024-04-26T12:42:41.068554+0000","last_fullsized":"2024-04-26T12:42:41.068554+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:12.726095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074100+0000","last_change":"2024-04-26T12:42:21.932892+0000","last_active":"2024-04-26T12:42:41.074100+0000","last_peered":"2024-04-26T12:42:41.074100+0000","last_clean":"2024-04-26T12:42:41.074100+0000","last_became_active":"2024-04-26T12:42:21.931947+0000","last_became_peered":"2024-04-26T12:42:21.931947+0000","last_unstale":"2024-04-26T12:42:41.074100+0000","last_undegraded":"2024-04-26T12:42:41.074100+0000","last_fullsized":"2024-04-26T12:42:41.074100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:26.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409372+0000","last_change":"2024-04-26T12:42:21.935064+0000","last_active":"2024-04-26T12:42:41.409372+0000","last_peered":"2024-04-26T12:42:41.409372+0000","last_clean":"2024-04-26T12:42:41.409372+0000","last_became_active":"2024-04-26T12:42:21.933611+0000","last_became_peered":"2024-04-26T12:42:21.933611+0000","last_unstale":"2024-04-26T12:42:41.409372+0000","last_undegraded":"2024-04-26T12:42:41.409372+0000","last_fullsized":"2024-04-26T12:42:41.409372+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:10.425425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.274338+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:42:40.274338+0000","last_peered":"2024-04-26T12:42:40.274338+0000","last_clean":"2024-04-26T12:42:40.274338+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:42:40.274338+0000","last_undegraded":"2024-04-26T12:42:40.274338+0000","last_fullsized":"2024-04-26T12:42:40.274338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976329+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:42:41.976329+0000","last_peered":"2024-04-26T12:42:41.976329+0000","last_clean":"2024-04-26T12:42:41.976329+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:42:41.976329+0000","last_undegraded":"2024-04-26T12:42:41.976329+0000","last_fullsized":"2024-04-26T12:42:41.976329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"114'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068827+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:42:41.068827+0000","last_peered":"2024-04-26T12:42:41.068827+0000","last_clean":"2024-04-26T12:42:41.068827+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:42:41.068827+0000","last_undegraded":"2024-04-26T12:42:41.068827+0000","last_fullsized":"2024-04-26T12:42:41.068827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409671+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:42:41.409671+0000","last_peered":"2024-04-26T12:42:41.409671+0000","last_clean":"2024-04-26T12:42:41.409671+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:42:41.409671+0000","last_undegraded":"2024-04-26T12:42:41.409671+0000","last_fullsized":"2024-04-26T12:42:41.409671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"117'12","reported_seq":61,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067261+0000","last_change":"2024-04-26T12:42:34.023030+0000","last_active":"2024-04-26T12:42:41.067261+0000","last_peered":"2024-04-26T12:42:41.067261+0000","last_clean":"2024-04-26T12:42:41.067261+0000","last_became_active":"2024-04-26T12:42:34.022362+0000","last_became_peered":"2024-04-26T12:42:34.022362+0000","last_unstale":"2024-04-26T12:42:41.067261+0000","last_undegraded":"2024-04-26T12:42:41.067261+0000","last_fullsized":"2024-04-26T12:42:41.067261+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:14.876710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"117'134","reported_seq":423,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.280214+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:42:40.280214+0000","last_peered":"2024-04-26T12:42:40.280214+0000","last_clean":"2024-04-26T12:42:40.280214+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:42:40.280214+0000","last_undegraded":"2024-04-26T12:42:40.280214+0000","last_fullsized":"2024-04-26T12:42:40.280214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"117'4","reported_seq":233,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.269994+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:42:40.269994+0000","last_peered":"2024-04-26T12:42:40.269994+0000","last_clean":"2024-04-26T12:42:40.269994+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:42:40.269994+0000","last_undegraded":"2024-04-26T12:42:40.269994+0000","last_fullsized":"2024-04-26T12:42:40.269994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066160+0000","last_change":"2024-04-26T12:42:34.029194+0000","last_active":"2024-04-26T12:42:41.066160+0000","last_peered":"2024-04-26T12:42:41.066160+0000","last_clean":"2024-04-26T12:42:41.066160+0000","last_became_active":"2024-04-26T12:42:34.028313+0000","last_became_peered":"2024-04-26T12:42:34.028313+0000","last_unstale":"2024-04-26T12:42:41.066160+0000","last_undegraded":"2024-04-26T12:42:41.066160+0000","last_fullsized":"2024-04-26T12:42:41.066160+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:01.651376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"117'26","reported_seq":277,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.272881+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:42:40.272881+0000","last_peered":"2024-04-26T12:42:40.272881+0000","last_clean":"2024-04-26T12:42:40.272881+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:42:40.272881+0000","last_undegraded":"2024-04-26T12:42:40.272881+0000","last_fullsized":"2024-04-26T12:42:40.272881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":239,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273910+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:42:40.273910+0000","last_peered":"2024-04-26T12:42:40.273910+0000","last_clean":"2024-04-26T12:42:40.273910+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:42:40.273910+0000","last_undegraded":"2024-04-26T12:42:40.273910+0000","last_fullsized":"2024-04-26T12:42:40.273910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"117'24","reported_seq":273,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.274744+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:42:40.274744+0000","last_peered":"2024-04-26T12:42:40.274744+0000","last_clean":"2024-04-26T12:42:40.274744+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:42:40.274744+0000","last_undegraded":"2024-04-26T12:42:40.274744+0000","last_fullsized":"2024-04-26T12:42:40.274744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070022+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:42:41.070022+0000","last_peered":"2024-04-26T12:42:41.070022+0000","last_clean":"2024-04-26T12:42:41.070022+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:42:41.070022+0000","last_undegraded":"2024-04-26T12:42:41.070022+0000","last_fullsized":"2024-04-26T12:42:41.070022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":227,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.278012+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:42:40.278012+0000","last_peered":"2024-04-26T12:42:40.278012+0000","last_clean":"2024-04-26T12:42:40.278012+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:42:40.278012+0000","last_undegraded":"2024-04-26T12:42:40.278012+0000","last_fullsized":"2024-04-26T12:42:40.278012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"117'14","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067733+0000","last_change":"2024-04-26T12:42:34.032654+0000","last_active":"2024-04-26T12:42:41.067733+0000","last_peered":"2024-04-26T12:42:41.067733+0000","last_clean":"2024-04-26T12:42:41.067733+0000","last_became_active":"2024-04-26T12:42:34.031426+0000","last_became_peered":"2024-04-26T12:42:34.031426+0000","last_unstale":"2024-04-26T12:42:41.067733+0000","last_undegraded":"2024-04-26T12:42:41.067733+0000","last_fullsized":"2024-04-26T12:42:41.067733+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:08.054625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'38","reported_seq":289,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.277042+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:42:40.277042+0000","last_peered":"2024-04-26T12:42:40.277042+0000","last_clean":"2024-04-26T12:42:40.277042+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:42:40.277042+0000","last_undegraded":"2024-04-26T12:42:40.277042+0000","last_fullsized":"2024-04-26T12:42:40.277042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":243,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271265+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:42:40.271265+0000","last_peered":"2024-04-26T12:42:40.271265+0000","last_clean":"2024-04-26T12:42:40.271265+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:42:40.271265+0000","last_undegraded":"2024-04-26T12:42:40.271265+0000","last_fullsized":"2024-04-26T12:42:40.271265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070299+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:42:41.070299+0000","last_peered":"2024-04-26T12:42:41.070299+0000","last_clean":"2024-04-26T12:42:41.070299+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:42:41.070299+0000","last_undegraded":"2024-04-26T12:42:41.070299+0000","last_fullsized":"2024-04-26T12:42:41.070299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":232,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.273180+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:42:40.273180+0000","last_peered":"2024-04-26T12:42:40.273180+0000","last_clean":"2024-04-26T12:42:40.273180+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:42:40.273180+0000","last_undegraded":"2024-04-26T12:42:40.273180+0000","last_fullsized":"2024-04-26T12:42:40.273180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":183,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073883+0000","last_change":"2024-04-26T12:42:21.961763+0000","last_active":"2024-04-26T12:42:41.073883+0000","last_peered":"2024-04-26T12:42:41.073883+0000","last_clean":"2024-04-26T12:42:41.073883+0000","last_became_active":"2024-04-26T12:42:21.951213+0000","last_became_peered":"2024-04-26T12:42:21.951213+0000","last_unstale":"2024-04-26T12:42:41.073883+0000","last_undegraded":"2024-04-26T12:42:41.073883+0000","last_fullsized":"2024-04-26T12:42:41.073883+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:11.260016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069763+0000","last_change":"2024-04-26T12:42:21.963634+0000","last_active":"2024-04-26T12:42:41.069763+0000","last_peered":"2024-04-26T12:42:41.069763+0000","last_clean":"2024-04-26T12:42:41.069763+0000","last_became_active":"2024-04-26T12:42:21.952291+0000","last_became_peered":"2024-04-26T12:42:21.952291+0000","last_unstale":"2024-04-26T12:42:41.069763+0000","last_undegraded":"2024-04-26T12:42:41.069763+0000","last_fullsized":"2024-04-26T12:42:41.069763+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:54.609591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"117'27","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072915+0000","last_change":"2024-04-26T12:42:21.929252+0000","last_active":"2024-04-26T12:42:41.072915+0000","last_peered":"2024-04-26T12:42:41.072915+0000","last_clean":"2024-04-26T12:42:41.072915+0000","last_became_active":"2024-04-26T12:42:21.928247+0000","last_became_peered":"2024-04-26T12:42:21.928247+0000","last_unstale":"2024-04-26T12:42:41.072915+0000","last_undegraded":"2024-04-26T12:42:41.072915+0000","last_fullsized":"2024-04-26T12:42:41.072915+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:45.518571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065498+0000","last_change":"2024-04-26T12:42:34.022643+0000","last_active":"2024-04-26T12:42:41.065498+0000","last_peered":"2024-04-26T12:42:41.065498+0000","last_clean":"2024-04-26T12:42:41.065498+0000","last_became_active":"2024-04-26T12:42:34.022065+0000","last_became_peered":"2024-04-26T12:42:34.022065+0000","last_unstale":"2024-04-26T12:42:41.065498+0000","last_undegraded":"2024-04-26T12:42:41.065498+0000","last_fullsized":"2024-04-26T12:42:41.065498+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:59.260776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"117'14","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068905+0000","last_change":"2024-04-26T12:42:21.975843+0000","last_active":"2024-04-26T12:42:41.068905+0000","last_peered":"2024-04-26T12:42:41.068905+0000","last_clean":"2024-04-26T12:42:41.068905+0000","last_became_active":"2024-04-26T12:42:21.971062+0000","last_became_peered":"2024-04-26T12:42:21.971062+0000","last_unstale":"2024-04-26T12:42:41.068905+0000","last_undegraded":"2024-04-26T12:42:41.068905+0000","last_fullsized":"2024-04-26T12:42:41.068905+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:19.436937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065759+0000","last_change":"2024-04-26T12:42:34.025446+0000","last_active":"2024-04-26T12:42:41.065759+0000","last_peered":"2024-04-26T12:42:41.065759+0000","last_clean":"2024-04-26T12:42:41.065759+0000","last_became_active":"2024-04-26T12:42:34.024706+0000","last_became_peered":"2024-04-26T12:42:34.024706+0000","last_unstale":"2024-04-26T12:42:41.065759+0000","last_undegraded":"2024-04-26T12:42:41.065759+0000","last_fullsized":"2024-04-26T12:42:41.065759+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.762146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":231,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.276626+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:42:40.276626+0000","last_peered":"2024-04-26T12:42:40.276626+0000","last_clean":"2024-04-26T12:42:40.276626+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:42:40.276626+0000","last_undegraded":"2024-04-26T12:42:40.276626+0000","last_fullsized":"2024-04-26T12:42:40.276626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":225,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066300+0000","last_change":"2024-04-26T12:42:34.023824+0000","last_active":"2024-04-26T12:42:41.066300+0000","last_peered":"2024-04-26T12:42:41.066300+0000","last_clean":"2024-04-26T12:42:41.066300+0000","last_became_active":"2024-04-26T12:42:34.022553+0000","last_became_peered":"2024-04-26T12:42:34.022553+0000","last_unstale":"2024-04-26T12:42:41.066300+0000","last_undegraded":"2024-04-26T12:42:41.066300+0000","last_fullsized":"2024-04-26T12:42:41.066300+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:14.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071804+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:42:41.071804+0000","last_peered":"2024-04-26T12:42:41.071804+0000","last_clean":"2024-04-26T12:42:41.071804+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:42:41.071804+0000","last_undegraded":"2024-04-26T12:42:41.071804+0000","last_fullsized":"2024-04-26T12:42:41.071804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":334,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408101+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:42:41.408101+0000","last_peered":"2024-04-26T12:42:41.408101+0000","last_clean":"2024-04-26T12:42:41.408101+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:42:41.408101+0000","last_undegraded":"2024-04-26T12:42:41.408101+0000","last_fullsized":"2024-04-26T12:42:41.408101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"117'17","reported_seq":62,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066047+0000","last_change":"2024-04-26T12:42:34.021259+0000","last_active":"2024-04-26T12:42:41.066047+0000","last_peered":"2024-04-26T12:42:41.066047+0000","last_clean":"2024-04-26T12:42:41.066047+0000","last_became_active":"2024-04-26T12:42:34.017996+0000","last_became_peered":"2024-04-26T12:42:34.017996+0000","last_unstale":"2024-04-26T12:42:41.066047+0000","last_undegraded":"2024-04-26T12:42:41.066047+0000","last_fullsized":"2024-04-26T12:42:41.066047+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:25.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068303+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:42:41.068303+0000","last_peered":"2024-04-26T12:42:41.068303+0000","last_clean":"2024-04-26T12:42:41.068303+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:42:41.068303+0000","last_undegraded":"2024-04-26T12:42:41.068303+0000","last_fullsized":"2024-04-26T12:42:41.068303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068670+0000","last_change":"2024-04-26T12:42:34.015473+0000","last_active":"2024-04-26T12:42:41.068670+0000","last_peered":"2024-04-26T12:42:41.068670+0000","last_clean":"2024-04-26T12:42:41.068670+0000","last_became_active":"2024-04-26T12:42:34.011472+0000","last_became_peered":"2024-04-26T12:42:34.011472+0000","last_unstale":"2024-04-26T12:42:41.068670+0000","last_undegraded":"2024-04-26T12:42:41.068670+0000","last_fullsized":"2024-04-26T12:42:41.068670+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"117'8","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410161+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:42:41.410161+0000","last_peered":"2024-04-26T12:42:41.410161+0000","last_clean":"2024-04-26T12:42:41.410161+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:42:41.410161+0000","last_undegraded":"2024-04-26T12:42:41.410161+0000","last_fullsized":"2024-04-26T12:42:41.410161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"115'18","reported_seq":267,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271792+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:42:40.271792+0000","last_peered":"2024-04-26T12:42:40.271792+0000","last_clean":"2024-04-26T12:42:40.271792+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:42:40.271792+0000","last_undegraded":"2024-04-26T12:42:40.271792+0000","last_fullsized":"2024-04-26T12:42:40.271792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409722+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:42:41.409722+0000","last_peered":"2024-04-26T12:42:41.409722+0000","last_clean":"2024-04-26T12:42:41.409722+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:42:41.409722+0000","last_undegraded":"2024-04-26T12:42:41.409722+0000","last_fullsized":"2024-04-26T12:42:41.409722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"117'28","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977334+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:42:41.977334+0000","last_peered":"2024-04-26T12:42:41.977334+0000","last_clean":"2024-04-26T12:42:41.977334+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:42:41.977334+0000","last_undegraded":"2024-04-26T12:42:41.977334+0000","last_fullsized":"2024-04-26T12:42:41.977334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":265,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.276025+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:42:40.276025+0000","last_peered":"2024-04-26T12:42:40.276025+0000","last_clean":"2024-04-26T12:42:40.276025+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:42:40.276025+0000","last_undegraded":"2024-04-26T12:42:40.276025+0000","last_fullsized":"2024-04-26T12:42:40.276025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'25","reported_seq":284,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271302+0000","last_change":"2024-04-26T12:42:21.926395+0000","last_active":"2024-04-26T12:42:40.271302+0000","last_peered":"2024-04-26T12:42:40.271302+0000","last_clean":"2024-04-26T12:42:40.271302+0000","last_became_active":"2024-04-26T12:42:21.925708+0000","last_became_peered":"2024-04-26T12:42:21.925708+0000","last_unstale":"2024-04-26T12:42:40.271302+0000","last_undegraded":"2024-04-26T12:42:40.271302+0000","last_fullsized":"2024-04-26T12:42:40.271302+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:41.849994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"117'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409207+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:42:41.409207+0000","last_peered":"2024-04-26T12:42:41.409207+0000","last_clean":"2024-04-26T12:42:41.409207+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:42:41.409207+0000","last_undegraded":"2024-04-26T12:42:41.409207+0000","last_fullsized":"2024-04-26T12:42:41.409207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'28","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069354+0000","last_change":"2024-04-26T12:42:21.959563+0000","last_active":"2024-04-26T12:42:41.069354+0000","last_peered":"2024-04-26T12:42:41.069354+0000","last_clean":"2024-04-26T12:42:41.069354+0000","last_became_active":"2024-04-26T12:42:21.957515+0000","last_became_peered":"2024-04-26T12:42:21.957515+0000","last_unstale":"2024-04-26T12:42:41.069354+0000","last_undegraded":"2024-04-26T12:42:41.069354+0000","last_fullsized":"2024-04-26T12:42:41.069354+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:46.718927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068640+0000","last_change":"2024-04-26T12:42:21.975117+0000","last_active":"2024-04-26T12:42:41.068640+0000","last_peered":"2024-04-26T12:42:41.068640+0000","last_clean":"2024-04-26T12:42:41.068640+0000","last_became_active":"2024-04-26T12:42:21.970669+0000","last_became_peered":"2024-04-26T12:42:21.970669+0000","last_unstale":"2024-04-26T12:42:41.068640+0000","last_undegraded":"2024-04-26T12:42:41.068640+0000","last_fullsized":"2024-04-26T12:42:41.068640+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:18.013624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'23","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071983+0000","last_change":"2024-04-26T12:42:21.964762+0000","last_active":"2024-04-26T12:42:41.071983+0000","last_peered":"2024-04-26T12:42:41.071983+0000","last_clean":"2024-04-26T12:42:41.071983+0000","last_became_active":"2024-04-26T12:42:21.961965+0000","last_became_peered":"2024-04-26T12:42:21.961965+0000","last_unstale":"2024-04-26T12:42:41.071983+0000","last_undegraded":"2024-04-26T12:42:41.071983+0000","last_fullsized":"2024-04-26T12:42:41.071983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:11.098641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068239+0000","last_change":"2024-04-26T12:42:34.025570+0000","last_active":"2024-04-26T12:42:41.068239+0000","last_peered":"2024-04-26T12:42:41.068239+0000","last_clean":"2024-04-26T12:42:41.068239+0000","last_became_active":"2024-04-26T12:42:34.024880+0000","last_became_peered":"2024-04-26T12:42:34.024880+0000","last_unstale":"2024-04-26T12:42:41.068239+0000","last_undegraded":"2024-04-26T12:42:41.068239+0000","last_fullsized":"2024-04-26T12:42:41.068239+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:55.070371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"117'19","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410111+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:42:41.410111+0000","last_peered":"2024-04-26T12:42:41.410111+0000","last_clean":"2024-04-26T12:42:41.410111+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:42:41.410111+0000","last_undegraded":"2024-04-26T12:42:41.410111+0000","last_fullsized":"2024-04-26T12:42:41.410111+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":185,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070064+0000","last_change":"2024-04-26T12:42:21.942927+0000","last_active":"2024-04-26T12:42:41.070064+0000","last_peered":"2024-04-26T12:42:41.070064+0000","last_clean":"2024-04-26T12:42:41.070064+0000","last_became_active":"2024-04-26T12:42:21.941594+0000","last_became_peered":"2024-04-26T12:42:21.941594+0000","last_unstale":"2024-04-26T12:42:41.070064+0000","last_undegraded":"2024-04-26T12:42:41.070064+0000","last_fullsized":"2024-04-26T12:42:41.070064+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:04.021398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'27","reported_seq":276,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.279446+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:42:40.279446+0000","last_peered":"2024-04-26T12:42:40.279446+0000","last_clean":"2024-04-26T12:42:40.279446+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:42:40.279446+0000","last_undegraded":"2024-04-26T12:42:40.279446+0000","last_fullsized":"2024-04-26T12:42:40.279446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"117'12","reported_seq":295,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271412+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:42:40.271412+0000","last_peered":"2024-04-26T12:42:40.271412+0000","last_clean":"2024-04-26T12:42:40.271412+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:42:40.271412+0000","last_undegraded":"2024-04-26T12:42:40.271412+0000","last_fullsized":"2024-04-26T12:42:40.271412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"117'32","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073767+0000","last_change":"2024-04-26T12:42:21.951944+0000","last_active":"2024-04-26T12:42:41.073767+0000","last_peered":"2024-04-26T12:42:41.073767+0000","last_clean":"2024-04-26T12:42:41.073767+0000","last_became_active":"2024-04-26T12:42:21.948694+0000","last_became_peered":"2024-04-26T12:42:21.948694+0000","last_unstale":"2024-04-26T12:42:41.073767+0000","last_undegraded":"2024-04-26T12:42:41.073767+0000","last_fullsized":"2024-04-26T12:42:41.073767+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:27.567798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132120576,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":289,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071522+0000","last_change":"2024-04-26T12:42:21.957965+0000","last_active":"2024-04-26T12:42:41.071522+0000","last_peered":"2024-04-26T12:42:41.071522+0000","last_clean":"2024-04-26T12:42:41.071522+0000","last_became_active":"2024-04-26T12:42:21.956925+0000","last_became_peered":"2024-04-26T12:42:21.956925+0000","last_unstale":"2024-04-26T12:42:41.071522+0000","last_undegraded":"2024-04-26T12:42:41.071522+0000","last_fullsized":"2024-04-26T12:42:41.071522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:23.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'29","reported_seq":288,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.270718+0000","last_change":"2024-04-26T12:42:21.950280+0000","last_active":"2024-04-26T12:42:40.270718+0000","last_peered":"2024-04-26T12:42:40.270718+0000","last_clean":"2024-04-26T12:42:40.270718+0000","last_became_active":"2024-04-26T12:42:21.949469+0000","last_became_peered":"2024-04-26T12:42:21.949469+0000","last_unstale":"2024-04-26T12:42:40.270718+0000","last_undegraded":"2024-04-26T12:42:40.270718+0000","last_fullsized":"2024-04-26T12:42:40.270718+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:05.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067819+0000","last_change":"2024-04-26T12:42:34.019992+0000","last_active":"2024-04-26T12:42:41.067819+0000","last_peered":"2024-04-26T12:42:41.067819+0000","last_clean":"2024-04-26T12:42:41.067819+0000","last_became_active":"2024-04-26T12:42:34.018659+0000","last_became_peered":"2024-04-26T12:42:34.018659+0000","last_unstale":"2024-04-26T12:42:41.067819+0000","last_undegraded":"2024-04-26T12:42:41.067819+0000","last_fullsized":"2024-04-26T12:42:41.067819+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:24.593225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'18","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069486+0000","last_change":"2024-04-26T12:42:21.933174+0000","last_active":"2024-04-26T12:42:41.069486+0000","last_peered":"2024-04-26T12:42:41.069486+0000","last_clean":"2024-04-26T12:42:41.069486+0000","last_became_active":"2024-04-26T12:42:21.932263+0000","last_became_peered":"2024-04-26T12:42:21.932263+0000","last_unstale":"2024-04-26T12:42:41.069486+0000","last_undegraded":"2024-04-26T12:42:41.069486+0000","last_fullsized":"2024-04-26T12:42:41.069486+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:26.946555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"117'4","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976498+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:42:41.976498+0000","last_peered":"2024-04-26T12:42:41.976498+0000","last_clean":"2024-04-26T12:42:41.976498+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:42:41.976498+0000","last_undegraded":"2024-04-26T12:42:41.976498+0000","last_fullsized":"2024-04-26T12:42:41.976498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"112'16","reported_seq":268,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271232+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:42:40.271232+0000","last_peered":"2024-04-26T12:42:40.271232+0000","last_clean":"2024-04-26T12:42:40.271232+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:42:40.271232+0000","last_undegraded":"2024-04-26T12:42:40.271232+0000","last_fullsized":"2024-04-26T12:42:40.271232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068189+0000","last_change":"2024-04-26T12:42:34.024717+0000","last_active":"2024-04-26T12:42:41.068189+0000","last_peered":"2024-04-26T12:42:41.068189+0000","last_clean":"2024-04-26T12:42:41.068189+0000","last_became_active":"2024-04-26T12:42:34.023978+0000","last_became_peered":"2024-04-26T12:42:34.023978+0000","last_unstale":"2024-04-26T12:42:41.068189+0000","last_undegraded":"2024-04-26T12:42:41.068189+0000","last_fullsized":"2024-04-26T12:42:41.068189+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'23","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071543+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:42:41.071543+0000","last_peered":"2024-04-26T12:42:41.071543+0000","last_clean":"2024-04-26T12:42:41.071543+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:42:41.071543+0000","last_undegraded":"2024-04-26T12:42:41.071543+0000","last_fullsized":"2024-04-26T12:42:41.071543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":267,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.274944+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:42:40.274944+0000","last_peered":"2024-04-26T12:42:40.274944+0000","last_clean":"2024-04-26T12:42:40.274944+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:42:40.274944+0000","last_undegraded":"2024-04-26T12:42:40.274944+0000","last_fullsized":"2024-04-26T12:42:40.274944+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'17","reported_seq":266,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.280625+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:42:40.280625+0000","last_peered":"2024-04-26T12:42:40.280625+0000","last_clean":"2024-04-26T12:42:40.280625+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:42:40.280625+0000","last_undegraded":"2024-04-26T12:42:40.280625+0000","last_fullsized":"2024-04-26T12:42:40.280625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068613+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:42:41.068613+0000","last_peered":"2024-04-26T12:42:41.068613+0000","last_clean":"2024-04-26T12:42:41.068613+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:42:41.068613+0000","last_undegraded":"2024-04-26T12:42:41.068613+0000","last_fullsized":"2024-04-26T12:42:41.068613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'24","reported_seq":271,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.278157+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:42:40.278157+0000","last_peered":"2024-04-26T12:42:40.278157+0000","last_clean":"2024-04-26T12:42:40.278157+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:42:40.278157+0000","last_undegraded":"2024-04-26T12:42:40.278157+0000","last_fullsized":"2024-04-26T12:42:40.278157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070772+0000","last_change":"2024-04-26T12:42:21.967040+0000","last_active":"2024-04-26T12:42:41.070772+0000","last_peered":"2024-04-26T12:42:41.070772+0000","last_clean":"2024-04-26T12:42:41.070772+0000","last_became_active":"2024-04-26T12:42:21.965634+0000","last_became_peered":"2024-04-26T12:42:21.965634+0000","last_unstale":"2024-04-26T12:42:41.070772+0000","last_undegraded":"2024-04-26T12:42:41.070772+0000","last_fullsized":"2024-04-26T12:42:41.070772+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:58.603311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'16","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976821+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:42:41.976821+0000","last_peered":"2024-04-26T12:42:41.976821+0000","last_clean":"2024-04-26T12:42:41.976821+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:42:41.976821+0000","last_undegraded":"2024-04-26T12:42:41.976821+0000","last_fullsized":"2024-04-26T12:42:41.976821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":269,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.271168+0000","last_change":"2024-04-26T12:42:21.967682+0000","last_active":"2024-04-26T12:42:40.271168+0000","last_peered":"2024-04-26T12:42:40.271168+0000","last_clean":"2024-04-26T12:42:40.271168+0000","last_became_active":"2024-04-26T12:42:21.967048+0000","last_became_peered":"2024-04-26T12:42:21.967048+0000","last_unstale":"2024-04-26T12:42:40.271168+0000","last_undegraded":"2024-04-26T12:42:40.271168+0000","last_fullsized":"2024-04-26T12:42:40.271168+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:43.288294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"117'15","reported_seq":266,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.279997+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:42:40.279997+0000","last_peered":"2024-04-26T12:42:40.279997+0000","last_clean":"2024-04-26T12:42:40.279997+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:42:40.279997+0000","last_undegraded":"2024-04-26T12:42:40.279997+0000","last_fullsized":"2024-04-26T12:42:40.279997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"116'24","reported_seq":275,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.270452+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:42:40.270452+0000","last_peered":"2024-04-26T12:42:40.270452+0000","last_clean":"2024-04-26T12:42:40.270452+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:42:40.270452+0000","last_undegraded":"2024-04-26T12:42:40.270452+0000","last_fullsized":"2024-04-26T12:42:40.270452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070164+0000","last_change":"2024-04-26T12:42:21.937768+0000","last_active":"2024-04-26T12:42:41.070164+0000","last_peered":"2024-04-26T12:42:41.070164+0000","last_clean":"2024-04-26T12:42:41.070164+0000","last_became_active":"2024-04-26T12:42:21.936930+0000","last_became_peered":"2024-04-26T12:42:21.936930+0000","last_unstale":"2024-04-26T12:42:41.070164+0000","last_undegraded":"2024-04-26T12:42:41.070164+0000","last_fullsized":"2024-04-26T12:42:41.070164+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.253226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"117'25","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408802+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:42:41.408802+0000","last_peered":"2024-04-26T12:42:41.408802+0000","last_clean":"2024-04-26T12:42:41.408802+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:42:41.408802+0000","last_undegraded":"2024-04-26T12:42:41.408802+0000","last_fullsized":"2024-04-26T12:42:41.408802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"117'2","reported_seq":255,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-04-26T12:42:40.278883+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:42:40.278883+0000","last_peered":"2024-04-26T12:42:40.278883+0000","last_clean":"2024-04-26T12:42:40.278883+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:42:40.278883+0000","last_undegraded":"2024-04-26T12:42:40.278883+0000","last_fullsized":"2024-04-26T12:42:40.278883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":336,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1076,"ondisk_log_size":1076,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382929,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":607,"num_write":463,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1275,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1700564,"kb_used_data":1669384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92671276,"statfs":{"total":96636764160,"available":94895386624,"internally_reserved":0,"allocated":1709449216,"data_stored":1708733495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1136700,"kb_used_data":1105516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93235140,"statfs":{"total":96636764160,"available":95472783360,"internally_reserved":0,"allocated":1132048384,"data_stored":1131366405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1950060,"kb_used_data":1914712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92421780,"statfs":{"total":96636764160,"available":94639902720,"internally_reserved":0,"allocated":1960665088,"data_stored":1959919116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1808444,"kb_used_data":1777264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92563396,"statfs":{"total":96636764160,"available":94784917504,"internally_reserved":0,"allocated":1819918336,"data_stored":1819239618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":122,"seq":523986010118,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1942864,"kb_used_data":1906500,"kb_used_omap":6,"kb_used_meta":36345,"kb_avail":92428976,"statfs":{"total":96636764160,"available":94647271424,"internally_reserved":0,"allocated":1952256000,"data_stored":1951536896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6715,"internal_metadata":37217733},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163384,"kb_used_data":1128036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93208456,"statfs":{"total":96636764160,"available":95445458944,"internally_reserved":0,"allocated":1155108864,"data_stored":1154435075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1130840,"kb_used_data":1091340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93241000,"statfs":{"total":96636764160,"available":95478784000,"internally_reserved":0,"allocated":1117532160,"data_stored":1116813587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1762172,"kb_used_data":1726832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92609668,"statfs":{"total":96636764160,"available":94832300032,"internally_reserved":0,"allocated":1768275968,"data_stored":1767576542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1765801984,"data_stored":1765801984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1115684864,"data_stored":1115684864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1153433600,"data_stored":1153433600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1958739968,"data_stored":1958739968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1130364928,"data_stored":1130364928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1707081728,"data_stored":1707081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":175679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":176622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":176872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:42:44.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:42:44.990 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:42:44.996 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:42:45.005 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":273,"stamp":"2024-04-26T12:42:44.782987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819921,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3100,"num_read_kb":2786,"num_write":2843,"num_write_kb":6187910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3893,"ondisk_log_size":3893,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595040,"kb_used_data":12319608,"kb_used_omap":17,"kb_used_meta":275310,"kb_avail":742379680,"statfs":{"total":773094113280,"available":760196792320,"internally_reserved":0,"allocated":12615278592,"data_stored":12609636430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17874,"internal_metadata":281917998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002973"},"pg_stats":[{"pgid":"3.3f","version":"116'21","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519202+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:42:42.519202+0000","last_peered":"2024-04-26T12:42:42.519202+0000","last_clean":"2024-04-26T12:42:42.519202+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:42:42.519202+0000","last_undegraded":"2024-04-26T12:42:42.519202+0000","last_fullsized":"2024-04-26T12:42:42.519202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"117'6","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121480+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:42:42.121480+0000","last_peered":"2024-04-26T12:42:42.121480+0000","last_clean":"2024-04-26T12:42:42.121480+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:42:42.121480+0000","last_undegraded":"2024-04-26T12:42:42.121480+0000","last_fullsized":"2024-04-26T12:42:42.121480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'16","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409799+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:42:41.409799+0000","last_peered":"2024-04-26T12:42:41.409799+0000","last_clean":"2024-04-26T12:42:41.409799+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:42:41.409799+0000","last_undegraded":"2024-04-26T12:42:41.409799+0000","last_fullsized":"2024-04-26T12:42:41.409799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518093+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:42:42.518093+0000","last_peered":"2024-04-26T12:42:42.518093+0000","last_clean":"2024-04-26T12:42:42.518093+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:42:42.518093+0000","last_undegraded":"2024-04-26T12:42:42.518093+0000","last_fullsized":"2024-04-26T12:42:42.518093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069713+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:42:41.069713+0000","last_peered":"2024-04-26T12:42:41.069713+0000","last_clean":"2024-04-26T12:42:41.069713+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:42:41.069713+0000","last_undegraded":"2024-04-26T12:42:41.069713+0000","last_fullsized":"2024-04-26T12:42:41.069713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066786+0000","last_change":"2024-04-26T12:42:34.019445+0000","last_active":"2024-04-26T12:42:41.066786+0000","last_peered":"2024-04-26T12:42:41.066786+0000","last_clean":"2024-04-26T12:42:41.066786+0000","last_became_active":"2024-04-26T12:42:34.016025+0000","last_became_peered":"2024-04-26T12:42:34.016025+0000","last_unstale":"2024-04-26T12:42:41.066786+0000","last_undegraded":"2024-04-26T12:42:41.066786+0000","last_fullsized":"2024-04-26T12:42:41.066786+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:55.436710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'31","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123102+0000","last_change":"2024-04-26T12:42:21.947248+0000","last_active":"2024-04-26T12:42:42.123102+0000","last_peered":"2024-04-26T12:42:42.123102+0000","last_clean":"2024-04-26T12:42:42.123102+0000","last_became_active":"2024-04-26T12:42:21.946477+0000","last_became_peered":"2024-04-26T12:42:21.946477+0000","last_unstale":"2024-04-26T12:42:42.123102+0000","last_undegraded":"2024-04-26T12:42:42.123102+0000","last_fullsized":"2024-04-26T12:42:42.123102+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.347007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069100+0000","last_change":"2024-04-26T12:42:21.958105+0000","last_active":"2024-04-26T12:42:41.069100+0000","last_peered":"2024-04-26T12:42:41.069100+0000","last_clean":"2024-04-26T12:42:41.069100+0000","last_became_active":"2024-04-26T12:42:21.956507+0000","last_became_peered":"2024-04-26T12:42:21.956507+0000","last_unstale":"2024-04-26T12:42:41.069100+0000","last_undegraded":"2024-04-26T12:42:41.069100+0000","last_fullsized":"2024-04-26T12:42:41.069100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'25","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513970+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:42:42.513970+0000","last_peered":"2024-04-26T12:42:42.513970+0000","last_clean":"2024-04-26T12:42:42.513970+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:42:42.513970+0000","last_undegraded":"2024-04-26T12:42:42.513970+0000","last_fullsized":"2024-04-26T12:42:42.513970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520555+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:42:42.520555+0000","last_peered":"2024-04-26T12:42:42.520555+0000","last_clean":"2024-04-26T12:42:42.520555+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:42:42.520555+0000","last_undegraded":"2024-04-26T12:42:42.520555+0000","last_fullsized":"2024-04-26T12:42:42.520555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'25","reported_seq":228,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975912+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:42:41.975912+0000","last_peered":"2024-04-26T12:42:41.975912+0000","last_clean":"2024-04-26T12:42:41.975912+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:42:41.975912+0000","last_undegraded":"2024-04-26T12:42:41.975912+0000","last_fullsized":"2024-04-26T12:42:41.975912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":122,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066858+0000","last_change":"2024-04-26T12:42:34.007918+0000","last_active":"2024-04-26T12:42:41.066858+0000","last_peered":"2024-04-26T12:42:41.066858+0000","last_clean":"2024-04-26T12:42:41.066858+0000","last_became_active":"2024-04-26T12:42:34.006179+0000","last_became_peered":"2024-04-26T12:42:34.006179+0000","last_unstale":"2024-04-26T12:42:41.066858+0000","last_undegraded":"2024-04-26T12:42:41.066858+0000","last_fullsized":"2024-04-26T12:42:41.066858+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:13.173789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'22","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513774+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:42:42.513774+0000","last_peered":"2024-04-26T12:42:42.513774+0000","last_clean":"2024-04-26T12:42:42.513774+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:42:42.513774+0000","last_undegraded":"2024-04-26T12:42:42.513774+0000","last_fullsized":"2024-04-26T12:42:42.513774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123326+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:42:42.123326+0000","last_peered":"2024-04-26T12:42:42.123326+0000","last_clean":"2024-04-26T12:42:42.123326+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:42:42.123326+0000","last_undegraded":"2024-04-26T12:42:42.123326+0000","last_fullsized":"2024-04-26T12:42:42.123326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"117'13","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067810+0000","last_change":"2024-04-26T12:42:21.952625+0000","last_active":"2024-04-26T12:42:41.067810+0000","last_peered":"2024-04-26T12:42:41.067810+0000","last_clean":"2024-04-26T12:42:41.067810+0000","last_became_active":"2024-04-26T12:42:21.948971+0000","last_became_peered":"2024-04-26T12:42:21.948971+0000","last_unstale":"2024-04-26T12:42:41.067810+0000","last_undegraded":"2024-04-26T12:42:41.067810+0000","last_fullsized":"2024-04-26T12:42:41.067810+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:55.735297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977969+0000","last_change":"2024-04-26T12:42:21.965782+0000","last_active":"2024-04-26T12:42:41.977969+0000","last_peered":"2024-04-26T12:42:41.977969+0000","last_clean":"2024-04-26T12:42:41.977969+0000","last_became_active":"2024-04-26T12:42:21.964820+0000","last_became_peered":"2024-04-26T12:42:21.964820+0000","last_unstale":"2024-04-26T12:42:41.977969+0000","last_undegraded":"2024-04-26T12:42:41.977969+0000","last_fullsized":"2024-04-26T12:42:41.977969+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:07.092768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":168,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066034+0000","last_change":"2024-04-26T12:42:34.005982+0000","last_active":"2024-04-26T12:42:41.066034+0000","last_peered":"2024-04-26T12:42:41.066034+0000","last_clean":"2024-04-26T12:42:41.066034+0000","last_became_active":"2024-04-26T12:42:34.003575+0000","last_became_peered":"2024-04-26T12:42:34.003575+0000","last_unstale":"2024-04-26T12:42:41.066034+0000","last_undegraded":"2024-04-26T12:42:41.066034+0000","last_fullsized":"2024-04-26T12:42:41.066034+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:19.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'25","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516034+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:42:42.516034+0000","last_peered":"2024-04-26T12:42:42.516034+0000","last_clean":"2024-04-26T12:42:42.516034+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:42:42.516034+0000","last_undegraded":"2024-04-26T12:42:42.516034+0000","last_fullsized":"2024-04-26T12:42:42.516034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"117'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518358+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:42:42.518358+0000","last_peered":"2024-04-26T12:42:42.518358+0000","last_clean":"2024-04-26T12:42:42.518358+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:42:42.518358+0000","last_undegraded":"2024-04-26T12:42:42.518358+0000","last_fullsized":"2024-04-26T12:42:42.518358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"115'35","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516148+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:42:42.516148+0000","last_peered":"2024-04-26T12:42:42.516148+0000","last_clean":"2024-04-26T12:42:42.516148+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:42:42.516148+0000","last_undegraded":"2024-04-26T12:42:42.516148+0000","last_fullsized":"2024-04-26T12:42:42.516148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":45,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122421+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:42:42.122421+0000","last_peered":"2024-04-26T12:42:42.122421+0000","last_clean":"2024-04-26T12:42:42.122421+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:42:42.122421+0000","last_undegraded":"2024-04-26T12:42:42.122421+0000","last_fullsized":"2024-04-26T12:42:42.122421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'28","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515382+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:42:42.515382+0000","last_peered":"2024-04-26T12:42:42.515382+0000","last_clean":"2024-04-26T12:42:42.515382+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:42:42.515382+0000","last_undegraded":"2024-04-26T12:42:42.515382+0000","last_fullsized":"2024-04-26T12:42:42.515382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976530+0000","last_change":"2024-04-26T12:42:21.957465+0000","last_active":"2024-04-26T12:42:41.976530+0000","last_peered":"2024-04-26T12:42:41.976530+0000","last_clean":"2024-04-26T12:42:41.976530+0000","last_became_active":"2024-04-26T12:42:21.956566+0000","last_became_peered":"2024-04-26T12:42:21.956566+0000","last_unstale":"2024-04-26T12:42:41.976530+0000","last_undegraded":"2024-04-26T12:42:41.976530+0000","last_fullsized":"2024-04-26T12:42:41.976530+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:30.300637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"115'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066651+0000","last_change":"2024-04-26T12:42:34.024102+0000","last_active":"2024-04-26T12:42:41.066651+0000","last_peered":"2024-04-26T12:42:41.066651+0000","last_clean":"2024-04-26T12:42:41.066651+0000","last_became_active":"2024-04-26T12:42:34.022426+0000","last_became_peered":"2024-04-26T12:42:34.022426+0000","last_unstale":"2024-04-26T12:42:41.066651+0000","last_undegraded":"2024-04-26T12:42:41.066651+0000","last_fullsized":"2024-04-26T12:42:41.066651+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:21.509191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976221+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:42:41.976221+0000","last_peered":"2024-04-26T12:42:41.976221+0000","last_clean":"2024-04-26T12:42:41.976221+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:42:41.976221+0000","last_undegraded":"2024-04-26T12:42:41.976221+0000","last_fullsized":"2024-04-26T12:42:41.976221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'21","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070281+0000","last_change":"2024-04-26T12:42:21.946507+0000","last_active":"2024-04-26T12:42:41.070281+0000","last_peered":"2024-04-26T12:42:41.070281+0000","last_clean":"2024-04-26T12:42:41.070281+0000","last_became_active":"2024-04-26T12:42:21.932303+0000","last_became_peered":"2024-04-26T12:42:21.932303+0000","last_unstale":"2024-04-26T12:42:41.070281+0000","last_undegraded":"2024-04-26T12:42:41.070281+0000","last_fullsized":"2024-04-26T12:42:41.070281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:48.132898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":113,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066875+0000","last_change":"2024-04-26T12:42:34.027080+0000","last_active":"2024-04-26T12:42:41.066875+0000","last_peered":"2024-04-26T12:42:41.066875+0000","last_clean":"2024-04-26T12:42:41.066875+0000","last_became_active":"2024-04-26T12:42:34.025281+0000","last_became_peered":"2024-04-26T12:42:34.025281+0000","last_unstale":"2024-04-26T12:42:41.066875+0000","last_undegraded":"2024-04-26T12:42:41.066875+0000","last_fullsized":"2024-04-26T12:42:41.066875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:16.292958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"115'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069550+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:42:41.069550+0000","last_peered":"2024-04-26T12:42:41.069550+0000","last_clean":"2024-04-26T12:42:41.069550+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:42:41.069550+0000","last_undegraded":"2024-04-26T12:42:41.069550+0000","last_fullsized":"2024-04-26T12:42:41.069550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065496+0000","last_change":"2024-04-26T12:42:34.014303+0000","last_active":"2024-04-26T12:42:41.065496+0000","last_peered":"2024-04-26T12:42:41.065496+0000","last_clean":"2024-04-26T12:42:41.065496+0000","last_became_active":"2024-04-26T12:42:34.013263+0000","last_became_peered":"2024-04-26T12:42:34.013263+0000","last_unstale":"2024-04-26T12:42:41.065496+0000","last_undegraded":"2024-04-26T12:42:41.065496+0000","last_fullsized":"2024-04-26T12:42:41.065496+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:35.131864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072787+0000","last_change":"2024-04-26T12:42:21.967042+0000","last_active":"2024-04-26T12:42:41.072787+0000","last_peered":"2024-04-26T12:42:41.072787+0000","last_clean":"2024-04-26T12:42:41.072787+0000","last_became_active":"2024-04-26T12:42:21.961909+0000","last_became_peered":"2024-04-26T12:42:21.961909+0000","last_unstale":"2024-04-26T12:42:41.072787+0000","last_undegraded":"2024-04-26T12:42:41.072787+0000","last_fullsized":"2024-04-26T12:42:41.072787+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:33.810933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'18","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513868+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:42:42.513868+0000","last_peered":"2024-04-26T12:42:42.513868+0000","last_clean":"2024-04-26T12:42:42.513868+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:42:42.513868+0000","last_undegraded":"2024-04-26T12:42:42.513868+0000","last_fullsized":"2024-04-26T12:42:42.513868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122848+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:42:42.122848+0000","last_peered":"2024-04-26T12:42:42.122848+0000","last_clean":"2024-04-26T12:42:42.122848+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:42:42.122848+0000","last_undegraded":"2024-04-26T12:42:42.122848+0000","last_fullsized":"2024-04-26T12:42:42.122848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070613+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:42:41.070613+0000","last_peered":"2024-04-26T12:42:41.070613+0000","last_clean":"2024-04-26T12:42:41.070613+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:42:41.070613+0000","last_undegraded":"2024-04-26T12:42:41.070613+0000","last_fullsized":"2024-04-26T12:42:41.070613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516269+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:42:42.516269+0000","last_peered":"2024-04-26T12:42:42.516269+0000","last_clean":"2024-04-26T12:42:42.516269+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:42:42.516269+0000","last_undegraded":"2024-04-26T12:42:42.516269+0000","last_fullsized":"2024-04-26T12:42:42.516269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"117'48","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121554+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:42:42.121554+0000","last_peered":"2024-04-26T12:42:42.121554+0000","last_clean":"2024-04-26T12:42:42.121554+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:42:42.121554+0000","last_undegraded":"2024-04-26T12:42:42.121554+0000","last_fullsized":"2024-04-26T12:42:42.121554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123831+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:42:42.123831+0000","last_peered":"2024-04-26T12:42:42.123831+0000","last_clean":"2024-04-26T12:42:42.123831+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:42:42.123831+0000","last_undegraded":"2024-04-26T12:42:42.123831+0000","last_fullsized":"2024-04-26T12:42:42.123831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'34","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069854+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:42:41.069854+0000","last_peered":"2024-04-26T12:42:41.069854+0000","last_clean":"2024-04-26T12:42:41.069854+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:42:41.069854+0000","last_undegraded":"2024-04-26T12:42:41.069854+0000","last_fullsized":"2024-04-26T12:42:41.069854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074395+0000","last_change":"2024-04-26T12:42:21.970469+0000","last_active":"2024-04-26T12:42:41.074395+0000","last_peered":"2024-04-26T12:42:41.074395+0000","last_clean":"2024-04-26T12:42:41.074395+0000","last_became_active":"2024-04-26T12:42:21.968825+0000","last_became_peered":"2024-04-26T12:42:21.968825+0000","last_unstale":"2024-04-26T12:42:41.074395+0000","last_undegraded":"2024-04-26T12:42:41.074395+0000","last_fullsized":"2024-04-26T12:42:41.074395+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:54.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":55,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066772+0000","last_change":"2024-04-26T12:42:34.021039+0000","last_active":"2024-04-26T12:42:41.066772+0000","last_peered":"2024-04-26T12:42:41.066772+0000","last_clean":"2024-04-26T12:42:41.066772+0000","last_became_active":"2024-04-26T12:42:34.018809+0000","last_became_peered":"2024-04-26T12:42:34.018809+0000","last_unstale":"2024-04-26T12:42:41.066772+0000","last_undegraded":"2024-04-26T12:42:41.066772+0000","last_fullsized":"2024-04-26T12:42:41.066772+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066660+0000","last_change":"2024-04-26T12:42:34.007481+0000","last_active":"2024-04-26T12:42:41.066660+0000","last_peered":"2024-04-26T12:42:41.066660+0000","last_clean":"2024-04-26T12:42:41.066660+0000","last_became_active":"2024-04-26T12:42:34.004534+0000","last_became_peered":"2024-04-26T12:42:34.004534+0000","last_unstale":"2024-04-26T12:42:41.066660+0000","last_undegraded":"2024-04-26T12:42:41.066660+0000","last_fullsized":"2024-04-26T12:42:41.066660+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:33.240125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068768+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:42:41.068768+0000","last_peered":"2024-04-26T12:42:41.068768+0000","last_clean":"2024-04-26T12:42:41.068768+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:42:41.068768+0000","last_undegraded":"2024-04-26T12:42:41.068768+0000","last_fullsized":"2024-04-26T12:42:41.068768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072461+0000","last_change":"2024-04-26T12:42:21.937320+0000","last_active":"2024-04-26T12:42:41.072461+0000","last_peered":"2024-04-26T12:42:41.072461+0000","last_clean":"2024-04-26T12:42:41.072461+0000","last_became_active":"2024-04-26T12:42:21.936393+0000","last_became_peered":"2024-04-26T12:42:21.936393+0000","last_unstale":"2024-04-26T12:42:41.072461+0000","last_undegraded":"2024-04-26T12:42:41.072461+0000","last_fullsized":"2024-04-26T12:42:41.072461+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:21.787788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"115'21","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513709+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:42:42.513709+0000","last_peered":"2024-04-26T12:42:42.513709+0000","last_clean":"2024-04-26T12:42:42.513709+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:42:42.513709+0000","last_undegraded":"2024-04-26T12:42:42.513709+0000","last_fullsized":"2024-04-26T12:42:42.513709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074226+0000","last_change":"2024-04-26T12:42:21.961567+0000","last_active":"2024-04-26T12:42:41.074226+0000","last_peered":"2024-04-26T12:42:41.074226+0000","last_clean":"2024-04-26T12:42:41.074226+0000","last_became_active":"2024-04-26T12:42:21.957657+0000","last_became_peered":"2024-04-26T12:42:21.957657+0000","last_unstale":"2024-04-26T12:42:41.074226+0000","last_undegraded":"2024-04-26T12:42:41.074226+0000","last_fullsized":"2024-04-26T12:42:41.074226+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:50.723405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975984+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:42:41.975984+0000","last_peered":"2024-04-26T12:42:41.975984+0000","last_clean":"2024-04-26T12:42:41.975984+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:42:41.975984+0000","last_undegraded":"2024-04-26T12:42:41.975984+0000","last_fullsized":"2024-04-26T12:42:41.975984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"117'134","reported_seq":498,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515253+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:42:42.515253+0000","last_peered":"2024-04-26T12:42:42.515253+0000","last_clean":"2024-04-26T12:42:42.515253+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:42:42.515253+0000","last_undegraded":"2024-04-26T12:42:42.515253+0000","last_fullsized":"2024-04-26T12:42:42.515253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066020+0000","last_change":"2024-04-26T12:42:34.015888+0000","last_active":"2024-04-26T12:42:41.066020+0000","last_peered":"2024-04-26T12:42:41.066020+0000","last_clean":"2024-04-26T12:42:41.066020+0000","last_became_active":"2024-04-26T12:42:34.015101+0000","last_became_peered":"2024-04-26T12:42:34.015101+0000","last_unstale":"2024-04-26T12:42:41.066020+0000","last_undegraded":"2024-04-26T12:42:41.066020+0000","last_fullsized":"2024-04-26T12:42:41.066020+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:23.606728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074777+0000","last_change":"2024-04-26T12:42:21.971692+0000","last_active":"2024-04-26T12:42:41.074777+0000","last_peered":"2024-04-26T12:42:41.074777+0000","last_clean":"2024-04-26T12:42:41.074777+0000","last_became_active":"2024-04-26T12:42:21.970815+0000","last_became_peered":"2024-04-26T12:42:21.970815+0000","last_unstale":"2024-04-26T12:42:41.074777+0000","last_undegraded":"2024-04-26T12:42:41.074777+0000","last_fullsized":"2024-04-26T12:42:41.074777+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:03.033305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'28","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513771+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:42:42.513771+0000","last_peered":"2024-04-26T12:42:42.513771+0000","last_clean":"2024-04-26T12:42:42.513771+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:42:42.513771+0000","last_undegraded":"2024-04-26T12:42:42.513771+0000","last_fullsized":"2024-04-26T12:42:42.513771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123181+0000","last_change":"2024-04-26T12:42:21.926752+0000","last_active":"2024-04-26T12:42:42.123181+0000","last_peered":"2024-04-26T12:42:42.123181+0000","last_clean":"2024-04-26T12:42:42.123181+0000","last_became_active":"2024-04-26T12:42:21.926086+0000","last_became_peered":"2024-04-26T12:42:21.926086+0000","last_unstale":"2024-04-26T12:42:42.123181+0000","last_undegraded":"2024-04-26T12:42:42.123181+0000","last_fullsized":"2024-04-26T12:42:42.123181+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.645084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"117'17","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518589+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:42:42.518589+0000","last_peered":"2024-04-26T12:42:42.518589+0000","last_clean":"2024-04-26T12:42:42.518589+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:42:42.518589+0000","last_undegraded":"2024-04-26T12:42:42.518589+0000","last_fullsized":"2024-04-26T12:42:42.518589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"123'136","reported_seq":412,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073796+0000","last_change":"2024-04-26T12:42:21.973003+0000","last_active":"2024-04-26T12:42:41.073796+0000","last_peered":"2024-04-26T12:42:41.073796+0000","last_clean":"2024-04-26T12:42:41.073796+0000","last_became_active":"2024-04-26T12:42:21.972298+0000","last_became_peered":"2024-04-26T12:42:21.972298+0000","last_unstale":"2024-04-26T12:42:41.073796+0000","last_undegraded":"2024-04-26T12:42:41.073796+0000","last_fullsized":"2024-04-26T12:42:41.073796+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:09.716281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122553+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:42:42.122553+0000","last_peered":"2024-04-26T12:42:42.122553+0000","last_clean":"2024-04-26T12:42:42.122553+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:42:42.122553+0000","last_undegraded":"2024-04-26T12:42:42.122553+0000","last_fullsized":"2024-04-26T12:42:42.122553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"115'24","reported_seq":227,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977649+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:42:41.977649+0000","last_peered":"2024-04-26T12:42:41.977649+0000","last_clean":"2024-04-26T12:42:41.977649+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:42:41.977649+0000","last_undegraded":"2024-04-26T12:42:41.977649+0000","last_fullsized":"2024-04-26T12:42:41.977649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517468+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:42:42.517468+0000","last_peered":"2024-04-26T12:42:42.517468+0000","last_clean":"2024-04-26T12:42:42.517468+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:42:42.517468+0000","last_undegraded":"2024-04-26T12:42:42.517468+0000","last_fullsized":"2024-04-26T12:42:42.517468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"117'27","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121597+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:42:42.121597+0000","last_peered":"2024-04-26T12:42:42.121597+0000","last_clean":"2024-04-26T12:42:42.121597+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:42:42.121597+0000","last_undegraded":"2024-04-26T12:42:42.121597+0000","last_fullsized":"2024-04-26T12:42:42.121597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408696+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:42:41.408696+0000","last_peered":"2024-04-26T12:42:41.408696+0000","last_clean":"2024-04-26T12:42:41.408696+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:42:41.408696+0000","last_undegraded":"2024-04-26T12:42:41.408696+0000","last_fullsized":"2024-04-26T12:42:41.408696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121946+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:42:42.121946+0000","last_peered":"2024-04-26T12:42:42.121946+0000","last_clean":"2024-04-26T12:42:42.121946+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:42:42.121946+0000","last_undegraded":"2024-04-26T12:42:42.121946+0000","last_fullsized":"2024-04-26T12:42:42.121946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065995+0000","last_change":"2024-04-26T12:42:34.029770+0000","last_active":"2024-04-26T12:42:41.065995+0000","last_peered":"2024-04-26T12:42:41.065995+0000","last_clean":"2024-04-26T12:42:41.065995+0000","last_became_active":"2024-04-26T12:42:34.027515+0000","last_became_peered":"2024-04-26T12:42:34.027515+0000","last_unstale":"2024-04-26T12:42:41.065995+0000","last_undegraded":"2024-04-26T12:42:41.065995+0000","last_fullsized":"2024-04-26T12:42:41.065995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:24.498714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'20","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515684+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:42:42.515684+0000","last_peered":"2024-04-26T12:42:42.515684+0000","last_clean":"2024-04-26T12:42:42.515684+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:42:42.515684+0000","last_undegraded":"2024-04-26T12:42:42.515684+0000","last_fullsized":"2024-04-26T12:42:42.515684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975908+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:42:41.975908+0000","last_peered":"2024-04-26T12:42:41.975908+0000","last_clean":"2024-04-26T12:42:41.975908+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:42:41.975908+0000","last_undegraded":"2024-04-26T12:42:41.975908+0000","last_fullsized":"2024-04-26T12:42:41.975908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"117'19","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068371+0000","last_change":"2024-04-26T12:42:21.974974+0000","last_active":"2024-04-26T12:42:41.068371+0000","last_peered":"2024-04-26T12:42:41.068371+0000","last_clean":"2024-04-26T12:42:41.068371+0000","last_became_active":"2024-04-26T12:42:21.968492+0000","last_became_peered":"2024-04-26T12:42:21.968492+0000","last_unstale":"2024-04-26T12:42:41.068371+0000","last_undegraded":"2024-04-26T12:42:41.068371+0000","last_fullsized":"2024-04-26T12:42:41.068371+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:59.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068594+0000","last_change":"2024-04-26T12:42:21.943962+0000","last_active":"2024-04-26T12:42:41.068594+0000","last_peered":"2024-04-26T12:42:41.068594+0000","last_clean":"2024-04-26T12:42:41.068594+0000","last_became_active":"2024-04-26T12:42:21.942925+0000","last_became_peered":"2024-04-26T12:42:21.942925+0000","last_unstale":"2024-04-26T12:42:41.068594+0000","last_undegraded":"2024-04-26T12:42:41.068594+0000","last_fullsized":"2024-04-26T12:42:41.068594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:17.453438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519637+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:42:42.519637+0000","last_peered":"2024-04-26T12:42:42.519637+0000","last_clean":"2024-04-26T12:42:42.519637+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:42:42.519637+0000","last_undegraded":"2024-04-26T12:42:42.519637+0000","last_fullsized":"2024-04-26T12:42:42.519637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518899+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:42:42.518899+0000","last_peered":"2024-04-26T12:42:42.518899+0000","last_clean":"2024-04-26T12:42:42.518899+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:42:42.518899+0000","last_undegraded":"2024-04-26T12:42:42.518899+0000","last_fullsized":"2024-04-26T12:42:42.518899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"114'19","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514720+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:42:42.514720+0000","last_peered":"2024-04-26T12:42:42.514720+0000","last_clean":"2024-04-26T12:42:42.514720+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:42:42.514720+0000","last_undegraded":"2024-04-26T12:42:42.514720+0000","last_fullsized":"2024-04-26T12:42:42.514720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976759+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:42:41.976759+0000","last_peered":"2024-04-26T12:42:41.976759+0000","last_clean":"2024-04-26T12:42:41.976759+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:42:41.976759+0000","last_undegraded":"2024-04-26T12:42:41.976759+0000","last_fullsized":"2024-04-26T12:42:41.976759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"117'24","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516808+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:42:42.516808+0000","last_peered":"2024-04-26T12:42:42.516808+0000","last_clean":"2024-04-26T12:42:42.516808+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:42:42.516808+0000","last_undegraded":"2024-04-26T12:42:42.516808+0000","last_fullsized":"2024-04-26T12:42:42.516808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"117'134","reported_seq":453,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070071+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:42:41.070071+0000","last_peered":"2024-04-26T12:42:41.070071+0000","last_clean":"2024-04-26T12:42:41.070071+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:42:41.070071+0000","last_undegraded":"2024-04-26T12:42:41.070071+0000","last_fullsized":"2024-04-26T12:42:41.070071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071038+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:42:41.071038+0000","last_peered":"2024-04-26T12:42:41.071038+0000","last_clean":"2024-04-26T12:42:41.071038+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:42:41.071038+0000","last_undegraded":"2024-04-26T12:42:41.071038+0000","last_fullsized":"2024-04-26T12:42:41.071038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072483+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:42:41.072483+0000","last_peered":"2024-04-26T12:42:41.072483+0000","last_clean":"2024-04-26T12:42:41.072483+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:42:41.072483+0000","last_undegraded":"2024-04-26T12:42:41.072483+0000","last_fullsized":"2024-04-26T12:42:41.072483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'18","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122964+0000","last_change":"2024-04-26T12:42:21.959737+0000","last_active":"2024-04-26T12:42:42.122964+0000","last_peered":"2024-04-26T12:42:42.122964+0000","last_clean":"2024-04-26T12:42:42.122964+0000","last_became_active":"2024-04-26T12:42:21.959122+0000","last_became_peered":"2024-04-26T12:42:21.959122+0000","last_unstale":"2024-04-26T12:42:42.122964+0000","last_undegraded":"2024-04-26T12:42:42.122964+0000","last_fullsized":"2024-04-26T12:42:42.122964+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:53.425209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976180+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:42:41.976180+0000","last_peered":"2024-04-26T12:42:41.976180+0000","last_clean":"2024-04-26T12:42:41.976180+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:42:41.976180+0000","last_undegraded":"2024-04-26T12:42:41.976180+0000","last_fullsized":"2024-04-26T12:42:41.976180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"117'29","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070847+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:42:41.070847+0000","last_peered":"2024-04-26T12:42:41.070847+0000","last_clean":"2024-04-26T12:42:41.070847+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:42:41.070847+0000","last_undegraded":"2024-04-26T12:42:41.070847+0000","last_fullsized":"2024-04-26T12:42:41.070847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975732+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:42:41.975732+0000","last_peered":"2024-04-26T12:42:41.975732+0000","last_clean":"2024-04-26T12:42:41.975732+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:42:41.975732+0000","last_undegraded":"2024-04-26T12:42:41.975732+0000","last_fullsized":"2024-04-26T12:42:41.975732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'7","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409967+0000","last_change":"2024-04-26T12:42:21.935665+0000","last_active":"2024-04-26T12:42:41.409967+0000","last_peered":"2024-04-26T12:42:41.409967+0000","last_clean":"2024-04-26T12:42:41.409967+0000","last_became_active":"2024-04-26T12:42:21.934686+0000","last_became_peered":"2024-04-26T12:42:21.934686+0000","last_unstale":"2024-04-26T12:42:41.409967+0000","last_undegraded":"2024-04-26T12:42:41.409967+0000","last_fullsized":"2024-04-26T12:42:41.409967+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:39.070102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"117'4","reported_seq":230,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067873+0000","last_change":"2024-04-26T12:42:34.032506+0000","last_active":"2024-04-26T12:42:41.067873+0000","last_peered":"2024-04-26T12:42:41.067873+0000","last_clean":"2024-04-26T12:42:41.067873+0000","last_became_active":"2024-04-26T12:42:34.031776+0000","last_became_peered":"2024-04-26T12:42:34.031776+0000","last_unstale":"2024-04-26T12:42:41.067873+0000","last_undegraded":"2024-04-26T12:42:41.067873+0000","last_fullsized":"2024-04-26T12:42:41.067873+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:40.297834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'26","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069641+0000","last_change":"2024-04-26T12:42:21.974477+0000","last_active":"2024-04-26T12:42:41.069641+0000","last_peered":"2024-04-26T12:42:41.069641+0000","last_clean":"2024-04-26T12:42:41.069641+0000","last_became_active":"2024-04-26T12:42:21.967072+0000","last_became_peered":"2024-04-26T12:42:21.967072+0000","last_unstale":"2024-04-26T12:42:41.069641+0000","last_undegraded":"2024-04-26T12:42:41.069641+0000","last_fullsized":"2024-04-26T12:42:41.069641+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.202160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976283+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:42:41.976283+0000","last_peered":"2024-04-26T12:42:41.976283+0000","last_clean":"2024-04-26T12:42:41.976283+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:42:41.976283+0000","last_undegraded":"2024-04-26T12:42:41.976283+0000","last_fullsized":"2024-04-26T12:42:41.976283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"117'19","reported_seq":65,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066738+0000","last_change":"2024-04-26T12:42:34.028589+0000","last_active":"2024-04-26T12:42:41.066738+0000","last_peered":"2024-04-26T12:42:41.066738+0000","last_clean":"2024-04-26T12:42:41.066738+0000","last_became_active":"2024-04-26T12:42:34.027524+0000","last_became_peered":"2024-04-26T12:42:34.027524+0000","last_unstale":"2024-04-26T12:42:41.066738+0000","last_undegraded":"2024-04-26T12:42:41.066738+0000","last_fullsized":"2024-04-26T12:42:41.066738+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:11.088686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069873+0000","last_change":"2024-04-26T12:42:21.938337+0000","last_active":"2024-04-26T12:42:41.069873+0000","last_peered":"2024-04-26T12:42:41.069873+0000","last_clean":"2024-04-26T12:42:41.069873+0000","last_became_active":"2024-04-26T12:42:21.937057+0000","last_became_peered":"2024-04-26T12:42:21.937057+0000","last_unstale":"2024-04-26T12:42:41.069873+0000","last_undegraded":"2024-04-26T12:42:41.069873+0000","last_fullsized":"2024-04-26T12:42:41.069873+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:16.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072835+0000","last_change":"2024-04-26T12:42:21.957634+0000","last_active":"2024-04-26T12:42:41.072835+0000","last_peered":"2024-04-26T12:42:41.072835+0000","last_clean":"2024-04-26T12:42:41.072835+0000","last_became_active":"2024-04-26T12:42:21.948878+0000","last_became_peered":"2024-04-26T12:42:21.948878+0000","last_unstale":"2024-04-26T12:42:41.072835+0000","last_undegraded":"2024-04-26T12:42:41.072835+0000","last_fullsized":"2024-04-26T12:42:41.072835+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:38.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067852+0000","last_change":"2024-04-26T12:42:34.019680+0000","last_active":"2024-04-26T12:42:41.067852+0000","last_peered":"2024-04-26T12:42:41.067852+0000","last_clean":"2024-04-26T12:42:41.067852+0000","last_became_active":"2024-04-26T12:42:34.018540+0000","last_became_peered":"2024-04-26T12:42:34.018540+0000","last_unstale":"2024-04-26T12:42:41.067852+0000","last_undegraded":"2024-04-26T12:42:41.067852+0000","last_fullsized":"2024-04-26T12:42:41.067852+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:44.798659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'20","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514187+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:42:42.514187+0000","last_peered":"2024-04-26T12:42:42.514187+0000","last_clean":"2024-04-26T12:42:42.514187+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:42:42.514187+0000","last_undegraded":"2024-04-26T12:42:42.514187+0000","last_fullsized":"2024-04-26T12:42:42.514187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408746+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:42:41.408746+0000","last_peered":"2024-04-26T12:42:41.408746+0000","last_clean":"2024-04-26T12:42:41.408746+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:42:41.408746+0000","last_undegraded":"2024-04-26T12:42:41.408746+0000","last_fullsized":"2024-04-26T12:42:41.408746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"117'23","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977811+0000","last_change":"2024-04-26T12:42:21.959840+0000","last_active":"2024-04-26T12:42:41.977811+0000","last_peered":"2024-04-26T12:42:41.977811+0000","last_clean":"2024-04-26T12:42:41.977811+0000","last_became_active":"2024-04-26T12:42:21.958977+0000","last_became_peered":"2024-04-26T12:42:21.958977+0000","last_unstale":"2024-04-26T12:42:41.977811+0000","last_undegraded":"2024-04-26T12:42:41.977811+0000","last_fullsized":"2024-04-26T12:42:41.977811+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:54.837056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"117'134","reported_seq":437,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976564+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:42:41.976564+0000","last_peered":"2024-04-26T12:42:41.976564+0000","last_clean":"2024-04-26T12:42:41.976564+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:42:41.976564+0000","last_undegraded":"2024-04-26T12:42:41.976564+0000","last_fullsized":"2024-04-26T12:42:41.976564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408500+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:42:41.408500+0000","last_peered":"2024-04-26T12:42:41.408500+0000","last_clean":"2024-04-26T12:42:41.408500+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:42:41.408500+0000","last_undegraded":"2024-04-26T12:42:41.408500+0000","last_fullsized":"2024-04-26T12:42:41.408500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":180,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068000+0000","last_change":"2024-04-26T12:42:34.026595+0000","last_active":"2024-04-26T12:42:41.068000+0000","last_peered":"2024-04-26T12:42:41.068000+0000","last_clean":"2024-04-26T12:42:41.068000+0000","last_became_active":"2024-04-26T12:42:34.025094+0000","last_became_peered":"2024-04-26T12:42:34.025094+0000","last_unstale":"2024-04-26T12:42:41.068000+0000","last_undegraded":"2024-04-26T12:42:41.068000+0000","last_fullsized":"2024-04-26T12:42:41.068000+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:15.877357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"117'35","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066995+0000","last_change":"2024-04-26T12:42:34.021002+0000","last_active":"2024-04-26T12:42:41.066995+0000","last_peered":"2024-04-26T12:42:41.066995+0000","last_clean":"2024-04-26T12:42:41.066995+0000","last_became_active":"2024-04-26T12:42:34.019821+0000","last_became_peered":"2024-04-26T12:42:34.019821+0000","last_unstale":"2024-04-26T12:42:41.066995+0000","last_undegraded":"2024-04-26T12:42:41.066995+0000","last_fullsized":"2024-04-26T12:42:41.066995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:02.705267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":425,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122873+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:42:42.122873+0000","last_peered":"2024-04-26T12:42:42.122873+0000","last_clean":"2024-04-26T12:42:42.122873+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:42:42.122873+0000","last_undegraded":"2024-04-26T12:42:42.122873+0000","last_fullsized":"2024-04-26T12:42:42.122873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073443+0000","last_change":"2024-04-26T12:42:21.962837+0000","last_active":"2024-04-26T12:42:41.073443+0000","last_peered":"2024-04-26T12:42:41.073443+0000","last_clean":"2024-04-26T12:42:41.073443+0000","last_became_active":"2024-04-26T12:42:21.952480+0000","last_became_peered":"2024-04-26T12:42:21.952480+0000","last_unstale":"2024-04-26T12:42:41.073443+0000","last_undegraded":"2024-04-26T12:42:41.073443+0000","last_fullsized":"2024-04-26T12:42:41.073443+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:55.807987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"117'134","reported_seq":469,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515677+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:42:42.515677+0000","last_peered":"2024-04-26T12:42:42.515677+0000","last_clean":"2024-04-26T12:42:42.515677+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:42:42.515677+0000","last_undegraded":"2024-04-26T12:42:42.515677+0000","last_fullsized":"2024-04-26T12:42:42.515677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066666+0000","last_change":"2024-04-26T12:42:34.020098+0000","last_active":"2024-04-26T12:42:41.066666+0000","last_peered":"2024-04-26T12:42:41.066666+0000","last_clean":"2024-04-26T12:42:41.066666+0000","last_became_active":"2024-04-26T12:42:34.015095+0000","last_became_peered":"2024-04-26T12:42:34.015095+0000","last_unstale":"2024-04-26T12:42:41.066666+0000","last_undegraded":"2024-04-26T12:42:41.066666+0000","last_fullsized":"2024-04-26T12:42:41.066666+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:05.746648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410249+0000","last_change":"2024-04-26T12:42:21.953982+0000","last_active":"2024-04-26T12:42:41.410249+0000","last_peered":"2024-04-26T12:42:41.410249+0000","last_clean":"2024-04-26T12:42:41.410249+0000","last_became_active":"2024-04-26T12:42:21.953253+0000","last_became_peered":"2024-04-26T12:42:21.953253+0000","last_unstale":"2024-04-26T12:42:41.410249+0000","last_undegraded":"2024-04-26T12:42:41.410249+0000","last_fullsized":"2024-04-26T12:42:41.410249+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:24.067594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"115'20","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067138+0000","last_change":"2024-04-26T12:42:21.949610+0000","last_active":"2024-04-26T12:42:41.067138+0000","last_peered":"2024-04-26T12:42:41.067138+0000","last_clean":"2024-04-26T12:42:41.067138+0000","last_became_active":"2024-04-26T12:42:21.940512+0000","last_became_peered":"2024-04-26T12:42:21.940512+0000","last_unstale":"2024-04-26T12:42:41.067138+0000","last_undegraded":"2024-04-26T12:42:41.067138+0000","last_fullsized":"2024-04-26T12:42:41.067138+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:19.966458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067393+0000","last_change":"2024-04-26T12:42:34.007412+0000","last_active":"2024-04-26T12:42:41.067393+0000","last_peered":"2024-04-26T12:42:41.067393+0000","last_clean":"2024-04-26T12:42:41.067393+0000","last_became_active":"2024-04-26T12:42:34.005897+0000","last_became_peered":"2024-04-26T12:42:34.005897+0000","last_unstale":"2024-04-26T12:42:41.067393+0000","last_undegraded":"2024-04-26T12:42:41.067393+0000","last_fullsized":"2024-04-26T12:42:41.067393+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:22.483984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"117'26","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123026+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:42:42.123026+0000","last_peered":"2024-04-26T12:42:42.123026+0000","last_clean":"2024-04-26T12:42:42.123026+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:42:42.123026+0000","last_undegraded":"2024-04-26T12:42:42.123026+0000","last_fullsized":"2024-04-26T12:42:42.123026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520121+0000","last_change":"2024-04-26T12:42:21.947536+0000","last_active":"2024-04-26T12:42:42.520121+0000","last_peered":"2024-04-26T12:42:42.520121+0000","last_clean":"2024-04-26T12:42:42.520121+0000","last_became_active":"2024-04-26T12:42:21.946663+0000","last_became_peered":"2024-04-26T12:42:21.946663+0000","last_unstale":"2024-04-26T12:42:42.520121+0000","last_undegraded":"2024-04-26T12:42:42.520121+0000","last_fullsized":"2024-04-26T12:42:42.520121+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:31.336436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":232,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408441+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:42:41.408441+0000","last_peered":"2024-04-26T12:42:41.408441+0000","last_clean":"2024-04-26T12:42:41.408441+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:42:41.408441+0000","last_undegraded":"2024-04-26T12:42:41.408441+0000","last_fullsized":"2024-04-26T12:42:41.408441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520346+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:42:42.520346+0000","last_peered":"2024-04-26T12:42:42.520346+0000","last_clean":"2024-04-26T12:42:42.520346+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:42:42.520346+0000","last_undegraded":"2024-04-26T12:42:42.520346+0000","last_fullsized":"2024-04-26T12:42:42.520346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":406,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516883+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:42:42.516883+0000","last_peered":"2024-04-26T12:42:42.516883+0000","last_clean":"2024-04-26T12:42:42.516883+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:42:42.516883+0000","last_undegraded":"2024-04-26T12:42:42.516883+0000","last_fullsized":"2024-04-26T12:42:42.516883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122546+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:42:42.122546+0000","last_peered":"2024-04-26T12:42:42.122546+0000","last_clean":"2024-04-26T12:42:42.122546+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:42:42.122546+0000","last_undegraded":"2024-04-26T12:42:42.122546+0000","last_fullsized":"2024-04-26T12:42:42.122546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"117'33","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067725+0000","last_change":"2024-04-26T12:42:21.931544+0000","last_active":"2024-04-26T12:42:41.067725+0000","last_peered":"2024-04-26T12:42:41.067725+0000","last_clean":"2024-04-26T12:42:41.067725+0000","last_became_active":"2024-04-26T12:42:21.929093+0000","last_became_peered":"2024-04-26T12:42:21.929093+0000","last_unstale":"2024-04-26T12:42:41.067725+0000","last_undegraded":"2024-04-26T12:42:41.067725+0000","last_fullsized":"2024-04-26T12:42:41.067725+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:06.052469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518900+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:42:42.518900+0000","last_peered":"2024-04-26T12:42:42.518900+0000","last_clean":"2024-04-26T12:42:42.518900+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:42:42.518900+0000","last_undegraded":"2024-04-26T12:42:42.518900+0000","last_fullsized":"2024-04-26T12:42:42.518900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"117'39","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123490+0000","last_change":"2024-04-26T12:42:21.932409+0000","last_active":"2024-04-26T12:42:42.123490+0000","last_peered":"2024-04-26T12:42:42.123490+0000","last_clean":"2024-04-26T12:42:42.123490+0000","last_became_active":"2024-04-26T12:42:21.931114+0000","last_became_peered":"2024-04-26T12:42:21.931114+0000","last_unstale":"2024-04-26T12:42:42.123490+0000","last_undegraded":"2024-04-26T12:42:42.123490+0000","last_fullsized":"2024-04-26T12:42:42.123490+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:31.083567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182602,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071191+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:42:41.071191+0000","last_peered":"2024-04-26T12:42:41.071191+0000","last_clean":"2024-04-26T12:42:41.071191+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:42:41.071191+0000","last_undegraded":"2024-04-26T12:42:41.071191+0000","last_fullsized":"2024-04-26T12:42:41.071191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517357+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:42:42.517357+0000","last_peered":"2024-04-26T12:42:42.517357+0000","last_clean":"2024-04-26T12:42:42.517357+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:42:42.517357+0000","last_undegraded":"2024-04-26T12:42:42.517357+0000","last_fullsized":"2024-04-26T12:42:42.517357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071947+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:42:41.071947+0000","last_peered":"2024-04-26T12:42:41.071947+0000","last_clean":"2024-04-26T12:42:41.071947+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:42:41.071947+0000","last_undegraded":"2024-04-26T12:42:41.071947+0000","last_fullsized":"2024-04-26T12:42:41.071947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516595+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:42:42.516595+0000","last_peered":"2024-04-26T12:42:42.516595+0000","last_clean":"2024-04-26T12:42:42.516595+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:42:42.516595+0000","last_undegraded":"2024-04-26T12:42:42.516595+0000","last_fullsized":"2024-04-26T12:42:42.516595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"115'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071136+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:42:41.071136+0000","last_peered":"2024-04-26T12:42:41.071136+0000","last_clean":"2024-04-26T12:42:41.071136+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:42:41.071136+0000","last_undegraded":"2024-04-26T12:42:41.071136+0000","last_fullsized":"2024-04-26T12:42:41.071136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123676+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:42:42.123676+0000","last_peered":"2024-04-26T12:42:42.123676+0000","last_clean":"2024-04-26T12:42:42.123676+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:42:42.123676+0000","last_undegraded":"2024-04-26T12:42:42.123676+0000","last_fullsized":"2024-04-26T12:42:42.123676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"117'136","reported_seq":491,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408423+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:42:41.408423+0000","last_peered":"2024-04-26T12:42:41.408423+0000","last_clean":"2024-04-26T12:42:41.408423+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:42:41.408423+0000","last_undegraded":"2024-04-26T12:42:41.408423+0000","last_fullsized":"2024-04-26T12:42:41.408423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514992+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:42:42.514992+0000","last_peered":"2024-04-26T12:42:42.514992+0000","last_clean":"2024-04-26T12:42:42.514992+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:42:42.514992+0000","last_undegraded":"2024-04-26T12:42:42.514992+0000","last_fullsized":"2024-04-26T12:42:42.514992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"117'2","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408083+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:42:41.408083+0000","last_peered":"2024-04-26T12:42:41.408083+0000","last_clean":"2024-04-26T12:42:41.408083+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:42:41.408083+0000","last_undegraded":"2024-04-26T12:42:41.408083+0000","last_fullsized":"2024-04-26T12:42:41.408083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410330+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:42:41.410330+0000","last_peered":"2024-04-26T12:42:41.410330+0000","last_clean":"2024-04-26T12:42:41.410330+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:42:41.410330+0000","last_undegraded":"2024-04-26T12:42:41.410330+0000","last_fullsized":"2024-04-26T12:42:41.410330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977561+0000","last_change":"2024-04-26T12:42:21.939098+0000","last_active":"2024-04-26T12:42:41.977561+0000","last_peered":"2024-04-26T12:42:41.977561+0000","last_clean":"2024-04-26T12:42:41.977561+0000","last_became_active":"2024-04-26T12:42:21.938117+0000","last_became_peered":"2024-04-26T12:42:21.938117+0000","last_unstale":"2024-04-26T12:42:41.977561+0000","last_undegraded":"2024-04-26T12:42:41.977561+0000","last_fullsized":"2024-04-26T12:42:41.977561+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:15.636096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'34","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408092+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:42:41.408092+0000","last_peered":"2024-04-26T12:42:41.408092+0000","last_clean":"2024-04-26T12:42:41.408092+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:42:41.408092+0000","last_undegraded":"2024-04-26T12:42:41.408092+0000","last_fullsized":"2024-04-26T12:42:41.408092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":44,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":335,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976702+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:42:41.976702+0000","last_peered":"2024-04-26T12:42:41.976702+0000","last_clean":"2024-04-26T12:42:41.976702+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:42:41.976702+0000","last_undegraded":"2024-04-26T12:42:41.976702+0000","last_fullsized":"2024-04-26T12:42:41.976702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"91'17","reported_seq":314,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519132+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:42:42.519132+0000","last_peered":"2024-04-26T12:42:42.519132+0000","last_clean":"2024-04-26T12:42:42.519132+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:42:42.519132+0000","last_undegraded":"2024-04-26T12:42:42.519132+0000","last_fullsized":"2024-04-26T12:42:42.519132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069911+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:42:41.069911+0000","last_peered":"2024-04-26T12:42:41.069911+0000","last_clean":"2024-04-26T12:42:41.069911+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:42:41.069911+0000","last_undegraded":"2024-04-26T12:42:41.069911+0000","last_fullsized":"2024-04-26T12:42:41.069911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070589+0000","last_change":"2024-04-26T12:42:21.942734+0000","last_active":"2024-04-26T12:42:41.070589+0000","last_peered":"2024-04-26T12:42:41.070589+0000","last_clean":"2024-04-26T12:42:41.070589+0000","last_became_active":"2024-04-26T12:42:21.928602+0000","last_became_peered":"2024-04-26T12:42:21.928602+0000","last_unstale":"2024-04-26T12:42:41.070589+0000","last_undegraded":"2024-04-26T12:42:41.070589+0000","last_fullsized":"2024-04-26T12:42:41.070589+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:45.167813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409089+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:42:41.409089+0000","last_peered":"2024-04-26T12:42:41.409089+0000","last_clean":"2024-04-26T12:42:41.409089+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:42:41.409089+0000","last_undegraded":"2024-04-26T12:42:41.409089+0000","last_fullsized":"2024-04-26T12:42:41.409089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122667+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:42:42.122667+0000","last_peered":"2024-04-26T12:42:42.122667+0000","last_clean":"2024-04-26T12:42:42.122667+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:42:42.122667+0000","last_undegraded":"2024-04-26T12:42:42.122667+0000","last_fullsized":"2024-04-26T12:42:42.122667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'18","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067370+0000","last_change":"2024-04-26T12:42:34.006811+0000","last_active":"2024-04-26T12:42:41.067370+0000","last_peered":"2024-04-26T12:42:41.067370+0000","last_clean":"2024-04-26T12:42:41.067370+0000","last_became_active":"2024-04-26T12:42:34.004041+0000","last_became_peered":"2024-04-26T12:42:34.004041+0000","last_unstale":"2024-04-26T12:42:41.067370+0000","last_undegraded":"2024-04-26T12:42:41.067370+0000","last_fullsized":"2024-04-26T12:42:41.067370+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:08.613547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069460+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:42:41.069460+0000","last_peered":"2024-04-26T12:42:41.069460+0000","last_clean":"2024-04-26T12:42:41.069460+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:42:41.069460+0000","last_undegraded":"2024-04-26T12:42:41.069460+0000","last_fullsized":"2024-04-26T12:42:41.069460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073574+0000","last_change":"2024-04-26T12:42:21.946073+0000","last_active":"2024-04-26T12:42:41.073574+0000","last_peered":"2024-04-26T12:42:41.073574+0000","last_clean":"2024-04-26T12:42:41.073574+0000","last_became_active":"2024-04-26T12:42:21.942937+0000","last_became_peered":"2024-04-26T12:42:21.942937+0000","last_unstale":"2024-04-26T12:42:41.073574+0000","last_undegraded":"2024-04-26T12:42:41.073574+0000","last_fullsized":"2024-04-26T12:42:41.073574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:30.907752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515300+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:42:42.515300+0000","last_peered":"2024-04-26T12:42:42.515300+0000","last_clean":"2024-04-26T12:42:42.515300+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:42:42.515300+0000","last_undegraded":"2024-04-26T12:42:42.515300+0000","last_fullsized":"2024-04-26T12:42:42.515300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121144+0000","last_change":"2024-04-26T12:42:21.942893+0000","last_active":"2024-04-26T12:42:42.121144+0000","last_peered":"2024-04-26T12:42:42.121144+0000","last_clean":"2024-04-26T12:42:42.121144+0000","last_became_active":"2024-04-26T12:42:21.941954+0000","last_became_peered":"2024-04-26T12:42:21.941954+0000","last_unstale":"2024-04-26T12:42:42.121144+0000","last_undegraded":"2024-04-26T12:42:42.121144+0000","last_fullsized":"2024-04-26T12:42:42.121144+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408457+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:42:41.408457+0000","last_peered":"2024-04-26T12:42:41.408457+0000","last_clean":"2024-04-26T12:42:41.408457+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:42:41.408457+0000","last_undegraded":"2024-04-26T12:42:41.408457+0000","last_fullsized":"2024-04-26T12:42:41.408457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'26","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.124036+0000","last_change":"2024-04-26T12:42:21.924370+0000","last_active":"2024-04-26T12:42:42.124036+0000","last_peered":"2024-04-26T12:42:42.124036+0000","last_clean":"2024-04-26T12:42:42.124036+0000","last_became_active":"2024-04-26T12:42:21.923345+0000","last_became_peered":"2024-04-26T12:42:21.923345+0000","last_unstale":"2024-04-26T12:42:42.124036+0000","last_undegraded":"2024-04-26T12:42:42.124036+0000","last_fullsized":"2024-04-26T12:42:42.124036+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:11.162289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409328+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:42:41.409328+0000","last_peered":"2024-04-26T12:42:41.409328+0000","last_clean":"2024-04-26T12:42:41.409328+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:42:41.409328+0000","last_undegraded":"2024-04-26T12:42:41.409328+0000","last_fullsized":"2024-04-26T12:42:41.409328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071121+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:42:41.071121+0000","last_peered":"2024-04-26T12:42:41.071121+0000","last_clean":"2024-04-26T12:42:41.071121+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:42:41.071121+0000","last_undegraded":"2024-04-26T12:42:41.071121+0000","last_fullsized":"2024-04-26T12:42:41.071121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"117'34","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071421+0000","last_change":"2024-04-26T12:42:21.957374+0000","last_active":"2024-04-26T12:42:41.071421+0000","last_peered":"2024-04-26T12:42:41.071421+0000","last_clean":"2024-04-26T12:42:41.071421+0000","last_became_active":"2024-04-26T12:42:21.956451+0000","last_became_peered":"2024-04-26T12:42:21.956451+0000","last_unstale":"2024-04-26T12:42:41.071421+0000","last_undegraded":"2024-04-26T12:42:41.071421+0000","last_fullsized":"2024-04-26T12:42:41.071421+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:20.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":204,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065521+0000","last_change":"2024-04-26T12:42:34.015627+0000","last_active":"2024-04-26T12:42:41.065521+0000","last_peered":"2024-04-26T12:42:41.065521+0000","last_clean":"2024-04-26T12:42:41.065521+0000","last_became_active":"2024-04-26T12:42:34.014949+0000","last_became_peered":"2024-04-26T12:42:34.014949+0000","last_unstale":"2024-04-26T12:42:41.065521+0000","last_undegraded":"2024-04-26T12:42:41.065521+0000","last_fullsized":"2024-04-26T12:42:41.065521+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:46.390226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070165+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:42:41.070165+0000","last_peered":"2024-04-26T12:42:41.070165+0000","last_clean":"2024-04-26T12:42:41.070165+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:42:41.070165+0000","last_undegraded":"2024-04-26T12:42:41.070165+0000","last_fullsized":"2024-04-26T12:42:41.070165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072305+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:42:41.072305+0000","last_peered":"2024-04-26T12:42:41.072305+0000","last_clean":"2024-04-26T12:42:41.072305+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:42:41.072305+0000","last_undegraded":"2024-04-26T12:42:41.072305+0000","last_fullsized":"2024-04-26T12:42:41.072305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'31","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409224+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:42:41.409224+0000","last_peered":"2024-04-26T12:42:41.409224+0000","last_clean":"2024-04-26T12:42:41.409224+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:42:41.409224+0000","last_undegraded":"2024-04-26T12:42:41.409224+0000","last_fullsized":"2024-04-26T12:42:41.409224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519825+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:42:42.519825+0000","last_peered":"2024-04-26T12:42:42.519825+0000","last_clean":"2024-04-26T12:42:42.519825+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:42:42.519825+0000","last_undegraded":"2024-04-26T12:42:42.519825+0000","last_fullsized":"2024-04-26T12:42:42.519825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518456+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:42:42.518456+0000","last_peered":"2024-04-26T12:42:42.518456+0000","last_clean":"2024-04-26T12:42:42.518456+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:42:42.518456+0000","last_undegraded":"2024-04-26T12:42:42.518456+0000","last_fullsized":"2024-04-26T12:42:42.518456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408014+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:42:41.408014+0000","last_peered":"2024-04-26T12:42:41.408014+0000","last_clean":"2024-04-26T12:42:41.408014+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:42:41.408014+0000","last_undegraded":"2024-04-26T12:42:41.408014+0000","last_fullsized":"2024-04-26T12:42:41.408014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"117'134","reported_seq":425,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121636+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:42:42.121636+0000","last_peered":"2024-04-26T12:42:42.121636+0000","last_clean":"2024-04-26T12:42:42.121636+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:42:42.121636+0000","last_undegraded":"2024-04-26T12:42:42.121636+0000","last_fullsized":"2024-04-26T12:42:42.121636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073784+0000","last_change":"2024-04-26T12:42:21.962241+0000","last_active":"2024-04-26T12:42:41.073784+0000","last_peered":"2024-04-26T12:42:41.073784+0000","last_clean":"2024-04-26T12:42:41.073784+0000","last_became_active":"2024-04-26T12:42:21.960618+0000","last_became_peered":"2024-04-26T12:42:21.960618+0000","last_unstale":"2024-04-26T12:42:41.073784+0000","last_undegraded":"2024-04-26T12:42:41.073784+0000","last_fullsized":"2024-04-26T12:42:41.073784+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:39.076778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067522+0000","last_change":"2024-04-26T12:42:21.965811+0000","last_active":"2024-04-26T12:42:41.067522+0000","last_peered":"2024-04-26T12:42:41.067522+0000","last_clean":"2024-04-26T12:42:41.067522+0000","last_became_active":"2024-04-26T12:42:21.960998+0000","last_became_peered":"2024-04-26T12:42:21.960998+0000","last_unstale":"2024-04-26T12:42:41.067522+0000","last_undegraded":"2024-04-26T12:42:41.067522+0000","last_fullsized":"2024-04-26T12:42:41.067522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.081118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"116'27","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074564+0000","last_change":"2024-04-26T12:42:21.971344+0000","last_active":"2024-04-26T12:42:41.074564+0000","last_peered":"2024-04-26T12:42:41.074564+0000","last_clean":"2024-04-26T12:42:41.074564+0000","last_became_active":"2024-04-26T12:42:21.968901+0000","last_became_peered":"2024-04-26T12:42:21.968901+0000","last_unstale":"2024-04-26T12:42:41.074564+0000","last_undegraded":"2024-04-26T12:42:41.074564+0000","last_fullsized":"2024-04-26T12:42:41.074564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:04.596971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409908+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:42:41.409908+0000","last_peered":"2024-04-26T12:42:41.409908+0000","last_clean":"2024-04-26T12:42:41.409908+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:42:41.409908+0000","last_undegraded":"2024-04-26T12:42:41.409908+0000","last_fullsized":"2024-04-26T12:42:41.409908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065795+0000","last_change":"2024-04-26T12:42:34.016582+0000","last_active":"2024-04-26T12:42:41.065795+0000","last_peered":"2024-04-26T12:42:41.065795+0000","last_clean":"2024-04-26T12:42:41.065795+0000","last_became_active":"2024-04-26T12:42:34.015774+0000","last_became_peered":"2024-04-26T12:42:34.015774+0000","last_unstale":"2024-04-26T12:42:41.065795+0000","last_undegraded":"2024-04-26T12:42:41.065795+0000","last_fullsized":"2024-04-26T12:42:41.065795+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:09.670527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":71,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067390+0000","last_change":"2024-04-26T12:42:34.031336+0000","last_active":"2024-04-26T12:42:41.067390+0000","last_peered":"2024-04-26T12:42:41.067390+0000","last_clean":"2024-04-26T12:42:41.067390+0000","last_became_active":"2024-04-26T12:42:34.029037+0000","last_became_peered":"2024-04-26T12:42:34.029037+0000","last_unstale":"2024-04-26T12:42:41.067390+0000","last_undegraded":"2024-04-26T12:42:41.067390+0000","last_fullsized":"2024-04-26T12:42:41.067390+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:10.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"123'136","reported_seq":412,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068106+0000","last_change":"2024-04-26T12:42:21.972386+0000","last_active":"2024-04-26T12:42:41.068106+0000","last_peered":"2024-04-26T12:42:41.068106+0000","last_clean":"2024-04-26T12:42:41.068106+0000","last_became_active":"2024-04-26T12:42:21.962332+0000","last_became_peered":"2024-04-26T12:42:21.962332+0000","last_unstale":"2024-04-26T12:42:41.068106+0000","last_undegraded":"2024-04-26T12:42:41.068106+0000","last_fullsized":"2024-04-26T12:42:41.068106+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:50.916736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071272+0000","last_change":"2024-04-26T12:42:21.957370+0000","last_active":"2024-04-26T12:42:41.071272+0000","last_peered":"2024-04-26T12:42:41.071272+0000","last_clean":"2024-04-26T12:42:41.071272+0000","last_became_active":"2024-04-26T12:42:21.956715+0000","last_became_peered":"2024-04-26T12:42:21.956715+0000","last_unstale":"2024-04-26T12:42:41.071272+0000","last_undegraded":"2024-04-26T12:42:41.071272+0000","last_fullsized":"2024-04-26T12:42:41.071272+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:22.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066049+0000","last_change":"2024-04-26T12:42:34.013472+0000","last_active":"2024-04-26T12:42:41.066049+0000","last_peered":"2024-04-26T12:42:41.066049+0000","last_clean":"2024-04-26T12:42:41.066049+0000","last_became_active":"2024-04-26T12:42:34.010800+0000","last_became_peered":"2024-04-26T12:42:34.010800+0000","last_unstale":"2024-04-26T12:42:41.066049+0000","last_undegraded":"2024-04-26T12:42:41.066049+0000","last_fullsized":"2024-04-26T12:42:41.066049+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:43.861494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"117'24","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072776+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:42:41.072776+0000","last_peered":"2024-04-26T12:42:41.072776+0000","last_clean":"2024-04-26T12:42:41.072776+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:42:41.072776+0000","last_undegraded":"2024-04-26T12:42:41.072776+0000","last_fullsized":"2024-04-26T12:42:41.072776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521218+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:42:42.521218+0000","last_peered":"2024-04-26T12:42:42.521218+0000","last_clean":"2024-04-26T12:42:42.521218+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:42:42.521218+0000","last_undegraded":"2024-04-26T12:42:42.521218+0000","last_fullsized":"2024-04-26T12:42:42.521218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068515+0000","last_change":"2024-04-26T12:42:21.941484+0000","last_active":"2024-04-26T12:42:41.068515+0000","last_peered":"2024-04-26T12:42:41.068515+0000","last_clean":"2024-04-26T12:42:41.068515+0000","last_became_active":"2024-04-26T12:42:21.926472+0000","last_became_peered":"2024-04-26T12:42:21.926472+0000","last_unstale":"2024-04-26T12:42:41.068515+0000","last_undegraded":"2024-04-26T12:42:41.068515+0000","last_fullsized":"2024-04-26T12:42:41.068515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.214353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"117'43","reported_seq":298,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519477+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:42:42.519477+0000","last_peered":"2024-04-26T12:42:42.519477+0000","last_clean":"2024-04-26T12:42:42.519477+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:42:42.519477+0000","last_undegraded":"2024-04-26T12:42:42.519477+0000","last_fullsized":"2024-04-26T12:42:42.519477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068343+0000","last_change":"2024-04-26T12:42:21.919160+0000","last_active":"2024-04-26T12:42:41.068343+0000","last_peered":"2024-04-26T12:42:41.068343+0000","last_clean":"2024-04-26T12:42:41.068343+0000","last_became_active":"2024-04-26T12:42:21.918031+0000","last_became_peered":"2024-04-26T12:42:21.918031+0000","last_unstale":"2024-04-26T12:42:41.068343+0000","last_undegraded":"2024-04-26T12:42:41.068343+0000","last_fullsized":"2024-04-26T12:42:41.068343+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:35.941555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122585+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:42:42.122585+0000","last_peered":"2024-04-26T12:42:42.122585+0000","last_clean":"2024-04-26T12:42:42.122585+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:42:42.122585+0000","last_undegraded":"2024-04-26T12:42:42.122585+0000","last_fullsized":"2024-04-26T12:42:42.122585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069566+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:42:41.069566+0000","last_peered":"2024-04-26T12:42:41.069566+0000","last_clean":"2024-04-26T12:42:41.069566+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:42:41.069566+0000","last_undegraded":"2024-04-26T12:42:41.069566+0000","last_fullsized":"2024-04-26T12:42:41.069566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":186,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066912+0000","last_change":"2024-04-26T12:42:34.023953+0000","last_active":"2024-04-26T12:42:41.066912+0000","last_peered":"2024-04-26T12:42:41.066912+0000","last_clean":"2024-04-26T12:42:41.066912+0000","last_became_active":"2024-04-26T12:42:34.022792+0000","last_became_peered":"2024-04-26T12:42:34.022792+0000","last_unstale":"2024-04-26T12:42:41.066912+0000","last_undegraded":"2024-04-26T12:42:41.066912+0000","last_fullsized":"2024-04-26T12:42:41.066912+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:16.851419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066522+0000","last_change":"2024-04-26T12:42:34.012055+0000","last_active":"2024-04-26T12:42:41.066522+0000","last_peered":"2024-04-26T12:42:41.066522+0000","last_clean":"2024-04-26T12:42:41.066522+0000","last_became_active":"2024-04-26T12:42:34.008295+0000","last_became_peered":"2024-04-26T12:42:34.008295+0000","last_unstale":"2024-04-26T12:42:41.066522+0000","last_undegraded":"2024-04-26T12:42:41.066522+0000","last_fullsized":"2024-04-26T12:42:41.066522+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:59.626034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408588+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:42:41.408588+0000","last_peered":"2024-04-26T12:42:41.408588+0000","last_clean":"2024-04-26T12:42:41.408588+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:42:41.408588+0000","last_undegraded":"2024-04-26T12:42:41.408588+0000","last_fullsized":"2024-04-26T12:42:41.408588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070334+0000","last_change":"2024-04-26T12:42:21.967112+0000","last_active":"2024-04-26T12:42:41.070334+0000","last_peered":"2024-04-26T12:42:41.070334+0000","last_clean":"2024-04-26T12:42:41.070334+0000","last_became_active":"2024-04-26T12:42:21.964467+0000","last_became_peered":"2024-04-26T12:42:21.964467+0000","last_unstale":"2024-04-26T12:42:41.070334+0000","last_undegraded":"2024-04-26T12:42:41.070334+0000","last_fullsized":"2024-04-26T12:42:41.070334+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:41.170576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072547+0000","last_change":"2024-04-26T12:42:21.964141+0000","last_active":"2024-04-26T12:42:41.072547+0000","last_peered":"2024-04-26T12:42:41.072547+0000","last_clean":"2024-04-26T12:42:41.072547+0000","last_became_active":"2024-04-26T12:42:21.959360+0000","last_became_peered":"2024-04-26T12:42:21.959360+0000","last_unstale":"2024-04-26T12:42:41.072547+0000","last_undegraded":"2024-04-26T12:42:41.072547+0000","last_fullsized":"2024-04-26T12:42:41.072547+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:57.964968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074053+0000","last_change":"2024-04-26T12:42:21.970393+0000","last_active":"2024-04-26T12:42:41.074053+0000","last_peered":"2024-04-26T12:42:41.074053+0000","last_clean":"2024-04-26T12:42:41.074053+0000","last_became_active":"2024-04-26T12:42:21.968658+0000","last_became_peered":"2024-04-26T12:42:21.968658+0000","last_unstale":"2024-04-26T12:42:41.074053+0000","last_undegraded":"2024-04-26T12:42:41.074053+0000","last_fullsized":"2024-04-26T12:42:41.074053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:45.400045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408339+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:42:41.408339+0000","last_peered":"2024-04-26T12:42:41.408339+0000","last_clean":"2024-04-26T12:42:41.408339+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:42:41.408339+0000","last_undegraded":"2024-04-26T12:42:41.408339+0000","last_fullsized":"2024-04-26T12:42:41.408339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"117'23","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519528+0000","last_change":"2024-04-26T12:42:21.956317+0000","last_active":"2024-04-26T12:42:42.519528+0000","last_peered":"2024-04-26T12:42:42.519528+0000","last_clean":"2024-04-26T12:42:42.519528+0000","last_became_active":"2024-04-26T12:42:21.955428+0000","last_became_peered":"2024-04-26T12:42:21.955428+0000","last_unstale":"2024-04-26T12:42:42.519528+0000","last_undegraded":"2024-04-26T12:42:42.519528+0000","last_fullsized":"2024-04-26T12:42:42.519528+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:50.243608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067590+0000","last_change":"2024-04-26T12:42:21.973314+0000","last_active":"2024-04-26T12:42:41.067590+0000","last_peered":"2024-04-26T12:42:41.067590+0000","last_clean":"2024-04-26T12:42:41.067590+0000","last_became_active":"2024-04-26T12:42:21.964554+0000","last_became_peered":"2024-04-26T12:42:21.964554+0000","last_unstale":"2024-04-26T12:42:41.067590+0000","last_undegraded":"2024-04-26T12:42:41.067590+0000","last_fullsized":"2024-04-26T12:42:41.067590+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:20.524995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"120'9","reported_seq":250,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070910+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:42:41.070910+0000","last_peered":"2024-04-26T12:42:41.070910+0000","last_clean":"2024-04-26T12:42:41.070910+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:42:41.070910+0000","last_undegraded":"2024-04-26T12:42:41.070910+0000","last_fullsized":"2024-04-26T12:42:41.070910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517854+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:42:42.517854+0000","last_peered":"2024-04-26T12:42:42.517854+0000","last_clean":"2024-04-26T12:42:42.517854+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:42:42.517854+0000","last_undegraded":"2024-04-26T12:42:42.517854+0000","last_fullsized":"2024-04-26T12:42:42.517854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069199+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:42:41.069199+0000","last_peered":"2024-04-26T12:42:41.069199+0000","last_clean":"2024-04-26T12:42:41.069199+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:42:41.069199+0000","last_undegraded":"2024-04-26T12:42:41.069199+0000","last_fullsized":"2024-04-26T12:42:41.069199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069067+0000","last_change":"2024-04-26T12:42:21.967538+0000","last_active":"2024-04-26T12:42:41.069067+0000","last_peered":"2024-04-26T12:42:41.069067+0000","last_clean":"2024-04-26T12:42:41.069067+0000","last_became_active":"2024-04-26T12:42:21.965760+0000","last_became_peered":"2024-04-26T12:42:21.965760+0000","last_unstale":"2024-04-26T12:42:41.069067+0000","last_undegraded":"2024-04-26T12:42:41.069067+0000","last_fullsized":"2024-04-26T12:42:41.069067+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:34.724137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'27","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123766+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:42:42.123766+0000","last_peered":"2024-04-26T12:42:42.123766+0000","last_clean":"2024-04-26T12:42:42.123766+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:42:42.123766+0000","last_undegraded":"2024-04-26T12:42:42.123766+0000","last_fullsized":"2024-04-26T12:42:42.123766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516156+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:42:42.516156+0000","last_peered":"2024-04-26T12:42:42.516156+0000","last_clean":"2024-04-26T12:42:42.516156+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:42:42.516156+0000","last_undegraded":"2024-04-26T12:42:42.516156+0000","last_fullsized":"2024-04-26T12:42:42.516156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069367+0000","last_change":"2024-04-26T12:42:21.974557+0000","last_active":"2024-04-26T12:42:41.069367+0000","last_peered":"2024-04-26T12:42:41.069367+0000","last_clean":"2024-04-26T12:42:41.069367+0000","last_became_active":"2024-04-26T12:42:21.967735+0000","last_became_peered":"2024-04-26T12:42:21.967735+0000","last_unstale":"2024-04-26T12:42:41.069367+0000","last_undegraded":"2024-04-26T12:42:41.069367+0000","last_fullsized":"2024-04-26T12:42:41.069367+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:01.266925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514760+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:42:42.514760+0000","last_peered":"2024-04-26T12:42:42.514760+0000","last_clean":"2024-04-26T12:42:42.514760+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:42:42.514760+0000","last_undegraded":"2024-04-26T12:42:42.514760+0000","last_fullsized":"2024-04-26T12:42:42.514760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121837+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:42:42.121837+0000","last_peered":"2024-04-26T12:42:42.121837+0000","last_clean":"2024-04-26T12:42:42.121837+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:42:42.121837+0000","last_undegraded":"2024-04-26T12:42:42.121837+0000","last_fullsized":"2024-04-26T12:42:42.121837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068104+0000","last_change":"2024-04-26T12:42:21.946016+0000","last_active":"2024-04-26T12:42:41.068104+0000","last_peered":"2024-04-26T12:42:41.068104+0000","last_clean":"2024-04-26T12:42:41.068104+0000","last_became_active":"2024-04-26T12:42:21.927785+0000","last_became_peered":"2024-04-26T12:42:21.927785+0000","last_unstale":"2024-04-26T12:42:41.068104+0000","last_undegraded":"2024-04-26T12:42:41.068104+0000","last_fullsized":"2024-04-26T12:42:41.068104+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:08.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'20","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072117+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:42:41.072117+0000","last_peered":"2024-04-26T12:42:41.072117+0000","last_clean":"2024-04-26T12:42:41.072117+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:42:41.072117+0000","last_undegraded":"2024-04-26T12:42:41.072117+0000","last_fullsized":"2024-04-26T12:42:41.072117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518072+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:42:42.518072+0000","last_peered":"2024-04-26T12:42:42.518072+0000","last_clean":"2024-04-26T12:42:42.518072+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:42:42.518072+0000","last_undegraded":"2024-04-26T12:42:42.518072+0000","last_fullsized":"2024-04-26T12:42:42.518072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"117'20","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517863+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:42:42.517863+0000","last_peered":"2024-04-26T12:42:42.517863+0000","last_clean":"2024-04-26T12:42:42.517863+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:42:42.517863+0000","last_undegraded":"2024-04-26T12:42:42.517863+0000","last_fullsized":"2024-04-26T12:42:42.517863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068567+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:42:41.068567+0000","last_peered":"2024-04-26T12:42:41.068567+0000","last_clean":"2024-04-26T12:42:41.068567+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:42:41.068567+0000","last_undegraded":"2024-04-26T12:42:41.068567+0000","last_fullsized":"2024-04-26T12:42:41.068567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521075+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:42:42.521075+0000","last_peered":"2024-04-26T12:42:42.521075+0000","last_clean":"2024-04-26T12:42:42.521075+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:42:42.521075+0000","last_undegraded":"2024-04-26T12:42:42.521075+0000","last_fullsized":"2024-04-26T12:42:42.521075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'15","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067129+0000","last_change":"2024-04-26T12:42:21.967299+0000","last_active":"2024-04-26T12:42:41.067129+0000","last_peered":"2024-04-26T12:42:41.067129+0000","last_clean":"2024-04-26T12:42:41.067129+0000","last_became_active":"2024-04-26T12:42:21.964241+0000","last_became_peered":"2024-04-26T12:42:21.964241+0000","last_unstale":"2024-04-26T12:42:41.067129+0000","last_undegraded":"2024-04-26T12:42:41.067129+0000","last_fullsized":"2024-04-26T12:42:41.067129+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:24.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071446+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:42:41.071446+0000","last_peered":"2024-04-26T12:42:41.071446+0000","last_clean":"2024-04-26T12:42:41.071446+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:42:41.071446+0000","last_undegraded":"2024-04-26T12:42:41.071446+0000","last_fullsized":"2024-04-26T12:42:41.071446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"117'28","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409065+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:42:41.409065+0000","last_peered":"2024-04-26T12:42:41.409065+0000","last_clean":"2024-04-26T12:42:41.409065+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:42:41.409065+0000","last_undegraded":"2024-04-26T12:42:41.409065+0000","last_fullsized":"2024-04-26T12:42:41.409065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122126+0000","last_change":"2024-04-26T12:42:21.947268+0000","last_active":"2024-04-26T12:42:42.122126+0000","last_peered":"2024-04-26T12:42:42.122126+0000","last_clean":"2024-04-26T12:42:42.122126+0000","last_became_active":"2024-04-26T12:42:21.946664+0000","last_became_peered":"2024-04-26T12:42:21.946664+0000","last_unstale":"2024-04-26T12:42:42.122126+0000","last_undegraded":"2024-04-26T12:42:42.122126+0000","last_fullsized":"2024-04-26T12:42:42.122126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:21.575803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067833+0000","last_change":"2024-04-26T12:42:21.973393+0000","last_active":"2024-04-26T12:42:41.067833+0000","last_peered":"2024-04-26T12:42:41.067833+0000","last_clean":"2024-04-26T12:42:41.067833+0000","last_became_active":"2024-04-26T12:42:21.963727+0000","last_became_peered":"2024-04-26T12:42:21.963727+0000","last_unstale":"2024-04-26T12:42:41.067833+0000","last_undegraded":"2024-04-26T12:42:41.067833+0000","last_fullsized":"2024-04-26T12:42:41.067833+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:52.960136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072465+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:42:41.072465+0000","last_peered":"2024-04-26T12:42:41.072465+0000","last_clean":"2024-04-26T12:42:41.072465+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:42:41.072465+0000","last_undegraded":"2024-04-26T12:42:41.072465+0000","last_fullsized":"2024-04-26T12:42:41.072465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'32","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408983+0000","last_change":"2024-04-26T12:42:21.934786+0000","last_active":"2024-04-26T12:42:41.408983+0000","last_peered":"2024-04-26T12:42:41.408983+0000","last_clean":"2024-04-26T12:42:41.408983+0000","last_became_active":"2024-04-26T12:42:21.933941+0000","last_became_peered":"2024-04-26T12:42:21.933941+0000","last_unstale":"2024-04-26T12:42:41.408983+0000","last_undegraded":"2024-04-26T12:42:41.408983+0000","last_fullsized":"2024-04-26T12:42:41.408983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:56.359990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520965+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:42:42.520965+0000","last_peered":"2024-04-26T12:42:42.520965+0000","last_clean":"2024-04-26T12:42:42.520965+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:42:42.520965+0000","last_undegraded":"2024-04-26T12:42:42.520965+0000","last_fullsized":"2024-04-26T12:42:42.520965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"117'23","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518241+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:42:42.518241+0000","last_peered":"2024-04-26T12:42:42.518241+0000","last_clean":"2024-04-26T12:42:42.518241+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:42:42.518241+0000","last_undegraded":"2024-04-26T12:42:42.518241+0000","last_fullsized":"2024-04-26T12:42:42.518241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409160+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:42:41.409160+0000","last_peered":"2024-04-26T12:42:41.409160+0000","last_clean":"2024-04-26T12:42:41.409160+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:42:41.409160+0000","last_undegraded":"2024-04-26T12:42:41.409160+0000","last_fullsized":"2024-04-26T12:42:41.409160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518124+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:42:42.518124+0000","last_peered":"2024-04-26T12:42:42.518124+0000","last_clean":"2024-04-26T12:42:42.518124+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:42:42.518124+0000","last_undegraded":"2024-04-26T12:42:42.518124+0000","last_fullsized":"2024-04-26T12:42:42.518124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072909+0000","last_change":"2024-04-26T12:42:21.925516+0000","last_active":"2024-04-26T12:42:41.072909+0000","last_peered":"2024-04-26T12:42:41.072909+0000","last_clean":"2024-04-26T12:42:41.072909+0000","last_became_active":"2024-04-26T12:42:21.924628+0000","last_became_peered":"2024-04-26T12:42:21.924628+0000","last_unstale":"2024-04-26T12:42:41.072909+0000","last_undegraded":"2024-04-26T12:42:41.072909+0000","last_fullsized":"2024-04-26T12:42:41.072909+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.079347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'21","reported_seq":223,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068512+0000","last_change":"2024-04-26T12:42:34.034805+0000","last_active":"2024-04-26T12:42:41.068512+0000","last_peered":"2024-04-26T12:42:41.068512+0000","last_clean":"2024-04-26T12:42:41.068512+0000","last_became_active":"2024-04-26T12:42:34.034029+0000","last_became_peered":"2024-04-26T12:42:34.034029+0000","last_unstale":"2024-04-26T12:42:41.068512+0000","last_undegraded":"2024-04-26T12:42:41.068512+0000","last_fullsized":"2024-04-26T12:42:41.068512+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:41.159253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068554+0000","last_change":"2024-04-26T12:42:34.032136+0000","last_active":"2024-04-26T12:42:41.068554+0000","last_peered":"2024-04-26T12:42:41.068554+0000","last_clean":"2024-04-26T12:42:41.068554+0000","last_became_active":"2024-04-26T12:42:34.031261+0000","last_became_peered":"2024-04-26T12:42:34.031261+0000","last_unstale":"2024-04-26T12:42:41.068554+0000","last_undegraded":"2024-04-26T12:42:41.068554+0000","last_fullsized":"2024-04-26T12:42:41.068554+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:12.726095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074100+0000","last_change":"2024-04-26T12:42:21.932892+0000","last_active":"2024-04-26T12:42:41.074100+0000","last_peered":"2024-04-26T12:42:41.074100+0000","last_clean":"2024-04-26T12:42:41.074100+0000","last_became_active":"2024-04-26T12:42:21.931947+0000","last_became_peered":"2024-04-26T12:42:21.931947+0000","last_unstale":"2024-04-26T12:42:41.074100+0000","last_undegraded":"2024-04-26T12:42:41.074100+0000","last_fullsized":"2024-04-26T12:42:41.074100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:26.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409372+0000","last_change":"2024-04-26T12:42:21.935064+0000","last_active":"2024-04-26T12:42:41.409372+0000","last_peered":"2024-04-26T12:42:41.409372+0000","last_clean":"2024-04-26T12:42:41.409372+0000","last_became_active":"2024-04-26T12:42:21.933611+0000","last_became_peered":"2024-04-26T12:42:21.933611+0000","last_unstale":"2024-04-26T12:42:41.409372+0000","last_undegraded":"2024-04-26T12:42:41.409372+0000","last_fullsized":"2024-04-26T12:42:41.409372+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:10.425425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122185+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:42:42.122185+0000","last_peered":"2024-04-26T12:42:42.122185+0000","last_clean":"2024-04-26T12:42:42.122185+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:42:42.122185+0000","last_undegraded":"2024-04-26T12:42:42.122185+0000","last_fullsized":"2024-04-26T12:42:42.122185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976329+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:42:41.976329+0000","last_peered":"2024-04-26T12:42:41.976329+0000","last_clean":"2024-04-26T12:42:41.976329+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:42:41.976329+0000","last_undegraded":"2024-04-26T12:42:41.976329+0000","last_fullsized":"2024-04-26T12:42:41.976329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"114'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068827+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:42:41.068827+0000","last_peered":"2024-04-26T12:42:41.068827+0000","last_clean":"2024-04-26T12:42:41.068827+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:42:41.068827+0000","last_undegraded":"2024-04-26T12:42:41.068827+0000","last_fullsized":"2024-04-26T12:42:41.068827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409671+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:42:41.409671+0000","last_peered":"2024-04-26T12:42:41.409671+0000","last_clean":"2024-04-26T12:42:41.409671+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:42:41.409671+0000","last_undegraded":"2024-04-26T12:42:41.409671+0000","last_fullsized":"2024-04-26T12:42:41.409671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"117'12","reported_seq":61,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067261+0000","last_change":"2024-04-26T12:42:34.023030+0000","last_active":"2024-04-26T12:42:41.067261+0000","last_peered":"2024-04-26T12:42:41.067261+0000","last_clean":"2024-04-26T12:42:41.067261+0000","last_became_active":"2024-04-26T12:42:34.022362+0000","last_became_peered":"2024-04-26T12:42:34.022362+0000","last_unstale":"2024-04-26T12:42:41.067261+0000","last_undegraded":"2024-04-26T12:42:41.067261+0000","last_fullsized":"2024-04-26T12:42:41.067261+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:14.876710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"117'134","reported_seq":425,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515568+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:42:42.515568+0000","last_peered":"2024-04-26T12:42:42.515568+0000","last_clean":"2024-04-26T12:42:42.515568+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:42:42.515568+0000","last_undegraded":"2024-04-26T12:42:42.515568+0000","last_fullsized":"2024-04-26T12:42:42.515568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"117'4","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515862+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:42:42.515862+0000","last_peered":"2024-04-26T12:42:42.515862+0000","last_clean":"2024-04-26T12:42:42.515862+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:42:42.515862+0000","last_undegraded":"2024-04-26T12:42:42.515862+0000","last_fullsized":"2024-04-26T12:42:42.515862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066160+0000","last_change":"2024-04-26T12:42:34.029194+0000","last_active":"2024-04-26T12:42:41.066160+0000","last_peered":"2024-04-26T12:42:41.066160+0000","last_clean":"2024-04-26T12:42:41.066160+0000","last_became_active":"2024-04-26T12:42:34.028313+0000","last_became_peered":"2024-04-26T12:42:34.028313+0000","last_unstale":"2024-04-26T12:42:41.066160+0000","last_undegraded":"2024-04-26T12:42:41.066160+0000","last_fullsized":"2024-04-26T12:42:41.066160+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:01.651376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"117'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122475+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:42:42.122475+0000","last_peered":"2024-04-26T12:42:42.122475+0000","last_clean":"2024-04-26T12:42:42.122475+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:42:42.122475+0000","last_undegraded":"2024-04-26T12:42:42.122475+0000","last_fullsized":"2024-04-26T12:42:42.122475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518145+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:42:42.518145+0000","last_peered":"2024-04-26T12:42:42.518145+0000","last_clean":"2024-04-26T12:42:42.518145+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:42:42.518145+0000","last_undegraded":"2024-04-26T12:42:42.518145+0000","last_fullsized":"2024-04-26T12:42:42.518145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"117'24","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122039+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:42:42.122039+0000","last_peered":"2024-04-26T12:42:42.122039+0000","last_clean":"2024-04-26T12:42:42.122039+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:42:42.122039+0000","last_undegraded":"2024-04-26T12:42:42.122039+0000","last_fullsized":"2024-04-26T12:42:42.122039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070022+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:42:41.070022+0000","last_peered":"2024-04-26T12:42:41.070022+0000","last_clean":"2024-04-26T12:42:41.070022+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:42:41.070022+0000","last_undegraded":"2024-04-26T12:42:41.070022+0000","last_fullsized":"2024-04-26T12:42:41.070022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":229,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519271+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:42:42.519271+0000","last_peered":"2024-04-26T12:42:42.519271+0000","last_clean":"2024-04-26T12:42:42.519271+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:42:42.519271+0000","last_undegraded":"2024-04-26T12:42:42.519271+0000","last_fullsized":"2024-04-26T12:42:42.519271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"117'14","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067733+0000","last_change":"2024-04-26T12:42:34.032654+0000","last_active":"2024-04-26T12:42:41.067733+0000","last_peered":"2024-04-26T12:42:41.067733+0000","last_clean":"2024-04-26T12:42:41.067733+0000","last_became_active":"2024-04-26T12:42:34.031426+0000","last_became_peered":"2024-04-26T12:42:34.031426+0000","last_unstale":"2024-04-26T12:42:41.067733+0000","last_undegraded":"2024-04-26T12:42:41.067733+0000","last_fullsized":"2024-04-26T12:42:41.067733+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:08.054625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'38","reported_seq":291,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123903+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:42:42.123903+0000","last_peered":"2024-04-26T12:42:42.123903+0000","last_clean":"2024-04-26T12:42:42.123903+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:42:42.123903+0000","last_undegraded":"2024-04-26T12:42:42.123903+0000","last_fullsized":"2024-04-26T12:42:42.123903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122227+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:42:42.122227+0000","last_peered":"2024-04-26T12:42:42.122227+0000","last_clean":"2024-04-26T12:42:42.122227+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:42:42.122227+0000","last_undegraded":"2024-04-26T12:42:42.122227+0000","last_fullsized":"2024-04-26T12:42:42.122227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070299+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:42:41.070299+0000","last_peered":"2024-04-26T12:42:41.070299+0000","last_clean":"2024-04-26T12:42:41.070299+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:42:41.070299+0000","last_undegraded":"2024-04-26T12:42:41.070299+0000","last_fullsized":"2024-04-26T12:42:41.070299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517640+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:42:42.517640+0000","last_peered":"2024-04-26T12:42:42.517640+0000","last_clean":"2024-04-26T12:42:42.517640+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:42:42.517640+0000","last_undegraded":"2024-04-26T12:42:42.517640+0000","last_fullsized":"2024-04-26T12:42:42.517640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":183,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073883+0000","last_change":"2024-04-26T12:42:21.961763+0000","last_active":"2024-04-26T12:42:41.073883+0000","last_peered":"2024-04-26T12:42:41.073883+0000","last_clean":"2024-04-26T12:42:41.073883+0000","last_became_active":"2024-04-26T12:42:21.951213+0000","last_became_peered":"2024-04-26T12:42:21.951213+0000","last_unstale":"2024-04-26T12:42:41.073883+0000","last_undegraded":"2024-04-26T12:42:41.073883+0000","last_fullsized":"2024-04-26T12:42:41.073883+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:11.260016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069763+0000","last_change":"2024-04-26T12:42:21.963634+0000","last_active":"2024-04-26T12:42:41.069763+0000","last_peered":"2024-04-26T12:42:41.069763+0000","last_clean":"2024-04-26T12:42:41.069763+0000","last_became_active":"2024-04-26T12:42:21.952291+0000","last_became_peered":"2024-04-26T12:42:21.952291+0000","last_unstale":"2024-04-26T12:42:41.069763+0000","last_undegraded":"2024-04-26T12:42:41.069763+0000","last_fullsized":"2024-04-26T12:42:41.069763+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:54.609591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"117'27","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072915+0000","last_change":"2024-04-26T12:42:21.929252+0000","last_active":"2024-04-26T12:42:41.072915+0000","last_peered":"2024-04-26T12:42:41.072915+0000","last_clean":"2024-04-26T12:42:41.072915+0000","last_became_active":"2024-04-26T12:42:21.928247+0000","last_became_peered":"2024-04-26T12:42:21.928247+0000","last_unstale":"2024-04-26T12:42:41.072915+0000","last_undegraded":"2024-04-26T12:42:41.072915+0000","last_fullsized":"2024-04-26T12:42:41.072915+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:45.518571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065498+0000","last_change":"2024-04-26T12:42:34.022643+0000","last_active":"2024-04-26T12:42:41.065498+0000","last_peered":"2024-04-26T12:42:41.065498+0000","last_clean":"2024-04-26T12:42:41.065498+0000","last_became_active":"2024-04-26T12:42:34.022065+0000","last_became_peered":"2024-04-26T12:42:34.022065+0000","last_unstale":"2024-04-26T12:42:41.065498+0000","last_undegraded":"2024-04-26T12:42:41.065498+0000","last_fullsized":"2024-04-26T12:42:41.065498+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:59.260776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"117'14","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068905+0000","last_change":"2024-04-26T12:42:21.975843+0000","last_active":"2024-04-26T12:42:41.068905+0000","last_peered":"2024-04-26T12:42:41.068905+0000","last_clean":"2024-04-26T12:42:41.068905+0000","last_became_active":"2024-04-26T12:42:21.971062+0000","last_became_peered":"2024-04-26T12:42:21.971062+0000","last_unstale":"2024-04-26T12:42:41.068905+0000","last_undegraded":"2024-04-26T12:42:41.068905+0000","last_fullsized":"2024-04-26T12:42:41.068905+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:19.436937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065759+0000","last_change":"2024-04-26T12:42:34.025446+0000","last_active":"2024-04-26T12:42:41.065759+0000","last_peered":"2024-04-26T12:42:41.065759+0000","last_clean":"2024-04-26T12:42:41.065759+0000","last_became_active":"2024-04-26T12:42:34.024706+0000","last_became_peered":"2024-04-26T12:42:34.024706+0000","last_unstale":"2024-04-26T12:42:41.065759+0000","last_undegraded":"2024-04-26T12:42:41.065759+0000","last_fullsized":"2024-04-26T12:42:41.065759+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.762146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518863+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:42:42.518863+0000","last_peered":"2024-04-26T12:42:42.518863+0000","last_clean":"2024-04-26T12:42:42.518863+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:42:42.518863+0000","last_undegraded":"2024-04-26T12:42:42.518863+0000","last_fullsized":"2024-04-26T12:42:42.518863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":225,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066300+0000","last_change":"2024-04-26T12:42:34.023824+0000","last_active":"2024-04-26T12:42:41.066300+0000","last_peered":"2024-04-26T12:42:41.066300+0000","last_clean":"2024-04-26T12:42:41.066300+0000","last_became_active":"2024-04-26T12:42:34.022553+0000","last_became_peered":"2024-04-26T12:42:34.022553+0000","last_unstale":"2024-04-26T12:42:41.066300+0000","last_undegraded":"2024-04-26T12:42:41.066300+0000","last_fullsized":"2024-04-26T12:42:41.066300+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:14.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071804+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:42:41.071804+0000","last_peered":"2024-04-26T12:42:41.071804+0000","last_clean":"2024-04-26T12:42:41.071804+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:42:41.071804+0000","last_undegraded":"2024-04-26T12:42:41.071804+0000","last_fullsized":"2024-04-26T12:42:41.071804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":334,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408101+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:42:41.408101+0000","last_peered":"2024-04-26T12:42:41.408101+0000","last_clean":"2024-04-26T12:42:41.408101+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:42:41.408101+0000","last_undegraded":"2024-04-26T12:42:41.408101+0000","last_fullsized":"2024-04-26T12:42:41.408101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"117'17","reported_seq":62,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066047+0000","last_change":"2024-04-26T12:42:34.021259+0000","last_active":"2024-04-26T12:42:41.066047+0000","last_peered":"2024-04-26T12:42:41.066047+0000","last_clean":"2024-04-26T12:42:41.066047+0000","last_became_active":"2024-04-26T12:42:34.017996+0000","last_became_peered":"2024-04-26T12:42:34.017996+0000","last_unstale":"2024-04-26T12:42:41.066047+0000","last_undegraded":"2024-04-26T12:42:41.066047+0000","last_fullsized":"2024-04-26T12:42:41.066047+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:25.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068303+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:42:41.068303+0000","last_peered":"2024-04-26T12:42:41.068303+0000","last_clean":"2024-04-26T12:42:41.068303+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:42:41.068303+0000","last_undegraded":"2024-04-26T12:42:41.068303+0000","last_fullsized":"2024-04-26T12:42:41.068303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068670+0000","last_change":"2024-04-26T12:42:34.015473+0000","last_active":"2024-04-26T12:42:41.068670+0000","last_peered":"2024-04-26T12:42:41.068670+0000","last_clean":"2024-04-26T12:42:41.068670+0000","last_became_active":"2024-04-26T12:42:34.011472+0000","last_became_peered":"2024-04-26T12:42:34.011472+0000","last_unstale":"2024-04-26T12:42:41.068670+0000","last_undegraded":"2024-04-26T12:42:41.068670+0000","last_fullsized":"2024-04-26T12:42:41.068670+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"117'8","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410161+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:42:41.410161+0000","last_peered":"2024-04-26T12:42:41.410161+0000","last_clean":"2024-04-26T12:42:41.410161+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:42:41.410161+0000","last_undegraded":"2024-04-26T12:42:41.410161+0000","last_fullsized":"2024-04-26T12:42:41.410161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"115'18","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513972+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:42:42.513972+0000","last_peered":"2024-04-26T12:42:42.513972+0000","last_clean":"2024-04-26T12:42:42.513972+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:42:42.513972+0000","last_undegraded":"2024-04-26T12:42:42.513972+0000","last_fullsized":"2024-04-26T12:42:42.513972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409722+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:42:41.409722+0000","last_peered":"2024-04-26T12:42:41.409722+0000","last_clean":"2024-04-26T12:42:41.409722+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:42:41.409722+0000","last_undegraded":"2024-04-26T12:42:41.409722+0000","last_fullsized":"2024-04-26T12:42:41.409722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"117'28","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977334+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:42:41.977334+0000","last_peered":"2024-04-26T12:42:41.977334+0000","last_clean":"2024-04-26T12:42:41.977334+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:42:41.977334+0000","last_undegraded":"2024-04-26T12:42:41.977334+0000","last_fullsized":"2024-04-26T12:42:41.977334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123354+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:42:42.123354+0000","last_peered":"2024-04-26T12:42:42.123354+0000","last_clean":"2024-04-26T12:42:42.123354+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:42:42.123354+0000","last_undegraded":"2024-04-26T12:42:42.123354+0000","last_fullsized":"2024-04-26T12:42:42.123354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'25","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122527+0000","last_change":"2024-04-26T12:42:21.926395+0000","last_active":"2024-04-26T12:42:42.122527+0000","last_peered":"2024-04-26T12:42:42.122527+0000","last_clean":"2024-04-26T12:42:42.122527+0000","last_became_active":"2024-04-26T12:42:21.925708+0000","last_became_peered":"2024-04-26T12:42:21.925708+0000","last_unstale":"2024-04-26T12:42:42.122527+0000","last_undegraded":"2024-04-26T12:42:42.122527+0000","last_fullsized":"2024-04-26T12:42:42.122527+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:41.849994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"117'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409207+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:42:41.409207+0000","last_peered":"2024-04-26T12:42:41.409207+0000","last_clean":"2024-04-26T12:42:41.409207+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:42:41.409207+0000","last_undegraded":"2024-04-26T12:42:41.409207+0000","last_fullsized":"2024-04-26T12:42:41.409207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'28","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069354+0000","last_change":"2024-04-26T12:42:21.959563+0000","last_active":"2024-04-26T12:42:41.069354+0000","last_peered":"2024-04-26T12:42:41.069354+0000","last_clean":"2024-04-26T12:42:41.069354+0000","last_became_active":"2024-04-26T12:42:21.957515+0000","last_became_peered":"2024-04-26T12:42:21.957515+0000","last_unstale":"2024-04-26T12:42:41.069354+0000","last_undegraded":"2024-04-26T12:42:41.069354+0000","last_fullsized":"2024-04-26T12:42:41.069354+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:46.718927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068640+0000","last_change":"2024-04-26T12:42:21.975117+0000","last_active":"2024-04-26T12:42:41.068640+0000","last_peered":"2024-04-26T12:42:41.068640+0000","last_clean":"2024-04-26T12:42:41.068640+0000","last_became_active":"2024-04-26T12:42:21.970669+0000","last_became_peered":"2024-04-26T12:42:21.970669+0000","last_unstale":"2024-04-26T12:42:41.068640+0000","last_undegraded":"2024-04-26T12:42:41.068640+0000","last_fullsized":"2024-04-26T12:42:41.068640+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:18.013624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'23","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071983+0000","last_change":"2024-04-26T12:42:21.964762+0000","last_active":"2024-04-26T12:42:41.071983+0000","last_peered":"2024-04-26T12:42:41.071983+0000","last_clean":"2024-04-26T12:42:41.071983+0000","last_became_active":"2024-04-26T12:42:21.961965+0000","last_became_peered":"2024-04-26T12:42:21.961965+0000","last_unstale":"2024-04-26T12:42:41.071983+0000","last_undegraded":"2024-04-26T12:42:41.071983+0000","last_fullsized":"2024-04-26T12:42:41.071983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:11.098641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068239+0000","last_change":"2024-04-26T12:42:34.025570+0000","last_active":"2024-04-26T12:42:41.068239+0000","last_peered":"2024-04-26T12:42:41.068239+0000","last_clean":"2024-04-26T12:42:41.068239+0000","last_became_active":"2024-04-26T12:42:34.024880+0000","last_became_peered":"2024-04-26T12:42:34.024880+0000","last_unstale":"2024-04-26T12:42:41.068239+0000","last_undegraded":"2024-04-26T12:42:41.068239+0000","last_fullsized":"2024-04-26T12:42:41.068239+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:55.070371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"117'19","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410111+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:42:41.410111+0000","last_peered":"2024-04-26T12:42:41.410111+0000","last_clean":"2024-04-26T12:42:41.410111+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:42:41.410111+0000","last_undegraded":"2024-04-26T12:42:41.410111+0000","last_fullsized":"2024-04-26T12:42:41.410111+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":185,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070064+0000","last_change":"2024-04-26T12:42:21.942927+0000","last_active":"2024-04-26T12:42:41.070064+0000","last_peered":"2024-04-26T12:42:41.070064+0000","last_clean":"2024-04-26T12:42:41.070064+0000","last_became_active":"2024-04-26T12:42:21.941594+0000","last_became_peered":"2024-04-26T12:42:21.941594+0000","last_unstale":"2024-04-26T12:42:41.070064+0000","last_undegraded":"2024-04-26T12:42:41.070064+0000","last_fullsized":"2024-04-26T12:42:41.070064+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:04.021398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'27","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520265+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:42:42.520265+0000","last_peered":"2024-04-26T12:42:42.520265+0000","last_clean":"2024-04-26T12:42:42.520265+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:42:42.520265+0000","last_undegraded":"2024-04-26T12:42:42.520265+0000","last_fullsized":"2024-04-26T12:42:42.520265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"117'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517260+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:42:42.517260+0000","last_peered":"2024-04-26T12:42:42.517260+0000","last_clean":"2024-04-26T12:42:42.517260+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:42:42.517260+0000","last_undegraded":"2024-04-26T12:42:42.517260+0000","last_fullsized":"2024-04-26T12:42:42.517260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"117'32","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073767+0000","last_change":"2024-04-26T12:42:21.951944+0000","last_active":"2024-04-26T12:42:41.073767+0000","last_peered":"2024-04-26T12:42:41.073767+0000","last_clean":"2024-04-26T12:42:41.073767+0000","last_became_active":"2024-04-26T12:42:21.948694+0000","last_became_peered":"2024-04-26T12:42:21.948694+0000","last_unstale":"2024-04-26T12:42:41.073767+0000","last_undegraded":"2024-04-26T12:42:41.073767+0000","last_fullsized":"2024-04-26T12:42:41.073767+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:27.567798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132120576,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":289,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071522+0000","last_change":"2024-04-26T12:42:21.957965+0000","last_active":"2024-04-26T12:42:41.071522+0000","last_peered":"2024-04-26T12:42:41.071522+0000","last_clean":"2024-04-26T12:42:41.071522+0000","last_became_active":"2024-04-26T12:42:21.956925+0000","last_became_peered":"2024-04-26T12:42:21.956925+0000","last_unstale":"2024-04-26T12:42:41.071522+0000","last_undegraded":"2024-04-26T12:42:41.071522+0000","last_fullsized":"2024-04-26T12:42:41.071522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:23.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'29","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123130+0000","last_change":"2024-04-26T12:42:21.950280+0000","last_active":"2024-04-26T12:42:42.123130+0000","last_peered":"2024-04-26T12:42:42.123130+0000","last_clean":"2024-04-26T12:42:42.123130+0000","last_became_active":"2024-04-26T12:42:21.949469+0000","last_became_peered":"2024-04-26T12:42:21.949469+0000","last_unstale":"2024-04-26T12:42:42.123130+0000","last_undegraded":"2024-04-26T12:42:42.123130+0000","last_fullsized":"2024-04-26T12:42:42.123130+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:05.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067819+0000","last_change":"2024-04-26T12:42:34.019992+0000","last_active":"2024-04-26T12:42:41.067819+0000","last_peered":"2024-04-26T12:42:41.067819+0000","last_clean":"2024-04-26T12:42:41.067819+0000","last_became_active":"2024-04-26T12:42:34.018659+0000","last_became_peered":"2024-04-26T12:42:34.018659+0000","last_unstale":"2024-04-26T12:42:41.067819+0000","last_undegraded":"2024-04-26T12:42:41.067819+0000","last_fullsized":"2024-04-26T12:42:41.067819+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:24.593225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'18","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069486+0000","last_change":"2024-04-26T12:42:21.933174+0000","last_active":"2024-04-26T12:42:41.069486+0000","last_peered":"2024-04-26T12:42:41.069486+0000","last_clean":"2024-04-26T12:42:41.069486+0000","last_became_active":"2024-04-26T12:42:21.932263+0000","last_became_peered":"2024-04-26T12:42:21.932263+0000","last_unstale":"2024-04-26T12:42:41.069486+0000","last_undegraded":"2024-04-26T12:42:41.069486+0000","last_fullsized":"2024-04-26T12:42:41.069486+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:26.946555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"117'4","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976542+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:42:41.976542+0000","last_peered":"2024-04-26T12:42:41.976542+0000","last_clean":"2024-04-26T12:42:41.976542+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:42:41.976542+0000","last_undegraded":"2024-04-26T12:42:41.976542+0000","last_fullsized":"2024-04-26T12:42:41.976542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"112'16","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122214+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:42:42.122214+0000","last_peered":"2024-04-26T12:42:42.122214+0000","last_clean":"2024-04-26T12:42:42.122214+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:42:42.122214+0000","last_undegraded":"2024-04-26T12:42:42.122214+0000","last_fullsized":"2024-04-26T12:42:42.122214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068189+0000","last_change":"2024-04-26T12:42:34.024717+0000","last_active":"2024-04-26T12:42:41.068189+0000","last_peered":"2024-04-26T12:42:41.068189+0000","last_clean":"2024-04-26T12:42:41.068189+0000","last_became_active":"2024-04-26T12:42:34.023978+0000","last_became_peered":"2024-04-26T12:42:34.023978+0000","last_unstale":"2024-04-26T12:42:41.068189+0000","last_undegraded":"2024-04-26T12:42:41.068189+0000","last_fullsized":"2024-04-26T12:42:41.068189+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'23","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071543+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:42:41.071543+0000","last_peered":"2024-04-26T12:42:41.071543+0000","last_clean":"2024-04-26T12:42:41.071543+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:42:41.071543+0000","last_undegraded":"2024-04-26T12:42:41.071543+0000","last_fullsized":"2024-04-26T12:42:41.071543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520003+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:42:42.520003+0000","last_peered":"2024-04-26T12:42:42.520003+0000","last_clean":"2024-04-26T12:42:42.520003+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:42:42.520003+0000","last_undegraded":"2024-04-26T12:42:42.520003+0000","last_fullsized":"2024-04-26T12:42:42.520003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'17","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514500+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:42:42.514500+0000","last_peered":"2024-04-26T12:42:42.514500+0000","last_clean":"2024-04-26T12:42:42.514500+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:42:42.514500+0000","last_undegraded":"2024-04-26T12:42:42.514500+0000","last_fullsized":"2024-04-26T12:42:42.514500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068613+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:42:41.068613+0000","last_peered":"2024-04-26T12:42:41.068613+0000","last_clean":"2024-04-26T12:42:41.068613+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:42:41.068613+0000","last_undegraded":"2024-04-26T12:42:41.068613+0000","last_fullsized":"2024-04-26T12:42:41.068613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'24","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514550+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:42:42.514550+0000","last_peered":"2024-04-26T12:42:42.514550+0000","last_clean":"2024-04-26T12:42:42.514550+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:42:42.514550+0000","last_undegraded":"2024-04-26T12:42:42.514550+0000","last_fullsized":"2024-04-26T12:42:42.514550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070772+0000","last_change":"2024-04-26T12:42:21.967040+0000","last_active":"2024-04-26T12:42:41.070772+0000","last_peered":"2024-04-26T12:42:41.070772+0000","last_clean":"2024-04-26T12:42:41.070772+0000","last_became_active":"2024-04-26T12:42:21.965634+0000","last_became_peered":"2024-04-26T12:42:21.965634+0000","last_unstale":"2024-04-26T12:42:41.070772+0000","last_undegraded":"2024-04-26T12:42:41.070772+0000","last_fullsized":"2024-04-26T12:42:41.070772+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:58.603311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'16","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976821+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:42:41.976821+0000","last_peered":"2024-04-26T12:42:41.976821+0000","last_clean":"2024-04-26T12:42:41.976821+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:42:41.976821+0000","last_undegraded":"2024-04-26T12:42:41.976821+0000","last_fullsized":"2024-04-26T12:42:41.976821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516557+0000","last_change":"2024-04-26T12:42:21.967682+0000","last_active":"2024-04-26T12:42:42.516557+0000","last_peered":"2024-04-26T12:42:42.516557+0000","last_clean":"2024-04-26T12:42:42.516557+0000","last_became_active":"2024-04-26T12:42:21.967048+0000","last_became_peered":"2024-04-26T12:42:21.967048+0000","last_unstale":"2024-04-26T12:42:42.516557+0000","last_undegraded":"2024-04-26T12:42:42.516557+0000","last_fullsized":"2024-04-26T12:42:42.516557+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:43.288294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"117'15","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123879+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:42:42.123879+0000","last_peered":"2024-04-26T12:42:42.123879+0000","last_clean":"2024-04-26T12:42:42.123879+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:42:42.123879+0000","last_undegraded":"2024-04-26T12:42:42.123879+0000","last_fullsized":"2024-04-26T12:42:42.123879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"116'24","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122836+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:42:42.122836+0000","last_peered":"2024-04-26T12:42:42.122836+0000","last_clean":"2024-04-26T12:42:42.122836+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:42:42.122836+0000","last_undegraded":"2024-04-26T12:42:42.122836+0000","last_fullsized":"2024-04-26T12:42:42.122836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070164+0000","last_change":"2024-04-26T12:42:21.937768+0000","last_active":"2024-04-26T12:42:41.070164+0000","last_peered":"2024-04-26T12:42:41.070164+0000","last_clean":"2024-04-26T12:42:41.070164+0000","last_became_active":"2024-04-26T12:42:21.936930+0000","last_became_peered":"2024-04-26T12:42:21.936930+0000","last_unstale":"2024-04-26T12:42:41.070164+0000","last_undegraded":"2024-04-26T12:42:41.070164+0000","last_fullsized":"2024-04-26T12:42:41.070164+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.253226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"117'25","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408802+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:42:41.408802+0000","last_peered":"2024-04-26T12:42:41.408802+0000","last_clean":"2024-04-26T12:42:41.408802+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:42:41.408802+0000","last_undegraded":"2024-04-26T12:42:41.408802+0000","last_fullsized":"2024-04-26T12:42:41.408802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"117'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123586+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:42:42.123586+0000","last_peered":"2024-04-26T12:42:42.123586+0000","last_clean":"2024-04-26T12:42:42.123586+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:42:42.123586+0000","last_undegraded":"2024-04-26T12:42:42.123586+0000","last_fullsized":"2024-04-26T12:42:42.123586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":336,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1076,"ondisk_log_size":1076,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382929,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":607,"num_write":463,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":756,"ondisk_log_size":756,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1275,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1700564,"kb_used_data":1669384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92671276,"statfs":{"total":96636764160,"available":94895386624,"internally_reserved":0,"allocated":1709449216,"data_stored":1708733495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1136708,"kb_used_data":1105528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93235132,"statfs":{"total":96636764160,"available":95472775168,"internally_reserved":0,"allocated":1132060672,"data_stored":1131374253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1950060,"kb_used_data":1914712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92421780,"statfs":{"total":96636764160,"available":94639902720,"internally_reserved":0,"allocated":1960665088,"data_stored":1959919116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1808444,"kb_used_data":1777264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92563396,"statfs":{"total":96636764160,"available":94784917504,"internally_reserved":0,"allocated":1819918336,"data_stored":1819239618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":122,"seq":523986010118,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1942864,"kb_used_data":1906500,"kb_used_omap":6,"kb_used_meta":36345,"kb_avail":92428976,"statfs":{"total":96636764160,"available":94647271424,"internally_reserved":0,"allocated":1952256000,"data_stored":1951536896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6715,"internal_metadata":37217733},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163388,"kb_used_data":1128048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93208452,"statfs":{"total":96636764160,"available":95445454848,"internally_reserved":0,"allocated":1155121152,"data_stored":1154442923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1130840,"kb_used_data":1091340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93241000,"statfs":{"total":96636764160,"available":95478784000,"internally_reserved":0,"allocated":1117532160,"data_stored":1116813587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1762172,"kb_used_data":1726832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92609668,"statfs":{"total":96636764160,"available":94832300032,"internally_reserved":0,"allocated":1768275968,"data_stored":1767576542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1765801984,"data_stored":1765801984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1115684864,"data_stored":1115684864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1153433600,"data_stored":1153433600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1958739968,"data_stored":1958739968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1130364928,"data_stored":1130364928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1707081728,"data_stored":1707081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":175679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":176622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":176872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:42:45.016 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T12:42:45.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T12:42:45.381 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-26T12:42:45.390 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-26T12:42:45.390 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:42:45.391 INFO:tasks.rgw.client.0.smithi016.stdout:2024-04-26T12:42:45.389+0000 7f9464548640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31343) UID: 0 2024-04-26T12:42:45.391 INFO:tasks.rgw.client.0.smithi016.stdout:2024-04-26T12:42:45.389+0000 7f9467d90a40 -1 shutting down 2024-04-26T12:42:50.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-26T12:42:51.491 INFO:tasks.rgw.client.0:Stopped 2024-04-26T12:42:51.492 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-26T12:42:51.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/vault-root-token 2024-04-26T12:42:51.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-26T12:42:51.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-26T12:42:51.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-26T12:42:51.609 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-26T12:42:52.905 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T12:42:52.914 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T12:42:52.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:42:53.231 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:42:53.237 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:42:53.250 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-04-26T12:42:52.787702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819921,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3100,"num_read_kb":2786,"num_write":2843,"num_write_kb":6187910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3903,"ondisk_log_size":3903,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595036,"kb_used_data":12319632,"kb_used_omap":17,"kb_used_meta":275310,"kb_avail":742379684,"statfs":{"total":773094113280,"available":760196796416,"internally_reserved":0,"allocated":12615303168,"data_stored":12609652126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17874,"internal_metadata":281917998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.724283"},"pg_stats":[{"pgid":"3.3f","version":"116'21","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519202+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:42:42.519202+0000","last_peered":"2024-04-26T12:42:42.519202+0000","last_clean":"2024-04-26T12:42:42.519202+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:42:42.519202+0000","last_undegraded":"2024-04-26T12:42:42.519202+0000","last_fullsized":"2024-04-26T12:42:42.519202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"117'6","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121480+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:42:42.121480+0000","last_peered":"2024-04-26T12:42:42.121480+0000","last_clean":"2024-04-26T12:42:42.121480+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:42:42.121480+0000","last_undegraded":"2024-04-26T12:42:42.121480+0000","last_fullsized":"2024-04-26T12:42:42.121480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'16","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409799+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:42:41.409799+0000","last_peered":"2024-04-26T12:42:41.409799+0000","last_clean":"2024-04-26T12:42:41.409799+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:42:41.409799+0000","last_undegraded":"2024-04-26T12:42:41.409799+0000","last_fullsized":"2024-04-26T12:42:41.409799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518093+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:42:42.518093+0000","last_peered":"2024-04-26T12:42:42.518093+0000","last_clean":"2024-04-26T12:42:42.518093+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:42:42.518093+0000","last_undegraded":"2024-04-26T12:42:42.518093+0000","last_fullsized":"2024-04-26T12:42:42.518093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069713+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:42:41.069713+0000","last_peered":"2024-04-26T12:42:41.069713+0000","last_clean":"2024-04-26T12:42:41.069713+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:42:41.069713+0000","last_undegraded":"2024-04-26T12:42:41.069713+0000","last_fullsized":"2024-04-26T12:42:41.069713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066786+0000","last_change":"2024-04-26T12:42:34.019445+0000","last_active":"2024-04-26T12:42:41.066786+0000","last_peered":"2024-04-26T12:42:41.066786+0000","last_clean":"2024-04-26T12:42:41.066786+0000","last_became_active":"2024-04-26T12:42:34.016025+0000","last_became_peered":"2024-04-26T12:42:34.016025+0000","last_unstale":"2024-04-26T12:42:41.066786+0000","last_undegraded":"2024-04-26T12:42:41.066786+0000","last_fullsized":"2024-04-26T12:42:41.066786+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:55.436710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'31","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123102+0000","last_change":"2024-04-26T12:42:21.947248+0000","last_active":"2024-04-26T12:42:42.123102+0000","last_peered":"2024-04-26T12:42:42.123102+0000","last_clean":"2024-04-26T12:42:42.123102+0000","last_became_active":"2024-04-26T12:42:21.946477+0000","last_became_peered":"2024-04-26T12:42:21.946477+0000","last_unstale":"2024-04-26T12:42:42.123102+0000","last_undegraded":"2024-04-26T12:42:42.123102+0000","last_fullsized":"2024-04-26T12:42:42.123102+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.347007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069100+0000","last_change":"2024-04-26T12:42:21.958105+0000","last_active":"2024-04-26T12:42:41.069100+0000","last_peered":"2024-04-26T12:42:41.069100+0000","last_clean":"2024-04-26T12:42:41.069100+0000","last_became_active":"2024-04-26T12:42:21.956507+0000","last_became_peered":"2024-04-26T12:42:21.956507+0000","last_unstale":"2024-04-26T12:42:41.069100+0000","last_undegraded":"2024-04-26T12:42:41.069100+0000","last_fullsized":"2024-04-26T12:42:41.069100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'25","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513970+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:42:42.513970+0000","last_peered":"2024-04-26T12:42:42.513970+0000","last_clean":"2024-04-26T12:42:42.513970+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:42:42.513970+0000","last_undegraded":"2024-04-26T12:42:42.513970+0000","last_fullsized":"2024-04-26T12:42:42.513970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520555+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:42:42.520555+0000","last_peered":"2024-04-26T12:42:42.520555+0000","last_clean":"2024-04-26T12:42:42.520555+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:42:42.520555+0000","last_undegraded":"2024-04-26T12:42:42.520555+0000","last_fullsized":"2024-04-26T12:42:42.520555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'25","reported_seq":228,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975912+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:42:41.975912+0000","last_peered":"2024-04-26T12:42:41.975912+0000","last_clean":"2024-04-26T12:42:41.975912+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:42:41.975912+0000","last_undegraded":"2024-04-26T12:42:41.975912+0000","last_fullsized":"2024-04-26T12:42:41.975912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":122,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066858+0000","last_change":"2024-04-26T12:42:34.007918+0000","last_active":"2024-04-26T12:42:41.066858+0000","last_peered":"2024-04-26T12:42:41.066858+0000","last_clean":"2024-04-26T12:42:41.066858+0000","last_became_active":"2024-04-26T12:42:34.006179+0000","last_became_peered":"2024-04-26T12:42:34.006179+0000","last_unstale":"2024-04-26T12:42:41.066858+0000","last_undegraded":"2024-04-26T12:42:41.066858+0000","last_fullsized":"2024-04-26T12:42:41.066858+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:13.173789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'22","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513774+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:42:42.513774+0000","last_peered":"2024-04-26T12:42:42.513774+0000","last_clean":"2024-04-26T12:42:42.513774+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:42:42.513774+0000","last_undegraded":"2024-04-26T12:42:42.513774+0000","last_fullsized":"2024-04-26T12:42:42.513774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123326+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:42:42.123326+0000","last_peered":"2024-04-26T12:42:42.123326+0000","last_clean":"2024-04-26T12:42:42.123326+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:42:42.123326+0000","last_undegraded":"2024-04-26T12:42:42.123326+0000","last_fullsized":"2024-04-26T12:42:42.123326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"117'13","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067810+0000","last_change":"2024-04-26T12:42:21.952625+0000","last_active":"2024-04-26T12:42:41.067810+0000","last_peered":"2024-04-26T12:42:41.067810+0000","last_clean":"2024-04-26T12:42:41.067810+0000","last_became_active":"2024-04-26T12:42:21.948971+0000","last_became_peered":"2024-04-26T12:42:21.948971+0000","last_unstale":"2024-04-26T12:42:41.067810+0000","last_undegraded":"2024-04-26T12:42:41.067810+0000","last_fullsized":"2024-04-26T12:42:41.067810+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:55.735297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977969+0000","last_change":"2024-04-26T12:42:21.965782+0000","last_active":"2024-04-26T12:42:41.977969+0000","last_peered":"2024-04-26T12:42:41.977969+0000","last_clean":"2024-04-26T12:42:41.977969+0000","last_became_active":"2024-04-26T12:42:21.964820+0000","last_became_peered":"2024-04-26T12:42:21.964820+0000","last_unstale":"2024-04-26T12:42:41.977969+0000","last_undegraded":"2024-04-26T12:42:41.977969+0000","last_fullsized":"2024-04-26T12:42:41.977969+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:07.092768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":168,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066034+0000","last_change":"2024-04-26T12:42:34.005982+0000","last_active":"2024-04-26T12:42:41.066034+0000","last_peered":"2024-04-26T12:42:41.066034+0000","last_clean":"2024-04-26T12:42:41.066034+0000","last_became_active":"2024-04-26T12:42:34.003575+0000","last_became_peered":"2024-04-26T12:42:34.003575+0000","last_unstale":"2024-04-26T12:42:41.066034+0000","last_undegraded":"2024-04-26T12:42:41.066034+0000","last_fullsized":"2024-04-26T12:42:41.066034+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:19.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'25","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516034+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:42:42.516034+0000","last_peered":"2024-04-26T12:42:42.516034+0000","last_clean":"2024-04-26T12:42:42.516034+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:42:42.516034+0000","last_undegraded":"2024-04-26T12:42:42.516034+0000","last_fullsized":"2024-04-26T12:42:42.516034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"117'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518358+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:42:42.518358+0000","last_peered":"2024-04-26T12:42:42.518358+0000","last_clean":"2024-04-26T12:42:42.518358+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:42:42.518358+0000","last_undegraded":"2024-04-26T12:42:42.518358+0000","last_fullsized":"2024-04-26T12:42:42.518358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"115'35","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516148+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:42:42.516148+0000","last_peered":"2024-04-26T12:42:42.516148+0000","last_clean":"2024-04-26T12:42:42.516148+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:42:42.516148+0000","last_undegraded":"2024-04-26T12:42:42.516148+0000","last_fullsized":"2024-04-26T12:42:42.516148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":45,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122421+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:42:42.122421+0000","last_peered":"2024-04-26T12:42:42.122421+0000","last_clean":"2024-04-26T12:42:42.122421+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:42:42.122421+0000","last_undegraded":"2024-04-26T12:42:42.122421+0000","last_fullsized":"2024-04-26T12:42:42.122421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'28","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515382+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:42:42.515382+0000","last_peered":"2024-04-26T12:42:42.515382+0000","last_clean":"2024-04-26T12:42:42.515382+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:42:42.515382+0000","last_undegraded":"2024-04-26T12:42:42.515382+0000","last_fullsized":"2024-04-26T12:42:42.515382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976530+0000","last_change":"2024-04-26T12:42:21.957465+0000","last_active":"2024-04-26T12:42:41.976530+0000","last_peered":"2024-04-26T12:42:41.976530+0000","last_clean":"2024-04-26T12:42:41.976530+0000","last_became_active":"2024-04-26T12:42:21.956566+0000","last_became_peered":"2024-04-26T12:42:21.956566+0000","last_unstale":"2024-04-26T12:42:41.976530+0000","last_undegraded":"2024-04-26T12:42:41.976530+0000","last_fullsized":"2024-04-26T12:42:41.976530+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:30.300637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"115'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066651+0000","last_change":"2024-04-26T12:42:34.024102+0000","last_active":"2024-04-26T12:42:41.066651+0000","last_peered":"2024-04-26T12:42:41.066651+0000","last_clean":"2024-04-26T12:42:41.066651+0000","last_became_active":"2024-04-26T12:42:34.022426+0000","last_became_peered":"2024-04-26T12:42:34.022426+0000","last_unstale":"2024-04-26T12:42:41.066651+0000","last_undegraded":"2024-04-26T12:42:41.066651+0000","last_fullsized":"2024-04-26T12:42:41.066651+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:21.509191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976221+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:42:41.976221+0000","last_peered":"2024-04-26T12:42:41.976221+0000","last_clean":"2024-04-26T12:42:41.976221+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:42:41.976221+0000","last_undegraded":"2024-04-26T12:42:41.976221+0000","last_fullsized":"2024-04-26T12:42:41.976221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'21","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070281+0000","last_change":"2024-04-26T12:42:21.946507+0000","last_active":"2024-04-26T12:42:41.070281+0000","last_peered":"2024-04-26T12:42:41.070281+0000","last_clean":"2024-04-26T12:42:41.070281+0000","last_became_active":"2024-04-26T12:42:21.932303+0000","last_became_peered":"2024-04-26T12:42:21.932303+0000","last_unstale":"2024-04-26T12:42:41.070281+0000","last_undegraded":"2024-04-26T12:42:41.070281+0000","last_fullsized":"2024-04-26T12:42:41.070281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:48.132898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":113,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066875+0000","last_change":"2024-04-26T12:42:34.027080+0000","last_active":"2024-04-26T12:42:41.066875+0000","last_peered":"2024-04-26T12:42:41.066875+0000","last_clean":"2024-04-26T12:42:41.066875+0000","last_became_active":"2024-04-26T12:42:34.025281+0000","last_became_peered":"2024-04-26T12:42:34.025281+0000","last_unstale":"2024-04-26T12:42:41.066875+0000","last_undegraded":"2024-04-26T12:42:41.066875+0000","last_fullsized":"2024-04-26T12:42:41.066875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:16.292958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"115'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069550+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:42:41.069550+0000","last_peered":"2024-04-26T12:42:41.069550+0000","last_clean":"2024-04-26T12:42:41.069550+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:42:41.069550+0000","last_undegraded":"2024-04-26T12:42:41.069550+0000","last_fullsized":"2024-04-26T12:42:41.069550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065496+0000","last_change":"2024-04-26T12:42:34.014303+0000","last_active":"2024-04-26T12:42:41.065496+0000","last_peered":"2024-04-26T12:42:41.065496+0000","last_clean":"2024-04-26T12:42:41.065496+0000","last_became_active":"2024-04-26T12:42:34.013263+0000","last_became_peered":"2024-04-26T12:42:34.013263+0000","last_unstale":"2024-04-26T12:42:41.065496+0000","last_undegraded":"2024-04-26T12:42:41.065496+0000","last_fullsized":"2024-04-26T12:42:41.065496+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:35.131864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072787+0000","last_change":"2024-04-26T12:42:21.967042+0000","last_active":"2024-04-26T12:42:41.072787+0000","last_peered":"2024-04-26T12:42:41.072787+0000","last_clean":"2024-04-26T12:42:41.072787+0000","last_became_active":"2024-04-26T12:42:21.961909+0000","last_became_peered":"2024-04-26T12:42:21.961909+0000","last_unstale":"2024-04-26T12:42:41.072787+0000","last_undegraded":"2024-04-26T12:42:41.072787+0000","last_fullsized":"2024-04-26T12:42:41.072787+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:33.810933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'18","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513868+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:42:42.513868+0000","last_peered":"2024-04-26T12:42:42.513868+0000","last_clean":"2024-04-26T12:42:42.513868+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:42:42.513868+0000","last_undegraded":"2024-04-26T12:42:42.513868+0000","last_fullsized":"2024-04-26T12:42:42.513868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122848+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:42:42.122848+0000","last_peered":"2024-04-26T12:42:42.122848+0000","last_clean":"2024-04-26T12:42:42.122848+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:42:42.122848+0000","last_undegraded":"2024-04-26T12:42:42.122848+0000","last_fullsized":"2024-04-26T12:42:42.122848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070613+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:42:41.070613+0000","last_peered":"2024-04-26T12:42:41.070613+0000","last_clean":"2024-04-26T12:42:41.070613+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:42:41.070613+0000","last_undegraded":"2024-04-26T12:42:41.070613+0000","last_fullsized":"2024-04-26T12:42:41.070613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516269+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:42:42.516269+0000","last_peered":"2024-04-26T12:42:42.516269+0000","last_clean":"2024-04-26T12:42:42.516269+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:42:42.516269+0000","last_undegraded":"2024-04-26T12:42:42.516269+0000","last_fullsized":"2024-04-26T12:42:42.516269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"117'48","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121554+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:42:42.121554+0000","last_peered":"2024-04-26T12:42:42.121554+0000","last_clean":"2024-04-26T12:42:42.121554+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:42:42.121554+0000","last_undegraded":"2024-04-26T12:42:42.121554+0000","last_fullsized":"2024-04-26T12:42:42.121554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123831+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:42:42.123831+0000","last_peered":"2024-04-26T12:42:42.123831+0000","last_clean":"2024-04-26T12:42:42.123831+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:42:42.123831+0000","last_undegraded":"2024-04-26T12:42:42.123831+0000","last_fullsized":"2024-04-26T12:42:42.123831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'34","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069854+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:42:41.069854+0000","last_peered":"2024-04-26T12:42:41.069854+0000","last_clean":"2024-04-26T12:42:41.069854+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:42:41.069854+0000","last_undegraded":"2024-04-26T12:42:41.069854+0000","last_fullsized":"2024-04-26T12:42:41.069854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074395+0000","last_change":"2024-04-26T12:42:21.970469+0000","last_active":"2024-04-26T12:42:41.074395+0000","last_peered":"2024-04-26T12:42:41.074395+0000","last_clean":"2024-04-26T12:42:41.074395+0000","last_became_active":"2024-04-26T12:42:21.968825+0000","last_became_peered":"2024-04-26T12:42:21.968825+0000","last_unstale":"2024-04-26T12:42:41.074395+0000","last_undegraded":"2024-04-26T12:42:41.074395+0000","last_fullsized":"2024-04-26T12:42:41.074395+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:54.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":55,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066772+0000","last_change":"2024-04-26T12:42:34.021039+0000","last_active":"2024-04-26T12:42:41.066772+0000","last_peered":"2024-04-26T12:42:41.066772+0000","last_clean":"2024-04-26T12:42:41.066772+0000","last_became_active":"2024-04-26T12:42:34.018809+0000","last_became_peered":"2024-04-26T12:42:34.018809+0000","last_unstale":"2024-04-26T12:42:41.066772+0000","last_undegraded":"2024-04-26T12:42:41.066772+0000","last_fullsized":"2024-04-26T12:42:41.066772+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066660+0000","last_change":"2024-04-26T12:42:34.007481+0000","last_active":"2024-04-26T12:42:41.066660+0000","last_peered":"2024-04-26T12:42:41.066660+0000","last_clean":"2024-04-26T12:42:41.066660+0000","last_became_active":"2024-04-26T12:42:34.004534+0000","last_became_peered":"2024-04-26T12:42:34.004534+0000","last_unstale":"2024-04-26T12:42:41.066660+0000","last_undegraded":"2024-04-26T12:42:41.066660+0000","last_fullsized":"2024-04-26T12:42:41.066660+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:33.240125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068768+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:42:41.068768+0000","last_peered":"2024-04-26T12:42:41.068768+0000","last_clean":"2024-04-26T12:42:41.068768+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:42:41.068768+0000","last_undegraded":"2024-04-26T12:42:41.068768+0000","last_fullsized":"2024-04-26T12:42:41.068768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072461+0000","last_change":"2024-04-26T12:42:21.937320+0000","last_active":"2024-04-26T12:42:41.072461+0000","last_peered":"2024-04-26T12:42:41.072461+0000","last_clean":"2024-04-26T12:42:41.072461+0000","last_became_active":"2024-04-26T12:42:21.936393+0000","last_became_peered":"2024-04-26T12:42:21.936393+0000","last_unstale":"2024-04-26T12:42:41.072461+0000","last_undegraded":"2024-04-26T12:42:41.072461+0000","last_fullsized":"2024-04-26T12:42:41.072461+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:21.787788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"115'21","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513709+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:42:42.513709+0000","last_peered":"2024-04-26T12:42:42.513709+0000","last_clean":"2024-04-26T12:42:42.513709+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:42:42.513709+0000","last_undegraded":"2024-04-26T12:42:42.513709+0000","last_fullsized":"2024-04-26T12:42:42.513709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074226+0000","last_change":"2024-04-26T12:42:21.961567+0000","last_active":"2024-04-26T12:42:41.074226+0000","last_peered":"2024-04-26T12:42:41.074226+0000","last_clean":"2024-04-26T12:42:41.074226+0000","last_became_active":"2024-04-26T12:42:21.957657+0000","last_became_peered":"2024-04-26T12:42:21.957657+0000","last_unstale":"2024-04-26T12:42:41.074226+0000","last_undegraded":"2024-04-26T12:42:41.074226+0000","last_fullsized":"2024-04-26T12:42:41.074226+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:50.723405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975984+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:42:41.975984+0000","last_peered":"2024-04-26T12:42:41.975984+0000","last_clean":"2024-04-26T12:42:41.975984+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:42:41.975984+0000","last_undegraded":"2024-04-26T12:42:41.975984+0000","last_fullsized":"2024-04-26T12:42:41.975984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"139'135","reported_seq":500,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.750936+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:42:44.750936+0000","last_peered":"2024-04-26T12:42:44.750936+0000","last_clean":"2024-04-26T12:42:44.750936+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:42:44.750936+0000","last_undegraded":"2024-04-26T12:42:44.750936+0000","last_fullsized":"2024-04-26T12:42:44.750936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066020+0000","last_change":"2024-04-26T12:42:34.015888+0000","last_active":"2024-04-26T12:42:41.066020+0000","last_peered":"2024-04-26T12:42:41.066020+0000","last_clean":"2024-04-26T12:42:41.066020+0000","last_became_active":"2024-04-26T12:42:34.015101+0000","last_became_peered":"2024-04-26T12:42:34.015101+0000","last_unstale":"2024-04-26T12:42:41.066020+0000","last_undegraded":"2024-04-26T12:42:41.066020+0000","last_fullsized":"2024-04-26T12:42:41.066020+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:23.606728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074777+0000","last_change":"2024-04-26T12:42:21.971692+0000","last_active":"2024-04-26T12:42:41.074777+0000","last_peered":"2024-04-26T12:42:41.074777+0000","last_clean":"2024-04-26T12:42:41.074777+0000","last_became_active":"2024-04-26T12:42:21.970815+0000","last_became_peered":"2024-04-26T12:42:21.970815+0000","last_unstale":"2024-04-26T12:42:41.074777+0000","last_undegraded":"2024-04-26T12:42:41.074777+0000","last_fullsized":"2024-04-26T12:42:41.074777+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:03.033305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'28","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513771+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:42:42.513771+0000","last_peered":"2024-04-26T12:42:42.513771+0000","last_clean":"2024-04-26T12:42:42.513771+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:42:42.513771+0000","last_undegraded":"2024-04-26T12:42:42.513771+0000","last_fullsized":"2024-04-26T12:42:42.513771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123181+0000","last_change":"2024-04-26T12:42:21.926752+0000","last_active":"2024-04-26T12:42:42.123181+0000","last_peered":"2024-04-26T12:42:42.123181+0000","last_clean":"2024-04-26T12:42:42.123181+0000","last_became_active":"2024-04-26T12:42:21.926086+0000","last_became_peered":"2024-04-26T12:42:21.926086+0000","last_unstale":"2024-04-26T12:42:42.123181+0000","last_undegraded":"2024-04-26T12:42:42.123181+0000","last_fullsized":"2024-04-26T12:42:42.123181+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.645084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"117'17","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518589+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:42:42.518589+0000","last_peered":"2024-04-26T12:42:42.518589+0000","last_clean":"2024-04-26T12:42:42.518589+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:42:42.518589+0000","last_undegraded":"2024-04-26T12:42:42.518589+0000","last_fullsized":"2024-04-26T12:42:42.518589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"139'137","reported_seq":414,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751637+0000","last_change":"2024-04-26T12:42:21.973003+0000","last_active":"2024-04-26T12:42:44.751637+0000","last_peered":"2024-04-26T12:42:44.751637+0000","last_clean":"2024-04-26T12:42:44.751637+0000","last_became_active":"2024-04-26T12:42:21.972298+0000","last_became_peered":"2024-04-26T12:42:21.972298+0000","last_unstale":"2024-04-26T12:42:44.751637+0000","last_undegraded":"2024-04-26T12:42:44.751637+0000","last_fullsized":"2024-04-26T12:42:44.751637+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:09.716281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122553+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:42:42.122553+0000","last_peered":"2024-04-26T12:42:42.122553+0000","last_clean":"2024-04-26T12:42:42.122553+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:42:42.122553+0000","last_undegraded":"2024-04-26T12:42:42.122553+0000","last_fullsized":"2024-04-26T12:42:42.122553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"115'24","reported_seq":227,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977649+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:42:41.977649+0000","last_peered":"2024-04-26T12:42:41.977649+0000","last_clean":"2024-04-26T12:42:41.977649+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:42:41.977649+0000","last_undegraded":"2024-04-26T12:42:41.977649+0000","last_fullsized":"2024-04-26T12:42:41.977649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517468+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:42:42.517468+0000","last_peered":"2024-04-26T12:42:42.517468+0000","last_clean":"2024-04-26T12:42:42.517468+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:42:42.517468+0000","last_undegraded":"2024-04-26T12:42:42.517468+0000","last_fullsized":"2024-04-26T12:42:42.517468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"117'27","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121597+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:42:42.121597+0000","last_peered":"2024-04-26T12:42:42.121597+0000","last_clean":"2024-04-26T12:42:42.121597+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:42:42.121597+0000","last_undegraded":"2024-04-26T12:42:42.121597+0000","last_fullsized":"2024-04-26T12:42:42.121597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408852+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:42:41.408852+0000","last_peered":"2024-04-26T12:42:41.408852+0000","last_clean":"2024-04-26T12:42:41.408852+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:42:41.408852+0000","last_undegraded":"2024-04-26T12:42:41.408852+0000","last_fullsized":"2024-04-26T12:42:41.408852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121946+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:42:42.121946+0000","last_peered":"2024-04-26T12:42:42.121946+0000","last_clean":"2024-04-26T12:42:42.121946+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:42:42.121946+0000","last_undegraded":"2024-04-26T12:42:42.121946+0000","last_fullsized":"2024-04-26T12:42:42.121946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065995+0000","last_change":"2024-04-26T12:42:34.029770+0000","last_active":"2024-04-26T12:42:41.065995+0000","last_peered":"2024-04-26T12:42:41.065995+0000","last_clean":"2024-04-26T12:42:41.065995+0000","last_became_active":"2024-04-26T12:42:34.027515+0000","last_became_peered":"2024-04-26T12:42:34.027515+0000","last_unstale":"2024-04-26T12:42:41.065995+0000","last_undegraded":"2024-04-26T12:42:41.065995+0000","last_fullsized":"2024-04-26T12:42:41.065995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:24.498714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'20","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515684+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:42:42.515684+0000","last_peered":"2024-04-26T12:42:42.515684+0000","last_clean":"2024-04-26T12:42:42.515684+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:42:42.515684+0000","last_undegraded":"2024-04-26T12:42:42.515684+0000","last_fullsized":"2024-04-26T12:42:42.515684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975908+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:42:41.975908+0000","last_peered":"2024-04-26T12:42:41.975908+0000","last_clean":"2024-04-26T12:42:41.975908+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:42:41.975908+0000","last_undegraded":"2024-04-26T12:42:41.975908+0000","last_fullsized":"2024-04-26T12:42:41.975908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"117'19","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068371+0000","last_change":"2024-04-26T12:42:21.974974+0000","last_active":"2024-04-26T12:42:41.068371+0000","last_peered":"2024-04-26T12:42:41.068371+0000","last_clean":"2024-04-26T12:42:41.068371+0000","last_became_active":"2024-04-26T12:42:21.968492+0000","last_became_peered":"2024-04-26T12:42:21.968492+0000","last_unstale":"2024-04-26T12:42:41.068371+0000","last_undegraded":"2024-04-26T12:42:41.068371+0000","last_fullsized":"2024-04-26T12:42:41.068371+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:59.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068594+0000","last_change":"2024-04-26T12:42:21.943962+0000","last_active":"2024-04-26T12:42:41.068594+0000","last_peered":"2024-04-26T12:42:41.068594+0000","last_clean":"2024-04-26T12:42:41.068594+0000","last_became_active":"2024-04-26T12:42:21.942925+0000","last_became_peered":"2024-04-26T12:42:21.942925+0000","last_unstale":"2024-04-26T12:42:41.068594+0000","last_undegraded":"2024-04-26T12:42:41.068594+0000","last_fullsized":"2024-04-26T12:42:41.068594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:17.453438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519637+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:42:42.519637+0000","last_peered":"2024-04-26T12:42:42.519637+0000","last_clean":"2024-04-26T12:42:42.519637+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:42:42.519637+0000","last_undegraded":"2024-04-26T12:42:42.519637+0000","last_fullsized":"2024-04-26T12:42:42.519637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518899+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:42:42.518899+0000","last_peered":"2024-04-26T12:42:42.518899+0000","last_clean":"2024-04-26T12:42:42.518899+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:42:42.518899+0000","last_undegraded":"2024-04-26T12:42:42.518899+0000","last_fullsized":"2024-04-26T12:42:42.518899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"114'19","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514720+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:42:42.514720+0000","last_peered":"2024-04-26T12:42:42.514720+0000","last_clean":"2024-04-26T12:42:42.514720+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:42:42.514720+0000","last_undegraded":"2024-04-26T12:42:42.514720+0000","last_fullsized":"2024-04-26T12:42:42.514720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976781+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:42:41.976781+0000","last_peered":"2024-04-26T12:42:41.976781+0000","last_clean":"2024-04-26T12:42:41.976781+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:42:41.976781+0000","last_undegraded":"2024-04-26T12:42:41.976781+0000","last_fullsized":"2024-04-26T12:42:41.976781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"117'24","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516808+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:42:42.516808+0000","last_peered":"2024-04-26T12:42:42.516808+0000","last_clean":"2024-04-26T12:42:42.516808+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:42:42.516808+0000","last_undegraded":"2024-04-26T12:42:42.516808+0000","last_fullsized":"2024-04-26T12:42:42.516808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"139'135","reported_seq":455,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.752218+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:42:44.752218+0000","last_peered":"2024-04-26T12:42:44.752218+0000","last_clean":"2024-04-26T12:42:44.752218+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:42:44.752218+0000","last_undegraded":"2024-04-26T12:42:44.752218+0000","last_fullsized":"2024-04-26T12:42:44.752218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071038+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:42:41.071038+0000","last_peered":"2024-04-26T12:42:41.071038+0000","last_clean":"2024-04-26T12:42:41.071038+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:42:41.071038+0000","last_undegraded":"2024-04-26T12:42:41.071038+0000","last_fullsized":"2024-04-26T12:42:41.071038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072483+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:42:41.072483+0000","last_peered":"2024-04-26T12:42:41.072483+0000","last_clean":"2024-04-26T12:42:41.072483+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:42:41.072483+0000","last_undegraded":"2024-04-26T12:42:41.072483+0000","last_fullsized":"2024-04-26T12:42:41.072483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'18","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122964+0000","last_change":"2024-04-26T12:42:21.959737+0000","last_active":"2024-04-26T12:42:42.122964+0000","last_peered":"2024-04-26T12:42:42.122964+0000","last_clean":"2024-04-26T12:42:42.122964+0000","last_became_active":"2024-04-26T12:42:21.959122+0000","last_became_peered":"2024-04-26T12:42:21.959122+0000","last_unstale":"2024-04-26T12:42:42.122964+0000","last_undegraded":"2024-04-26T12:42:42.122964+0000","last_fullsized":"2024-04-26T12:42:42.122964+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:53.425209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976180+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:42:41.976180+0000","last_peered":"2024-04-26T12:42:41.976180+0000","last_clean":"2024-04-26T12:42:41.976180+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:42:41.976180+0000","last_undegraded":"2024-04-26T12:42:41.976180+0000","last_fullsized":"2024-04-26T12:42:41.976180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"117'29","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070847+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:42:41.070847+0000","last_peered":"2024-04-26T12:42:41.070847+0000","last_clean":"2024-04-26T12:42:41.070847+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:42:41.070847+0000","last_undegraded":"2024-04-26T12:42:41.070847+0000","last_fullsized":"2024-04-26T12:42:41.070847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975732+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:42:41.975732+0000","last_peered":"2024-04-26T12:42:41.975732+0000","last_clean":"2024-04-26T12:42:41.975732+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:42:41.975732+0000","last_undegraded":"2024-04-26T12:42:41.975732+0000","last_fullsized":"2024-04-26T12:42:41.975732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'7","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409967+0000","last_change":"2024-04-26T12:42:21.935665+0000","last_active":"2024-04-26T12:42:41.409967+0000","last_peered":"2024-04-26T12:42:41.409967+0000","last_clean":"2024-04-26T12:42:41.409967+0000","last_became_active":"2024-04-26T12:42:21.934686+0000","last_became_peered":"2024-04-26T12:42:21.934686+0000","last_unstale":"2024-04-26T12:42:41.409967+0000","last_undegraded":"2024-04-26T12:42:41.409967+0000","last_fullsized":"2024-04-26T12:42:41.409967+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:39.070102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"117'4","reported_seq":230,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067873+0000","last_change":"2024-04-26T12:42:34.032506+0000","last_active":"2024-04-26T12:42:41.067873+0000","last_peered":"2024-04-26T12:42:41.067873+0000","last_clean":"2024-04-26T12:42:41.067873+0000","last_became_active":"2024-04-26T12:42:34.031776+0000","last_became_peered":"2024-04-26T12:42:34.031776+0000","last_unstale":"2024-04-26T12:42:41.067873+0000","last_undegraded":"2024-04-26T12:42:41.067873+0000","last_fullsized":"2024-04-26T12:42:41.067873+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:40.297834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'26","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069641+0000","last_change":"2024-04-26T12:42:21.974477+0000","last_active":"2024-04-26T12:42:41.069641+0000","last_peered":"2024-04-26T12:42:41.069641+0000","last_clean":"2024-04-26T12:42:41.069641+0000","last_became_active":"2024-04-26T12:42:21.967072+0000","last_became_peered":"2024-04-26T12:42:21.967072+0000","last_unstale":"2024-04-26T12:42:41.069641+0000","last_undegraded":"2024-04-26T12:42:41.069641+0000","last_fullsized":"2024-04-26T12:42:41.069641+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.202160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976323+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:42:41.976323+0000","last_peered":"2024-04-26T12:42:41.976323+0000","last_clean":"2024-04-26T12:42:41.976323+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:42:41.976323+0000","last_undegraded":"2024-04-26T12:42:41.976323+0000","last_fullsized":"2024-04-26T12:42:41.976323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"117'19","reported_seq":65,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066738+0000","last_change":"2024-04-26T12:42:34.028589+0000","last_active":"2024-04-26T12:42:41.066738+0000","last_peered":"2024-04-26T12:42:41.066738+0000","last_clean":"2024-04-26T12:42:41.066738+0000","last_became_active":"2024-04-26T12:42:34.027524+0000","last_became_peered":"2024-04-26T12:42:34.027524+0000","last_unstale":"2024-04-26T12:42:41.066738+0000","last_undegraded":"2024-04-26T12:42:41.066738+0000","last_fullsized":"2024-04-26T12:42:41.066738+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:11.088686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070014+0000","last_change":"2024-04-26T12:42:21.938337+0000","last_active":"2024-04-26T12:42:41.070014+0000","last_peered":"2024-04-26T12:42:41.070014+0000","last_clean":"2024-04-26T12:42:41.070014+0000","last_became_active":"2024-04-26T12:42:21.937057+0000","last_became_peered":"2024-04-26T12:42:21.937057+0000","last_unstale":"2024-04-26T12:42:41.070014+0000","last_undegraded":"2024-04-26T12:42:41.070014+0000","last_fullsized":"2024-04-26T12:42:41.070014+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:16.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072835+0000","last_change":"2024-04-26T12:42:21.957634+0000","last_active":"2024-04-26T12:42:41.072835+0000","last_peered":"2024-04-26T12:42:41.072835+0000","last_clean":"2024-04-26T12:42:41.072835+0000","last_became_active":"2024-04-26T12:42:21.948878+0000","last_became_peered":"2024-04-26T12:42:21.948878+0000","last_unstale":"2024-04-26T12:42:41.072835+0000","last_undegraded":"2024-04-26T12:42:41.072835+0000","last_fullsized":"2024-04-26T12:42:41.072835+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:38.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067852+0000","last_change":"2024-04-26T12:42:34.019680+0000","last_active":"2024-04-26T12:42:41.067852+0000","last_peered":"2024-04-26T12:42:41.067852+0000","last_clean":"2024-04-26T12:42:41.067852+0000","last_became_active":"2024-04-26T12:42:34.018540+0000","last_became_peered":"2024-04-26T12:42:34.018540+0000","last_unstale":"2024-04-26T12:42:41.067852+0000","last_undegraded":"2024-04-26T12:42:41.067852+0000","last_fullsized":"2024-04-26T12:42:41.067852+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:44.798659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'20","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514187+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:42:42.514187+0000","last_peered":"2024-04-26T12:42:42.514187+0000","last_clean":"2024-04-26T12:42:42.514187+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:42:42.514187+0000","last_undegraded":"2024-04-26T12:42:42.514187+0000","last_fullsized":"2024-04-26T12:42:42.514187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408883+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:42:41.408883+0000","last_peered":"2024-04-26T12:42:41.408883+0000","last_clean":"2024-04-26T12:42:41.408883+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:42:41.408883+0000","last_undegraded":"2024-04-26T12:42:41.408883+0000","last_fullsized":"2024-04-26T12:42:41.408883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"117'23","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977855+0000","last_change":"2024-04-26T12:42:21.959840+0000","last_active":"2024-04-26T12:42:41.977855+0000","last_peered":"2024-04-26T12:42:41.977855+0000","last_clean":"2024-04-26T12:42:41.977855+0000","last_became_active":"2024-04-26T12:42:21.958977+0000","last_became_peered":"2024-04-26T12:42:21.958977+0000","last_unstale":"2024-04-26T12:42:41.977855+0000","last_undegraded":"2024-04-26T12:42:41.977855+0000","last_fullsized":"2024-04-26T12:42:41.977855+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:54.837056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"139'135","reported_seq":440,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:45.557364+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:42:45.557364+0000","last_peered":"2024-04-26T12:42:45.557364+0000","last_clean":"2024-04-26T12:42:45.557364+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:42:45.557364+0000","last_undegraded":"2024-04-26T12:42:45.557364+0000","last_fullsized":"2024-04-26T12:42:45.557364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408500+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:42:41.408500+0000","last_peered":"2024-04-26T12:42:41.408500+0000","last_clean":"2024-04-26T12:42:41.408500+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:42:41.408500+0000","last_undegraded":"2024-04-26T12:42:41.408500+0000","last_fullsized":"2024-04-26T12:42:41.408500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":180,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068000+0000","last_change":"2024-04-26T12:42:34.026595+0000","last_active":"2024-04-26T12:42:41.068000+0000","last_peered":"2024-04-26T12:42:41.068000+0000","last_clean":"2024-04-26T12:42:41.068000+0000","last_became_active":"2024-04-26T12:42:34.025094+0000","last_became_peered":"2024-04-26T12:42:34.025094+0000","last_unstale":"2024-04-26T12:42:41.068000+0000","last_undegraded":"2024-04-26T12:42:41.068000+0000","last_fullsized":"2024-04-26T12:42:41.068000+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:15.877357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"117'35","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066995+0000","last_change":"2024-04-26T12:42:34.021002+0000","last_active":"2024-04-26T12:42:41.066995+0000","last_peered":"2024-04-26T12:42:41.066995+0000","last_clean":"2024-04-26T12:42:41.066995+0000","last_became_active":"2024-04-26T12:42:34.019821+0000","last_became_peered":"2024-04-26T12:42:34.019821+0000","last_unstale":"2024-04-26T12:42:41.066995+0000","last_undegraded":"2024-04-26T12:42:41.066995+0000","last_fullsized":"2024-04-26T12:42:41.066995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:02.705267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":426,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123009+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:42:42.123009+0000","last_peered":"2024-04-26T12:42:42.123009+0000","last_clean":"2024-04-26T12:42:42.123009+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:42:42.123009+0000","last_undegraded":"2024-04-26T12:42:42.123009+0000","last_fullsized":"2024-04-26T12:42:42.123009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073443+0000","last_change":"2024-04-26T12:42:21.962837+0000","last_active":"2024-04-26T12:42:41.073443+0000","last_peered":"2024-04-26T12:42:41.073443+0000","last_clean":"2024-04-26T12:42:41.073443+0000","last_became_active":"2024-04-26T12:42:21.952480+0000","last_became_peered":"2024-04-26T12:42:21.952480+0000","last_unstale":"2024-04-26T12:42:41.073443+0000","last_undegraded":"2024-04-26T12:42:41.073443+0000","last_fullsized":"2024-04-26T12:42:41.073443+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:55.807987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"139'135","reported_seq":472,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:45.559133+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:42:45.559133+0000","last_peered":"2024-04-26T12:42:45.559133+0000","last_clean":"2024-04-26T12:42:45.559133+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:42:45.559133+0000","last_undegraded":"2024-04-26T12:42:45.559133+0000","last_fullsized":"2024-04-26T12:42:45.559133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066666+0000","last_change":"2024-04-26T12:42:34.020098+0000","last_active":"2024-04-26T12:42:41.066666+0000","last_peered":"2024-04-26T12:42:41.066666+0000","last_clean":"2024-04-26T12:42:41.066666+0000","last_became_active":"2024-04-26T12:42:34.015095+0000","last_became_peered":"2024-04-26T12:42:34.015095+0000","last_unstale":"2024-04-26T12:42:41.066666+0000","last_undegraded":"2024-04-26T12:42:41.066666+0000","last_fullsized":"2024-04-26T12:42:41.066666+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:05.746648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410249+0000","last_change":"2024-04-26T12:42:21.953982+0000","last_active":"2024-04-26T12:42:41.410249+0000","last_peered":"2024-04-26T12:42:41.410249+0000","last_clean":"2024-04-26T12:42:41.410249+0000","last_became_active":"2024-04-26T12:42:21.953253+0000","last_became_peered":"2024-04-26T12:42:21.953253+0000","last_unstale":"2024-04-26T12:42:41.410249+0000","last_undegraded":"2024-04-26T12:42:41.410249+0000","last_fullsized":"2024-04-26T12:42:41.410249+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:24.067594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"115'20","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067138+0000","last_change":"2024-04-26T12:42:21.949610+0000","last_active":"2024-04-26T12:42:41.067138+0000","last_peered":"2024-04-26T12:42:41.067138+0000","last_clean":"2024-04-26T12:42:41.067138+0000","last_became_active":"2024-04-26T12:42:21.940512+0000","last_became_peered":"2024-04-26T12:42:21.940512+0000","last_unstale":"2024-04-26T12:42:41.067138+0000","last_undegraded":"2024-04-26T12:42:41.067138+0000","last_fullsized":"2024-04-26T12:42:41.067138+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:19.966458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067393+0000","last_change":"2024-04-26T12:42:34.007412+0000","last_active":"2024-04-26T12:42:41.067393+0000","last_peered":"2024-04-26T12:42:41.067393+0000","last_clean":"2024-04-26T12:42:41.067393+0000","last_became_active":"2024-04-26T12:42:34.005897+0000","last_became_peered":"2024-04-26T12:42:34.005897+0000","last_unstale":"2024-04-26T12:42:41.067393+0000","last_undegraded":"2024-04-26T12:42:41.067393+0000","last_fullsized":"2024-04-26T12:42:41.067393+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:22.483984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"117'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123154+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:42:42.123154+0000","last_peered":"2024-04-26T12:42:42.123154+0000","last_clean":"2024-04-26T12:42:42.123154+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:42:42.123154+0000","last_undegraded":"2024-04-26T12:42:42.123154+0000","last_fullsized":"2024-04-26T12:42:42.123154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520237+0000","last_change":"2024-04-26T12:42:21.947536+0000","last_active":"2024-04-26T12:42:42.520237+0000","last_peered":"2024-04-26T12:42:42.520237+0000","last_clean":"2024-04-26T12:42:42.520237+0000","last_became_active":"2024-04-26T12:42:21.946663+0000","last_became_peered":"2024-04-26T12:42:21.946663+0000","last_unstale":"2024-04-26T12:42:42.520237+0000","last_undegraded":"2024-04-26T12:42:42.520237+0000","last_fullsized":"2024-04-26T12:42:42.520237+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:31.336436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":232,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408441+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:42:41.408441+0000","last_peered":"2024-04-26T12:42:41.408441+0000","last_clean":"2024-04-26T12:42:41.408441+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:42:41.408441+0000","last_undegraded":"2024-04-26T12:42:41.408441+0000","last_fullsized":"2024-04-26T12:42:41.408441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520346+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:42:42.520346+0000","last_peered":"2024-04-26T12:42:42.520346+0000","last_clean":"2024-04-26T12:42:42.520346+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:42:42.520346+0000","last_undegraded":"2024-04-26T12:42:42.520346+0000","last_fullsized":"2024-04-26T12:42:42.520346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":406,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516883+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:42:42.516883+0000","last_peered":"2024-04-26T12:42:42.516883+0000","last_clean":"2024-04-26T12:42:42.516883+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:42:42.516883+0000","last_undegraded":"2024-04-26T12:42:42.516883+0000","last_fullsized":"2024-04-26T12:42:42.516883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122546+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:42:42.122546+0000","last_peered":"2024-04-26T12:42:42.122546+0000","last_clean":"2024-04-26T12:42:42.122546+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:42:42.122546+0000","last_undegraded":"2024-04-26T12:42:42.122546+0000","last_fullsized":"2024-04-26T12:42:42.122546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"117'33","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067725+0000","last_change":"2024-04-26T12:42:21.931544+0000","last_active":"2024-04-26T12:42:41.067725+0000","last_peered":"2024-04-26T12:42:41.067725+0000","last_clean":"2024-04-26T12:42:41.067725+0000","last_became_active":"2024-04-26T12:42:21.929093+0000","last_became_peered":"2024-04-26T12:42:21.929093+0000","last_unstale":"2024-04-26T12:42:41.067725+0000","last_undegraded":"2024-04-26T12:42:41.067725+0000","last_fullsized":"2024-04-26T12:42:41.067725+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:06.052469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518900+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:42:42.518900+0000","last_peered":"2024-04-26T12:42:42.518900+0000","last_clean":"2024-04-26T12:42:42.518900+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:42:42.518900+0000","last_undegraded":"2024-04-26T12:42:42.518900+0000","last_fullsized":"2024-04-26T12:42:42.518900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"117'39","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123490+0000","last_change":"2024-04-26T12:42:21.932409+0000","last_active":"2024-04-26T12:42:42.123490+0000","last_peered":"2024-04-26T12:42:42.123490+0000","last_clean":"2024-04-26T12:42:42.123490+0000","last_became_active":"2024-04-26T12:42:21.931114+0000","last_became_peered":"2024-04-26T12:42:21.931114+0000","last_unstale":"2024-04-26T12:42:42.123490+0000","last_undegraded":"2024-04-26T12:42:42.123490+0000","last_fullsized":"2024-04-26T12:42:42.123490+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:31.083567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182602,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071191+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:42:41.071191+0000","last_peered":"2024-04-26T12:42:41.071191+0000","last_clean":"2024-04-26T12:42:41.071191+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:42:41.071191+0000","last_undegraded":"2024-04-26T12:42:41.071191+0000","last_fullsized":"2024-04-26T12:42:41.071191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517357+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:42:42.517357+0000","last_peered":"2024-04-26T12:42:42.517357+0000","last_clean":"2024-04-26T12:42:42.517357+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:42:42.517357+0000","last_undegraded":"2024-04-26T12:42:42.517357+0000","last_fullsized":"2024-04-26T12:42:42.517357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071947+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:42:41.071947+0000","last_peered":"2024-04-26T12:42:41.071947+0000","last_clean":"2024-04-26T12:42:41.071947+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:42:41.071947+0000","last_undegraded":"2024-04-26T12:42:41.071947+0000","last_fullsized":"2024-04-26T12:42:41.071947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516595+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:42:42.516595+0000","last_peered":"2024-04-26T12:42:42.516595+0000","last_clean":"2024-04-26T12:42:42.516595+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:42:42.516595+0000","last_undegraded":"2024-04-26T12:42:42.516595+0000","last_fullsized":"2024-04-26T12:42:42.516595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"115'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071136+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:42:41.071136+0000","last_peered":"2024-04-26T12:42:41.071136+0000","last_clean":"2024-04-26T12:42:41.071136+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:42:41.071136+0000","last_undegraded":"2024-04-26T12:42:41.071136+0000","last_fullsized":"2024-04-26T12:42:41.071136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123676+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:42:42.123676+0000","last_peered":"2024-04-26T12:42:42.123676+0000","last_clean":"2024-04-26T12:42:42.123676+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:42:42.123676+0000","last_undegraded":"2024-04-26T12:42:42.123676+0000","last_fullsized":"2024-04-26T12:42:42.123676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"139'137","reported_seq":493,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.752091+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:42:44.752091+0000","last_peered":"2024-04-26T12:42:44.752091+0000","last_clean":"2024-04-26T12:42:44.752091+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:42:44.752091+0000","last_undegraded":"2024-04-26T12:42:44.752091+0000","last_fullsized":"2024-04-26T12:42:44.752091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514992+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:42:42.514992+0000","last_peered":"2024-04-26T12:42:42.514992+0000","last_clean":"2024-04-26T12:42:42.514992+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:42:42.514992+0000","last_undegraded":"2024-04-26T12:42:42.514992+0000","last_fullsized":"2024-04-26T12:42:42.514992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"117'2","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408083+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:42:41.408083+0000","last_peered":"2024-04-26T12:42:41.408083+0000","last_clean":"2024-04-26T12:42:41.408083+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:42:41.408083+0000","last_undegraded":"2024-04-26T12:42:41.408083+0000","last_fullsized":"2024-04-26T12:42:41.408083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410330+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:42:41.410330+0000","last_peered":"2024-04-26T12:42:41.410330+0000","last_clean":"2024-04-26T12:42:41.410330+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:42:41.410330+0000","last_undegraded":"2024-04-26T12:42:41.410330+0000","last_fullsized":"2024-04-26T12:42:41.410330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977561+0000","last_change":"2024-04-26T12:42:21.939098+0000","last_active":"2024-04-26T12:42:41.977561+0000","last_peered":"2024-04-26T12:42:41.977561+0000","last_clean":"2024-04-26T12:42:41.977561+0000","last_became_active":"2024-04-26T12:42:21.938117+0000","last_became_peered":"2024-04-26T12:42:21.938117+0000","last_unstale":"2024-04-26T12:42:41.977561+0000","last_undegraded":"2024-04-26T12:42:41.977561+0000","last_fullsized":"2024-04-26T12:42:41.977561+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:15.636096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'34","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408092+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:42:41.408092+0000","last_peered":"2024-04-26T12:42:41.408092+0000","last_clean":"2024-04-26T12:42:41.408092+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:42:41.408092+0000","last_undegraded":"2024-04-26T12:42:41.408092+0000","last_fullsized":"2024-04-26T12:42:41.408092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":44,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":335,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976702+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:42:41.976702+0000","last_peered":"2024-04-26T12:42:41.976702+0000","last_clean":"2024-04-26T12:42:41.976702+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:42:41.976702+0000","last_undegraded":"2024-04-26T12:42:41.976702+0000","last_fullsized":"2024-04-26T12:42:41.976702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"139'18","reported_seq":316,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.750561+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:42:44.750561+0000","last_peered":"2024-04-26T12:42:44.750561+0000","last_clean":"2024-04-26T12:42:44.750561+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:42:44.750561+0000","last_undegraded":"2024-04-26T12:42:44.750561+0000","last_fullsized":"2024-04-26T12:42:44.750561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069911+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:42:41.069911+0000","last_peered":"2024-04-26T12:42:41.069911+0000","last_clean":"2024-04-26T12:42:41.069911+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:42:41.069911+0000","last_undegraded":"2024-04-26T12:42:41.069911+0000","last_fullsized":"2024-04-26T12:42:41.069911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070589+0000","last_change":"2024-04-26T12:42:21.942734+0000","last_active":"2024-04-26T12:42:41.070589+0000","last_peered":"2024-04-26T12:42:41.070589+0000","last_clean":"2024-04-26T12:42:41.070589+0000","last_became_active":"2024-04-26T12:42:21.928602+0000","last_became_peered":"2024-04-26T12:42:21.928602+0000","last_unstale":"2024-04-26T12:42:41.070589+0000","last_undegraded":"2024-04-26T12:42:41.070589+0000","last_fullsized":"2024-04-26T12:42:41.070589+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:45.167813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409089+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:42:41.409089+0000","last_peered":"2024-04-26T12:42:41.409089+0000","last_clean":"2024-04-26T12:42:41.409089+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:42:41.409089+0000","last_undegraded":"2024-04-26T12:42:41.409089+0000","last_fullsized":"2024-04-26T12:42:41.409089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122667+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:42:42.122667+0000","last_peered":"2024-04-26T12:42:42.122667+0000","last_clean":"2024-04-26T12:42:42.122667+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:42:42.122667+0000","last_undegraded":"2024-04-26T12:42:42.122667+0000","last_fullsized":"2024-04-26T12:42:42.122667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'18","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067370+0000","last_change":"2024-04-26T12:42:34.006811+0000","last_active":"2024-04-26T12:42:41.067370+0000","last_peered":"2024-04-26T12:42:41.067370+0000","last_clean":"2024-04-26T12:42:41.067370+0000","last_became_active":"2024-04-26T12:42:34.004041+0000","last_became_peered":"2024-04-26T12:42:34.004041+0000","last_unstale":"2024-04-26T12:42:41.067370+0000","last_undegraded":"2024-04-26T12:42:41.067370+0000","last_fullsized":"2024-04-26T12:42:41.067370+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:08.613547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069460+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:42:41.069460+0000","last_peered":"2024-04-26T12:42:41.069460+0000","last_clean":"2024-04-26T12:42:41.069460+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:42:41.069460+0000","last_undegraded":"2024-04-26T12:42:41.069460+0000","last_fullsized":"2024-04-26T12:42:41.069460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073574+0000","last_change":"2024-04-26T12:42:21.946073+0000","last_active":"2024-04-26T12:42:41.073574+0000","last_peered":"2024-04-26T12:42:41.073574+0000","last_clean":"2024-04-26T12:42:41.073574+0000","last_became_active":"2024-04-26T12:42:21.942937+0000","last_became_peered":"2024-04-26T12:42:21.942937+0000","last_unstale":"2024-04-26T12:42:41.073574+0000","last_undegraded":"2024-04-26T12:42:41.073574+0000","last_fullsized":"2024-04-26T12:42:41.073574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:30.907752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515300+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:42:42.515300+0000","last_peered":"2024-04-26T12:42:42.515300+0000","last_clean":"2024-04-26T12:42:42.515300+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:42:42.515300+0000","last_undegraded":"2024-04-26T12:42:42.515300+0000","last_fullsized":"2024-04-26T12:42:42.515300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121144+0000","last_change":"2024-04-26T12:42:21.942893+0000","last_active":"2024-04-26T12:42:42.121144+0000","last_peered":"2024-04-26T12:42:42.121144+0000","last_clean":"2024-04-26T12:42:42.121144+0000","last_became_active":"2024-04-26T12:42:21.941954+0000","last_became_peered":"2024-04-26T12:42:21.941954+0000","last_unstale":"2024-04-26T12:42:42.121144+0000","last_undegraded":"2024-04-26T12:42:42.121144+0000","last_fullsized":"2024-04-26T12:42:42.121144+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408457+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:42:41.408457+0000","last_peered":"2024-04-26T12:42:41.408457+0000","last_clean":"2024-04-26T12:42:41.408457+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:42:41.408457+0000","last_undegraded":"2024-04-26T12:42:41.408457+0000","last_fullsized":"2024-04-26T12:42:41.408457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'26","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.124036+0000","last_change":"2024-04-26T12:42:21.924370+0000","last_active":"2024-04-26T12:42:42.124036+0000","last_peered":"2024-04-26T12:42:42.124036+0000","last_clean":"2024-04-26T12:42:42.124036+0000","last_became_active":"2024-04-26T12:42:21.923345+0000","last_became_peered":"2024-04-26T12:42:21.923345+0000","last_unstale":"2024-04-26T12:42:42.124036+0000","last_undegraded":"2024-04-26T12:42:42.124036+0000","last_fullsized":"2024-04-26T12:42:42.124036+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:11.162289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409328+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:42:41.409328+0000","last_peered":"2024-04-26T12:42:41.409328+0000","last_clean":"2024-04-26T12:42:41.409328+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:42:41.409328+0000","last_undegraded":"2024-04-26T12:42:41.409328+0000","last_fullsized":"2024-04-26T12:42:41.409328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071121+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:42:41.071121+0000","last_peered":"2024-04-26T12:42:41.071121+0000","last_clean":"2024-04-26T12:42:41.071121+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:42:41.071121+0000","last_undegraded":"2024-04-26T12:42:41.071121+0000","last_fullsized":"2024-04-26T12:42:41.071121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"117'34","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071421+0000","last_change":"2024-04-26T12:42:21.957374+0000","last_active":"2024-04-26T12:42:41.071421+0000","last_peered":"2024-04-26T12:42:41.071421+0000","last_clean":"2024-04-26T12:42:41.071421+0000","last_became_active":"2024-04-26T12:42:21.956451+0000","last_became_peered":"2024-04-26T12:42:21.956451+0000","last_unstale":"2024-04-26T12:42:41.071421+0000","last_undegraded":"2024-04-26T12:42:41.071421+0000","last_fullsized":"2024-04-26T12:42:41.071421+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:20.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":204,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065521+0000","last_change":"2024-04-26T12:42:34.015627+0000","last_active":"2024-04-26T12:42:41.065521+0000","last_peered":"2024-04-26T12:42:41.065521+0000","last_clean":"2024-04-26T12:42:41.065521+0000","last_became_active":"2024-04-26T12:42:34.014949+0000","last_became_peered":"2024-04-26T12:42:34.014949+0000","last_unstale":"2024-04-26T12:42:41.065521+0000","last_undegraded":"2024-04-26T12:42:41.065521+0000","last_fullsized":"2024-04-26T12:42:41.065521+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:46.390226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070165+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:42:41.070165+0000","last_peered":"2024-04-26T12:42:41.070165+0000","last_clean":"2024-04-26T12:42:41.070165+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:42:41.070165+0000","last_undegraded":"2024-04-26T12:42:41.070165+0000","last_fullsized":"2024-04-26T12:42:41.070165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072305+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:42:41.072305+0000","last_peered":"2024-04-26T12:42:41.072305+0000","last_clean":"2024-04-26T12:42:41.072305+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:42:41.072305+0000","last_undegraded":"2024-04-26T12:42:41.072305+0000","last_fullsized":"2024-04-26T12:42:41.072305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'31","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409224+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:42:41.409224+0000","last_peered":"2024-04-26T12:42:41.409224+0000","last_clean":"2024-04-26T12:42:41.409224+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:42:41.409224+0000","last_undegraded":"2024-04-26T12:42:41.409224+0000","last_fullsized":"2024-04-26T12:42:41.409224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519825+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:42:42.519825+0000","last_peered":"2024-04-26T12:42:42.519825+0000","last_clean":"2024-04-26T12:42:42.519825+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:42:42.519825+0000","last_undegraded":"2024-04-26T12:42:42.519825+0000","last_fullsized":"2024-04-26T12:42:42.519825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518456+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:42:42.518456+0000","last_peered":"2024-04-26T12:42:42.518456+0000","last_clean":"2024-04-26T12:42:42.518456+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:42:42.518456+0000","last_undegraded":"2024-04-26T12:42:42.518456+0000","last_fullsized":"2024-04-26T12:42:42.518456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408014+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:42:41.408014+0000","last_peered":"2024-04-26T12:42:41.408014+0000","last_clean":"2024-04-26T12:42:41.408014+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:42:41.408014+0000","last_undegraded":"2024-04-26T12:42:41.408014+0000","last_fullsized":"2024-04-26T12:42:41.408014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"139'135","reported_seq":427,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751022+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:42:44.751022+0000","last_peered":"2024-04-26T12:42:44.751022+0000","last_clean":"2024-04-26T12:42:44.751022+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:42:44.751022+0000","last_undegraded":"2024-04-26T12:42:44.751022+0000","last_fullsized":"2024-04-26T12:42:44.751022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073784+0000","last_change":"2024-04-26T12:42:21.962241+0000","last_active":"2024-04-26T12:42:41.073784+0000","last_peered":"2024-04-26T12:42:41.073784+0000","last_clean":"2024-04-26T12:42:41.073784+0000","last_became_active":"2024-04-26T12:42:21.960618+0000","last_became_peered":"2024-04-26T12:42:21.960618+0000","last_unstale":"2024-04-26T12:42:41.073784+0000","last_undegraded":"2024-04-26T12:42:41.073784+0000","last_fullsized":"2024-04-26T12:42:41.073784+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:39.076778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067522+0000","last_change":"2024-04-26T12:42:21.965811+0000","last_active":"2024-04-26T12:42:41.067522+0000","last_peered":"2024-04-26T12:42:41.067522+0000","last_clean":"2024-04-26T12:42:41.067522+0000","last_became_active":"2024-04-26T12:42:21.960998+0000","last_became_peered":"2024-04-26T12:42:21.960998+0000","last_unstale":"2024-04-26T12:42:41.067522+0000","last_undegraded":"2024-04-26T12:42:41.067522+0000","last_fullsized":"2024-04-26T12:42:41.067522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.081118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"116'27","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074564+0000","last_change":"2024-04-26T12:42:21.971344+0000","last_active":"2024-04-26T12:42:41.074564+0000","last_peered":"2024-04-26T12:42:41.074564+0000","last_clean":"2024-04-26T12:42:41.074564+0000","last_became_active":"2024-04-26T12:42:21.968901+0000","last_became_peered":"2024-04-26T12:42:21.968901+0000","last_unstale":"2024-04-26T12:42:41.074564+0000","last_undegraded":"2024-04-26T12:42:41.074564+0000","last_fullsized":"2024-04-26T12:42:41.074564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:04.596971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409908+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:42:41.409908+0000","last_peered":"2024-04-26T12:42:41.409908+0000","last_clean":"2024-04-26T12:42:41.409908+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:42:41.409908+0000","last_undegraded":"2024-04-26T12:42:41.409908+0000","last_fullsized":"2024-04-26T12:42:41.409908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065795+0000","last_change":"2024-04-26T12:42:34.016582+0000","last_active":"2024-04-26T12:42:41.065795+0000","last_peered":"2024-04-26T12:42:41.065795+0000","last_clean":"2024-04-26T12:42:41.065795+0000","last_became_active":"2024-04-26T12:42:34.015774+0000","last_became_peered":"2024-04-26T12:42:34.015774+0000","last_unstale":"2024-04-26T12:42:41.065795+0000","last_undegraded":"2024-04-26T12:42:41.065795+0000","last_fullsized":"2024-04-26T12:42:41.065795+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:09.670527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":71,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067390+0000","last_change":"2024-04-26T12:42:34.031336+0000","last_active":"2024-04-26T12:42:41.067390+0000","last_peered":"2024-04-26T12:42:41.067390+0000","last_clean":"2024-04-26T12:42:41.067390+0000","last_became_active":"2024-04-26T12:42:34.029037+0000","last_became_peered":"2024-04-26T12:42:34.029037+0000","last_unstale":"2024-04-26T12:42:41.067390+0000","last_undegraded":"2024-04-26T12:42:41.067390+0000","last_fullsized":"2024-04-26T12:42:41.067390+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:10.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"139'137","reported_seq":414,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751750+0000","last_change":"2024-04-26T12:42:21.972386+0000","last_active":"2024-04-26T12:42:44.751750+0000","last_peered":"2024-04-26T12:42:44.751750+0000","last_clean":"2024-04-26T12:42:44.751750+0000","last_became_active":"2024-04-26T12:42:21.962332+0000","last_became_peered":"2024-04-26T12:42:21.962332+0000","last_unstale":"2024-04-26T12:42:44.751750+0000","last_undegraded":"2024-04-26T12:42:44.751750+0000","last_fullsized":"2024-04-26T12:42:44.751750+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:50.916736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071272+0000","last_change":"2024-04-26T12:42:21.957370+0000","last_active":"2024-04-26T12:42:41.071272+0000","last_peered":"2024-04-26T12:42:41.071272+0000","last_clean":"2024-04-26T12:42:41.071272+0000","last_became_active":"2024-04-26T12:42:21.956715+0000","last_became_peered":"2024-04-26T12:42:21.956715+0000","last_unstale":"2024-04-26T12:42:41.071272+0000","last_undegraded":"2024-04-26T12:42:41.071272+0000","last_fullsized":"2024-04-26T12:42:41.071272+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:22.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066049+0000","last_change":"2024-04-26T12:42:34.013472+0000","last_active":"2024-04-26T12:42:41.066049+0000","last_peered":"2024-04-26T12:42:41.066049+0000","last_clean":"2024-04-26T12:42:41.066049+0000","last_became_active":"2024-04-26T12:42:34.010800+0000","last_became_peered":"2024-04-26T12:42:34.010800+0000","last_unstale":"2024-04-26T12:42:41.066049+0000","last_undegraded":"2024-04-26T12:42:41.066049+0000","last_fullsized":"2024-04-26T12:42:41.066049+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:43.861494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"117'24","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072776+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:42:41.072776+0000","last_peered":"2024-04-26T12:42:41.072776+0000","last_clean":"2024-04-26T12:42:41.072776+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:42:41.072776+0000","last_undegraded":"2024-04-26T12:42:41.072776+0000","last_fullsized":"2024-04-26T12:42:41.072776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521218+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:42:42.521218+0000","last_peered":"2024-04-26T12:42:42.521218+0000","last_clean":"2024-04-26T12:42:42.521218+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:42:42.521218+0000","last_undegraded":"2024-04-26T12:42:42.521218+0000","last_fullsized":"2024-04-26T12:42:42.521218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068515+0000","last_change":"2024-04-26T12:42:21.941484+0000","last_active":"2024-04-26T12:42:41.068515+0000","last_peered":"2024-04-26T12:42:41.068515+0000","last_clean":"2024-04-26T12:42:41.068515+0000","last_became_active":"2024-04-26T12:42:21.926472+0000","last_became_peered":"2024-04-26T12:42:21.926472+0000","last_unstale":"2024-04-26T12:42:41.068515+0000","last_undegraded":"2024-04-26T12:42:41.068515+0000","last_fullsized":"2024-04-26T12:42:41.068515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.214353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"117'43","reported_seq":298,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519477+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:42:42.519477+0000","last_peered":"2024-04-26T12:42:42.519477+0000","last_clean":"2024-04-26T12:42:42.519477+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:42:42.519477+0000","last_undegraded":"2024-04-26T12:42:42.519477+0000","last_fullsized":"2024-04-26T12:42:42.519477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068343+0000","last_change":"2024-04-26T12:42:21.919160+0000","last_active":"2024-04-26T12:42:41.068343+0000","last_peered":"2024-04-26T12:42:41.068343+0000","last_clean":"2024-04-26T12:42:41.068343+0000","last_became_active":"2024-04-26T12:42:21.918031+0000","last_became_peered":"2024-04-26T12:42:21.918031+0000","last_unstale":"2024-04-26T12:42:41.068343+0000","last_undegraded":"2024-04-26T12:42:41.068343+0000","last_fullsized":"2024-04-26T12:42:41.068343+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:35.941555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122585+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:42:42.122585+0000","last_peered":"2024-04-26T12:42:42.122585+0000","last_clean":"2024-04-26T12:42:42.122585+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:42:42.122585+0000","last_undegraded":"2024-04-26T12:42:42.122585+0000","last_fullsized":"2024-04-26T12:42:42.122585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069566+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:42:41.069566+0000","last_peered":"2024-04-26T12:42:41.069566+0000","last_clean":"2024-04-26T12:42:41.069566+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:42:41.069566+0000","last_undegraded":"2024-04-26T12:42:41.069566+0000","last_fullsized":"2024-04-26T12:42:41.069566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":186,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066912+0000","last_change":"2024-04-26T12:42:34.023953+0000","last_active":"2024-04-26T12:42:41.066912+0000","last_peered":"2024-04-26T12:42:41.066912+0000","last_clean":"2024-04-26T12:42:41.066912+0000","last_became_active":"2024-04-26T12:42:34.022792+0000","last_became_peered":"2024-04-26T12:42:34.022792+0000","last_unstale":"2024-04-26T12:42:41.066912+0000","last_undegraded":"2024-04-26T12:42:41.066912+0000","last_fullsized":"2024-04-26T12:42:41.066912+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:16.851419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066522+0000","last_change":"2024-04-26T12:42:34.012055+0000","last_active":"2024-04-26T12:42:41.066522+0000","last_peered":"2024-04-26T12:42:41.066522+0000","last_clean":"2024-04-26T12:42:41.066522+0000","last_became_active":"2024-04-26T12:42:34.008295+0000","last_became_peered":"2024-04-26T12:42:34.008295+0000","last_unstale":"2024-04-26T12:42:41.066522+0000","last_undegraded":"2024-04-26T12:42:41.066522+0000","last_fullsized":"2024-04-26T12:42:41.066522+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:59.626034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408588+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:42:41.408588+0000","last_peered":"2024-04-26T12:42:41.408588+0000","last_clean":"2024-04-26T12:42:41.408588+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:42:41.408588+0000","last_undegraded":"2024-04-26T12:42:41.408588+0000","last_fullsized":"2024-04-26T12:42:41.408588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070334+0000","last_change":"2024-04-26T12:42:21.967112+0000","last_active":"2024-04-26T12:42:41.070334+0000","last_peered":"2024-04-26T12:42:41.070334+0000","last_clean":"2024-04-26T12:42:41.070334+0000","last_became_active":"2024-04-26T12:42:21.964467+0000","last_became_peered":"2024-04-26T12:42:21.964467+0000","last_unstale":"2024-04-26T12:42:41.070334+0000","last_undegraded":"2024-04-26T12:42:41.070334+0000","last_fullsized":"2024-04-26T12:42:41.070334+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:41.170576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072547+0000","last_change":"2024-04-26T12:42:21.964141+0000","last_active":"2024-04-26T12:42:41.072547+0000","last_peered":"2024-04-26T12:42:41.072547+0000","last_clean":"2024-04-26T12:42:41.072547+0000","last_became_active":"2024-04-26T12:42:21.959360+0000","last_became_peered":"2024-04-26T12:42:21.959360+0000","last_unstale":"2024-04-26T12:42:41.072547+0000","last_undegraded":"2024-04-26T12:42:41.072547+0000","last_fullsized":"2024-04-26T12:42:41.072547+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:57.964968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074053+0000","last_change":"2024-04-26T12:42:21.970393+0000","last_active":"2024-04-26T12:42:41.074053+0000","last_peered":"2024-04-26T12:42:41.074053+0000","last_clean":"2024-04-26T12:42:41.074053+0000","last_became_active":"2024-04-26T12:42:21.968658+0000","last_became_peered":"2024-04-26T12:42:21.968658+0000","last_unstale":"2024-04-26T12:42:41.074053+0000","last_undegraded":"2024-04-26T12:42:41.074053+0000","last_fullsized":"2024-04-26T12:42:41.074053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:45.400045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408339+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:42:41.408339+0000","last_peered":"2024-04-26T12:42:41.408339+0000","last_clean":"2024-04-26T12:42:41.408339+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:42:41.408339+0000","last_undegraded":"2024-04-26T12:42:41.408339+0000","last_fullsized":"2024-04-26T12:42:41.408339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"117'23","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519528+0000","last_change":"2024-04-26T12:42:21.956317+0000","last_active":"2024-04-26T12:42:42.519528+0000","last_peered":"2024-04-26T12:42:42.519528+0000","last_clean":"2024-04-26T12:42:42.519528+0000","last_became_active":"2024-04-26T12:42:21.955428+0000","last_became_peered":"2024-04-26T12:42:21.955428+0000","last_unstale":"2024-04-26T12:42:42.519528+0000","last_undegraded":"2024-04-26T12:42:42.519528+0000","last_fullsized":"2024-04-26T12:42:42.519528+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:50.243608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067590+0000","last_change":"2024-04-26T12:42:21.973314+0000","last_active":"2024-04-26T12:42:41.067590+0000","last_peered":"2024-04-26T12:42:41.067590+0000","last_clean":"2024-04-26T12:42:41.067590+0000","last_became_active":"2024-04-26T12:42:21.964554+0000","last_became_peered":"2024-04-26T12:42:21.964554+0000","last_unstale":"2024-04-26T12:42:41.067590+0000","last_undegraded":"2024-04-26T12:42:41.067590+0000","last_fullsized":"2024-04-26T12:42:41.067590+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:20.524995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"120'9","reported_seq":250,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070910+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:42:41.070910+0000","last_peered":"2024-04-26T12:42:41.070910+0000","last_clean":"2024-04-26T12:42:41.070910+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:42:41.070910+0000","last_undegraded":"2024-04-26T12:42:41.070910+0000","last_fullsized":"2024-04-26T12:42:41.070910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517854+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:42:42.517854+0000","last_peered":"2024-04-26T12:42:42.517854+0000","last_clean":"2024-04-26T12:42:42.517854+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:42:42.517854+0000","last_undegraded":"2024-04-26T12:42:42.517854+0000","last_fullsized":"2024-04-26T12:42:42.517854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069199+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:42:41.069199+0000","last_peered":"2024-04-26T12:42:41.069199+0000","last_clean":"2024-04-26T12:42:41.069199+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:42:41.069199+0000","last_undegraded":"2024-04-26T12:42:41.069199+0000","last_fullsized":"2024-04-26T12:42:41.069199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069067+0000","last_change":"2024-04-26T12:42:21.967538+0000","last_active":"2024-04-26T12:42:41.069067+0000","last_peered":"2024-04-26T12:42:41.069067+0000","last_clean":"2024-04-26T12:42:41.069067+0000","last_became_active":"2024-04-26T12:42:21.965760+0000","last_became_peered":"2024-04-26T12:42:21.965760+0000","last_unstale":"2024-04-26T12:42:41.069067+0000","last_undegraded":"2024-04-26T12:42:41.069067+0000","last_fullsized":"2024-04-26T12:42:41.069067+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:34.724137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'27","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123766+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:42:42.123766+0000","last_peered":"2024-04-26T12:42:42.123766+0000","last_clean":"2024-04-26T12:42:42.123766+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:42:42.123766+0000","last_undegraded":"2024-04-26T12:42:42.123766+0000","last_fullsized":"2024-04-26T12:42:42.123766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516156+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:42:42.516156+0000","last_peered":"2024-04-26T12:42:42.516156+0000","last_clean":"2024-04-26T12:42:42.516156+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:42:42.516156+0000","last_undegraded":"2024-04-26T12:42:42.516156+0000","last_fullsized":"2024-04-26T12:42:42.516156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069367+0000","last_change":"2024-04-26T12:42:21.974557+0000","last_active":"2024-04-26T12:42:41.069367+0000","last_peered":"2024-04-26T12:42:41.069367+0000","last_clean":"2024-04-26T12:42:41.069367+0000","last_became_active":"2024-04-26T12:42:21.967735+0000","last_became_peered":"2024-04-26T12:42:21.967735+0000","last_unstale":"2024-04-26T12:42:41.069367+0000","last_undegraded":"2024-04-26T12:42:41.069367+0000","last_fullsized":"2024-04-26T12:42:41.069367+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:01.266925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514760+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:42:42.514760+0000","last_peered":"2024-04-26T12:42:42.514760+0000","last_clean":"2024-04-26T12:42:42.514760+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:42:42.514760+0000","last_undegraded":"2024-04-26T12:42:42.514760+0000","last_fullsized":"2024-04-26T12:42:42.514760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121837+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:42:42.121837+0000","last_peered":"2024-04-26T12:42:42.121837+0000","last_clean":"2024-04-26T12:42:42.121837+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:42:42.121837+0000","last_undegraded":"2024-04-26T12:42:42.121837+0000","last_fullsized":"2024-04-26T12:42:42.121837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068104+0000","last_change":"2024-04-26T12:42:21.946016+0000","last_active":"2024-04-26T12:42:41.068104+0000","last_peered":"2024-04-26T12:42:41.068104+0000","last_clean":"2024-04-26T12:42:41.068104+0000","last_became_active":"2024-04-26T12:42:21.927785+0000","last_became_peered":"2024-04-26T12:42:21.927785+0000","last_unstale":"2024-04-26T12:42:41.068104+0000","last_undegraded":"2024-04-26T12:42:41.068104+0000","last_fullsized":"2024-04-26T12:42:41.068104+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:08.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'20","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072117+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:42:41.072117+0000","last_peered":"2024-04-26T12:42:41.072117+0000","last_clean":"2024-04-26T12:42:41.072117+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:42:41.072117+0000","last_undegraded":"2024-04-26T12:42:41.072117+0000","last_fullsized":"2024-04-26T12:42:41.072117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518072+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:42:42.518072+0000","last_peered":"2024-04-26T12:42:42.518072+0000","last_clean":"2024-04-26T12:42:42.518072+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:42:42.518072+0000","last_undegraded":"2024-04-26T12:42:42.518072+0000","last_fullsized":"2024-04-26T12:42:42.518072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"117'20","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517863+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:42:42.517863+0000","last_peered":"2024-04-26T12:42:42.517863+0000","last_clean":"2024-04-26T12:42:42.517863+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:42:42.517863+0000","last_undegraded":"2024-04-26T12:42:42.517863+0000","last_fullsized":"2024-04-26T12:42:42.517863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068567+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:42:41.068567+0000","last_peered":"2024-04-26T12:42:41.068567+0000","last_clean":"2024-04-26T12:42:41.068567+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:42:41.068567+0000","last_undegraded":"2024-04-26T12:42:41.068567+0000","last_fullsized":"2024-04-26T12:42:41.068567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521075+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:42:42.521075+0000","last_peered":"2024-04-26T12:42:42.521075+0000","last_clean":"2024-04-26T12:42:42.521075+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:42:42.521075+0000","last_undegraded":"2024-04-26T12:42:42.521075+0000","last_fullsized":"2024-04-26T12:42:42.521075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'15","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067129+0000","last_change":"2024-04-26T12:42:21.967299+0000","last_active":"2024-04-26T12:42:41.067129+0000","last_peered":"2024-04-26T12:42:41.067129+0000","last_clean":"2024-04-26T12:42:41.067129+0000","last_became_active":"2024-04-26T12:42:21.964241+0000","last_became_peered":"2024-04-26T12:42:21.964241+0000","last_unstale":"2024-04-26T12:42:41.067129+0000","last_undegraded":"2024-04-26T12:42:41.067129+0000","last_fullsized":"2024-04-26T12:42:41.067129+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:24.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071446+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:42:41.071446+0000","last_peered":"2024-04-26T12:42:41.071446+0000","last_clean":"2024-04-26T12:42:41.071446+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:42:41.071446+0000","last_undegraded":"2024-04-26T12:42:41.071446+0000","last_fullsized":"2024-04-26T12:42:41.071446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"117'28","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409065+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:42:41.409065+0000","last_peered":"2024-04-26T12:42:41.409065+0000","last_clean":"2024-04-26T12:42:41.409065+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:42:41.409065+0000","last_undegraded":"2024-04-26T12:42:41.409065+0000","last_fullsized":"2024-04-26T12:42:41.409065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122126+0000","last_change":"2024-04-26T12:42:21.947268+0000","last_active":"2024-04-26T12:42:42.122126+0000","last_peered":"2024-04-26T12:42:42.122126+0000","last_clean":"2024-04-26T12:42:42.122126+0000","last_became_active":"2024-04-26T12:42:21.946664+0000","last_became_peered":"2024-04-26T12:42:21.946664+0000","last_unstale":"2024-04-26T12:42:42.122126+0000","last_undegraded":"2024-04-26T12:42:42.122126+0000","last_fullsized":"2024-04-26T12:42:42.122126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:21.575803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067833+0000","last_change":"2024-04-26T12:42:21.973393+0000","last_active":"2024-04-26T12:42:41.067833+0000","last_peered":"2024-04-26T12:42:41.067833+0000","last_clean":"2024-04-26T12:42:41.067833+0000","last_became_active":"2024-04-26T12:42:21.963727+0000","last_became_peered":"2024-04-26T12:42:21.963727+0000","last_unstale":"2024-04-26T12:42:41.067833+0000","last_undegraded":"2024-04-26T12:42:41.067833+0000","last_fullsized":"2024-04-26T12:42:41.067833+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:52.960136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072465+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:42:41.072465+0000","last_peered":"2024-04-26T12:42:41.072465+0000","last_clean":"2024-04-26T12:42:41.072465+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:42:41.072465+0000","last_undegraded":"2024-04-26T12:42:41.072465+0000","last_fullsized":"2024-04-26T12:42:41.072465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'32","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408983+0000","last_change":"2024-04-26T12:42:21.934786+0000","last_active":"2024-04-26T12:42:41.408983+0000","last_peered":"2024-04-26T12:42:41.408983+0000","last_clean":"2024-04-26T12:42:41.408983+0000","last_became_active":"2024-04-26T12:42:21.933941+0000","last_became_peered":"2024-04-26T12:42:21.933941+0000","last_unstale":"2024-04-26T12:42:41.408983+0000","last_undegraded":"2024-04-26T12:42:41.408983+0000","last_fullsized":"2024-04-26T12:42:41.408983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:56.359990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520965+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:42:42.520965+0000","last_peered":"2024-04-26T12:42:42.520965+0000","last_clean":"2024-04-26T12:42:42.520965+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:42:42.520965+0000","last_undegraded":"2024-04-26T12:42:42.520965+0000","last_fullsized":"2024-04-26T12:42:42.520965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"117'23","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518241+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:42:42.518241+0000","last_peered":"2024-04-26T12:42:42.518241+0000","last_clean":"2024-04-26T12:42:42.518241+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:42:42.518241+0000","last_undegraded":"2024-04-26T12:42:42.518241+0000","last_fullsized":"2024-04-26T12:42:42.518241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409160+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:42:41.409160+0000","last_peered":"2024-04-26T12:42:41.409160+0000","last_clean":"2024-04-26T12:42:41.409160+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:42:41.409160+0000","last_undegraded":"2024-04-26T12:42:41.409160+0000","last_fullsized":"2024-04-26T12:42:41.409160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518124+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:42:42.518124+0000","last_peered":"2024-04-26T12:42:42.518124+0000","last_clean":"2024-04-26T12:42:42.518124+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:42:42.518124+0000","last_undegraded":"2024-04-26T12:42:42.518124+0000","last_fullsized":"2024-04-26T12:42:42.518124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072909+0000","last_change":"2024-04-26T12:42:21.925516+0000","last_active":"2024-04-26T12:42:41.072909+0000","last_peered":"2024-04-26T12:42:41.072909+0000","last_clean":"2024-04-26T12:42:41.072909+0000","last_became_active":"2024-04-26T12:42:21.924628+0000","last_became_peered":"2024-04-26T12:42:21.924628+0000","last_unstale":"2024-04-26T12:42:41.072909+0000","last_undegraded":"2024-04-26T12:42:41.072909+0000","last_fullsized":"2024-04-26T12:42:41.072909+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.079347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'21","reported_seq":223,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068512+0000","last_change":"2024-04-26T12:42:34.034805+0000","last_active":"2024-04-26T12:42:41.068512+0000","last_peered":"2024-04-26T12:42:41.068512+0000","last_clean":"2024-04-26T12:42:41.068512+0000","last_became_active":"2024-04-26T12:42:34.034029+0000","last_became_peered":"2024-04-26T12:42:34.034029+0000","last_unstale":"2024-04-26T12:42:41.068512+0000","last_undegraded":"2024-04-26T12:42:41.068512+0000","last_fullsized":"2024-04-26T12:42:41.068512+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:41.159253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068554+0000","last_change":"2024-04-26T12:42:34.032136+0000","last_active":"2024-04-26T12:42:41.068554+0000","last_peered":"2024-04-26T12:42:41.068554+0000","last_clean":"2024-04-26T12:42:41.068554+0000","last_became_active":"2024-04-26T12:42:34.031261+0000","last_became_peered":"2024-04-26T12:42:34.031261+0000","last_unstale":"2024-04-26T12:42:41.068554+0000","last_undegraded":"2024-04-26T12:42:41.068554+0000","last_fullsized":"2024-04-26T12:42:41.068554+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:12.726095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074100+0000","last_change":"2024-04-26T12:42:21.932892+0000","last_active":"2024-04-26T12:42:41.074100+0000","last_peered":"2024-04-26T12:42:41.074100+0000","last_clean":"2024-04-26T12:42:41.074100+0000","last_became_active":"2024-04-26T12:42:21.931947+0000","last_became_peered":"2024-04-26T12:42:21.931947+0000","last_unstale":"2024-04-26T12:42:41.074100+0000","last_undegraded":"2024-04-26T12:42:41.074100+0000","last_fullsized":"2024-04-26T12:42:41.074100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:26.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409372+0000","last_change":"2024-04-26T12:42:21.935064+0000","last_active":"2024-04-26T12:42:41.409372+0000","last_peered":"2024-04-26T12:42:41.409372+0000","last_clean":"2024-04-26T12:42:41.409372+0000","last_became_active":"2024-04-26T12:42:21.933611+0000","last_became_peered":"2024-04-26T12:42:21.933611+0000","last_unstale":"2024-04-26T12:42:41.409372+0000","last_undegraded":"2024-04-26T12:42:41.409372+0000","last_fullsized":"2024-04-26T12:42:41.409372+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:10.425425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122185+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:42:42.122185+0000","last_peered":"2024-04-26T12:42:42.122185+0000","last_clean":"2024-04-26T12:42:42.122185+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:42:42.122185+0000","last_undegraded":"2024-04-26T12:42:42.122185+0000","last_fullsized":"2024-04-26T12:42:42.122185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976329+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:42:41.976329+0000","last_peered":"2024-04-26T12:42:41.976329+0000","last_clean":"2024-04-26T12:42:41.976329+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:42:41.976329+0000","last_undegraded":"2024-04-26T12:42:41.976329+0000","last_fullsized":"2024-04-26T12:42:41.976329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"114'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068827+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:42:41.068827+0000","last_peered":"2024-04-26T12:42:41.068827+0000","last_clean":"2024-04-26T12:42:41.068827+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:42:41.068827+0000","last_undegraded":"2024-04-26T12:42:41.068827+0000","last_fullsized":"2024-04-26T12:42:41.068827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409671+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:42:41.409671+0000","last_peered":"2024-04-26T12:42:41.409671+0000","last_clean":"2024-04-26T12:42:41.409671+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:42:41.409671+0000","last_undegraded":"2024-04-26T12:42:41.409671+0000","last_fullsized":"2024-04-26T12:42:41.409671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"117'12","reported_seq":61,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067261+0000","last_change":"2024-04-26T12:42:34.023030+0000","last_active":"2024-04-26T12:42:41.067261+0000","last_peered":"2024-04-26T12:42:41.067261+0000","last_clean":"2024-04-26T12:42:41.067261+0000","last_became_active":"2024-04-26T12:42:34.022362+0000","last_became_peered":"2024-04-26T12:42:34.022362+0000","last_unstale":"2024-04-26T12:42:41.067261+0000","last_undegraded":"2024-04-26T12:42:41.067261+0000","last_fullsized":"2024-04-26T12:42:41.067261+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:14.876710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"139'135","reported_seq":427,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751193+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:42:44.751193+0000","last_peered":"2024-04-26T12:42:44.751193+0000","last_clean":"2024-04-26T12:42:44.751193+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:42:44.751193+0000","last_undegraded":"2024-04-26T12:42:44.751193+0000","last_fullsized":"2024-04-26T12:42:44.751193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"117'4","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515862+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:42:42.515862+0000","last_peered":"2024-04-26T12:42:42.515862+0000","last_clean":"2024-04-26T12:42:42.515862+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:42:42.515862+0000","last_undegraded":"2024-04-26T12:42:42.515862+0000","last_fullsized":"2024-04-26T12:42:42.515862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066160+0000","last_change":"2024-04-26T12:42:34.029194+0000","last_active":"2024-04-26T12:42:41.066160+0000","last_peered":"2024-04-26T12:42:41.066160+0000","last_clean":"2024-04-26T12:42:41.066160+0000","last_became_active":"2024-04-26T12:42:34.028313+0000","last_became_peered":"2024-04-26T12:42:34.028313+0000","last_unstale":"2024-04-26T12:42:41.066160+0000","last_undegraded":"2024-04-26T12:42:41.066160+0000","last_fullsized":"2024-04-26T12:42:41.066160+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:01.651376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"117'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122475+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:42:42.122475+0000","last_peered":"2024-04-26T12:42:42.122475+0000","last_clean":"2024-04-26T12:42:42.122475+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:42:42.122475+0000","last_undegraded":"2024-04-26T12:42:42.122475+0000","last_fullsized":"2024-04-26T12:42:42.122475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518145+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:42:42.518145+0000","last_peered":"2024-04-26T12:42:42.518145+0000","last_clean":"2024-04-26T12:42:42.518145+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:42:42.518145+0000","last_undegraded":"2024-04-26T12:42:42.518145+0000","last_fullsized":"2024-04-26T12:42:42.518145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"117'24","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122039+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:42:42.122039+0000","last_peered":"2024-04-26T12:42:42.122039+0000","last_clean":"2024-04-26T12:42:42.122039+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:42:42.122039+0000","last_undegraded":"2024-04-26T12:42:42.122039+0000","last_fullsized":"2024-04-26T12:42:42.122039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070022+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:42:41.070022+0000","last_peered":"2024-04-26T12:42:41.070022+0000","last_clean":"2024-04-26T12:42:41.070022+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:42:41.070022+0000","last_undegraded":"2024-04-26T12:42:41.070022+0000","last_fullsized":"2024-04-26T12:42:41.070022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":229,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519271+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:42:42.519271+0000","last_peered":"2024-04-26T12:42:42.519271+0000","last_clean":"2024-04-26T12:42:42.519271+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:42:42.519271+0000","last_undegraded":"2024-04-26T12:42:42.519271+0000","last_fullsized":"2024-04-26T12:42:42.519271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"117'14","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067733+0000","last_change":"2024-04-26T12:42:34.032654+0000","last_active":"2024-04-26T12:42:41.067733+0000","last_peered":"2024-04-26T12:42:41.067733+0000","last_clean":"2024-04-26T12:42:41.067733+0000","last_became_active":"2024-04-26T12:42:34.031426+0000","last_became_peered":"2024-04-26T12:42:34.031426+0000","last_unstale":"2024-04-26T12:42:41.067733+0000","last_undegraded":"2024-04-26T12:42:41.067733+0000","last_fullsized":"2024-04-26T12:42:41.067733+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:08.054625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'38","reported_seq":291,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123903+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:42:42.123903+0000","last_peered":"2024-04-26T12:42:42.123903+0000","last_clean":"2024-04-26T12:42:42.123903+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:42:42.123903+0000","last_undegraded":"2024-04-26T12:42:42.123903+0000","last_fullsized":"2024-04-26T12:42:42.123903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122227+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:42:42.122227+0000","last_peered":"2024-04-26T12:42:42.122227+0000","last_clean":"2024-04-26T12:42:42.122227+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:42:42.122227+0000","last_undegraded":"2024-04-26T12:42:42.122227+0000","last_fullsized":"2024-04-26T12:42:42.122227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070299+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:42:41.070299+0000","last_peered":"2024-04-26T12:42:41.070299+0000","last_clean":"2024-04-26T12:42:41.070299+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:42:41.070299+0000","last_undegraded":"2024-04-26T12:42:41.070299+0000","last_fullsized":"2024-04-26T12:42:41.070299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517640+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:42:42.517640+0000","last_peered":"2024-04-26T12:42:42.517640+0000","last_clean":"2024-04-26T12:42:42.517640+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:42:42.517640+0000","last_undegraded":"2024-04-26T12:42:42.517640+0000","last_fullsized":"2024-04-26T12:42:42.517640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":183,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073883+0000","last_change":"2024-04-26T12:42:21.961763+0000","last_active":"2024-04-26T12:42:41.073883+0000","last_peered":"2024-04-26T12:42:41.073883+0000","last_clean":"2024-04-26T12:42:41.073883+0000","last_became_active":"2024-04-26T12:42:21.951213+0000","last_became_peered":"2024-04-26T12:42:21.951213+0000","last_unstale":"2024-04-26T12:42:41.073883+0000","last_undegraded":"2024-04-26T12:42:41.073883+0000","last_fullsized":"2024-04-26T12:42:41.073883+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:11.260016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069763+0000","last_change":"2024-04-26T12:42:21.963634+0000","last_active":"2024-04-26T12:42:41.069763+0000","last_peered":"2024-04-26T12:42:41.069763+0000","last_clean":"2024-04-26T12:42:41.069763+0000","last_became_active":"2024-04-26T12:42:21.952291+0000","last_became_peered":"2024-04-26T12:42:21.952291+0000","last_unstale":"2024-04-26T12:42:41.069763+0000","last_undegraded":"2024-04-26T12:42:41.069763+0000","last_fullsized":"2024-04-26T12:42:41.069763+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:54.609591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"117'27","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072915+0000","last_change":"2024-04-26T12:42:21.929252+0000","last_active":"2024-04-26T12:42:41.072915+0000","last_peered":"2024-04-26T12:42:41.072915+0000","last_clean":"2024-04-26T12:42:41.072915+0000","last_became_active":"2024-04-26T12:42:21.928247+0000","last_became_peered":"2024-04-26T12:42:21.928247+0000","last_unstale":"2024-04-26T12:42:41.072915+0000","last_undegraded":"2024-04-26T12:42:41.072915+0000","last_fullsized":"2024-04-26T12:42:41.072915+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:45.518571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065498+0000","last_change":"2024-04-26T12:42:34.022643+0000","last_active":"2024-04-26T12:42:41.065498+0000","last_peered":"2024-04-26T12:42:41.065498+0000","last_clean":"2024-04-26T12:42:41.065498+0000","last_became_active":"2024-04-26T12:42:34.022065+0000","last_became_peered":"2024-04-26T12:42:34.022065+0000","last_unstale":"2024-04-26T12:42:41.065498+0000","last_undegraded":"2024-04-26T12:42:41.065498+0000","last_fullsized":"2024-04-26T12:42:41.065498+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:59.260776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"117'14","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068905+0000","last_change":"2024-04-26T12:42:21.975843+0000","last_active":"2024-04-26T12:42:41.068905+0000","last_peered":"2024-04-26T12:42:41.068905+0000","last_clean":"2024-04-26T12:42:41.068905+0000","last_became_active":"2024-04-26T12:42:21.971062+0000","last_became_peered":"2024-04-26T12:42:21.971062+0000","last_unstale":"2024-04-26T12:42:41.068905+0000","last_undegraded":"2024-04-26T12:42:41.068905+0000","last_fullsized":"2024-04-26T12:42:41.068905+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:19.436937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065759+0000","last_change":"2024-04-26T12:42:34.025446+0000","last_active":"2024-04-26T12:42:41.065759+0000","last_peered":"2024-04-26T12:42:41.065759+0000","last_clean":"2024-04-26T12:42:41.065759+0000","last_became_active":"2024-04-26T12:42:34.024706+0000","last_became_peered":"2024-04-26T12:42:34.024706+0000","last_unstale":"2024-04-26T12:42:41.065759+0000","last_undegraded":"2024-04-26T12:42:41.065759+0000","last_fullsized":"2024-04-26T12:42:41.065759+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.762146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518863+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:42:42.518863+0000","last_peered":"2024-04-26T12:42:42.518863+0000","last_clean":"2024-04-26T12:42:42.518863+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:42:42.518863+0000","last_undegraded":"2024-04-26T12:42:42.518863+0000","last_fullsized":"2024-04-26T12:42:42.518863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":225,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066300+0000","last_change":"2024-04-26T12:42:34.023824+0000","last_active":"2024-04-26T12:42:41.066300+0000","last_peered":"2024-04-26T12:42:41.066300+0000","last_clean":"2024-04-26T12:42:41.066300+0000","last_became_active":"2024-04-26T12:42:34.022553+0000","last_became_peered":"2024-04-26T12:42:34.022553+0000","last_unstale":"2024-04-26T12:42:41.066300+0000","last_undegraded":"2024-04-26T12:42:41.066300+0000","last_fullsized":"2024-04-26T12:42:41.066300+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:14.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071804+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:42:41.071804+0000","last_peered":"2024-04-26T12:42:41.071804+0000","last_clean":"2024-04-26T12:42:41.071804+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:42:41.071804+0000","last_undegraded":"2024-04-26T12:42:41.071804+0000","last_fullsized":"2024-04-26T12:42:41.071804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":334,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408101+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:42:41.408101+0000","last_peered":"2024-04-26T12:42:41.408101+0000","last_clean":"2024-04-26T12:42:41.408101+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:42:41.408101+0000","last_undegraded":"2024-04-26T12:42:41.408101+0000","last_fullsized":"2024-04-26T12:42:41.408101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"117'17","reported_seq":62,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066047+0000","last_change":"2024-04-26T12:42:34.021259+0000","last_active":"2024-04-26T12:42:41.066047+0000","last_peered":"2024-04-26T12:42:41.066047+0000","last_clean":"2024-04-26T12:42:41.066047+0000","last_became_active":"2024-04-26T12:42:34.017996+0000","last_became_peered":"2024-04-26T12:42:34.017996+0000","last_unstale":"2024-04-26T12:42:41.066047+0000","last_undegraded":"2024-04-26T12:42:41.066047+0000","last_fullsized":"2024-04-26T12:42:41.066047+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:25.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068303+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:42:41.068303+0000","last_peered":"2024-04-26T12:42:41.068303+0000","last_clean":"2024-04-26T12:42:41.068303+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:42:41.068303+0000","last_undegraded":"2024-04-26T12:42:41.068303+0000","last_fullsized":"2024-04-26T12:42:41.068303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068670+0000","last_change":"2024-04-26T12:42:34.015473+0000","last_active":"2024-04-26T12:42:41.068670+0000","last_peered":"2024-04-26T12:42:41.068670+0000","last_clean":"2024-04-26T12:42:41.068670+0000","last_became_active":"2024-04-26T12:42:34.011472+0000","last_became_peered":"2024-04-26T12:42:34.011472+0000","last_unstale":"2024-04-26T12:42:41.068670+0000","last_undegraded":"2024-04-26T12:42:41.068670+0000","last_fullsized":"2024-04-26T12:42:41.068670+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"117'8","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410161+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:42:41.410161+0000","last_peered":"2024-04-26T12:42:41.410161+0000","last_clean":"2024-04-26T12:42:41.410161+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:42:41.410161+0000","last_undegraded":"2024-04-26T12:42:41.410161+0000","last_fullsized":"2024-04-26T12:42:41.410161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"115'18","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513972+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:42:42.513972+0000","last_peered":"2024-04-26T12:42:42.513972+0000","last_clean":"2024-04-26T12:42:42.513972+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:42:42.513972+0000","last_undegraded":"2024-04-26T12:42:42.513972+0000","last_fullsized":"2024-04-26T12:42:42.513972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409722+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:42:41.409722+0000","last_peered":"2024-04-26T12:42:41.409722+0000","last_clean":"2024-04-26T12:42:41.409722+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:42:41.409722+0000","last_undegraded":"2024-04-26T12:42:41.409722+0000","last_fullsized":"2024-04-26T12:42:41.409722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"117'28","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977334+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:42:41.977334+0000","last_peered":"2024-04-26T12:42:41.977334+0000","last_clean":"2024-04-26T12:42:41.977334+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:42:41.977334+0000","last_undegraded":"2024-04-26T12:42:41.977334+0000","last_fullsized":"2024-04-26T12:42:41.977334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123354+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:42:42.123354+0000","last_peered":"2024-04-26T12:42:42.123354+0000","last_clean":"2024-04-26T12:42:42.123354+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:42:42.123354+0000","last_undegraded":"2024-04-26T12:42:42.123354+0000","last_fullsized":"2024-04-26T12:42:42.123354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'25","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122527+0000","last_change":"2024-04-26T12:42:21.926395+0000","last_active":"2024-04-26T12:42:42.122527+0000","last_peered":"2024-04-26T12:42:42.122527+0000","last_clean":"2024-04-26T12:42:42.122527+0000","last_became_active":"2024-04-26T12:42:21.925708+0000","last_became_peered":"2024-04-26T12:42:21.925708+0000","last_unstale":"2024-04-26T12:42:42.122527+0000","last_undegraded":"2024-04-26T12:42:42.122527+0000","last_fullsized":"2024-04-26T12:42:42.122527+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:41.849994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"117'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409207+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:42:41.409207+0000","last_peered":"2024-04-26T12:42:41.409207+0000","last_clean":"2024-04-26T12:42:41.409207+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:42:41.409207+0000","last_undegraded":"2024-04-26T12:42:41.409207+0000","last_fullsized":"2024-04-26T12:42:41.409207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'28","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069354+0000","last_change":"2024-04-26T12:42:21.959563+0000","last_active":"2024-04-26T12:42:41.069354+0000","last_peered":"2024-04-26T12:42:41.069354+0000","last_clean":"2024-04-26T12:42:41.069354+0000","last_became_active":"2024-04-26T12:42:21.957515+0000","last_became_peered":"2024-04-26T12:42:21.957515+0000","last_unstale":"2024-04-26T12:42:41.069354+0000","last_undegraded":"2024-04-26T12:42:41.069354+0000","last_fullsized":"2024-04-26T12:42:41.069354+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:46.718927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068640+0000","last_change":"2024-04-26T12:42:21.975117+0000","last_active":"2024-04-26T12:42:41.068640+0000","last_peered":"2024-04-26T12:42:41.068640+0000","last_clean":"2024-04-26T12:42:41.068640+0000","last_became_active":"2024-04-26T12:42:21.970669+0000","last_became_peered":"2024-04-26T12:42:21.970669+0000","last_unstale":"2024-04-26T12:42:41.068640+0000","last_undegraded":"2024-04-26T12:42:41.068640+0000","last_fullsized":"2024-04-26T12:42:41.068640+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:18.013624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'23","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071983+0000","last_change":"2024-04-26T12:42:21.964762+0000","last_active":"2024-04-26T12:42:41.071983+0000","last_peered":"2024-04-26T12:42:41.071983+0000","last_clean":"2024-04-26T12:42:41.071983+0000","last_became_active":"2024-04-26T12:42:21.961965+0000","last_became_peered":"2024-04-26T12:42:21.961965+0000","last_unstale":"2024-04-26T12:42:41.071983+0000","last_undegraded":"2024-04-26T12:42:41.071983+0000","last_fullsized":"2024-04-26T12:42:41.071983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:11.098641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068239+0000","last_change":"2024-04-26T12:42:34.025570+0000","last_active":"2024-04-26T12:42:41.068239+0000","last_peered":"2024-04-26T12:42:41.068239+0000","last_clean":"2024-04-26T12:42:41.068239+0000","last_became_active":"2024-04-26T12:42:34.024880+0000","last_became_peered":"2024-04-26T12:42:34.024880+0000","last_unstale":"2024-04-26T12:42:41.068239+0000","last_undegraded":"2024-04-26T12:42:41.068239+0000","last_fullsized":"2024-04-26T12:42:41.068239+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:55.070371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"117'19","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410111+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:42:41.410111+0000","last_peered":"2024-04-26T12:42:41.410111+0000","last_clean":"2024-04-26T12:42:41.410111+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:42:41.410111+0000","last_undegraded":"2024-04-26T12:42:41.410111+0000","last_fullsized":"2024-04-26T12:42:41.410111+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":185,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070064+0000","last_change":"2024-04-26T12:42:21.942927+0000","last_active":"2024-04-26T12:42:41.070064+0000","last_peered":"2024-04-26T12:42:41.070064+0000","last_clean":"2024-04-26T12:42:41.070064+0000","last_became_active":"2024-04-26T12:42:21.941594+0000","last_became_peered":"2024-04-26T12:42:21.941594+0000","last_unstale":"2024-04-26T12:42:41.070064+0000","last_undegraded":"2024-04-26T12:42:41.070064+0000","last_fullsized":"2024-04-26T12:42:41.070064+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:04.021398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'27","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520265+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:42:42.520265+0000","last_peered":"2024-04-26T12:42:42.520265+0000","last_clean":"2024-04-26T12:42:42.520265+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:42:42.520265+0000","last_undegraded":"2024-04-26T12:42:42.520265+0000","last_fullsized":"2024-04-26T12:42:42.520265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"117'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517260+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:42:42.517260+0000","last_peered":"2024-04-26T12:42:42.517260+0000","last_clean":"2024-04-26T12:42:42.517260+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:42:42.517260+0000","last_undegraded":"2024-04-26T12:42:42.517260+0000","last_fullsized":"2024-04-26T12:42:42.517260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"117'32","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073767+0000","last_change":"2024-04-26T12:42:21.951944+0000","last_active":"2024-04-26T12:42:41.073767+0000","last_peered":"2024-04-26T12:42:41.073767+0000","last_clean":"2024-04-26T12:42:41.073767+0000","last_became_active":"2024-04-26T12:42:21.948694+0000","last_became_peered":"2024-04-26T12:42:21.948694+0000","last_unstale":"2024-04-26T12:42:41.073767+0000","last_undegraded":"2024-04-26T12:42:41.073767+0000","last_fullsized":"2024-04-26T12:42:41.073767+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:27.567798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132120576,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":289,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071522+0000","last_change":"2024-04-26T12:42:21.957965+0000","last_active":"2024-04-26T12:42:41.071522+0000","last_peered":"2024-04-26T12:42:41.071522+0000","last_clean":"2024-04-26T12:42:41.071522+0000","last_became_active":"2024-04-26T12:42:21.956925+0000","last_became_peered":"2024-04-26T12:42:21.956925+0000","last_unstale":"2024-04-26T12:42:41.071522+0000","last_undegraded":"2024-04-26T12:42:41.071522+0000","last_fullsized":"2024-04-26T12:42:41.071522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:23.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'29","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123130+0000","last_change":"2024-04-26T12:42:21.950280+0000","last_active":"2024-04-26T12:42:42.123130+0000","last_peered":"2024-04-26T12:42:42.123130+0000","last_clean":"2024-04-26T12:42:42.123130+0000","last_became_active":"2024-04-26T12:42:21.949469+0000","last_became_peered":"2024-04-26T12:42:21.949469+0000","last_unstale":"2024-04-26T12:42:42.123130+0000","last_undegraded":"2024-04-26T12:42:42.123130+0000","last_fullsized":"2024-04-26T12:42:42.123130+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:05.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067819+0000","last_change":"2024-04-26T12:42:34.019992+0000","last_active":"2024-04-26T12:42:41.067819+0000","last_peered":"2024-04-26T12:42:41.067819+0000","last_clean":"2024-04-26T12:42:41.067819+0000","last_became_active":"2024-04-26T12:42:34.018659+0000","last_became_peered":"2024-04-26T12:42:34.018659+0000","last_unstale":"2024-04-26T12:42:41.067819+0000","last_undegraded":"2024-04-26T12:42:41.067819+0000","last_fullsized":"2024-04-26T12:42:41.067819+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:24.593225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'18","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069486+0000","last_change":"2024-04-26T12:42:21.933174+0000","last_active":"2024-04-26T12:42:41.069486+0000","last_peered":"2024-04-26T12:42:41.069486+0000","last_clean":"2024-04-26T12:42:41.069486+0000","last_became_active":"2024-04-26T12:42:21.932263+0000","last_became_peered":"2024-04-26T12:42:21.932263+0000","last_unstale":"2024-04-26T12:42:41.069486+0000","last_undegraded":"2024-04-26T12:42:41.069486+0000","last_fullsized":"2024-04-26T12:42:41.069486+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:26.946555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"117'4","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976542+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:42:41.976542+0000","last_peered":"2024-04-26T12:42:41.976542+0000","last_clean":"2024-04-26T12:42:41.976542+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:42:41.976542+0000","last_undegraded":"2024-04-26T12:42:41.976542+0000","last_fullsized":"2024-04-26T12:42:41.976542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"112'16","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122214+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:42:42.122214+0000","last_peered":"2024-04-26T12:42:42.122214+0000","last_clean":"2024-04-26T12:42:42.122214+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:42:42.122214+0000","last_undegraded":"2024-04-26T12:42:42.122214+0000","last_fullsized":"2024-04-26T12:42:42.122214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068189+0000","last_change":"2024-04-26T12:42:34.024717+0000","last_active":"2024-04-26T12:42:41.068189+0000","last_peered":"2024-04-26T12:42:41.068189+0000","last_clean":"2024-04-26T12:42:41.068189+0000","last_became_active":"2024-04-26T12:42:34.023978+0000","last_became_peered":"2024-04-26T12:42:34.023978+0000","last_unstale":"2024-04-26T12:42:41.068189+0000","last_undegraded":"2024-04-26T12:42:41.068189+0000","last_fullsized":"2024-04-26T12:42:41.068189+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'23","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071543+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:42:41.071543+0000","last_peered":"2024-04-26T12:42:41.071543+0000","last_clean":"2024-04-26T12:42:41.071543+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:42:41.071543+0000","last_undegraded":"2024-04-26T12:42:41.071543+0000","last_fullsized":"2024-04-26T12:42:41.071543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520003+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:42:42.520003+0000","last_peered":"2024-04-26T12:42:42.520003+0000","last_clean":"2024-04-26T12:42:42.520003+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:42:42.520003+0000","last_undegraded":"2024-04-26T12:42:42.520003+0000","last_fullsized":"2024-04-26T12:42:42.520003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'17","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514500+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:42:42.514500+0000","last_peered":"2024-04-26T12:42:42.514500+0000","last_clean":"2024-04-26T12:42:42.514500+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:42:42.514500+0000","last_undegraded":"2024-04-26T12:42:42.514500+0000","last_fullsized":"2024-04-26T12:42:42.514500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068613+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:42:41.068613+0000","last_peered":"2024-04-26T12:42:41.068613+0000","last_clean":"2024-04-26T12:42:41.068613+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:42:41.068613+0000","last_undegraded":"2024-04-26T12:42:41.068613+0000","last_fullsized":"2024-04-26T12:42:41.068613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'24","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514550+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:42:42.514550+0000","last_peered":"2024-04-26T12:42:42.514550+0000","last_clean":"2024-04-26T12:42:42.514550+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:42:42.514550+0000","last_undegraded":"2024-04-26T12:42:42.514550+0000","last_fullsized":"2024-04-26T12:42:42.514550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070772+0000","last_change":"2024-04-26T12:42:21.967040+0000","last_active":"2024-04-26T12:42:41.070772+0000","last_peered":"2024-04-26T12:42:41.070772+0000","last_clean":"2024-04-26T12:42:41.070772+0000","last_became_active":"2024-04-26T12:42:21.965634+0000","last_became_peered":"2024-04-26T12:42:21.965634+0000","last_unstale":"2024-04-26T12:42:41.070772+0000","last_undegraded":"2024-04-26T12:42:41.070772+0000","last_fullsized":"2024-04-26T12:42:41.070772+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:58.603311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'16","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976821+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:42:41.976821+0000","last_peered":"2024-04-26T12:42:41.976821+0000","last_clean":"2024-04-26T12:42:41.976821+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:42:41.976821+0000","last_undegraded":"2024-04-26T12:42:41.976821+0000","last_fullsized":"2024-04-26T12:42:41.976821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516557+0000","last_change":"2024-04-26T12:42:21.967682+0000","last_active":"2024-04-26T12:42:42.516557+0000","last_peered":"2024-04-26T12:42:42.516557+0000","last_clean":"2024-04-26T12:42:42.516557+0000","last_became_active":"2024-04-26T12:42:21.967048+0000","last_became_peered":"2024-04-26T12:42:21.967048+0000","last_unstale":"2024-04-26T12:42:42.516557+0000","last_undegraded":"2024-04-26T12:42:42.516557+0000","last_fullsized":"2024-04-26T12:42:42.516557+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:43.288294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"117'15","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123879+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:42:42.123879+0000","last_peered":"2024-04-26T12:42:42.123879+0000","last_clean":"2024-04-26T12:42:42.123879+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:42:42.123879+0000","last_undegraded":"2024-04-26T12:42:42.123879+0000","last_fullsized":"2024-04-26T12:42:42.123879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"116'24","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122836+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:42:42.122836+0000","last_peered":"2024-04-26T12:42:42.122836+0000","last_clean":"2024-04-26T12:42:42.122836+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:42:42.122836+0000","last_undegraded":"2024-04-26T12:42:42.122836+0000","last_fullsized":"2024-04-26T12:42:42.122836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070164+0000","last_change":"2024-04-26T12:42:21.937768+0000","last_active":"2024-04-26T12:42:41.070164+0000","last_peered":"2024-04-26T12:42:41.070164+0000","last_clean":"2024-04-26T12:42:41.070164+0000","last_became_active":"2024-04-26T12:42:21.936930+0000","last_became_peered":"2024-04-26T12:42:21.936930+0000","last_unstale":"2024-04-26T12:42:41.070164+0000","last_undegraded":"2024-04-26T12:42:41.070164+0000","last_fullsized":"2024-04-26T12:42:41.070164+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.253226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"117'25","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408802+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:42:41.408802+0000","last_peered":"2024-04-26T12:42:41.408802+0000","last_clean":"2024-04-26T12:42:41.408802+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:42:41.408802+0000","last_undegraded":"2024-04-26T12:42:41.408802+0000","last_fullsized":"2024-04-26T12:42:41.408802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"117'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123586+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:42:42.123586+0000","last_peered":"2024-04-26T12:42:42.123586+0000","last_clean":"2024-04-26T12:42:42.123586+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:42:42.123586+0000","last_undegraded":"2024-04-26T12:42:42.123586+0000","last_fullsized":"2024-04-26T12:42:42.123586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":336,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1084,"ondisk_log_size":1084,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382929,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":607,"num_write":463,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1275,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1700576,"kb_used_data":1669396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92671264,"statfs":{"total":96636764160,"available":94895374336,"internally_reserved":0,"allocated":1709461504,"data_stored":1708741343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1136704,"kb_used_data":1105528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93235136,"statfs":{"total":96636764160,"available":95472779264,"internally_reserved":0,"allocated":1132060672,"data_stored":1131374253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1950060,"kb_used_data":1914724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92421780,"statfs":{"total":96636764160,"available":94639902720,"internally_reserved":0,"allocated":1960677376,"data_stored":1959926964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1808444,"kb_used_data":1777264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92563396,"statfs":{"total":96636764160,"available":94784917504,"internally_reserved":0,"allocated":1819918336,"data_stored":1819239618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":122,"seq":523986010120,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1942860,"kb_used_data":1906500,"kb_used_omap":6,"kb_used_meta":36345,"kb_avail":92428980,"statfs":{"total":96636764160,"available":94647275520,"internally_reserved":0,"allocated":1952256000,"data_stored":1951536896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6715,"internal_metadata":37217733},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163384,"kb_used_data":1128048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93208456,"statfs":{"total":96636764160,"available":95445458944,"internally_reserved":0,"allocated":1155121152,"data_stored":1154442923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1130836,"kb_used_data":1091340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93241004,"statfs":{"total":96636764160,"available":95478788096,"internally_reserved":0,"allocated":1117532160,"data_stored":1116813587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1762172,"kb_used_data":1726832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92609668,"statfs":{"total":96636764160,"available":94832300032,"internally_reserved":0,"allocated":1768275968,"data_stored":1767576542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1765801984,"data_stored":1765801984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1115684864,"data_stored":1115684864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1153433600,"data_stored":1153433600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1958739968,"data_stored":1958739968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1130364928,"data_stored":1130364928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1707081728,"data_stored":1707081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":175679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":176622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":176872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:42:53.260 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:42:53.611 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:42:53.619 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:42:53.635 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-04-26T12:42:52.787702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819921,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3100,"num_read_kb":2786,"num_write":2843,"num_write_kb":6187910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3903,"ondisk_log_size":3903,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595036,"kb_used_data":12319632,"kb_used_omap":17,"kb_used_meta":275310,"kb_avail":742379684,"statfs":{"total":773094113280,"available":760196796416,"internally_reserved":0,"allocated":12615303168,"data_stored":12609652126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17874,"internal_metadata":281917998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.724283"},"pg_stats":[{"pgid":"3.3f","version":"116'21","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519202+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:42:42.519202+0000","last_peered":"2024-04-26T12:42:42.519202+0000","last_clean":"2024-04-26T12:42:42.519202+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:42:42.519202+0000","last_undegraded":"2024-04-26T12:42:42.519202+0000","last_fullsized":"2024-04-26T12:42:42.519202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"117'6","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121480+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:42:42.121480+0000","last_peered":"2024-04-26T12:42:42.121480+0000","last_clean":"2024-04-26T12:42:42.121480+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:42:42.121480+0000","last_undegraded":"2024-04-26T12:42:42.121480+0000","last_fullsized":"2024-04-26T12:42:42.121480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'16","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409799+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:42:41.409799+0000","last_peered":"2024-04-26T12:42:41.409799+0000","last_clean":"2024-04-26T12:42:41.409799+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:42:41.409799+0000","last_undegraded":"2024-04-26T12:42:41.409799+0000","last_fullsized":"2024-04-26T12:42:41.409799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518093+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:42:42.518093+0000","last_peered":"2024-04-26T12:42:42.518093+0000","last_clean":"2024-04-26T12:42:42.518093+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:42:42.518093+0000","last_undegraded":"2024-04-26T12:42:42.518093+0000","last_fullsized":"2024-04-26T12:42:42.518093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069713+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:42:41.069713+0000","last_peered":"2024-04-26T12:42:41.069713+0000","last_clean":"2024-04-26T12:42:41.069713+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:42:41.069713+0000","last_undegraded":"2024-04-26T12:42:41.069713+0000","last_fullsized":"2024-04-26T12:42:41.069713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066786+0000","last_change":"2024-04-26T12:42:34.019445+0000","last_active":"2024-04-26T12:42:41.066786+0000","last_peered":"2024-04-26T12:42:41.066786+0000","last_clean":"2024-04-26T12:42:41.066786+0000","last_became_active":"2024-04-26T12:42:34.016025+0000","last_became_peered":"2024-04-26T12:42:34.016025+0000","last_unstale":"2024-04-26T12:42:41.066786+0000","last_undegraded":"2024-04-26T12:42:41.066786+0000","last_fullsized":"2024-04-26T12:42:41.066786+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:55.436710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'31","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123102+0000","last_change":"2024-04-26T12:42:21.947248+0000","last_active":"2024-04-26T12:42:42.123102+0000","last_peered":"2024-04-26T12:42:42.123102+0000","last_clean":"2024-04-26T12:42:42.123102+0000","last_became_active":"2024-04-26T12:42:21.946477+0000","last_became_peered":"2024-04-26T12:42:21.946477+0000","last_unstale":"2024-04-26T12:42:42.123102+0000","last_undegraded":"2024-04-26T12:42:42.123102+0000","last_fullsized":"2024-04-26T12:42:42.123102+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.347007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069100+0000","last_change":"2024-04-26T12:42:21.958105+0000","last_active":"2024-04-26T12:42:41.069100+0000","last_peered":"2024-04-26T12:42:41.069100+0000","last_clean":"2024-04-26T12:42:41.069100+0000","last_became_active":"2024-04-26T12:42:21.956507+0000","last_became_peered":"2024-04-26T12:42:21.956507+0000","last_unstale":"2024-04-26T12:42:41.069100+0000","last_undegraded":"2024-04-26T12:42:41.069100+0000","last_fullsized":"2024-04-26T12:42:41.069100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'25","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513970+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:42:42.513970+0000","last_peered":"2024-04-26T12:42:42.513970+0000","last_clean":"2024-04-26T12:42:42.513970+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:42:42.513970+0000","last_undegraded":"2024-04-26T12:42:42.513970+0000","last_fullsized":"2024-04-26T12:42:42.513970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520555+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:42:42.520555+0000","last_peered":"2024-04-26T12:42:42.520555+0000","last_clean":"2024-04-26T12:42:42.520555+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:42:42.520555+0000","last_undegraded":"2024-04-26T12:42:42.520555+0000","last_fullsized":"2024-04-26T12:42:42.520555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'25","reported_seq":228,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975912+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:42:41.975912+0000","last_peered":"2024-04-26T12:42:41.975912+0000","last_clean":"2024-04-26T12:42:41.975912+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:42:41.975912+0000","last_undegraded":"2024-04-26T12:42:41.975912+0000","last_fullsized":"2024-04-26T12:42:41.975912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":122,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066858+0000","last_change":"2024-04-26T12:42:34.007918+0000","last_active":"2024-04-26T12:42:41.066858+0000","last_peered":"2024-04-26T12:42:41.066858+0000","last_clean":"2024-04-26T12:42:41.066858+0000","last_became_active":"2024-04-26T12:42:34.006179+0000","last_became_peered":"2024-04-26T12:42:34.006179+0000","last_unstale":"2024-04-26T12:42:41.066858+0000","last_undegraded":"2024-04-26T12:42:41.066858+0000","last_fullsized":"2024-04-26T12:42:41.066858+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:13.173789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'22","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513774+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:42:42.513774+0000","last_peered":"2024-04-26T12:42:42.513774+0000","last_clean":"2024-04-26T12:42:42.513774+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:42:42.513774+0000","last_undegraded":"2024-04-26T12:42:42.513774+0000","last_fullsized":"2024-04-26T12:42:42.513774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123326+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:42:42.123326+0000","last_peered":"2024-04-26T12:42:42.123326+0000","last_clean":"2024-04-26T12:42:42.123326+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:42:42.123326+0000","last_undegraded":"2024-04-26T12:42:42.123326+0000","last_fullsized":"2024-04-26T12:42:42.123326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"117'13","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067810+0000","last_change":"2024-04-26T12:42:21.952625+0000","last_active":"2024-04-26T12:42:41.067810+0000","last_peered":"2024-04-26T12:42:41.067810+0000","last_clean":"2024-04-26T12:42:41.067810+0000","last_became_active":"2024-04-26T12:42:21.948971+0000","last_became_peered":"2024-04-26T12:42:21.948971+0000","last_unstale":"2024-04-26T12:42:41.067810+0000","last_undegraded":"2024-04-26T12:42:41.067810+0000","last_fullsized":"2024-04-26T12:42:41.067810+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:55.735297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977969+0000","last_change":"2024-04-26T12:42:21.965782+0000","last_active":"2024-04-26T12:42:41.977969+0000","last_peered":"2024-04-26T12:42:41.977969+0000","last_clean":"2024-04-26T12:42:41.977969+0000","last_became_active":"2024-04-26T12:42:21.964820+0000","last_became_peered":"2024-04-26T12:42:21.964820+0000","last_unstale":"2024-04-26T12:42:41.977969+0000","last_undegraded":"2024-04-26T12:42:41.977969+0000","last_fullsized":"2024-04-26T12:42:41.977969+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:07.092768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":168,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066034+0000","last_change":"2024-04-26T12:42:34.005982+0000","last_active":"2024-04-26T12:42:41.066034+0000","last_peered":"2024-04-26T12:42:41.066034+0000","last_clean":"2024-04-26T12:42:41.066034+0000","last_became_active":"2024-04-26T12:42:34.003575+0000","last_became_peered":"2024-04-26T12:42:34.003575+0000","last_unstale":"2024-04-26T12:42:41.066034+0000","last_undegraded":"2024-04-26T12:42:41.066034+0000","last_fullsized":"2024-04-26T12:42:41.066034+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:19.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'25","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516034+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:42:42.516034+0000","last_peered":"2024-04-26T12:42:42.516034+0000","last_clean":"2024-04-26T12:42:42.516034+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:42:42.516034+0000","last_undegraded":"2024-04-26T12:42:42.516034+0000","last_fullsized":"2024-04-26T12:42:42.516034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"117'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518358+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:42:42.518358+0000","last_peered":"2024-04-26T12:42:42.518358+0000","last_clean":"2024-04-26T12:42:42.518358+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:42:42.518358+0000","last_undegraded":"2024-04-26T12:42:42.518358+0000","last_fullsized":"2024-04-26T12:42:42.518358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"115'35","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516148+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:42:42.516148+0000","last_peered":"2024-04-26T12:42:42.516148+0000","last_clean":"2024-04-26T12:42:42.516148+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:42:42.516148+0000","last_undegraded":"2024-04-26T12:42:42.516148+0000","last_fullsized":"2024-04-26T12:42:42.516148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":45,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122421+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:42:42.122421+0000","last_peered":"2024-04-26T12:42:42.122421+0000","last_clean":"2024-04-26T12:42:42.122421+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:42:42.122421+0000","last_undegraded":"2024-04-26T12:42:42.122421+0000","last_fullsized":"2024-04-26T12:42:42.122421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'28","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515382+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:42:42.515382+0000","last_peered":"2024-04-26T12:42:42.515382+0000","last_clean":"2024-04-26T12:42:42.515382+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:42:42.515382+0000","last_undegraded":"2024-04-26T12:42:42.515382+0000","last_fullsized":"2024-04-26T12:42:42.515382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976530+0000","last_change":"2024-04-26T12:42:21.957465+0000","last_active":"2024-04-26T12:42:41.976530+0000","last_peered":"2024-04-26T12:42:41.976530+0000","last_clean":"2024-04-26T12:42:41.976530+0000","last_became_active":"2024-04-26T12:42:21.956566+0000","last_became_peered":"2024-04-26T12:42:21.956566+0000","last_unstale":"2024-04-26T12:42:41.976530+0000","last_undegraded":"2024-04-26T12:42:41.976530+0000","last_fullsized":"2024-04-26T12:42:41.976530+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:30.300637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"115'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066651+0000","last_change":"2024-04-26T12:42:34.024102+0000","last_active":"2024-04-26T12:42:41.066651+0000","last_peered":"2024-04-26T12:42:41.066651+0000","last_clean":"2024-04-26T12:42:41.066651+0000","last_became_active":"2024-04-26T12:42:34.022426+0000","last_became_peered":"2024-04-26T12:42:34.022426+0000","last_unstale":"2024-04-26T12:42:41.066651+0000","last_undegraded":"2024-04-26T12:42:41.066651+0000","last_fullsized":"2024-04-26T12:42:41.066651+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:21.509191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976221+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:42:41.976221+0000","last_peered":"2024-04-26T12:42:41.976221+0000","last_clean":"2024-04-26T12:42:41.976221+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:42:41.976221+0000","last_undegraded":"2024-04-26T12:42:41.976221+0000","last_fullsized":"2024-04-26T12:42:41.976221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'21","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070281+0000","last_change":"2024-04-26T12:42:21.946507+0000","last_active":"2024-04-26T12:42:41.070281+0000","last_peered":"2024-04-26T12:42:41.070281+0000","last_clean":"2024-04-26T12:42:41.070281+0000","last_became_active":"2024-04-26T12:42:21.932303+0000","last_became_peered":"2024-04-26T12:42:21.932303+0000","last_unstale":"2024-04-26T12:42:41.070281+0000","last_undegraded":"2024-04-26T12:42:41.070281+0000","last_fullsized":"2024-04-26T12:42:41.070281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:48.132898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":113,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066875+0000","last_change":"2024-04-26T12:42:34.027080+0000","last_active":"2024-04-26T12:42:41.066875+0000","last_peered":"2024-04-26T12:42:41.066875+0000","last_clean":"2024-04-26T12:42:41.066875+0000","last_became_active":"2024-04-26T12:42:34.025281+0000","last_became_peered":"2024-04-26T12:42:34.025281+0000","last_unstale":"2024-04-26T12:42:41.066875+0000","last_undegraded":"2024-04-26T12:42:41.066875+0000","last_fullsized":"2024-04-26T12:42:41.066875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:16.292958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"115'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069550+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:42:41.069550+0000","last_peered":"2024-04-26T12:42:41.069550+0000","last_clean":"2024-04-26T12:42:41.069550+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:42:41.069550+0000","last_undegraded":"2024-04-26T12:42:41.069550+0000","last_fullsized":"2024-04-26T12:42:41.069550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065496+0000","last_change":"2024-04-26T12:42:34.014303+0000","last_active":"2024-04-26T12:42:41.065496+0000","last_peered":"2024-04-26T12:42:41.065496+0000","last_clean":"2024-04-26T12:42:41.065496+0000","last_became_active":"2024-04-26T12:42:34.013263+0000","last_became_peered":"2024-04-26T12:42:34.013263+0000","last_unstale":"2024-04-26T12:42:41.065496+0000","last_undegraded":"2024-04-26T12:42:41.065496+0000","last_fullsized":"2024-04-26T12:42:41.065496+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:35.131864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072787+0000","last_change":"2024-04-26T12:42:21.967042+0000","last_active":"2024-04-26T12:42:41.072787+0000","last_peered":"2024-04-26T12:42:41.072787+0000","last_clean":"2024-04-26T12:42:41.072787+0000","last_became_active":"2024-04-26T12:42:21.961909+0000","last_became_peered":"2024-04-26T12:42:21.961909+0000","last_unstale":"2024-04-26T12:42:41.072787+0000","last_undegraded":"2024-04-26T12:42:41.072787+0000","last_fullsized":"2024-04-26T12:42:41.072787+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:33.810933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'18","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513868+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:42:42.513868+0000","last_peered":"2024-04-26T12:42:42.513868+0000","last_clean":"2024-04-26T12:42:42.513868+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:42:42.513868+0000","last_undegraded":"2024-04-26T12:42:42.513868+0000","last_fullsized":"2024-04-26T12:42:42.513868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122848+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:42:42.122848+0000","last_peered":"2024-04-26T12:42:42.122848+0000","last_clean":"2024-04-26T12:42:42.122848+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:42:42.122848+0000","last_undegraded":"2024-04-26T12:42:42.122848+0000","last_fullsized":"2024-04-26T12:42:42.122848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070613+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:42:41.070613+0000","last_peered":"2024-04-26T12:42:41.070613+0000","last_clean":"2024-04-26T12:42:41.070613+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:42:41.070613+0000","last_undegraded":"2024-04-26T12:42:41.070613+0000","last_fullsized":"2024-04-26T12:42:41.070613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516269+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:42:42.516269+0000","last_peered":"2024-04-26T12:42:42.516269+0000","last_clean":"2024-04-26T12:42:42.516269+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:42:42.516269+0000","last_undegraded":"2024-04-26T12:42:42.516269+0000","last_fullsized":"2024-04-26T12:42:42.516269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"117'48","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121554+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:42:42.121554+0000","last_peered":"2024-04-26T12:42:42.121554+0000","last_clean":"2024-04-26T12:42:42.121554+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:42:42.121554+0000","last_undegraded":"2024-04-26T12:42:42.121554+0000","last_fullsized":"2024-04-26T12:42:42.121554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123831+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:42:42.123831+0000","last_peered":"2024-04-26T12:42:42.123831+0000","last_clean":"2024-04-26T12:42:42.123831+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:42:42.123831+0000","last_undegraded":"2024-04-26T12:42:42.123831+0000","last_fullsized":"2024-04-26T12:42:42.123831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'34","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069854+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:42:41.069854+0000","last_peered":"2024-04-26T12:42:41.069854+0000","last_clean":"2024-04-26T12:42:41.069854+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:42:41.069854+0000","last_undegraded":"2024-04-26T12:42:41.069854+0000","last_fullsized":"2024-04-26T12:42:41.069854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074395+0000","last_change":"2024-04-26T12:42:21.970469+0000","last_active":"2024-04-26T12:42:41.074395+0000","last_peered":"2024-04-26T12:42:41.074395+0000","last_clean":"2024-04-26T12:42:41.074395+0000","last_became_active":"2024-04-26T12:42:21.968825+0000","last_became_peered":"2024-04-26T12:42:21.968825+0000","last_unstale":"2024-04-26T12:42:41.074395+0000","last_undegraded":"2024-04-26T12:42:41.074395+0000","last_fullsized":"2024-04-26T12:42:41.074395+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:54.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":55,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066772+0000","last_change":"2024-04-26T12:42:34.021039+0000","last_active":"2024-04-26T12:42:41.066772+0000","last_peered":"2024-04-26T12:42:41.066772+0000","last_clean":"2024-04-26T12:42:41.066772+0000","last_became_active":"2024-04-26T12:42:34.018809+0000","last_became_peered":"2024-04-26T12:42:34.018809+0000","last_unstale":"2024-04-26T12:42:41.066772+0000","last_undegraded":"2024-04-26T12:42:41.066772+0000","last_fullsized":"2024-04-26T12:42:41.066772+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066660+0000","last_change":"2024-04-26T12:42:34.007481+0000","last_active":"2024-04-26T12:42:41.066660+0000","last_peered":"2024-04-26T12:42:41.066660+0000","last_clean":"2024-04-26T12:42:41.066660+0000","last_became_active":"2024-04-26T12:42:34.004534+0000","last_became_peered":"2024-04-26T12:42:34.004534+0000","last_unstale":"2024-04-26T12:42:41.066660+0000","last_undegraded":"2024-04-26T12:42:41.066660+0000","last_fullsized":"2024-04-26T12:42:41.066660+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:33.240125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068768+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:42:41.068768+0000","last_peered":"2024-04-26T12:42:41.068768+0000","last_clean":"2024-04-26T12:42:41.068768+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:42:41.068768+0000","last_undegraded":"2024-04-26T12:42:41.068768+0000","last_fullsized":"2024-04-26T12:42:41.068768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072461+0000","last_change":"2024-04-26T12:42:21.937320+0000","last_active":"2024-04-26T12:42:41.072461+0000","last_peered":"2024-04-26T12:42:41.072461+0000","last_clean":"2024-04-26T12:42:41.072461+0000","last_became_active":"2024-04-26T12:42:21.936393+0000","last_became_peered":"2024-04-26T12:42:21.936393+0000","last_unstale":"2024-04-26T12:42:41.072461+0000","last_undegraded":"2024-04-26T12:42:41.072461+0000","last_fullsized":"2024-04-26T12:42:41.072461+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:21.787788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"115'21","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513709+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:42:42.513709+0000","last_peered":"2024-04-26T12:42:42.513709+0000","last_clean":"2024-04-26T12:42:42.513709+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:42:42.513709+0000","last_undegraded":"2024-04-26T12:42:42.513709+0000","last_fullsized":"2024-04-26T12:42:42.513709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074226+0000","last_change":"2024-04-26T12:42:21.961567+0000","last_active":"2024-04-26T12:42:41.074226+0000","last_peered":"2024-04-26T12:42:41.074226+0000","last_clean":"2024-04-26T12:42:41.074226+0000","last_became_active":"2024-04-26T12:42:21.957657+0000","last_became_peered":"2024-04-26T12:42:21.957657+0000","last_unstale":"2024-04-26T12:42:41.074226+0000","last_undegraded":"2024-04-26T12:42:41.074226+0000","last_fullsized":"2024-04-26T12:42:41.074226+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:50.723405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975984+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:42:41.975984+0000","last_peered":"2024-04-26T12:42:41.975984+0000","last_clean":"2024-04-26T12:42:41.975984+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:42:41.975984+0000","last_undegraded":"2024-04-26T12:42:41.975984+0000","last_fullsized":"2024-04-26T12:42:41.975984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"139'135","reported_seq":500,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.750936+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:42:44.750936+0000","last_peered":"2024-04-26T12:42:44.750936+0000","last_clean":"2024-04-26T12:42:44.750936+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:42:44.750936+0000","last_undegraded":"2024-04-26T12:42:44.750936+0000","last_fullsized":"2024-04-26T12:42:44.750936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066020+0000","last_change":"2024-04-26T12:42:34.015888+0000","last_active":"2024-04-26T12:42:41.066020+0000","last_peered":"2024-04-26T12:42:41.066020+0000","last_clean":"2024-04-26T12:42:41.066020+0000","last_became_active":"2024-04-26T12:42:34.015101+0000","last_became_peered":"2024-04-26T12:42:34.015101+0000","last_unstale":"2024-04-26T12:42:41.066020+0000","last_undegraded":"2024-04-26T12:42:41.066020+0000","last_fullsized":"2024-04-26T12:42:41.066020+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:23.606728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074777+0000","last_change":"2024-04-26T12:42:21.971692+0000","last_active":"2024-04-26T12:42:41.074777+0000","last_peered":"2024-04-26T12:42:41.074777+0000","last_clean":"2024-04-26T12:42:41.074777+0000","last_became_active":"2024-04-26T12:42:21.970815+0000","last_became_peered":"2024-04-26T12:42:21.970815+0000","last_unstale":"2024-04-26T12:42:41.074777+0000","last_undegraded":"2024-04-26T12:42:41.074777+0000","last_fullsized":"2024-04-26T12:42:41.074777+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:03.033305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'28","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513771+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:42:42.513771+0000","last_peered":"2024-04-26T12:42:42.513771+0000","last_clean":"2024-04-26T12:42:42.513771+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:42:42.513771+0000","last_undegraded":"2024-04-26T12:42:42.513771+0000","last_fullsized":"2024-04-26T12:42:42.513771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123181+0000","last_change":"2024-04-26T12:42:21.926752+0000","last_active":"2024-04-26T12:42:42.123181+0000","last_peered":"2024-04-26T12:42:42.123181+0000","last_clean":"2024-04-26T12:42:42.123181+0000","last_became_active":"2024-04-26T12:42:21.926086+0000","last_became_peered":"2024-04-26T12:42:21.926086+0000","last_unstale":"2024-04-26T12:42:42.123181+0000","last_undegraded":"2024-04-26T12:42:42.123181+0000","last_fullsized":"2024-04-26T12:42:42.123181+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.645084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"117'17","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518589+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:42:42.518589+0000","last_peered":"2024-04-26T12:42:42.518589+0000","last_clean":"2024-04-26T12:42:42.518589+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:42:42.518589+0000","last_undegraded":"2024-04-26T12:42:42.518589+0000","last_fullsized":"2024-04-26T12:42:42.518589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"139'137","reported_seq":414,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751637+0000","last_change":"2024-04-26T12:42:21.973003+0000","last_active":"2024-04-26T12:42:44.751637+0000","last_peered":"2024-04-26T12:42:44.751637+0000","last_clean":"2024-04-26T12:42:44.751637+0000","last_became_active":"2024-04-26T12:42:21.972298+0000","last_became_peered":"2024-04-26T12:42:21.972298+0000","last_unstale":"2024-04-26T12:42:44.751637+0000","last_undegraded":"2024-04-26T12:42:44.751637+0000","last_fullsized":"2024-04-26T12:42:44.751637+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:09.716281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122553+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:42:42.122553+0000","last_peered":"2024-04-26T12:42:42.122553+0000","last_clean":"2024-04-26T12:42:42.122553+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:42:42.122553+0000","last_undegraded":"2024-04-26T12:42:42.122553+0000","last_fullsized":"2024-04-26T12:42:42.122553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"115'24","reported_seq":227,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977649+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:42:41.977649+0000","last_peered":"2024-04-26T12:42:41.977649+0000","last_clean":"2024-04-26T12:42:41.977649+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:42:41.977649+0000","last_undegraded":"2024-04-26T12:42:41.977649+0000","last_fullsized":"2024-04-26T12:42:41.977649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517468+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:42:42.517468+0000","last_peered":"2024-04-26T12:42:42.517468+0000","last_clean":"2024-04-26T12:42:42.517468+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:42:42.517468+0000","last_undegraded":"2024-04-26T12:42:42.517468+0000","last_fullsized":"2024-04-26T12:42:42.517468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"117'27","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121597+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:42:42.121597+0000","last_peered":"2024-04-26T12:42:42.121597+0000","last_clean":"2024-04-26T12:42:42.121597+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:42:42.121597+0000","last_undegraded":"2024-04-26T12:42:42.121597+0000","last_fullsized":"2024-04-26T12:42:42.121597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408852+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:42:41.408852+0000","last_peered":"2024-04-26T12:42:41.408852+0000","last_clean":"2024-04-26T12:42:41.408852+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:42:41.408852+0000","last_undegraded":"2024-04-26T12:42:41.408852+0000","last_fullsized":"2024-04-26T12:42:41.408852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121946+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:42:42.121946+0000","last_peered":"2024-04-26T12:42:42.121946+0000","last_clean":"2024-04-26T12:42:42.121946+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:42:42.121946+0000","last_undegraded":"2024-04-26T12:42:42.121946+0000","last_fullsized":"2024-04-26T12:42:42.121946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065995+0000","last_change":"2024-04-26T12:42:34.029770+0000","last_active":"2024-04-26T12:42:41.065995+0000","last_peered":"2024-04-26T12:42:41.065995+0000","last_clean":"2024-04-26T12:42:41.065995+0000","last_became_active":"2024-04-26T12:42:34.027515+0000","last_became_peered":"2024-04-26T12:42:34.027515+0000","last_unstale":"2024-04-26T12:42:41.065995+0000","last_undegraded":"2024-04-26T12:42:41.065995+0000","last_fullsized":"2024-04-26T12:42:41.065995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:24.498714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'20","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515684+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:42:42.515684+0000","last_peered":"2024-04-26T12:42:42.515684+0000","last_clean":"2024-04-26T12:42:42.515684+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:42:42.515684+0000","last_undegraded":"2024-04-26T12:42:42.515684+0000","last_fullsized":"2024-04-26T12:42:42.515684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975908+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:42:41.975908+0000","last_peered":"2024-04-26T12:42:41.975908+0000","last_clean":"2024-04-26T12:42:41.975908+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:42:41.975908+0000","last_undegraded":"2024-04-26T12:42:41.975908+0000","last_fullsized":"2024-04-26T12:42:41.975908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"117'19","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068371+0000","last_change":"2024-04-26T12:42:21.974974+0000","last_active":"2024-04-26T12:42:41.068371+0000","last_peered":"2024-04-26T12:42:41.068371+0000","last_clean":"2024-04-26T12:42:41.068371+0000","last_became_active":"2024-04-26T12:42:21.968492+0000","last_became_peered":"2024-04-26T12:42:21.968492+0000","last_unstale":"2024-04-26T12:42:41.068371+0000","last_undegraded":"2024-04-26T12:42:41.068371+0000","last_fullsized":"2024-04-26T12:42:41.068371+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:59.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068594+0000","last_change":"2024-04-26T12:42:21.943962+0000","last_active":"2024-04-26T12:42:41.068594+0000","last_peered":"2024-04-26T12:42:41.068594+0000","last_clean":"2024-04-26T12:42:41.068594+0000","last_became_active":"2024-04-26T12:42:21.942925+0000","last_became_peered":"2024-04-26T12:42:21.942925+0000","last_unstale":"2024-04-26T12:42:41.068594+0000","last_undegraded":"2024-04-26T12:42:41.068594+0000","last_fullsized":"2024-04-26T12:42:41.068594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:17.453438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519637+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:42:42.519637+0000","last_peered":"2024-04-26T12:42:42.519637+0000","last_clean":"2024-04-26T12:42:42.519637+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:42:42.519637+0000","last_undegraded":"2024-04-26T12:42:42.519637+0000","last_fullsized":"2024-04-26T12:42:42.519637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518899+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:42:42.518899+0000","last_peered":"2024-04-26T12:42:42.518899+0000","last_clean":"2024-04-26T12:42:42.518899+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:42:42.518899+0000","last_undegraded":"2024-04-26T12:42:42.518899+0000","last_fullsized":"2024-04-26T12:42:42.518899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"114'19","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514720+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:42:42.514720+0000","last_peered":"2024-04-26T12:42:42.514720+0000","last_clean":"2024-04-26T12:42:42.514720+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:42:42.514720+0000","last_undegraded":"2024-04-26T12:42:42.514720+0000","last_fullsized":"2024-04-26T12:42:42.514720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976781+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:42:41.976781+0000","last_peered":"2024-04-26T12:42:41.976781+0000","last_clean":"2024-04-26T12:42:41.976781+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:42:41.976781+0000","last_undegraded":"2024-04-26T12:42:41.976781+0000","last_fullsized":"2024-04-26T12:42:41.976781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"117'24","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516808+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:42:42.516808+0000","last_peered":"2024-04-26T12:42:42.516808+0000","last_clean":"2024-04-26T12:42:42.516808+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:42:42.516808+0000","last_undegraded":"2024-04-26T12:42:42.516808+0000","last_fullsized":"2024-04-26T12:42:42.516808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"139'135","reported_seq":455,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.752218+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:42:44.752218+0000","last_peered":"2024-04-26T12:42:44.752218+0000","last_clean":"2024-04-26T12:42:44.752218+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:42:44.752218+0000","last_undegraded":"2024-04-26T12:42:44.752218+0000","last_fullsized":"2024-04-26T12:42:44.752218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071038+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:42:41.071038+0000","last_peered":"2024-04-26T12:42:41.071038+0000","last_clean":"2024-04-26T12:42:41.071038+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:42:41.071038+0000","last_undegraded":"2024-04-26T12:42:41.071038+0000","last_fullsized":"2024-04-26T12:42:41.071038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072483+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:42:41.072483+0000","last_peered":"2024-04-26T12:42:41.072483+0000","last_clean":"2024-04-26T12:42:41.072483+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:42:41.072483+0000","last_undegraded":"2024-04-26T12:42:41.072483+0000","last_fullsized":"2024-04-26T12:42:41.072483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'18","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122964+0000","last_change":"2024-04-26T12:42:21.959737+0000","last_active":"2024-04-26T12:42:42.122964+0000","last_peered":"2024-04-26T12:42:42.122964+0000","last_clean":"2024-04-26T12:42:42.122964+0000","last_became_active":"2024-04-26T12:42:21.959122+0000","last_became_peered":"2024-04-26T12:42:21.959122+0000","last_unstale":"2024-04-26T12:42:42.122964+0000","last_undegraded":"2024-04-26T12:42:42.122964+0000","last_fullsized":"2024-04-26T12:42:42.122964+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:53.425209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976180+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:42:41.976180+0000","last_peered":"2024-04-26T12:42:41.976180+0000","last_clean":"2024-04-26T12:42:41.976180+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:42:41.976180+0000","last_undegraded":"2024-04-26T12:42:41.976180+0000","last_fullsized":"2024-04-26T12:42:41.976180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"117'29","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070847+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:42:41.070847+0000","last_peered":"2024-04-26T12:42:41.070847+0000","last_clean":"2024-04-26T12:42:41.070847+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:42:41.070847+0000","last_undegraded":"2024-04-26T12:42:41.070847+0000","last_fullsized":"2024-04-26T12:42:41.070847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975732+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:42:41.975732+0000","last_peered":"2024-04-26T12:42:41.975732+0000","last_clean":"2024-04-26T12:42:41.975732+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:42:41.975732+0000","last_undegraded":"2024-04-26T12:42:41.975732+0000","last_fullsized":"2024-04-26T12:42:41.975732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'7","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409967+0000","last_change":"2024-04-26T12:42:21.935665+0000","last_active":"2024-04-26T12:42:41.409967+0000","last_peered":"2024-04-26T12:42:41.409967+0000","last_clean":"2024-04-26T12:42:41.409967+0000","last_became_active":"2024-04-26T12:42:21.934686+0000","last_became_peered":"2024-04-26T12:42:21.934686+0000","last_unstale":"2024-04-26T12:42:41.409967+0000","last_undegraded":"2024-04-26T12:42:41.409967+0000","last_fullsized":"2024-04-26T12:42:41.409967+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:39.070102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"117'4","reported_seq":230,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067873+0000","last_change":"2024-04-26T12:42:34.032506+0000","last_active":"2024-04-26T12:42:41.067873+0000","last_peered":"2024-04-26T12:42:41.067873+0000","last_clean":"2024-04-26T12:42:41.067873+0000","last_became_active":"2024-04-26T12:42:34.031776+0000","last_became_peered":"2024-04-26T12:42:34.031776+0000","last_unstale":"2024-04-26T12:42:41.067873+0000","last_undegraded":"2024-04-26T12:42:41.067873+0000","last_fullsized":"2024-04-26T12:42:41.067873+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:40.297834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'26","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069641+0000","last_change":"2024-04-26T12:42:21.974477+0000","last_active":"2024-04-26T12:42:41.069641+0000","last_peered":"2024-04-26T12:42:41.069641+0000","last_clean":"2024-04-26T12:42:41.069641+0000","last_became_active":"2024-04-26T12:42:21.967072+0000","last_became_peered":"2024-04-26T12:42:21.967072+0000","last_unstale":"2024-04-26T12:42:41.069641+0000","last_undegraded":"2024-04-26T12:42:41.069641+0000","last_fullsized":"2024-04-26T12:42:41.069641+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.202160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976323+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:42:41.976323+0000","last_peered":"2024-04-26T12:42:41.976323+0000","last_clean":"2024-04-26T12:42:41.976323+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:42:41.976323+0000","last_undegraded":"2024-04-26T12:42:41.976323+0000","last_fullsized":"2024-04-26T12:42:41.976323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"117'19","reported_seq":65,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066738+0000","last_change":"2024-04-26T12:42:34.028589+0000","last_active":"2024-04-26T12:42:41.066738+0000","last_peered":"2024-04-26T12:42:41.066738+0000","last_clean":"2024-04-26T12:42:41.066738+0000","last_became_active":"2024-04-26T12:42:34.027524+0000","last_became_peered":"2024-04-26T12:42:34.027524+0000","last_unstale":"2024-04-26T12:42:41.066738+0000","last_undegraded":"2024-04-26T12:42:41.066738+0000","last_fullsized":"2024-04-26T12:42:41.066738+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:11.088686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070014+0000","last_change":"2024-04-26T12:42:21.938337+0000","last_active":"2024-04-26T12:42:41.070014+0000","last_peered":"2024-04-26T12:42:41.070014+0000","last_clean":"2024-04-26T12:42:41.070014+0000","last_became_active":"2024-04-26T12:42:21.937057+0000","last_became_peered":"2024-04-26T12:42:21.937057+0000","last_unstale":"2024-04-26T12:42:41.070014+0000","last_undegraded":"2024-04-26T12:42:41.070014+0000","last_fullsized":"2024-04-26T12:42:41.070014+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:16.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072835+0000","last_change":"2024-04-26T12:42:21.957634+0000","last_active":"2024-04-26T12:42:41.072835+0000","last_peered":"2024-04-26T12:42:41.072835+0000","last_clean":"2024-04-26T12:42:41.072835+0000","last_became_active":"2024-04-26T12:42:21.948878+0000","last_became_peered":"2024-04-26T12:42:21.948878+0000","last_unstale":"2024-04-26T12:42:41.072835+0000","last_undegraded":"2024-04-26T12:42:41.072835+0000","last_fullsized":"2024-04-26T12:42:41.072835+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:38.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067852+0000","last_change":"2024-04-26T12:42:34.019680+0000","last_active":"2024-04-26T12:42:41.067852+0000","last_peered":"2024-04-26T12:42:41.067852+0000","last_clean":"2024-04-26T12:42:41.067852+0000","last_became_active":"2024-04-26T12:42:34.018540+0000","last_became_peered":"2024-04-26T12:42:34.018540+0000","last_unstale":"2024-04-26T12:42:41.067852+0000","last_undegraded":"2024-04-26T12:42:41.067852+0000","last_fullsized":"2024-04-26T12:42:41.067852+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:44.798659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'20","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514187+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:42:42.514187+0000","last_peered":"2024-04-26T12:42:42.514187+0000","last_clean":"2024-04-26T12:42:42.514187+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:42:42.514187+0000","last_undegraded":"2024-04-26T12:42:42.514187+0000","last_fullsized":"2024-04-26T12:42:42.514187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408883+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:42:41.408883+0000","last_peered":"2024-04-26T12:42:41.408883+0000","last_clean":"2024-04-26T12:42:41.408883+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:42:41.408883+0000","last_undegraded":"2024-04-26T12:42:41.408883+0000","last_fullsized":"2024-04-26T12:42:41.408883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"117'23","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977855+0000","last_change":"2024-04-26T12:42:21.959840+0000","last_active":"2024-04-26T12:42:41.977855+0000","last_peered":"2024-04-26T12:42:41.977855+0000","last_clean":"2024-04-26T12:42:41.977855+0000","last_became_active":"2024-04-26T12:42:21.958977+0000","last_became_peered":"2024-04-26T12:42:21.958977+0000","last_unstale":"2024-04-26T12:42:41.977855+0000","last_undegraded":"2024-04-26T12:42:41.977855+0000","last_fullsized":"2024-04-26T12:42:41.977855+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:54.837056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"139'135","reported_seq":440,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:45.557364+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:42:45.557364+0000","last_peered":"2024-04-26T12:42:45.557364+0000","last_clean":"2024-04-26T12:42:45.557364+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:42:45.557364+0000","last_undegraded":"2024-04-26T12:42:45.557364+0000","last_fullsized":"2024-04-26T12:42:45.557364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408500+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:42:41.408500+0000","last_peered":"2024-04-26T12:42:41.408500+0000","last_clean":"2024-04-26T12:42:41.408500+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:42:41.408500+0000","last_undegraded":"2024-04-26T12:42:41.408500+0000","last_fullsized":"2024-04-26T12:42:41.408500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":180,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068000+0000","last_change":"2024-04-26T12:42:34.026595+0000","last_active":"2024-04-26T12:42:41.068000+0000","last_peered":"2024-04-26T12:42:41.068000+0000","last_clean":"2024-04-26T12:42:41.068000+0000","last_became_active":"2024-04-26T12:42:34.025094+0000","last_became_peered":"2024-04-26T12:42:34.025094+0000","last_unstale":"2024-04-26T12:42:41.068000+0000","last_undegraded":"2024-04-26T12:42:41.068000+0000","last_fullsized":"2024-04-26T12:42:41.068000+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:15.877357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"117'35","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066995+0000","last_change":"2024-04-26T12:42:34.021002+0000","last_active":"2024-04-26T12:42:41.066995+0000","last_peered":"2024-04-26T12:42:41.066995+0000","last_clean":"2024-04-26T12:42:41.066995+0000","last_became_active":"2024-04-26T12:42:34.019821+0000","last_became_peered":"2024-04-26T12:42:34.019821+0000","last_unstale":"2024-04-26T12:42:41.066995+0000","last_undegraded":"2024-04-26T12:42:41.066995+0000","last_fullsized":"2024-04-26T12:42:41.066995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:02.705267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":426,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123009+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:42:42.123009+0000","last_peered":"2024-04-26T12:42:42.123009+0000","last_clean":"2024-04-26T12:42:42.123009+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:42:42.123009+0000","last_undegraded":"2024-04-26T12:42:42.123009+0000","last_fullsized":"2024-04-26T12:42:42.123009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073443+0000","last_change":"2024-04-26T12:42:21.962837+0000","last_active":"2024-04-26T12:42:41.073443+0000","last_peered":"2024-04-26T12:42:41.073443+0000","last_clean":"2024-04-26T12:42:41.073443+0000","last_became_active":"2024-04-26T12:42:21.952480+0000","last_became_peered":"2024-04-26T12:42:21.952480+0000","last_unstale":"2024-04-26T12:42:41.073443+0000","last_undegraded":"2024-04-26T12:42:41.073443+0000","last_fullsized":"2024-04-26T12:42:41.073443+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:55.807987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"139'135","reported_seq":472,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:45.559133+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:42:45.559133+0000","last_peered":"2024-04-26T12:42:45.559133+0000","last_clean":"2024-04-26T12:42:45.559133+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:42:45.559133+0000","last_undegraded":"2024-04-26T12:42:45.559133+0000","last_fullsized":"2024-04-26T12:42:45.559133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066666+0000","last_change":"2024-04-26T12:42:34.020098+0000","last_active":"2024-04-26T12:42:41.066666+0000","last_peered":"2024-04-26T12:42:41.066666+0000","last_clean":"2024-04-26T12:42:41.066666+0000","last_became_active":"2024-04-26T12:42:34.015095+0000","last_became_peered":"2024-04-26T12:42:34.015095+0000","last_unstale":"2024-04-26T12:42:41.066666+0000","last_undegraded":"2024-04-26T12:42:41.066666+0000","last_fullsized":"2024-04-26T12:42:41.066666+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:05.746648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410249+0000","last_change":"2024-04-26T12:42:21.953982+0000","last_active":"2024-04-26T12:42:41.410249+0000","last_peered":"2024-04-26T12:42:41.410249+0000","last_clean":"2024-04-26T12:42:41.410249+0000","last_became_active":"2024-04-26T12:42:21.953253+0000","last_became_peered":"2024-04-26T12:42:21.953253+0000","last_unstale":"2024-04-26T12:42:41.410249+0000","last_undegraded":"2024-04-26T12:42:41.410249+0000","last_fullsized":"2024-04-26T12:42:41.410249+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:24.067594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"115'20","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067138+0000","last_change":"2024-04-26T12:42:21.949610+0000","last_active":"2024-04-26T12:42:41.067138+0000","last_peered":"2024-04-26T12:42:41.067138+0000","last_clean":"2024-04-26T12:42:41.067138+0000","last_became_active":"2024-04-26T12:42:21.940512+0000","last_became_peered":"2024-04-26T12:42:21.940512+0000","last_unstale":"2024-04-26T12:42:41.067138+0000","last_undegraded":"2024-04-26T12:42:41.067138+0000","last_fullsized":"2024-04-26T12:42:41.067138+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:19.966458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067393+0000","last_change":"2024-04-26T12:42:34.007412+0000","last_active":"2024-04-26T12:42:41.067393+0000","last_peered":"2024-04-26T12:42:41.067393+0000","last_clean":"2024-04-26T12:42:41.067393+0000","last_became_active":"2024-04-26T12:42:34.005897+0000","last_became_peered":"2024-04-26T12:42:34.005897+0000","last_unstale":"2024-04-26T12:42:41.067393+0000","last_undegraded":"2024-04-26T12:42:41.067393+0000","last_fullsized":"2024-04-26T12:42:41.067393+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:22.483984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"117'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123154+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:42:42.123154+0000","last_peered":"2024-04-26T12:42:42.123154+0000","last_clean":"2024-04-26T12:42:42.123154+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:42:42.123154+0000","last_undegraded":"2024-04-26T12:42:42.123154+0000","last_fullsized":"2024-04-26T12:42:42.123154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520237+0000","last_change":"2024-04-26T12:42:21.947536+0000","last_active":"2024-04-26T12:42:42.520237+0000","last_peered":"2024-04-26T12:42:42.520237+0000","last_clean":"2024-04-26T12:42:42.520237+0000","last_became_active":"2024-04-26T12:42:21.946663+0000","last_became_peered":"2024-04-26T12:42:21.946663+0000","last_unstale":"2024-04-26T12:42:42.520237+0000","last_undegraded":"2024-04-26T12:42:42.520237+0000","last_fullsized":"2024-04-26T12:42:42.520237+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:31.336436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":232,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408441+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:42:41.408441+0000","last_peered":"2024-04-26T12:42:41.408441+0000","last_clean":"2024-04-26T12:42:41.408441+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:42:41.408441+0000","last_undegraded":"2024-04-26T12:42:41.408441+0000","last_fullsized":"2024-04-26T12:42:41.408441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520346+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:42:42.520346+0000","last_peered":"2024-04-26T12:42:42.520346+0000","last_clean":"2024-04-26T12:42:42.520346+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:42:42.520346+0000","last_undegraded":"2024-04-26T12:42:42.520346+0000","last_fullsized":"2024-04-26T12:42:42.520346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":406,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516883+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:42:42.516883+0000","last_peered":"2024-04-26T12:42:42.516883+0000","last_clean":"2024-04-26T12:42:42.516883+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:42:42.516883+0000","last_undegraded":"2024-04-26T12:42:42.516883+0000","last_fullsized":"2024-04-26T12:42:42.516883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122546+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:42:42.122546+0000","last_peered":"2024-04-26T12:42:42.122546+0000","last_clean":"2024-04-26T12:42:42.122546+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:42:42.122546+0000","last_undegraded":"2024-04-26T12:42:42.122546+0000","last_fullsized":"2024-04-26T12:42:42.122546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"117'33","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067725+0000","last_change":"2024-04-26T12:42:21.931544+0000","last_active":"2024-04-26T12:42:41.067725+0000","last_peered":"2024-04-26T12:42:41.067725+0000","last_clean":"2024-04-26T12:42:41.067725+0000","last_became_active":"2024-04-26T12:42:21.929093+0000","last_became_peered":"2024-04-26T12:42:21.929093+0000","last_unstale":"2024-04-26T12:42:41.067725+0000","last_undegraded":"2024-04-26T12:42:41.067725+0000","last_fullsized":"2024-04-26T12:42:41.067725+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:06.052469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518900+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:42:42.518900+0000","last_peered":"2024-04-26T12:42:42.518900+0000","last_clean":"2024-04-26T12:42:42.518900+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:42:42.518900+0000","last_undegraded":"2024-04-26T12:42:42.518900+0000","last_fullsized":"2024-04-26T12:42:42.518900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"117'39","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123490+0000","last_change":"2024-04-26T12:42:21.932409+0000","last_active":"2024-04-26T12:42:42.123490+0000","last_peered":"2024-04-26T12:42:42.123490+0000","last_clean":"2024-04-26T12:42:42.123490+0000","last_became_active":"2024-04-26T12:42:21.931114+0000","last_became_peered":"2024-04-26T12:42:21.931114+0000","last_unstale":"2024-04-26T12:42:42.123490+0000","last_undegraded":"2024-04-26T12:42:42.123490+0000","last_fullsized":"2024-04-26T12:42:42.123490+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:31.083567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182602,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071191+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:42:41.071191+0000","last_peered":"2024-04-26T12:42:41.071191+0000","last_clean":"2024-04-26T12:42:41.071191+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:42:41.071191+0000","last_undegraded":"2024-04-26T12:42:41.071191+0000","last_fullsized":"2024-04-26T12:42:41.071191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517357+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:42:42.517357+0000","last_peered":"2024-04-26T12:42:42.517357+0000","last_clean":"2024-04-26T12:42:42.517357+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:42:42.517357+0000","last_undegraded":"2024-04-26T12:42:42.517357+0000","last_fullsized":"2024-04-26T12:42:42.517357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071947+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:42:41.071947+0000","last_peered":"2024-04-26T12:42:41.071947+0000","last_clean":"2024-04-26T12:42:41.071947+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:42:41.071947+0000","last_undegraded":"2024-04-26T12:42:41.071947+0000","last_fullsized":"2024-04-26T12:42:41.071947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516595+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:42:42.516595+0000","last_peered":"2024-04-26T12:42:42.516595+0000","last_clean":"2024-04-26T12:42:42.516595+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:42:42.516595+0000","last_undegraded":"2024-04-26T12:42:42.516595+0000","last_fullsized":"2024-04-26T12:42:42.516595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"115'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071136+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:42:41.071136+0000","last_peered":"2024-04-26T12:42:41.071136+0000","last_clean":"2024-04-26T12:42:41.071136+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:42:41.071136+0000","last_undegraded":"2024-04-26T12:42:41.071136+0000","last_fullsized":"2024-04-26T12:42:41.071136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123676+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:42:42.123676+0000","last_peered":"2024-04-26T12:42:42.123676+0000","last_clean":"2024-04-26T12:42:42.123676+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:42:42.123676+0000","last_undegraded":"2024-04-26T12:42:42.123676+0000","last_fullsized":"2024-04-26T12:42:42.123676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"139'137","reported_seq":493,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.752091+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:42:44.752091+0000","last_peered":"2024-04-26T12:42:44.752091+0000","last_clean":"2024-04-26T12:42:44.752091+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:42:44.752091+0000","last_undegraded":"2024-04-26T12:42:44.752091+0000","last_fullsized":"2024-04-26T12:42:44.752091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514992+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:42:42.514992+0000","last_peered":"2024-04-26T12:42:42.514992+0000","last_clean":"2024-04-26T12:42:42.514992+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:42:42.514992+0000","last_undegraded":"2024-04-26T12:42:42.514992+0000","last_fullsized":"2024-04-26T12:42:42.514992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"117'2","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408083+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:42:41.408083+0000","last_peered":"2024-04-26T12:42:41.408083+0000","last_clean":"2024-04-26T12:42:41.408083+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:42:41.408083+0000","last_undegraded":"2024-04-26T12:42:41.408083+0000","last_fullsized":"2024-04-26T12:42:41.408083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410330+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:42:41.410330+0000","last_peered":"2024-04-26T12:42:41.410330+0000","last_clean":"2024-04-26T12:42:41.410330+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:42:41.410330+0000","last_undegraded":"2024-04-26T12:42:41.410330+0000","last_fullsized":"2024-04-26T12:42:41.410330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977561+0000","last_change":"2024-04-26T12:42:21.939098+0000","last_active":"2024-04-26T12:42:41.977561+0000","last_peered":"2024-04-26T12:42:41.977561+0000","last_clean":"2024-04-26T12:42:41.977561+0000","last_became_active":"2024-04-26T12:42:21.938117+0000","last_became_peered":"2024-04-26T12:42:21.938117+0000","last_unstale":"2024-04-26T12:42:41.977561+0000","last_undegraded":"2024-04-26T12:42:41.977561+0000","last_fullsized":"2024-04-26T12:42:41.977561+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:15.636096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'34","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408092+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:42:41.408092+0000","last_peered":"2024-04-26T12:42:41.408092+0000","last_clean":"2024-04-26T12:42:41.408092+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:42:41.408092+0000","last_undegraded":"2024-04-26T12:42:41.408092+0000","last_fullsized":"2024-04-26T12:42:41.408092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":44,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":335,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976702+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:42:41.976702+0000","last_peered":"2024-04-26T12:42:41.976702+0000","last_clean":"2024-04-26T12:42:41.976702+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:42:41.976702+0000","last_undegraded":"2024-04-26T12:42:41.976702+0000","last_fullsized":"2024-04-26T12:42:41.976702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"139'18","reported_seq":316,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.750561+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:42:44.750561+0000","last_peered":"2024-04-26T12:42:44.750561+0000","last_clean":"2024-04-26T12:42:44.750561+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:42:44.750561+0000","last_undegraded":"2024-04-26T12:42:44.750561+0000","last_fullsized":"2024-04-26T12:42:44.750561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069911+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:42:41.069911+0000","last_peered":"2024-04-26T12:42:41.069911+0000","last_clean":"2024-04-26T12:42:41.069911+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:42:41.069911+0000","last_undegraded":"2024-04-26T12:42:41.069911+0000","last_fullsized":"2024-04-26T12:42:41.069911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070589+0000","last_change":"2024-04-26T12:42:21.942734+0000","last_active":"2024-04-26T12:42:41.070589+0000","last_peered":"2024-04-26T12:42:41.070589+0000","last_clean":"2024-04-26T12:42:41.070589+0000","last_became_active":"2024-04-26T12:42:21.928602+0000","last_became_peered":"2024-04-26T12:42:21.928602+0000","last_unstale":"2024-04-26T12:42:41.070589+0000","last_undegraded":"2024-04-26T12:42:41.070589+0000","last_fullsized":"2024-04-26T12:42:41.070589+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:45.167813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409089+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:42:41.409089+0000","last_peered":"2024-04-26T12:42:41.409089+0000","last_clean":"2024-04-26T12:42:41.409089+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:42:41.409089+0000","last_undegraded":"2024-04-26T12:42:41.409089+0000","last_fullsized":"2024-04-26T12:42:41.409089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122667+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:42:42.122667+0000","last_peered":"2024-04-26T12:42:42.122667+0000","last_clean":"2024-04-26T12:42:42.122667+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:42:42.122667+0000","last_undegraded":"2024-04-26T12:42:42.122667+0000","last_fullsized":"2024-04-26T12:42:42.122667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'18","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067370+0000","last_change":"2024-04-26T12:42:34.006811+0000","last_active":"2024-04-26T12:42:41.067370+0000","last_peered":"2024-04-26T12:42:41.067370+0000","last_clean":"2024-04-26T12:42:41.067370+0000","last_became_active":"2024-04-26T12:42:34.004041+0000","last_became_peered":"2024-04-26T12:42:34.004041+0000","last_unstale":"2024-04-26T12:42:41.067370+0000","last_undegraded":"2024-04-26T12:42:41.067370+0000","last_fullsized":"2024-04-26T12:42:41.067370+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:08.613547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069460+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:42:41.069460+0000","last_peered":"2024-04-26T12:42:41.069460+0000","last_clean":"2024-04-26T12:42:41.069460+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:42:41.069460+0000","last_undegraded":"2024-04-26T12:42:41.069460+0000","last_fullsized":"2024-04-26T12:42:41.069460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073574+0000","last_change":"2024-04-26T12:42:21.946073+0000","last_active":"2024-04-26T12:42:41.073574+0000","last_peered":"2024-04-26T12:42:41.073574+0000","last_clean":"2024-04-26T12:42:41.073574+0000","last_became_active":"2024-04-26T12:42:21.942937+0000","last_became_peered":"2024-04-26T12:42:21.942937+0000","last_unstale":"2024-04-26T12:42:41.073574+0000","last_undegraded":"2024-04-26T12:42:41.073574+0000","last_fullsized":"2024-04-26T12:42:41.073574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:30.907752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515300+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:42:42.515300+0000","last_peered":"2024-04-26T12:42:42.515300+0000","last_clean":"2024-04-26T12:42:42.515300+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:42:42.515300+0000","last_undegraded":"2024-04-26T12:42:42.515300+0000","last_fullsized":"2024-04-26T12:42:42.515300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121144+0000","last_change":"2024-04-26T12:42:21.942893+0000","last_active":"2024-04-26T12:42:42.121144+0000","last_peered":"2024-04-26T12:42:42.121144+0000","last_clean":"2024-04-26T12:42:42.121144+0000","last_became_active":"2024-04-26T12:42:21.941954+0000","last_became_peered":"2024-04-26T12:42:21.941954+0000","last_unstale":"2024-04-26T12:42:42.121144+0000","last_undegraded":"2024-04-26T12:42:42.121144+0000","last_fullsized":"2024-04-26T12:42:42.121144+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408457+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:42:41.408457+0000","last_peered":"2024-04-26T12:42:41.408457+0000","last_clean":"2024-04-26T12:42:41.408457+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:42:41.408457+0000","last_undegraded":"2024-04-26T12:42:41.408457+0000","last_fullsized":"2024-04-26T12:42:41.408457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'26","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.124036+0000","last_change":"2024-04-26T12:42:21.924370+0000","last_active":"2024-04-26T12:42:42.124036+0000","last_peered":"2024-04-26T12:42:42.124036+0000","last_clean":"2024-04-26T12:42:42.124036+0000","last_became_active":"2024-04-26T12:42:21.923345+0000","last_became_peered":"2024-04-26T12:42:21.923345+0000","last_unstale":"2024-04-26T12:42:42.124036+0000","last_undegraded":"2024-04-26T12:42:42.124036+0000","last_fullsized":"2024-04-26T12:42:42.124036+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:11.162289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409328+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:42:41.409328+0000","last_peered":"2024-04-26T12:42:41.409328+0000","last_clean":"2024-04-26T12:42:41.409328+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:42:41.409328+0000","last_undegraded":"2024-04-26T12:42:41.409328+0000","last_fullsized":"2024-04-26T12:42:41.409328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071121+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:42:41.071121+0000","last_peered":"2024-04-26T12:42:41.071121+0000","last_clean":"2024-04-26T12:42:41.071121+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:42:41.071121+0000","last_undegraded":"2024-04-26T12:42:41.071121+0000","last_fullsized":"2024-04-26T12:42:41.071121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"117'34","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071421+0000","last_change":"2024-04-26T12:42:21.957374+0000","last_active":"2024-04-26T12:42:41.071421+0000","last_peered":"2024-04-26T12:42:41.071421+0000","last_clean":"2024-04-26T12:42:41.071421+0000","last_became_active":"2024-04-26T12:42:21.956451+0000","last_became_peered":"2024-04-26T12:42:21.956451+0000","last_unstale":"2024-04-26T12:42:41.071421+0000","last_undegraded":"2024-04-26T12:42:41.071421+0000","last_fullsized":"2024-04-26T12:42:41.071421+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:20.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":204,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065521+0000","last_change":"2024-04-26T12:42:34.015627+0000","last_active":"2024-04-26T12:42:41.065521+0000","last_peered":"2024-04-26T12:42:41.065521+0000","last_clean":"2024-04-26T12:42:41.065521+0000","last_became_active":"2024-04-26T12:42:34.014949+0000","last_became_peered":"2024-04-26T12:42:34.014949+0000","last_unstale":"2024-04-26T12:42:41.065521+0000","last_undegraded":"2024-04-26T12:42:41.065521+0000","last_fullsized":"2024-04-26T12:42:41.065521+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:46.390226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070165+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:42:41.070165+0000","last_peered":"2024-04-26T12:42:41.070165+0000","last_clean":"2024-04-26T12:42:41.070165+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:42:41.070165+0000","last_undegraded":"2024-04-26T12:42:41.070165+0000","last_fullsized":"2024-04-26T12:42:41.070165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072305+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:42:41.072305+0000","last_peered":"2024-04-26T12:42:41.072305+0000","last_clean":"2024-04-26T12:42:41.072305+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:42:41.072305+0000","last_undegraded":"2024-04-26T12:42:41.072305+0000","last_fullsized":"2024-04-26T12:42:41.072305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'31","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409224+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:42:41.409224+0000","last_peered":"2024-04-26T12:42:41.409224+0000","last_clean":"2024-04-26T12:42:41.409224+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:42:41.409224+0000","last_undegraded":"2024-04-26T12:42:41.409224+0000","last_fullsized":"2024-04-26T12:42:41.409224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519825+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:42:42.519825+0000","last_peered":"2024-04-26T12:42:42.519825+0000","last_clean":"2024-04-26T12:42:42.519825+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:42:42.519825+0000","last_undegraded":"2024-04-26T12:42:42.519825+0000","last_fullsized":"2024-04-26T12:42:42.519825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518456+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:42:42.518456+0000","last_peered":"2024-04-26T12:42:42.518456+0000","last_clean":"2024-04-26T12:42:42.518456+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:42:42.518456+0000","last_undegraded":"2024-04-26T12:42:42.518456+0000","last_fullsized":"2024-04-26T12:42:42.518456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408014+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:42:41.408014+0000","last_peered":"2024-04-26T12:42:41.408014+0000","last_clean":"2024-04-26T12:42:41.408014+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:42:41.408014+0000","last_undegraded":"2024-04-26T12:42:41.408014+0000","last_fullsized":"2024-04-26T12:42:41.408014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"139'135","reported_seq":427,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751022+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:42:44.751022+0000","last_peered":"2024-04-26T12:42:44.751022+0000","last_clean":"2024-04-26T12:42:44.751022+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:42:44.751022+0000","last_undegraded":"2024-04-26T12:42:44.751022+0000","last_fullsized":"2024-04-26T12:42:44.751022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073784+0000","last_change":"2024-04-26T12:42:21.962241+0000","last_active":"2024-04-26T12:42:41.073784+0000","last_peered":"2024-04-26T12:42:41.073784+0000","last_clean":"2024-04-26T12:42:41.073784+0000","last_became_active":"2024-04-26T12:42:21.960618+0000","last_became_peered":"2024-04-26T12:42:21.960618+0000","last_unstale":"2024-04-26T12:42:41.073784+0000","last_undegraded":"2024-04-26T12:42:41.073784+0000","last_fullsized":"2024-04-26T12:42:41.073784+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:39.076778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067522+0000","last_change":"2024-04-26T12:42:21.965811+0000","last_active":"2024-04-26T12:42:41.067522+0000","last_peered":"2024-04-26T12:42:41.067522+0000","last_clean":"2024-04-26T12:42:41.067522+0000","last_became_active":"2024-04-26T12:42:21.960998+0000","last_became_peered":"2024-04-26T12:42:21.960998+0000","last_unstale":"2024-04-26T12:42:41.067522+0000","last_undegraded":"2024-04-26T12:42:41.067522+0000","last_fullsized":"2024-04-26T12:42:41.067522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.081118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"116'27","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074564+0000","last_change":"2024-04-26T12:42:21.971344+0000","last_active":"2024-04-26T12:42:41.074564+0000","last_peered":"2024-04-26T12:42:41.074564+0000","last_clean":"2024-04-26T12:42:41.074564+0000","last_became_active":"2024-04-26T12:42:21.968901+0000","last_became_peered":"2024-04-26T12:42:21.968901+0000","last_unstale":"2024-04-26T12:42:41.074564+0000","last_undegraded":"2024-04-26T12:42:41.074564+0000","last_fullsized":"2024-04-26T12:42:41.074564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:04.596971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409908+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:42:41.409908+0000","last_peered":"2024-04-26T12:42:41.409908+0000","last_clean":"2024-04-26T12:42:41.409908+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:42:41.409908+0000","last_undegraded":"2024-04-26T12:42:41.409908+0000","last_fullsized":"2024-04-26T12:42:41.409908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065795+0000","last_change":"2024-04-26T12:42:34.016582+0000","last_active":"2024-04-26T12:42:41.065795+0000","last_peered":"2024-04-26T12:42:41.065795+0000","last_clean":"2024-04-26T12:42:41.065795+0000","last_became_active":"2024-04-26T12:42:34.015774+0000","last_became_peered":"2024-04-26T12:42:34.015774+0000","last_unstale":"2024-04-26T12:42:41.065795+0000","last_undegraded":"2024-04-26T12:42:41.065795+0000","last_fullsized":"2024-04-26T12:42:41.065795+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:09.670527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":71,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067390+0000","last_change":"2024-04-26T12:42:34.031336+0000","last_active":"2024-04-26T12:42:41.067390+0000","last_peered":"2024-04-26T12:42:41.067390+0000","last_clean":"2024-04-26T12:42:41.067390+0000","last_became_active":"2024-04-26T12:42:34.029037+0000","last_became_peered":"2024-04-26T12:42:34.029037+0000","last_unstale":"2024-04-26T12:42:41.067390+0000","last_undegraded":"2024-04-26T12:42:41.067390+0000","last_fullsized":"2024-04-26T12:42:41.067390+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:10.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"139'137","reported_seq":414,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751750+0000","last_change":"2024-04-26T12:42:21.972386+0000","last_active":"2024-04-26T12:42:44.751750+0000","last_peered":"2024-04-26T12:42:44.751750+0000","last_clean":"2024-04-26T12:42:44.751750+0000","last_became_active":"2024-04-26T12:42:21.962332+0000","last_became_peered":"2024-04-26T12:42:21.962332+0000","last_unstale":"2024-04-26T12:42:44.751750+0000","last_undegraded":"2024-04-26T12:42:44.751750+0000","last_fullsized":"2024-04-26T12:42:44.751750+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:50.916736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071272+0000","last_change":"2024-04-26T12:42:21.957370+0000","last_active":"2024-04-26T12:42:41.071272+0000","last_peered":"2024-04-26T12:42:41.071272+0000","last_clean":"2024-04-26T12:42:41.071272+0000","last_became_active":"2024-04-26T12:42:21.956715+0000","last_became_peered":"2024-04-26T12:42:21.956715+0000","last_unstale":"2024-04-26T12:42:41.071272+0000","last_undegraded":"2024-04-26T12:42:41.071272+0000","last_fullsized":"2024-04-26T12:42:41.071272+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:22.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066049+0000","last_change":"2024-04-26T12:42:34.013472+0000","last_active":"2024-04-26T12:42:41.066049+0000","last_peered":"2024-04-26T12:42:41.066049+0000","last_clean":"2024-04-26T12:42:41.066049+0000","last_became_active":"2024-04-26T12:42:34.010800+0000","last_became_peered":"2024-04-26T12:42:34.010800+0000","last_unstale":"2024-04-26T12:42:41.066049+0000","last_undegraded":"2024-04-26T12:42:41.066049+0000","last_fullsized":"2024-04-26T12:42:41.066049+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:43.861494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"117'24","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072776+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:42:41.072776+0000","last_peered":"2024-04-26T12:42:41.072776+0000","last_clean":"2024-04-26T12:42:41.072776+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:42:41.072776+0000","last_undegraded":"2024-04-26T12:42:41.072776+0000","last_fullsized":"2024-04-26T12:42:41.072776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521218+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:42:42.521218+0000","last_peered":"2024-04-26T12:42:42.521218+0000","last_clean":"2024-04-26T12:42:42.521218+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:42:42.521218+0000","last_undegraded":"2024-04-26T12:42:42.521218+0000","last_fullsized":"2024-04-26T12:42:42.521218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068515+0000","last_change":"2024-04-26T12:42:21.941484+0000","last_active":"2024-04-26T12:42:41.068515+0000","last_peered":"2024-04-26T12:42:41.068515+0000","last_clean":"2024-04-26T12:42:41.068515+0000","last_became_active":"2024-04-26T12:42:21.926472+0000","last_became_peered":"2024-04-26T12:42:21.926472+0000","last_unstale":"2024-04-26T12:42:41.068515+0000","last_undegraded":"2024-04-26T12:42:41.068515+0000","last_fullsized":"2024-04-26T12:42:41.068515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.214353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"117'43","reported_seq":298,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519477+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:42:42.519477+0000","last_peered":"2024-04-26T12:42:42.519477+0000","last_clean":"2024-04-26T12:42:42.519477+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:42:42.519477+0000","last_undegraded":"2024-04-26T12:42:42.519477+0000","last_fullsized":"2024-04-26T12:42:42.519477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068343+0000","last_change":"2024-04-26T12:42:21.919160+0000","last_active":"2024-04-26T12:42:41.068343+0000","last_peered":"2024-04-26T12:42:41.068343+0000","last_clean":"2024-04-26T12:42:41.068343+0000","last_became_active":"2024-04-26T12:42:21.918031+0000","last_became_peered":"2024-04-26T12:42:21.918031+0000","last_unstale":"2024-04-26T12:42:41.068343+0000","last_undegraded":"2024-04-26T12:42:41.068343+0000","last_fullsized":"2024-04-26T12:42:41.068343+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:35.941555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122585+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:42:42.122585+0000","last_peered":"2024-04-26T12:42:42.122585+0000","last_clean":"2024-04-26T12:42:42.122585+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:42:42.122585+0000","last_undegraded":"2024-04-26T12:42:42.122585+0000","last_fullsized":"2024-04-26T12:42:42.122585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069566+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:42:41.069566+0000","last_peered":"2024-04-26T12:42:41.069566+0000","last_clean":"2024-04-26T12:42:41.069566+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:42:41.069566+0000","last_undegraded":"2024-04-26T12:42:41.069566+0000","last_fullsized":"2024-04-26T12:42:41.069566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":186,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066912+0000","last_change":"2024-04-26T12:42:34.023953+0000","last_active":"2024-04-26T12:42:41.066912+0000","last_peered":"2024-04-26T12:42:41.066912+0000","last_clean":"2024-04-26T12:42:41.066912+0000","last_became_active":"2024-04-26T12:42:34.022792+0000","last_became_peered":"2024-04-26T12:42:34.022792+0000","last_unstale":"2024-04-26T12:42:41.066912+0000","last_undegraded":"2024-04-26T12:42:41.066912+0000","last_fullsized":"2024-04-26T12:42:41.066912+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:16.851419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066522+0000","last_change":"2024-04-26T12:42:34.012055+0000","last_active":"2024-04-26T12:42:41.066522+0000","last_peered":"2024-04-26T12:42:41.066522+0000","last_clean":"2024-04-26T12:42:41.066522+0000","last_became_active":"2024-04-26T12:42:34.008295+0000","last_became_peered":"2024-04-26T12:42:34.008295+0000","last_unstale":"2024-04-26T12:42:41.066522+0000","last_undegraded":"2024-04-26T12:42:41.066522+0000","last_fullsized":"2024-04-26T12:42:41.066522+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:59.626034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408588+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:42:41.408588+0000","last_peered":"2024-04-26T12:42:41.408588+0000","last_clean":"2024-04-26T12:42:41.408588+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:42:41.408588+0000","last_undegraded":"2024-04-26T12:42:41.408588+0000","last_fullsized":"2024-04-26T12:42:41.408588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070334+0000","last_change":"2024-04-26T12:42:21.967112+0000","last_active":"2024-04-26T12:42:41.070334+0000","last_peered":"2024-04-26T12:42:41.070334+0000","last_clean":"2024-04-26T12:42:41.070334+0000","last_became_active":"2024-04-26T12:42:21.964467+0000","last_became_peered":"2024-04-26T12:42:21.964467+0000","last_unstale":"2024-04-26T12:42:41.070334+0000","last_undegraded":"2024-04-26T12:42:41.070334+0000","last_fullsized":"2024-04-26T12:42:41.070334+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:41.170576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072547+0000","last_change":"2024-04-26T12:42:21.964141+0000","last_active":"2024-04-26T12:42:41.072547+0000","last_peered":"2024-04-26T12:42:41.072547+0000","last_clean":"2024-04-26T12:42:41.072547+0000","last_became_active":"2024-04-26T12:42:21.959360+0000","last_became_peered":"2024-04-26T12:42:21.959360+0000","last_unstale":"2024-04-26T12:42:41.072547+0000","last_undegraded":"2024-04-26T12:42:41.072547+0000","last_fullsized":"2024-04-26T12:42:41.072547+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:57.964968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074053+0000","last_change":"2024-04-26T12:42:21.970393+0000","last_active":"2024-04-26T12:42:41.074053+0000","last_peered":"2024-04-26T12:42:41.074053+0000","last_clean":"2024-04-26T12:42:41.074053+0000","last_became_active":"2024-04-26T12:42:21.968658+0000","last_became_peered":"2024-04-26T12:42:21.968658+0000","last_unstale":"2024-04-26T12:42:41.074053+0000","last_undegraded":"2024-04-26T12:42:41.074053+0000","last_fullsized":"2024-04-26T12:42:41.074053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:45.400045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408339+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:42:41.408339+0000","last_peered":"2024-04-26T12:42:41.408339+0000","last_clean":"2024-04-26T12:42:41.408339+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:42:41.408339+0000","last_undegraded":"2024-04-26T12:42:41.408339+0000","last_fullsized":"2024-04-26T12:42:41.408339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"117'23","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519528+0000","last_change":"2024-04-26T12:42:21.956317+0000","last_active":"2024-04-26T12:42:42.519528+0000","last_peered":"2024-04-26T12:42:42.519528+0000","last_clean":"2024-04-26T12:42:42.519528+0000","last_became_active":"2024-04-26T12:42:21.955428+0000","last_became_peered":"2024-04-26T12:42:21.955428+0000","last_unstale":"2024-04-26T12:42:42.519528+0000","last_undegraded":"2024-04-26T12:42:42.519528+0000","last_fullsized":"2024-04-26T12:42:42.519528+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:50.243608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067590+0000","last_change":"2024-04-26T12:42:21.973314+0000","last_active":"2024-04-26T12:42:41.067590+0000","last_peered":"2024-04-26T12:42:41.067590+0000","last_clean":"2024-04-26T12:42:41.067590+0000","last_became_active":"2024-04-26T12:42:21.964554+0000","last_became_peered":"2024-04-26T12:42:21.964554+0000","last_unstale":"2024-04-26T12:42:41.067590+0000","last_undegraded":"2024-04-26T12:42:41.067590+0000","last_fullsized":"2024-04-26T12:42:41.067590+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:20.524995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"120'9","reported_seq":250,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070910+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:42:41.070910+0000","last_peered":"2024-04-26T12:42:41.070910+0000","last_clean":"2024-04-26T12:42:41.070910+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:42:41.070910+0000","last_undegraded":"2024-04-26T12:42:41.070910+0000","last_fullsized":"2024-04-26T12:42:41.070910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517854+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:42:42.517854+0000","last_peered":"2024-04-26T12:42:42.517854+0000","last_clean":"2024-04-26T12:42:42.517854+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:42:42.517854+0000","last_undegraded":"2024-04-26T12:42:42.517854+0000","last_fullsized":"2024-04-26T12:42:42.517854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069199+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:42:41.069199+0000","last_peered":"2024-04-26T12:42:41.069199+0000","last_clean":"2024-04-26T12:42:41.069199+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:42:41.069199+0000","last_undegraded":"2024-04-26T12:42:41.069199+0000","last_fullsized":"2024-04-26T12:42:41.069199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069067+0000","last_change":"2024-04-26T12:42:21.967538+0000","last_active":"2024-04-26T12:42:41.069067+0000","last_peered":"2024-04-26T12:42:41.069067+0000","last_clean":"2024-04-26T12:42:41.069067+0000","last_became_active":"2024-04-26T12:42:21.965760+0000","last_became_peered":"2024-04-26T12:42:21.965760+0000","last_unstale":"2024-04-26T12:42:41.069067+0000","last_undegraded":"2024-04-26T12:42:41.069067+0000","last_fullsized":"2024-04-26T12:42:41.069067+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:34.724137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'27","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123766+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:42:42.123766+0000","last_peered":"2024-04-26T12:42:42.123766+0000","last_clean":"2024-04-26T12:42:42.123766+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:42:42.123766+0000","last_undegraded":"2024-04-26T12:42:42.123766+0000","last_fullsized":"2024-04-26T12:42:42.123766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516156+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:42:42.516156+0000","last_peered":"2024-04-26T12:42:42.516156+0000","last_clean":"2024-04-26T12:42:42.516156+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:42:42.516156+0000","last_undegraded":"2024-04-26T12:42:42.516156+0000","last_fullsized":"2024-04-26T12:42:42.516156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069367+0000","last_change":"2024-04-26T12:42:21.974557+0000","last_active":"2024-04-26T12:42:41.069367+0000","last_peered":"2024-04-26T12:42:41.069367+0000","last_clean":"2024-04-26T12:42:41.069367+0000","last_became_active":"2024-04-26T12:42:21.967735+0000","last_became_peered":"2024-04-26T12:42:21.967735+0000","last_unstale":"2024-04-26T12:42:41.069367+0000","last_undegraded":"2024-04-26T12:42:41.069367+0000","last_fullsized":"2024-04-26T12:42:41.069367+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:01.266925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514760+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:42:42.514760+0000","last_peered":"2024-04-26T12:42:42.514760+0000","last_clean":"2024-04-26T12:42:42.514760+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:42:42.514760+0000","last_undegraded":"2024-04-26T12:42:42.514760+0000","last_fullsized":"2024-04-26T12:42:42.514760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121837+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:42:42.121837+0000","last_peered":"2024-04-26T12:42:42.121837+0000","last_clean":"2024-04-26T12:42:42.121837+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:42:42.121837+0000","last_undegraded":"2024-04-26T12:42:42.121837+0000","last_fullsized":"2024-04-26T12:42:42.121837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068104+0000","last_change":"2024-04-26T12:42:21.946016+0000","last_active":"2024-04-26T12:42:41.068104+0000","last_peered":"2024-04-26T12:42:41.068104+0000","last_clean":"2024-04-26T12:42:41.068104+0000","last_became_active":"2024-04-26T12:42:21.927785+0000","last_became_peered":"2024-04-26T12:42:21.927785+0000","last_unstale":"2024-04-26T12:42:41.068104+0000","last_undegraded":"2024-04-26T12:42:41.068104+0000","last_fullsized":"2024-04-26T12:42:41.068104+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:08.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'20","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072117+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:42:41.072117+0000","last_peered":"2024-04-26T12:42:41.072117+0000","last_clean":"2024-04-26T12:42:41.072117+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:42:41.072117+0000","last_undegraded":"2024-04-26T12:42:41.072117+0000","last_fullsized":"2024-04-26T12:42:41.072117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518072+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:42:42.518072+0000","last_peered":"2024-04-26T12:42:42.518072+0000","last_clean":"2024-04-26T12:42:42.518072+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:42:42.518072+0000","last_undegraded":"2024-04-26T12:42:42.518072+0000","last_fullsized":"2024-04-26T12:42:42.518072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"117'20","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517863+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:42:42.517863+0000","last_peered":"2024-04-26T12:42:42.517863+0000","last_clean":"2024-04-26T12:42:42.517863+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:42:42.517863+0000","last_undegraded":"2024-04-26T12:42:42.517863+0000","last_fullsized":"2024-04-26T12:42:42.517863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068567+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:42:41.068567+0000","last_peered":"2024-04-26T12:42:41.068567+0000","last_clean":"2024-04-26T12:42:41.068567+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:42:41.068567+0000","last_undegraded":"2024-04-26T12:42:41.068567+0000","last_fullsized":"2024-04-26T12:42:41.068567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521075+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:42:42.521075+0000","last_peered":"2024-04-26T12:42:42.521075+0000","last_clean":"2024-04-26T12:42:42.521075+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:42:42.521075+0000","last_undegraded":"2024-04-26T12:42:42.521075+0000","last_fullsized":"2024-04-26T12:42:42.521075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'15","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067129+0000","last_change":"2024-04-26T12:42:21.967299+0000","last_active":"2024-04-26T12:42:41.067129+0000","last_peered":"2024-04-26T12:42:41.067129+0000","last_clean":"2024-04-26T12:42:41.067129+0000","last_became_active":"2024-04-26T12:42:21.964241+0000","last_became_peered":"2024-04-26T12:42:21.964241+0000","last_unstale":"2024-04-26T12:42:41.067129+0000","last_undegraded":"2024-04-26T12:42:41.067129+0000","last_fullsized":"2024-04-26T12:42:41.067129+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:24.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071446+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:42:41.071446+0000","last_peered":"2024-04-26T12:42:41.071446+0000","last_clean":"2024-04-26T12:42:41.071446+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:42:41.071446+0000","last_undegraded":"2024-04-26T12:42:41.071446+0000","last_fullsized":"2024-04-26T12:42:41.071446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"117'28","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409065+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:42:41.409065+0000","last_peered":"2024-04-26T12:42:41.409065+0000","last_clean":"2024-04-26T12:42:41.409065+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:42:41.409065+0000","last_undegraded":"2024-04-26T12:42:41.409065+0000","last_fullsized":"2024-04-26T12:42:41.409065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122126+0000","last_change":"2024-04-26T12:42:21.947268+0000","last_active":"2024-04-26T12:42:42.122126+0000","last_peered":"2024-04-26T12:42:42.122126+0000","last_clean":"2024-04-26T12:42:42.122126+0000","last_became_active":"2024-04-26T12:42:21.946664+0000","last_became_peered":"2024-04-26T12:42:21.946664+0000","last_unstale":"2024-04-26T12:42:42.122126+0000","last_undegraded":"2024-04-26T12:42:42.122126+0000","last_fullsized":"2024-04-26T12:42:42.122126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:21.575803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067833+0000","last_change":"2024-04-26T12:42:21.973393+0000","last_active":"2024-04-26T12:42:41.067833+0000","last_peered":"2024-04-26T12:42:41.067833+0000","last_clean":"2024-04-26T12:42:41.067833+0000","last_became_active":"2024-04-26T12:42:21.963727+0000","last_became_peered":"2024-04-26T12:42:21.963727+0000","last_unstale":"2024-04-26T12:42:41.067833+0000","last_undegraded":"2024-04-26T12:42:41.067833+0000","last_fullsized":"2024-04-26T12:42:41.067833+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:52.960136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072465+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:42:41.072465+0000","last_peered":"2024-04-26T12:42:41.072465+0000","last_clean":"2024-04-26T12:42:41.072465+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:42:41.072465+0000","last_undegraded":"2024-04-26T12:42:41.072465+0000","last_fullsized":"2024-04-26T12:42:41.072465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'32","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408983+0000","last_change":"2024-04-26T12:42:21.934786+0000","last_active":"2024-04-26T12:42:41.408983+0000","last_peered":"2024-04-26T12:42:41.408983+0000","last_clean":"2024-04-26T12:42:41.408983+0000","last_became_active":"2024-04-26T12:42:21.933941+0000","last_became_peered":"2024-04-26T12:42:21.933941+0000","last_unstale":"2024-04-26T12:42:41.408983+0000","last_undegraded":"2024-04-26T12:42:41.408983+0000","last_fullsized":"2024-04-26T12:42:41.408983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:56.359990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520965+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:42:42.520965+0000","last_peered":"2024-04-26T12:42:42.520965+0000","last_clean":"2024-04-26T12:42:42.520965+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:42:42.520965+0000","last_undegraded":"2024-04-26T12:42:42.520965+0000","last_fullsized":"2024-04-26T12:42:42.520965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"117'23","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518241+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:42:42.518241+0000","last_peered":"2024-04-26T12:42:42.518241+0000","last_clean":"2024-04-26T12:42:42.518241+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:42:42.518241+0000","last_undegraded":"2024-04-26T12:42:42.518241+0000","last_fullsized":"2024-04-26T12:42:42.518241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409160+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:42:41.409160+0000","last_peered":"2024-04-26T12:42:41.409160+0000","last_clean":"2024-04-26T12:42:41.409160+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:42:41.409160+0000","last_undegraded":"2024-04-26T12:42:41.409160+0000","last_fullsized":"2024-04-26T12:42:41.409160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518124+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:42:42.518124+0000","last_peered":"2024-04-26T12:42:42.518124+0000","last_clean":"2024-04-26T12:42:42.518124+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:42:42.518124+0000","last_undegraded":"2024-04-26T12:42:42.518124+0000","last_fullsized":"2024-04-26T12:42:42.518124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072909+0000","last_change":"2024-04-26T12:42:21.925516+0000","last_active":"2024-04-26T12:42:41.072909+0000","last_peered":"2024-04-26T12:42:41.072909+0000","last_clean":"2024-04-26T12:42:41.072909+0000","last_became_active":"2024-04-26T12:42:21.924628+0000","last_became_peered":"2024-04-26T12:42:21.924628+0000","last_unstale":"2024-04-26T12:42:41.072909+0000","last_undegraded":"2024-04-26T12:42:41.072909+0000","last_fullsized":"2024-04-26T12:42:41.072909+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.079347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'21","reported_seq":223,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068512+0000","last_change":"2024-04-26T12:42:34.034805+0000","last_active":"2024-04-26T12:42:41.068512+0000","last_peered":"2024-04-26T12:42:41.068512+0000","last_clean":"2024-04-26T12:42:41.068512+0000","last_became_active":"2024-04-26T12:42:34.034029+0000","last_became_peered":"2024-04-26T12:42:34.034029+0000","last_unstale":"2024-04-26T12:42:41.068512+0000","last_undegraded":"2024-04-26T12:42:41.068512+0000","last_fullsized":"2024-04-26T12:42:41.068512+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:41.159253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068554+0000","last_change":"2024-04-26T12:42:34.032136+0000","last_active":"2024-04-26T12:42:41.068554+0000","last_peered":"2024-04-26T12:42:41.068554+0000","last_clean":"2024-04-26T12:42:41.068554+0000","last_became_active":"2024-04-26T12:42:34.031261+0000","last_became_peered":"2024-04-26T12:42:34.031261+0000","last_unstale":"2024-04-26T12:42:41.068554+0000","last_undegraded":"2024-04-26T12:42:41.068554+0000","last_fullsized":"2024-04-26T12:42:41.068554+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:12.726095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074100+0000","last_change":"2024-04-26T12:42:21.932892+0000","last_active":"2024-04-26T12:42:41.074100+0000","last_peered":"2024-04-26T12:42:41.074100+0000","last_clean":"2024-04-26T12:42:41.074100+0000","last_became_active":"2024-04-26T12:42:21.931947+0000","last_became_peered":"2024-04-26T12:42:21.931947+0000","last_unstale":"2024-04-26T12:42:41.074100+0000","last_undegraded":"2024-04-26T12:42:41.074100+0000","last_fullsized":"2024-04-26T12:42:41.074100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:26.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409372+0000","last_change":"2024-04-26T12:42:21.935064+0000","last_active":"2024-04-26T12:42:41.409372+0000","last_peered":"2024-04-26T12:42:41.409372+0000","last_clean":"2024-04-26T12:42:41.409372+0000","last_became_active":"2024-04-26T12:42:21.933611+0000","last_became_peered":"2024-04-26T12:42:21.933611+0000","last_unstale":"2024-04-26T12:42:41.409372+0000","last_undegraded":"2024-04-26T12:42:41.409372+0000","last_fullsized":"2024-04-26T12:42:41.409372+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:10.425425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122185+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:42:42.122185+0000","last_peered":"2024-04-26T12:42:42.122185+0000","last_clean":"2024-04-26T12:42:42.122185+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:42:42.122185+0000","last_undegraded":"2024-04-26T12:42:42.122185+0000","last_fullsized":"2024-04-26T12:42:42.122185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976329+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:42:41.976329+0000","last_peered":"2024-04-26T12:42:41.976329+0000","last_clean":"2024-04-26T12:42:41.976329+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:42:41.976329+0000","last_undegraded":"2024-04-26T12:42:41.976329+0000","last_fullsized":"2024-04-26T12:42:41.976329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"114'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068827+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:42:41.068827+0000","last_peered":"2024-04-26T12:42:41.068827+0000","last_clean":"2024-04-26T12:42:41.068827+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:42:41.068827+0000","last_undegraded":"2024-04-26T12:42:41.068827+0000","last_fullsized":"2024-04-26T12:42:41.068827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409671+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:42:41.409671+0000","last_peered":"2024-04-26T12:42:41.409671+0000","last_clean":"2024-04-26T12:42:41.409671+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:42:41.409671+0000","last_undegraded":"2024-04-26T12:42:41.409671+0000","last_fullsized":"2024-04-26T12:42:41.409671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"117'12","reported_seq":61,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067261+0000","last_change":"2024-04-26T12:42:34.023030+0000","last_active":"2024-04-26T12:42:41.067261+0000","last_peered":"2024-04-26T12:42:41.067261+0000","last_clean":"2024-04-26T12:42:41.067261+0000","last_became_active":"2024-04-26T12:42:34.022362+0000","last_became_peered":"2024-04-26T12:42:34.022362+0000","last_unstale":"2024-04-26T12:42:41.067261+0000","last_undegraded":"2024-04-26T12:42:41.067261+0000","last_fullsized":"2024-04-26T12:42:41.067261+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:14.876710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"139'135","reported_seq":427,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751193+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:42:44.751193+0000","last_peered":"2024-04-26T12:42:44.751193+0000","last_clean":"2024-04-26T12:42:44.751193+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:42:44.751193+0000","last_undegraded":"2024-04-26T12:42:44.751193+0000","last_fullsized":"2024-04-26T12:42:44.751193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"117'4","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515862+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:42:42.515862+0000","last_peered":"2024-04-26T12:42:42.515862+0000","last_clean":"2024-04-26T12:42:42.515862+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:42:42.515862+0000","last_undegraded":"2024-04-26T12:42:42.515862+0000","last_fullsized":"2024-04-26T12:42:42.515862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066160+0000","last_change":"2024-04-26T12:42:34.029194+0000","last_active":"2024-04-26T12:42:41.066160+0000","last_peered":"2024-04-26T12:42:41.066160+0000","last_clean":"2024-04-26T12:42:41.066160+0000","last_became_active":"2024-04-26T12:42:34.028313+0000","last_became_peered":"2024-04-26T12:42:34.028313+0000","last_unstale":"2024-04-26T12:42:41.066160+0000","last_undegraded":"2024-04-26T12:42:41.066160+0000","last_fullsized":"2024-04-26T12:42:41.066160+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:01.651376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"117'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122475+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:42:42.122475+0000","last_peered":"2024-04-26T12:42:42.122475+0000","last_clean":"2024-04-26T12:42:42.122475+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:42:42.122475+0000","last_undegraded":"2024-04-26T12:42:42.122475+0000","last_fullsized":"2024-04-26T12:42:42.122475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518145+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:42:42.518145+0000","last_peered":"2024-04-26T12:42:42.518145+0000","last_clean":"2024-04-26T12:42:42.518145+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:42:42.518145+0000","last_undegraded":"2024-04-26T12:42:42.518145+0000","last_fullsized":"2024-04-26T12:42:42.518145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"117'24","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122039+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:42:42.122039+0000","last_peered":"2024-04-26T12:42:42.122039+0000","last_clean":"2024-04-26T12:42:42.122039+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:42:42.122039+0000","last_undegraded":"2024-04-26T12:42:42.122039+0000","last_fullsized":"2024-04-26T12:42:42.122039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070022+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:42:41.070022+0000","last_peered":"2024-04-26T12:42:41.070022+0000","last_clean":"2024-04-26T12:42:41.070022+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:42:41.070022+0000","last_undegraded":"2024-04-26T12:42:41.070022+0000","last_fullsized":"2024-04-26T12:42:41.070022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":229,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519271+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:42:42.519271+0000","last_peered":"2024-04-26T12:42:42.519271+0000","last_clean":"2024-04-26T12:42:42.519271+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:42:42.519271+0000","last_undegraded":"2024-04-26T12:42:42.519271+0000","last_fullsized":"2024-04-26T12:42:42.519271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"117'14","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067733+0000","last_change":"2024-04-26T12:42:34.032654+0000","last_active":"2024-04-26T12:42:41.067733+0000","last_peered":"2024-04-26T12:42:41.067733+0000","last_clean":"2024-04-26T12:42:41.067733+0000","last_became_active":"2024-04-26T12:42:34.031426+0000","last_became_peered":"2024-04-26T12:42:34.031426+0000","last_unstale":"2024-04-26T12:42:41.067733+0000","last_undegraded":"2024-04-26T12:42:41.067733+0000","last_fullsized":"2024-04-26T12:42:41.067733+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:08.054625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'38","reported_seq":291,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123903+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:42:42.123903+0000","last_peered":"2024-04-26T12:42:42.123903+0000","last_clean":"2024-04-26T12:42:42.123903+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:42:42.123903+0000","last_undegraded":"2024-04-26T12:42:42.123903+0000","last_fullsized":"2024-04-26T12:42:42.123903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122227+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:42:42.122227+0000","last_peered":"2024-04-26T12:42:42.122227+0000","last_clean":"2024-04-26T12:42:42.122227+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:42:42.122227+0000","last_undegraded":"2024-04-26T12:42:42.122227+0000","last_fullsized":"2024-04-26T12:42:42.122227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070299+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:42:41.070299+0000","last_peered":"2024-04-26T12:42:41.070299+0000","last_clean":"2024-04-26T12:42:41.070299+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:42:41.070299+0000","last_undegraded":"2024-04-26T12:42:41.070299+0000","last_fullsized":"2024-04-26T12:42:41.070299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517640+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:42:42.517640+0000","last_peered":"2024-04-26T12:42:42.517640+0000","last_clean":"2024-04-26T12:42:42.517640+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:42:42.517640+0000","last_undegraded":"2024-04-26T12:42:42.517640+0000","last_fullsized":"2024-04-26T12:42:42.517640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":183,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073883+0000","last_change":"2024-04-26T12:42:21.961763+0000","last_active":"2024-04-26T12:42:41.073883+0000","last_peered":"2024-04-26T12:42:41.073883+0000","last_clean":"2024-04-26T12:42:41.073883+0000","last_became_active":"2024-04-26T12:42:21.951213+0000","last_became_peered":"2024-04-26T12:42:21.951213+0000","last_unstale":"2024-04-26T12:42:41.073883+0000","last_undegraded":"2024-04-26T12:42:41.073883+0000","last_fullsized":"2024-04-26T12:42:41.073883+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:11.260016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069763+0000","last_change":"2024-04-26T12:42:21.963634+0000","last_active":"2024-04-26T12:42:41.069763+0000","last_peered":"2024-04-26T12:42:41.069763+0000","last_clean":"2024-04-26T12:42:41.069763+0000","last_became_active":"2024-04-26T12:42:21.952291+0000","last_became_peered":"2024-04-26T12:42:21.952291+0000","last_unstale":"2024-04-26T12:42:41.069763+0000","last_undegraded":"2024-04-26T12:42:41.069763+0000","last_fullsized":"2024-04-26T12:42:41.069763+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:54.609591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"117'27","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072915+0000","last_change":"2024-04-26T12:42:21.929252+0000","last_active":"2024-04-26T12:42:41.072915+0000","last_peered":"2024-04-26T12:42:41.072915+0000","last_clean":"2024-04-26T12:42:41.072915+0000","last_became_active":"2024-04-26T12:42:21.928247+0000","last_became_peered":"2024-04-26T12:42:21.928247+0000","last_unstale":"2024-04-26T12:42:41.072915+0000","last_undegraded":"2024-04-26T12:42:41.072915+0000","last_fullsized":"2024-04-26T12:42:41.072915+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:45.518571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065498+0000","last_change":"2024-04-26T12:42:34.022643+0000","last_active":"2024-04-26T12:42:41.065498+0000","last_peered":"2024-04-26T12:42:41.065498+0000","last_clean":"2024-04-26T12:42:41.065498+0000","last_became_active":"2024-04-26T12:42:34.022065+0000","last_became_peered":"2024-04-26T12:42:34.022065+0000","last_unstale":"2024-04-26T12:42:41.065498+0000","last_undegraded":"2024-04-26T12:42:41.065498+0000","last_fullsized":"2024-04-26T12:42:41.065498+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:59.260776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"117'14","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068905+0000","last_change":"2024-04-26T12:42:21.975843+0000","last_active":"2024-04-26T12:42:41.068905+0000","last_peered":"2024-04-26T12:42:41.068905+0000","last_clean":"2024-04-26T12:42:41.068905+0000","last_became_active":"2024-04-26T12:42:21.971062+0000","last_became_peered":"2024-04-26T12:42:21.971062+0000","last_unstale":"2024-04-26T12:42:41.068905+0000","last_undegraded":"2024-04-26T12:42:41.068905+0000","last_fullsized":"2024-04-26T12:42:41.068905+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:19.436937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065759+0000","last_change":"2024-04-26T12:42:34.025446+0000","last_active":"2024-04-26T12:42:41.065759+0000","last_peered":"2024-04-26T12:42:41.065759+0000","last_clean":"2024-04-26T12:42:41.065759+0000","last_became_active":"2024-04-26T12:42:34.024706+0000","last_became_peered":"2024-04-26T12:42:34.024706+0000","last_unstale":"2024-04-26T12:42:41.065759+0000","last_undegraded":"2024-04-26T12:42:41.065759+0000","last_fullsized":"2024-04-26T12:42:41.065759+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.762146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518863+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:42:42.518863+0000","last_peered":"2024-04-26T12:42:42.518863+0000","last_clean":"2024-04-26T12:42:42.518863+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:42:42.518863+0000","last_undegraded":"2024-04-26T12:42:42.518863+0000","last_fullsized":"2024-04-26T12:42:42.518863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":225,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066300+0000","last_change":"2024-04-26T12:42:34.023824+0000","last_active":"2024-04-26T12:42:41.066300+0000","last_peered":"2024-04-26T12:42:41.066300+0000","last_clean":"2024-04-26T12:42:41.066300+0000","last_became_active":"2024-04-26T12:42:34.022553+0000","last_became_peered":"2024-04-26T12:42:34.022553+0000","last_unstale":"2024-04-26T12:42:41.066300+0000","last_undegraded":"2024-04-26T12:42:41.066300+0000","last_fullsized":"2024-04-26T12:42:41.066300+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:14.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071804+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:42:41.071804+0000","last_peered":"2024-04-26T12:42:41.071804+0000","last_clean":"2024-04-26T12:42:41.071804+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:42:41.071804+0000","last_undegraded":"2024-04-26T12:42:41.071804+0000","last_fullsized":"2024-04-26T12:42:41.071804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":334,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408101+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:42:41.408101+0000","last_peered":"2024-04-26T12:42:41.408101+0000","last_clean":"2024-04-26T12:42:41.408101+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:42:41.408101+0000","last_undegraded":"2024-04-26T12:42:41.408101+0000","last_fullsized":"2024-04-26T12:42:41.408101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"117'17","reported_seq":62,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066047+0000","last_change":"2024-04-26T12:42:34.021259+0000","last_active":"2024-04-26T12:42:41.066047+0000","last_peered":"2024-04-26T12:42:41.066047+0000","last_clean":"2024-04-26T12:42:41.066047+0000","last_became_active":"2024-04-26T12:42:34.017996+0000","last_became_peered":"2024-04-26T12:42:34.017996+0000","last_unstale":"2024-04-26T12:42:41.066047+0000","last_undegraded":"2024-04-26T12:42:41.066047+0000","last_fullsized":"2024-04-26T12:42:41.066047+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:25.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068303+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:42:41.068303+0000","last_peered":"2024-04-26T12:42:41.068303+0000","last_clean":"2024-04-26T12:42:41.068303+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:42:41.068303+0000","last_undegraded":"2024-04-26T12:42:41.068303+0000","last_fullsized":"2024-04-26T12:42:41.068303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068670+0000","last_change":"2024-04-26T12:42:34.015473+0000","last_active":"2024-04-26T12:42:41.068670+0000","last_peered":"2024-04-26T12:42:41.068670+0000","last_clean":"2024-04-26T12:42:41.068670+0000","last_became_active":"2024-04-26T12:42:34.011472+0000","last_became_peered":"2024-04-26T12:42:34.011472+0000","last_unstale":"2024-04-26T12:42:41.068670+0000","last_undegraded":"2024-04-26T12:42:41.068670+0000","last_fullsized":"2024-04-26T12:42:41.068670+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"117'8","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410161+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:42:41.410161+0000","last_peered":"2024-04-26T12:42:41.410161+0000","last_clean":"2024-04-26T12:42:41.410161+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:42:41.410161+0000","last_undegraded":"2024-04-26T12:42:41.410161+0000","last_fullsized":"2024-04-26T12:42:41.410161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"115'18","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513972+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:42:42.513972+0000","last_peered":"2024-04-26T12:42:42.513972+0000","last_clean":"2024-04-26T12:42:42.513972+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:42:42.513972+0000","last_undegraded":"2024-04-26T12:42:42.513972+0000","last_fullsized":"2024-04-26T12:42:42.513972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409722+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:42:41.409722+0000","last_peered":"2024-04-26T12:42:41.409722+0000","last_clean":"2024-04-26T12:42:41.409722+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:42:41.409722+0000","last_undegraded":"2024-04-26T12:42:41.409722+0000","last_fullsized":"2024-04-26T12:42:41.409722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"117'28","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977334+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:42:41.977334+0000","last_peered":"2024-04-26T12:42:41.977334+0000","last_clean":"2024-04-26T12:42:41.977334+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:42:41.977334+0000","last_undegraded":"2024-04-26T12:42:41.977334+0000","last_fullsized":"2024-04-26T12:42:41.977334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123354+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:42:42.123354+0000","last_peered":"2024-04-26T12:42:42.123354+0000","last_clean":"2024-04-26T12:42:42.123354+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:42:42.123354+0000","last_undegraded":"2024-04-26T12:42:42.123354+0000","last_fullsized":"2024-04-26T12:42:42.123354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'25","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122527+0000","last_change":"2024-04-26T12:42:21.926395+0000","last_active":"2024-04-26T12:42:42.122527+0000","last_peered":"2024-04-26T12:42:42.122527+0000","last_clean":"2024-04-26T12:42:42.122527+0000","last_became_active":"2024-04-26T12:42:21.925708+0000","last_became_peered":"2024-04-26T12:42:21.925708+0000","last_unstale":"2024-04-26T12:42:42.122527+0000","last_undegraded":"2024-04-26T12:42:42.122527+0000","last_fullsized":"2024-04-26T12:42:42.122527+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:41.849994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"117'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409207+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:42:41.409207+0000","last_peered":"2024-04-26T12:42:41.409207+0000","last_clean":"2024-04-26T12:42:41.409207+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:42:41.409207+0000","last_undegraded":"2024-04-26T12:42:41.409207+0000","last_fullsized":"2024-04-26T12:42:41.409207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'28","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069354+0000","last_change":"2024-04-26T12:42:21.959563+0000","last_active":"2024-04-26T12:42:41.069354+0000","last_peered":"2024-04-26T12:42:41.069354+0000","last_clean":"2024-04-26T12:42:41.069354+0000","last_became_active":"2024-04-26T12:42:21.957515+0000","last_became_peered":"2024-04-26T12:42:21.957515+0000","last_unstale":"2024-04-26T12:42:41.069354+0000","last_undegraded":"2024-04-26T12:42:41.069354+0000","last_fullsized":"2024-04-26T12:42:41.069354+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:46.718927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068640+0000","last_change":"2024-04-26T12:42:21.975117+0000","last_active":"2024-04-26T12:42:41.068640+0000","last_peered":"2024-04-26T12:42:41.068640+0000","last_clean":"2024-04-26T12:42:41.068640+0000","last_became_active":"2024-04-26T12:42:21.970669+0000","last_became_peered":"2024-04-26T12:42:21.970669+0000","last_unstale":"2024-04-26T12:42:41.068640+0000","last_undegraded":"2024-04-26T12:42:41.068640+0000","last_fullsized":"2024-04-26T12:42:41.068640+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:18.013624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'23","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071983+0000","last_change":"2024-04-26T12:42:21.964762+0000","last_active":"2024-04-26T12:42:41.071983+0000","last_peered":"2024-04-26T12:42:41.071983+0000","last_clean":"2024-04-26T12:42:41.071983+0000","last_became_active":"2024-04-26T12:42:21.961965+0000","last_became_peered":"2024-04-26T12:42:21.961965+0000","last_unstale":"2024-04-26T12:42:41.071983+0000","last_undegraded":"2024-04-26T12:42:41.071983+0000","last_fullsized":"2024-04-26T12:42:41.071983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:11.098641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068239+0000","last_change":"2024-04-26T12:42:34.025570+0000","last_active":"2024-04-26T12:42:41.068239+0000","last_peered":"2024-04-26T12:42:41.068239+0000","last_clean":"2024-04-26T12:42:41.068239+0000","last_became_active":"2024-04-26T12:42:34.024880+0000","last_became_peered":"2024-04-26T12:42:34.024880+0000","last_unstale":"2024-04-26T12:42:41.068239+0000","last_undegraded":"2024-04-26T12:42:41.068239+0000","last_fullsized":"2024-04-26T12:42:41.068239+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:55.070371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"117'19","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410111+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:42:41.410111+0000","last_peered":"2024-04-26T12:42:41.410111+0000","last_clean":"2024-04-26T12:42:41.410111+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:42:41.410111+0000","last_undegraded":"2024-04-26T12:42:41.410111+0000","last_fullsized":"2024-04-26T12:42:41.410111+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":185,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070064+0000","last_change":"2024-04-26T12:42:21.942927+0000","last_active":"2024-04-26T12:42:41.070064+0000","last_peered":"2024-04-26T12:42:41.070064+0000","last_clean":"2024-04-26T12:42:41.070064+0000","last_became_active":"2024-04-26T12:42:21.941594+0000","last_became_peered":"2024-04-26T12:42:21.941594+0000","last_unstale":"2024-04-26T12:42:41.070064+0000","last_undegraded":"2024-04-26T12:42:41.070064+0000","last_fullsized":"2024-04-26T12:42:41.070064+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:04.021398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'27","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520265+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:42:42.520265+0000","last_peered":"2024-04-26T12:42:42.520265+0000","last_clean":"2024-04-26T12:42:42.520265+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:42:42.520265+0000","last_undegraded":"2024-04-26T12:42:42.520265+0000","last_fullsized":"2024-04-26T12:42:42.520265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"117'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517260+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:42:42.517260+0000","last_peered":"2024-04-26T12:42:42.517260+0000","last_clean":"2024-04-26T12:42:42.517260+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:42:42.517260+0000","last_undegraded":"2024-04-26T12:42:42.517260+0000","last_fullsized":"2024-04-26T12:42:42.517260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"117'32","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073767+0000","last_change":"2024-04-26T12:42:21.951944+0000","last_active":"2024-04-26T12:42:41.073767+0000","last_peered":"2024-04-26T12:42:41.073767+0000","last_clean":"2024-04-26T12:42:41.073767+0000","last_became_active":"2024-04-26T12:42:21.948694+0000","last_became_peered":"2024-04-26T12:42:21.948694+0000","last_unstale":"2024-04-26T12:42:41.073767+0000","last_undegraded":"2024-04-26T12:42:41.073767+0000","last_fullsized":"2024-04-26T12:42:41.073767+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:27.567798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132120576,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":289,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071522+0000","last_change":"2024-04-26T12:42:21.957965+0000","last_active":"2024-04-26T12:42:41.071522+0000","last_peered":"2024-04-26T12:42:41.071522+0000","last_clean":"2024-04-26T12:42:41.071522+0000","last_became_active":"2024-04-26T12:42:21.956925+0000","last_became_peered":"2024-04-26T12:42:21.956925+0000","last_unstale":"2024-04-26T12:42:41.071522+0000","last_undegraded":"2024-04-26T12:42:41.071522+0000","last_fullsized":"2024-04-26T12:42:41.071522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:23.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'29","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123130+0000","last_change":"2024-04-26T12:42:21.950280+0000","last_active":"2024-04-26T12:42:42.123130+0000","last_peered":"2024-04-26T12:42:42.123130+0000","last_clean":"2024-04-26T12:42:42.123130+0000","last_became_active":"2024-04-26T12:42:21.949469+0000","last_became_peered":"2024-04-26T12:42:21.949469+0000","last_unstale":"2024-04-26T12:42:42.123130+0000","last_undegraded":"2024-04-26T12:42:42.123130+0000","last_fullsized":"2024-04-26T12:42:42.123130+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:05.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067819+0000","last_change":"2024-04-26T12:42:34.019992+0000","last_active":"2024-04-26T12:42:41.067819+0000","last_peered":"2024-04-26T12:42:41.067819+0000","last_clean":"2024-04-26T12:42:41.067819+0000","last_became_active":"2024-04-26T12:42:34.018659+0000","last_became_peered":"2024-04-26T12:42:34.018659+0000","last_unstale":"2024-04-26T12:42:41.067819+0000","last_undegraded":"2024-04-26T12:42:41.067819+0000","last_fullsized":"2024-04-26T12:42:41.067819+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:24.593225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'18","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069486+0000","last_change":"2024-04-26T12:42:21.933174+0000","last_active":"2024-04-26T12:42:41.069486+0000","last_peered":"2024-04-26T12:42:41.069486+0000","last_clean":"2024-04-26T12:42:41.069486+0000","last_became_active":"2024-04-26T12:42:21.932263+0000","last_became_peered":"2024-04-26T12:42:21.932263+0000","last_unstale":"2024-04-26T12:42:41.069486+0000","last_undegraded":"2024-04-26T12:42:41.069486+0000","last_fullsized":"2024-04-26T12:42:41.069486+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:26.946555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"117'4","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976542+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:42:41.976542+0000","last_peered":"2024-04-26T12:42:41.976542+0000","last_clean":"2024-04-26T12:42:41.976542+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:42:41.976542+0000","last_undegraded":"2024-04-26T12:42:41.976542+0000","last_fullsized":"2024-04-26T12:42:41.976542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"112'16","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122214+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:42:42.122214+0000","last_peered":"2024-04-26T12:42:42.122214+0000","last_clean":"2024-04-26T12:42:42.122214+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:42:42.122214+0000","last_undegraded":"2024-04-26T12:42:42.122214+0000","last_fullsized":"2024-04-26T12:42:42.122214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068189+0000","last_change":"2024-04-26T12:42:34.024717+0000","last_active":"2024-04-26T12:42:41.068189+0000","last_peered":"2024-04-26T12:42:41.068189+0000","last_clean":"2024-04-26T12:42:41.068189+0000","last_became_active":"2024-04-26T12:42:34.023978+0000","last_became_peered":"2024-04-26T12:42:34.023978+0000","last_unstale":"2024-04-26T12:42:41.068189+0000","last_undegraded":"2024-04-26T12:42:41.068189+0000","last_fullsized":"2024-04-26T12:42:41.068189+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'23","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071543+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:42:41.071543+0000","last_peered":"2024-04-26T12:42:41.071543+0000","last_clean":"2024-04-26T12:42:41.071543+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:42:41.071543+0000","last_undegraded":"2024-04-26T12:42:41.071543+0000","last_fullsized":"2024-04-26T12:42:41.071543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520003+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:42:42.520003+0000","last_peered":"2024-04-26T12:42:42.520003+0000","last_clean":"2024-04-26T12:42:42.520003+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:42:42.520003+0000","last_undegraded":"2024-04-26T12:42:42.520003+0000","last_fullsized":"2024-04-26T12:42:42.520003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'17","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514500+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:42:42.514500+0000","last_peered":"2024-04-26T12:42:42.514500+0000","last_clean":"2024-04-26T12:42:42.514500+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:42:42.514500+0000","last_undegraded":"2024-04-26T12:42:42.514500+0000","last_fullsized":"2024-04-26T12:42:42.514500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068613+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:42:41.068613+0000","last_peered":"2024-04-26T12:42:41.068613+0000","last_clean":"2024-04-26T12:42:41.068613+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:42:41.068613+0000","last_undegraded":"2024-04-26T12:42:41.068613+0000","last_fullsized":"2024-04-26T12:42:41.068613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'24","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514550+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:42:42.514550+0000","last_peered":"2024-04-26T12:42:42.514550+0000","last_clean":"2024-04-26T12:42:42.514550+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:42:42.514550+0000","last_undegraded":"2024-04-26T12:42:42.514550+0000","last_fullsized":"2024-04-26T12:42:42.514550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070772+0000","last_change":"2024-04-26T12:42:21.967040+0000","last_active":"2024-04-26T12:42:41.070772+0000","last_peered":"2024-04-26T12:42:41.070772+0000","last_clean":"2024-04-26T12:42:41.070772+0000","last_became_active":"2024-04-26T12:42:21.965634+0000","last_became_peered":"2024-04-26T12:42:21.965634+0000","last_unstale":"2024-04-26T12:42:41.070772+0000","last_undegraded":"2024-04-26T12:42:41.070772+0000","last_fullsized":"2024-04-26T12:42:41.070772+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:58.603311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'16","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976821+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:42:41.976821+0000","last_peered":"2024-04-26T12:42:41.976821+0000","last_clean":"2024-04-26T12:42:41.976821+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:42:41.976821+0000","last_undegraded":"2024-04-26T12:42:41.976821+0000","last_fullsized":"2024-04-26T12:42:41.976821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516557+0000","last_change":"2024-04-26T12:42:21.967682+0000","last_active":"2024-04-26T12:42:42.516557+0000","last_peered":"2024-04-26T12:42:42.516557+0000","last_clean":"2024-04-26T12:42:42.516557+0000","last_became_active":"2024-04-26T12:42:21.967048+0000","last_became_peered":"2024-04-26T12:42:21.967048+0000","last_unstale":"2024-04-26T12:42:42.516557+0000","last_undegraded":"2024-04-26T12:42:42.516557+0000","last_fullsized":"2024-04-26T12:42:42.516557+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:43.288294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"117'15","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123879+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:42:42.123879+0000","last_peered":"2024-04-26T12:42:42.123879+0000","last_clean":"2024-04-26T12:42:42.123879+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:42:42.123879+0000","last_undegraded":"2024-04-26T12:42:42.123879+0000","last_fullsized":"2024-04-26T12:42:42.123879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"116'24","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122836+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:42:42.122836+0000","last_peered":"2024-04-26T12:42:42.122836+0000","last_clean":"2024-04-26T12:42:42.122836+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:42:42.122836+0000","last_undegraded":"2024-04-26T12:42:42.122836+0000","last_fullsized":"2024-04-26T12:42:42.122836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070164+0000","last_change":"2024-04-26T12:42:21.937768+0000","last_active":"2024-04-26T12:42:41.070164+0000","last_peered":"2024-04-26T12:42:41.070164+0000","last_clean":"2024-04-26T12:42:41.070164+0000","last_became_active":"2024-04-26T12:42:21.936930+0000","last_became_peered":"2024-04-26T12:42:21.936930+0000","last_unstale":"2024-04-26T12:42:41.070164+0000","last_undegraded":"2024-04-26T12:42:41.070164+0000","last_fullsized":"2024-04-26T12:42:41.070164+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.253226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"117'25","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408802+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:42:41.408802+0000","last_peered":"2024-04-26T12:42:41.408802+0000","last_clean":"2024-04-26T12:42:41.408802+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:42:41.408802+0000","last_undegraded":"2024-04-26T12:42:41.408802+0000","last_fullsized":"2024-04-26T12:42:41.408802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"117'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123586+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:42:42.123586+0000","last_peered":"2024-04-26T12:42:42.123586+0000","last_clean":"2024-04-26T12:42:42.123586+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:42:42.123586+0000","last_undegraded":"2024-04-26T12:42:42.123586+0000","last_fullsized":"2024-04-26T12:42:42.123586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":336,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1084,"ondisk_log_size":1084,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382929,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":607,"num_write":463,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1275,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1700576,"kb_used_data":1669396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92671264,"statfs":{"total":96636764160,"available":94895374336,"internally_reserved":0,"allocated":1709461504,"data_stored":1708741343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1136704,"kb_used_data":1105528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93235136,"statfs":{"total":96636764160,"available":95472779264,"internally_reserved":0,"allocated":1132060672,"data_stored":1131374253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1950060,"kb_used_data":1914724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92421780,"statfs":{"total":96636764160,"available":94639902720,"internally_reserved":0,"allocated":1960677376,"data_stored":1959926964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1808444,"kb_used_data":1777264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92563396,"statfs":{"total":96636764160,"available":94784917504,"internally_reserved":0,"allocated":1819918336,"data_stored":1819239618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":122,"seq":523986010120,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1942860,"kb_used_data":1906500,"kb_used_omap":6,"kb_used_meta":36345,"kb_avail":92428980,"statfs":{"total":96636764160,"available":94647275520,"internally_reserved":0,"allocated":1952256000,"data_stored":1951536896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6715,"internal_metadata":37217733},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163384,"kb_used_data":1128048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93208456,"statfs":{"total":96636764160,"available":95445458944,"internally_reserved":0,"allocated":1155121152,"data_stored":1154442923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1130836,"kb_used_data":1091340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93241004,"statfs":{"total":96636764160,"available":95478788096,"internally_reserved":0,"allocated":1117532160,"data_stored":1116813587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1762172,"kb_used_data":1726832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92609668,"statfs":{"total":96636764160,"available":94832300032,"internally_reserved":0,"allocated":1768275968,"data_stored":1767576542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1765801984,"data_stored":1765801984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1115684864,"data_stored":1115684864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1153433600,"data_stored":1153433600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1958739968,"data_stored":1958739968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1130364928,"data_stored":1130364928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1707081728,"data_stored":1707081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":175679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":176622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":176872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:42:53.645 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T12:42:53.645 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:42:54.011 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:42:54.018 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:42:54.029 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-04-26T12:42:52.787702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819921,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3100,"num_read_kb":2786,"num_write":2843,"num_write_kb":6187910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3903,"ondisk_log_size":3903,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595036,"kb_used_data":12319632,"kb_used_omap":17,"kb_used_meta":275310,"kb_avail":742379684,"statfs":{"total":773094113280,"available":760196796416,"internally_reserved":0,"allocated":12615303168,"data_stored":12609652126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17874,"internal_metadata":281917998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.724283"},"pg_stats":[{"pgid":"3.3f","version":"116'21","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519202+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:42:42.519202+0000","last_peered":"2024-04-26T12:42:42.519202+0000","last_clean":"2024-04-26T12:42:42.519202+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:42:42.519202+0000","last_undegraded":"2024-04-26T12:42:42.519202+0000","last_fullsized":"2024-04-26T12:42:42.519202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"117'6","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121480+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:42:42.121480+0000","last_peered":"2024-04-26T12:42:42.121480+0000","last_clean":"2024-04-26T12:42:42.121480+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:42:42.121480+0000","last_undegraded":"2024-04-26T12:42:42.121480+0000","last_fullsized":"2024-04-26T12:42:42.121480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'16","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409799+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:42:41.409799+0000","last_peered":"2024-04-26T12:42:41.409799+0000","last_clean":"2024-04-26T12:42:41.409799+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:42:41.409799+0000","last_undegraded":"2024-04-26T12:42:41.409799+0000","last_fullsized":"2024-04-26T12:42:41.409799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518093+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:42:42.518093+0000","last_peered":"2024-04-26T12:42:42.518093+0000","last_clean":"2024-04-26T12:42:42.518093+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:42:42.518093+0000","last_undegraded":"2024-04-26T12:42:42.518093+0000","last_fullsized":"2024-04-26T12:42:42.518093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069713+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:42:41.069713+0000","last_peered":"2024-04-26T12:42:41.069713+0000","last_clean":"2024-04-26T12:42:41.069713+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:42:41.069713+0000","last_undegraded":"2024-04-26T12:42:41.069713+0000","last_fullsized":"2024-04-26T12:42:41.069713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066786+0000","last_change":"2024-04-26T12:42:34.019445+0000","last_active":"2024-04-26T12:42:41.066786+0000","last_peered":"2024-04-26T12:42:41.066786+0000","last_clean":"2024-04-26T12:42:41.066786+0000","last_became_active":"2024-04-26T12:42:34.016025+0000","last_became_peered":"2024-04-26T12:42:34.016025+0000","last_unstale":"2024-04-26T12:42:41.066786+0000","last_undegraded":"2024-04-26T12:42:41.066786+0000","last_fullsized":"2024-04-26T12:42:41.066786+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:55.436710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'31","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123102+0000","last_change":"2024-04-26T12:42:21.947248+0000","last_active":"2024-04-26T12:42:42.123102+0000","last_peered":"2024-04-26T12:42:42.123102+0000","last_clean":"2024-04-26T12:42:42.123102+0000","last_became_active":"2024-04-26T12:42:21.946477+0000","last_became_peered":"2024-04-26T12:42:21.946477+0000","last_unstale":"2024-04-26T12:42:42.123102+0000","last_undegraded":"2024-04-26T12:42:42.123102+0000","last_fullsized":"2024-04-26T12:42:42.123102+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.347007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069100+0000","last_change":"2024-04-26T12:42:21.958105+0000","last_active":"2024-04-26T12:42:41.069100+0000","last_peered":"2024-04-26T12:42:41.069100+0000","last_clean":"2024-04-26T12:42:41.069100+0000","last_became_active":"2024-04-26T12:42:21.956507+0000","last_became_peered":"2024-04-26T12:42:21.956507+0000","last_unstale":"2024-04-26T12:42:41.069100+0000","last_undegraded":"2024-04-26T12:42:41.069100+0000","last_fullsized":"2024-04-26T12:42:41.069100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'25","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513970+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:42:42.513970+0000","last_peered":"2024-04-26T12:42:42.513970+0000","last_clean":"2024-04-26T12:42:42.513970+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:42:42.513970+0000","last_undegraded":"2024-04-26T12:42:42.513970+0000","last_fullsized":"2024-04-26T12:42:42.513970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520555+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:42:42.520555+0000","last_peered":"2024-04-26T12:42:42.520555+0000","last_clean":"2024-04-26T12:42:42.520555+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:42:42.520555+0000","last_undegraded":"2024-04-26T12:42:42.520555+0000","last_fullsized":"2024-04-26T12:42:42.520555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'25","reported_seq":228,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975912+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:42:41.975912+0000","last_peered":"2024-04-26T12:42:41.975912+0000","last_clean":"2024-04-26T12:42:41.975912+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:42:41.975912+0000","last_undegraded":"2024-04-26T12:42:41.975912+0000","last_fullsized":"2024-04-26T12:42:41.975912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:59.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":122,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066858+0000","last_change":"2024-04-26T12:42:34.007918+0000","last_active":"2024-04-26T12:42:41.066858+0000","last_peered":"2024-04-26T12:42:41.066858+0000","last_clean":"2024-04-26T12:42:41.066858+0000","last_became_active":"2024-04-26T12:42:34.006179+0000","last_became_peered":"2024-04-26T12:42:34.006179+0000","last_unstale":"2024-04-26T12:42:41.066858+0000","last_undegraded":"2024-04-26T12:42:41.066858+0000","last_fullsized":"2024-04-26T12:42:41.066858+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:13.173789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'22","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513774+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:42:42.513774+0000","last_peered":"2024-04-26T12:42:42.513774+0000","last_clean":"2024-04-26T12:42:42.513774+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:42:42.513774+0000","last_undegraded":"2024-04-26T12:42:42.513774+0000","last_fullsized":"2024-04-26T12:42:42.513774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123326+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:42:42.123326+0000","last_peered":"2024-04-26T12:42:42.123326+0000","last_clean":"2024-04-26T12:42:42.123326+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:42:42.123326+0000","last_undegraded":"2024-04-26T12:42:42.123326+0000","last_fullsized":"2024-04-26T12:42:42.123326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"117'13","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067810+0000","last_change":"2024-04-26T12:42:21.952625+0000","last_active":"2024-04-26T12:42:41.067810+0000","last_peered":"2024-04-26T12:42:41.067810+0000","last_clean":"2024-04-26T12:42:41.067810+0000","last_became_active":"2024-04-26T12:42:21.948971+0000","last_became_peered":"2024-04-26T12:42:21.948971+0000","last_unstale":"2024-04-26T12:42:41.067810+0000","last_undegraded":"2024-04-26T12:42:41.067810+0000","last_fullsized":"2024-04-26T12:42:41.067810+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:55.735297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977969+0000","last_change":"2024-04-26T12:42:21.965782+0000","last_active":"2024-04-26T12:42:41.977969+0000","last_peered":"2024-04-26T12:42:41.977969+0000","last_clean":"2024-04-26T12:42:41.977969+0000","last_became_active":"2024-04-26T12:42:21.964820+0000","last_became_peered":"2024-04-26T12:42:21.964820+0000","last_unstale":"2024-04-26T12:42:41.977969+0000","last_undegraded":"2024-04-26T12:42:41.977969+0000","last_fullsized":"2024-04-26T12:42:41.977969+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:07.092768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":168,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066034+0000","last_change":"2024-04-26T12:42:34.005982+0000","last_active":"2024-04-26T12:42:41.066034+0000","last_peered":"2024-04-26T12:42:41.066034+0000","last_clean":"2024-04-26T12:42:41.066034+0000","last_became_active":"2024-04-26T12:42:34.003575+0000","last_became_peered":"2024-04-26T12:42:34.003575+0000","last_unstale":"2024-04-26T12:42:41.066034+0000","last_undegraded":"2024-04-26T12:42:41.066034+0000","last_fullsized":"2024-04-26T12:42:41.066034+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:19.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'25","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516034+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:42:42.516034+0000","last_peered":"2024-04-26T12:42:42.516034+0000","last_clean":"2024-04-26T12:42:42.516034+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:42:42.516034+0000","last_undegraded":"2024-04-26T12:42:42.516034+0000","last_fullsized":"2024-04-26T12:42:42.516034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"117'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518358+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:42:42.518358+0000","last_peered":"2024-04-26T12:42:42.518358+0000","last_clean":"2024-04-26T12:42:42.518358+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:42:42.518358+0000","last_undegraded":"2024-04-26T12:42:42.518358+0000","last_fullsized":"2024-04-26T12:42:42.518358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"115'35","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516148+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:42:42.516148+0000","last_peered":"2024-04-26T12:42:42.516148+0000","last_clean":"2024-04-26T12:42:42.516148+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:42:42.516148+0000","last_undegraded":"2024-04-26T12:42:42.516148+0000","last_fullsized":"2024-04-26T12:42:42.516148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":45,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122421+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:42:42.122421+0000","last_peered":"2024-04-26T12:42:42.122421+0000","last_clean":"2024-04-26T12:42:42.122421+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:42:42.122421+0000","last_undegraded":"2024-04-26T12:42:42.122421+0000","last_fullsized":"2024-04-26T12:42:42.122421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'28","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515382+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:42:42.515382+0000","last_peered":"2024-04-26T12:42:42.515382+0000","last_clean":"2024-04-26T12:42:42.515382+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:42:42.515382+0000","last_undegraded":"2024-04-26T12:42:42.515382+0000","last_fullsized":"2024-04-26T12:42:42.515382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976530+0000","last_change":"2024-04-26T12:42:21.957465+0000","last_active":"2024-04-26T12:42:41.976530+0000","last_peered":"2024-04-26T12:42:41.976530+0000","last_clean":"2024-04-26T12:42:41.976530+0000","last_became_active":"2024-04-26T12:42:21.956566+0000","last_became_peered":"2024-04-26T12:42:21.956566+0000","last_unstale":"2024-04-26T12:42:41.976530+0000","last_undegraded":"2024-04-26T12:42:41.976530+0000","last_fullsized":"2024-04-26T12:42:41.976530+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:30.300637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"115'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066651+0000","last_change":"2024-04-26T12:42:34.024102+0000","last_active":"2024-04-26T12:42:41.066651+0000","last_peered":"2024-04-26T12:42:41.066651+0000","last_clean":"2024-04-26T12:42:41.066651+0000","last_became_active":"2024-04-26T12:42:34.022426+0000","last_became_peered":"2024-04-26T12:42:34.022426+0000","last_unstale":"2024-04-26T12:42:41.066651+0000","last_undegraded":"2024-04-26T12:42:41.066651+0000","last_fullsized":"2024-04-26T12:42:41.066651+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:21.509191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976221+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:42:41.976221+0000","last_peered":"2024-04-26T12:42:41.976221+0000","last_clean":"2024-04-26T12:42:41.976221+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:42:41.976221+0000","last_undegraded":"2024-04-26T12:42:41.976221+0000","last_fullsized":"2024-04-26T12:42:41.976221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:12.772439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'21","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070281+0000","last_change":"2024-04-26T12:42:21.946507+0000","last_active":"2024-04-26T12:42:41.070281+0000","last_peered":"2024-04-26T12:42:41.070281+0000","last_clean":"2024-04-26T12:42:41.070281+0000","last_became_active":"2024-04-26T12:42:21.932303+0000","last_became_peered":"2024-04-26T12:42:21.932303+0000","last_unstale":"2024-04-26T12:42:41.070281+0000","last_undegraded":"2024-04-26T12:42:41.070281+0000","last_fullsized":"2024-04-26T12:42:41.070281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:48.132898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85983232,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":113,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066875+0000","last_change":"2024-04-26T12:42:34.027080+0000","last_active":"2024-04-26T12:42:41.066875+0000","last_peered":"2024-04-26T12:42:41.066875+0000","last_clean":"2024-04-26T12:42:41.066875+0000","last_became_active":"2024-04-26T12:42:34.025281+0000","last_became_peered":"2024-04-26T12:42:34.025281+0000","last_unstale":"2024-04-26T12:42:41.066875+0000","last_undegraded":"2024-04-26T12:42:41.066875+0000","last_fullsized":"2024-04-26T12:42:41.066875+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:16.292958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"115'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069550+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:42:41.069550+0000","last_peered":"2024-04-26T12:42:41.069550+0000","last_clean":"2024-04-26T12:42:41.069550+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:42:41.069550+0000","last_undegraded":"2024-04-26T12:42:41.069550+0000","last_fullsized":"2024-04-26T12:42:41.069550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065496+0000","last_change":"2024-04-26T12:42:34.014303+0000","last_active":"2024-04-26T12:42:41.065496+0000","last_peered":"2024-04-26T12:42:41.065496+0000","last_clean":"2024-04-26T12:42:41.065496+0000","last_became_active":"2024-04-26T12:42:34.013263+0000","last_became_peered":"2024-04-26T12:42:34.013263+0000","last_unstale":"2024-04-26T12:42:41.065496+0000","last_undegraded":"2024-04-26T12:42:41.065496+0000","last_fullsized":"2024-04-26T12:42:41.065496+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:35.131864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072787+0000","last_change":"2024-04-26T12:42:21.967042+0000","last_active":"2024-04-26T12:42:41.072787+0000","last_peered":"2024-04-26T12:42:41.072787+0000","last_clean":"2024-04-26T12:42:41.072787+0000","last_became_active":"2024-04-26T12:42:21.961909+0000","last_became_peered":"2024-04-26T12:42:21.961909+0000","last_unstale":"2024-04-26T12:42:41.072787+0000","last_undegraded":"2024-04-26T12:42:41.072787+0000","last_fullsized":"2024-04-26T12:42:41.072787+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:33.810933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'18","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513868+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:42:42.513868+0000","last_peered":"2024-04-26T12:42:42.513868+0000","last_clean":"2024-04-26T12:42:42.513868+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:42:42.513868+0000","last_undegraded":"2024-04-26T12:42:42.513868+0000","last_fullsized":"2024-04-26T12:42:42.513868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122848+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:42:42.122848+0000","last_peered":"2024-04-26T12:42:42.122848+0000","last_clean":"2024-04-26T12:42:42.122848+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:42:42.122848+0000","last_undegraded":"2024-04-26T12:42:42.122848+0000","last_fullsized":"2024-04-26T12:42:42.122848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070613+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:42:41.070613+0000","last_peered":"2024-04-26T12:42:41.070613+0000","last_clean":"2024-04-26T12:42:41.070613+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:42:41.070613+0000","last_undegraded":"2024-04-26T12:42:41.070613+0000","last_fullsized":"2024-04-26T12:42:41.070613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516269+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:42:42.516269+0000","last_peered":"2024-04-26T12:42:42.516269+0000","last_clean":"2024-04-26T12:42:42.516269+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:42:42.516269+0000","last_undegraded":"2024-04-26T12:42:42.516269+0000","last_fullsized":"2024-04-26T12:42:42.516269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"117'48","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121554+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:42:42.121554+0000","last_peered":"2024-04-26T12:42:42.121554+0000","last_clean":"2024-04-26T12:42:42.121554+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:42:42.121554+0000","last_undegraded":"2024-04-26T12:42:42.121554+0000","last_fullsized":"2024-04-26T12:42:42.121554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123831+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:42:42.123831+0000","last_peered":"2024-04-26T12:42:42.123831+0000","last_clean":"2024-04-26T12:42:42.123831+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:42:42.123831+0000","last_undegraded":"2024-04-26T12:42:42.123831+0000","last_fullsized":"2024-04-26T12:42:42.123831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'34","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069854+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:42:41.069854+0000","last_peered":"2024-04-26T12:42:41.069854+0000","last_clean":"2024-04-26T12:42:41.069854+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:42:41.069854+0000","last_undegraded":"2024-04-26T12:42:41.069854+0000","last_fullsized":"2024-04-26T12:42:41.069854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074395+0000","last_change":"2024-04-26T12:42:21.970469+0000","last_active":"2024-04-26T12:42:41.074395+0000","last_peered":"2024-04-26T12:42:41.074395+0000","last_clean":"2024-04-26T12:42:41.074395+0000","last_became_active":"2024-04-26T12:42:21.968825+0000","last_became_peered":"2024-04-26T12:42:21.968825+0000","last_unstale":"2024-04-26T12:42:41.074395+0000","last_undegraded":"2024-04-26T12:42:41.074395+0000","last_fullsized":"2024-04-26T12:42:41.074395+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:54.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":55,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066772+0000","last_change":"2024-04-26T12:42:34.021039+0000","last_active":"2024-04-26T12:42:41.066772+0000","last_peered":"2024-04-26T12:42:41.066772+0000","last_clean":"2024-04-26T12:42:41.066772+0000","last_became_active":"2024-04-26T12:42:34.018809+0000","last_became_peered":"2024-04-26T12:42:34.018809+0000","last_unstale":"2024-04-26T12:42:41.066772+0000","last_undegraded":"2024-04-26T12:42:41.066772+0000","last_fullsized":"2024-04-26T12:42:41.066772+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:27.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066660+0000","last_change":"2024-04-26T12:42:34.007481+0000","last_active":"2024-04-26T12:42:41.066660+0000","last_peered":"2024-04-26T12:42:41.066660+0000","last_clean":"2024-04-26T12:42:41.066660+0000","last_became_active":"2024-04-26T12:42:34.004534+0000","last_became_peered":"2024-04-26T12:42:34.004534+0000","last_unstale":"2024-04-26T12:42:41.066660+0000","last_undegraded":"2024-04-26T12:42:41.066660+0000","last_fullsized":"2024-04-26T12:42:41.066660+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:33.240125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068768+0000","last_change":"2024-04-26T12:38:20.515636+0000","last_active":"2024-04-26T12:42:41.068768+0000","last_peered":"2024-04-26T12:42:41.068768+0000","last_clean":"2024-04-26T12:42:41.068768+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:42:41.068768+0000","last_undegraded":"2024-04-26T12:42:41.068768+0000","last_fullsized":"2024-04-26T12:42:41.068768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072461+0000","last_change":"2024-04-26T12:42:21.937320+0000","last_active":"2024-04-26T12:42:41.072461+0000","last_peered":"2024-04-26T12:42:41.072461+0000","last_clean":"2024-04-26T12:42:41.072461+0000","last_became_active":"2024-04-26T12:42:21.936393+0000","last_became_peered":"2024-04-26T12:42:21.936393+0000","last_unstale":"2024-04-26T12:42:41.072461+0000","last_undegraded":"2024-04-26T12:42:41.072461+0000","last_fullsized":"2024-04-26T12:42:41.072461+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:21.787788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"115'21","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513709+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:42:42.513709+0000","last_peered":"2024-04-26T12:42:42.513709+0000","last_clean":"2024-04-26T12:42:42.513709+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:42:42.513709+0000","last_undegraded":"2024-04-26T12:42:42.513709+0000","last_fullsized":"2024-04-26T12:42:42.513709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074226+0000","last_change":"2024-04-26T12:42:21.961567+0000","last_active":"2024-04-26T12:42:41.074226+0000","last_peered":"2024-04-26T12:42:41.074226+0000","last_clean":"2024-04-26T12:42:41.074226+0000","last_became_active":"2024-04-26T12:42:21.957657+0000","last_became_peered":"2024-04-26T12:42:21.957657+0000","last_unstale":"2024-04-26T12:42:41.074226+0000","last_undegraded":"2024-04-26T12:42:41.074226+0000","last_fullsized":"2024-04-26T12:42:41.074226+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:50.723405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"29'10","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975984+0000","last_change":"2024-04-26T12:38:16.454038+0000","last_active":"2024-04-26T12:42:41.975984+0000","last_peered":"2024-04-26T12:42:41.975984+0000","last_clean":"2024-04-26T12:42:41.975984+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:42:41.975984+0000","last_undegraded":"2024-04-26T12:42:41.975984+0000","last_fullsized":"2024-04-26T12:42:41.975984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:32.298804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"139'135","reported_seq":500,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.750936+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:42:44.750936+0000","last_peered":"2024-04-26T12:42:44.750936+0000","last_clean":"2024-04-26T12:42:44.750936+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:42:44.750936+0000","last_undegraded":"2024-04-26T12:42:44.750936+0000","last_fullsized":"2024-04-26T12:42:44.750936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066020+0000","last_change":"2024-04-26T12:42:34.015888+0000","last_active":"2024-04-26T12:42:41.066020+0000","last_peered":"2024-04-26T12:42:41.066020+0000","last_clean":"2024-04-26T12:42:41.066020+0000","last_became_active":"2024-04-26T12:42:34.015101+0000","last_became_peered":"2024-04-26T12:42:34.015101+0000","last_unstale":"2024-04-26T12:42:41.066020+0000","last_undegraded":"2024-04-26T12:42:41.066020+0000","last_fullsized":"2024-04-26T12:42:41.066020+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:23.606728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074777+0000","last_change":"2024-04-26T12:42:21.971692+0000","last_active":"2024-04-26T12:42:41.074777+0000","last_peered":"2024-04-26T12:42:41.074777+0000","last_clean":"2024-04-26T12:42:41.074777+0000","last_became_active":"2024-04-26T12:42:21.970815+0000","last_became_peered":"2024-04-26T12:42:21.970815+0000","last_unstale":"2024-04-26T12:42:41.074777+0000","last_undegraded":"2024-04-26T12:42:41.074777+0000","last_fullsized":"2024-04-26T12:42:41.074777+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:03.033305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'28","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513771+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:42:42.513771+0000","last_peered":"2024-04-26T12:42:42.513771+0000","last_clean":"2024-04-26T12:42:42.513771+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:42:42.513771+0000","last_undegraded":"2024-04-26T12:42:42.513771+0000","last_fullsized":"2024-04-26T12:42:42.513771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123181+0000","last_change":"2024-04-26T12:42:21.926752+0000","last_active":"2024-04-26T12:42:42.123181+0000","last_peered":"2024-04-26T12:42:42.123181+0000","last_clean":"2024-04-26T12:42:42.123181+0000","last_became_active":"2024-04-26T12:42:21.926086+0000","last_became_peered":"2024-04-26T12:42:21.926086+0000","last_unstale":"2024-04-26T12:42:42.123181+0000","last_undegraded":"2024-04-26T12:42:42.123181+0000","last_fullsized":"2024-04-26T12:42:42.123181+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.645084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"117'17","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518589+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:42:42.518589+0000","last_peered":"2024-04-26T12:42:42.518589+0000","last_clean":"2024-04-26T12:42:42.518589+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:42:42.518589+0000","last_undegraded":"2024-04-26T12:42:42.518589+0000","last_fullsized":"2024-04-26T12:42:42.518589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"139'137","reported_seq":414,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751637+0000","last_change":"2024-04-26T12:42:21.973003+0000","last_active":"2024-04-26T12:42:44.751637+0000","last_peered":"2024-04-26T12:42:44.751637+0000","last_clean":"2024-04-26T12:42:44.751637+0000","last_became_active":"2024-04-26T12:42:21.972298+0000","last_became_peered":"2024-04-26T12:42:21.972298+0000","last_unstale":"2024-04-26T12:42:44.751637+0000","last_undegraded":"2024-04-26T12:42:44.751637+0000","last_fullsized":"2024-04-26T12:42:44.751637+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:09.716281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122553+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:42:42.122553+0000","last_peered":"2024-04-26T12:42:42.122553+0000","last_clean":"2024-04-26T12:42:42.122553+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:42:42.122553+0000","last_undegraded":"2024-04-26T12:42:42.122553+0000","last_fullsized":"2024-04-26T12:42:42.122553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"115'24","reported_seq":227,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977649+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:42:41.977649+0000","last_peered":"2024-04-26T12:42:41.977649+0000","last_clean":"2024-04-26T12:42:41.977649+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:42:41.977649+0000","last_undegraded":"2024-04-26T12:42:41.977649+0000","last_fullsized":"2024-04-26T12:42:41.977649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:46.968407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517468+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:42:42.517468+0000","last_peered":"2024-04-26T12:42:42.517468+0000","last_clean":"2024-04-26T12:42:42.517468+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:42:42.517468+0000","last_undegraded":"2024-04-26T12:42:42.517468+0000","last_fullsized":"2024-04-26T12:42:42.517468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"117'27","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121597+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:42:42.121597+0000","last_peered":"2024-04-26T12:42:42.121597+0000","last_clean":"2024-04-26T12:42:42.121597+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:42:42.121597+0000","last_undegraded":"2024-04-26T12:42:42.121597+0000","last_fullsized":"2024-04-26T12:42:42.121597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408852+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:42:41.408852+0000","last_peered":"2024-04-26T12:42:41.408852+0000","last_clean":"2024-04-26T12:42:41.408852+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:42:41.408852+0000","last_undegraded":"2024-04-26T12:42:41.408852+0000","last_fullsized":"2024-04-26T12:42:41.408852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:55.011626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121946+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:42:42.121946+0000","last_peered":"2024-04-26T12:42:42.121946+0000","last_clean":"2024-04-26T12:42:42.121946+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:42:42.121946+0000","last_undegraded":"2024-04-26T12:42:42.121946+0000","last_fullsized":"2024-04-26T12:42:42.121946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065995+0000","last_change":"2024-04-26T12:42:34.029770+0000","last_active":"2024-04-26T12:42:41.065995+0000","last_peered":"2024-04-26T12:42:41.065995+0000","last_clean":"2024-04-26T12:42:41.065995+0000","last_became_active":"2024-04-26T12:42:34.027515+0000","last_became_peered":"2024-04-26T12:42:34.027515+0000","last_unstale":"2024-04-26T12:42:41.065995+0000","last_undegraded":"2024-04-26T12:42:41.065995+0000","last_fullsized":"2024-04-26T12:42:41.065995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:24.498714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'20","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515684+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:42:42.515684+0000","last_peered":"2024-04-26T12:42:42.515684+0000","last_clean":"2024-04-26T12:42:42.515684+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:42:42.515684+0000","last_undegraded":"2024-04-26T12:42:42.515684+0000","last_fullsized":"2024-04-26T12:42:42.515684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975908+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:42:41.975908+0000","last_peered":"2024-04-26T12:42:41.975908+0000","last_clean":"2024-04-26T12:42:41.975908+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:42:41.975908+0000","last_undegraded":"2024-04-26T12:42:41.975908+0000","last_fullsized":"2024-04-26T12:42:41.975908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:33.092433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"117'19","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068371+0000","last_change":"2024-04-26T12:42:21.974974+0000","last_active":"2024-04-26T12:42:41.068371+0000","last_peered":"2024-04-26T12:42:41.068371+0000","last_clean":"2024-04-26T12:42:41.068371+0000","last_became_active":"2024-04-26T12:42:21.968492+0000","last_became_peered":"2024-04-26T12:42:21.968492+0000","last_unstale":"2024-04-26T12:42:41.068371+0000","last_undegraded":"2024-04-26T12:42:41.068371+0000","last_fullsized":"2024-04-26T12:42:41.068371+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:59.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068594+0000","last_change":"2024-04-26T12:42:21.943962+0000","last_active":"2024-04-26T12:42:41.068594+0000","last_peered":"2024-04-26T12:42:41.068594+0000","last_clean":"2024-04-26T12:42:41.068594+0000","last_became_active":"2024-04-26T12:42:21.942925+0000","last_became_peered":"2024-04-26T12:42:21.942925+0000","last_unstale":"2024-04-26T12:42:41.068594+0000","last_undegraded":"2024-04-26T12:42:41.068594+0000","last_fullsized":"2024-04-26T12:42:41.068594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:17.453438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519637+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:42:42.519637+0000","last_peered":"2024-04-26T12:42:42.519637+0000","last_clean":"2024-04-26T12:42:42.519637+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:42:42.519637+0000","last_undegraded":"2024-04-26T12:42:42.519637+0000","last_fullsized":"2024-04-26T12:42:42.519637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518899+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:42:42.518899+0000","last_peered":"2024-04-26T12:42:42.518899+0000","last_clean":"2024-04-26T12:42:42.518899+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:42:42.518899+0000","last_undegraded":"2024-04-26T12:42:42.518899+0000","last_fullsized":"2024-04-26T12:42:42.518899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"114'19","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514720+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:42:42.514720+0000","last_peered":"2024-04-26T12:42:42.514720+0000","last_clean":"2024-04-26T12:42:42.514720+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:42:42.514720+0000","last_undegraded":"2024-04-26T12:42:42.514720+0000","last_fullsized":"2024-04-26T12:42:42.514720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976781+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:42:41.976781+0000","last_peered":"2024-04-26T12:42:41.976781+0000","last_clean":"2024-04-26T12:42:41.976781+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:42:41.976781+0000","last_undegraded":"2024-04-26T12:42:41.976781+0000","last_fullsized":"2024-04-26T12:42:41.976781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:53.209384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"117'24","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516808+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:42:42.516808+0000","last_peered":"2024-04-26T12:42:42.516808+0000","last_clean":"2024-04-26T12:42:42.516808+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:42:42.516808+0000","last_undegraded":"2024-04-26T12:42:42.516808+0000","last_fullsized":"2024-04-26T12:42:42.516808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"139'135","reported_seq":455,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.752218+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:42:44.752218+0000","last_peered":"2024-04-26T12:42:44.752218+0000","last_clean":"2024-04-26T12:42:44.752218+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:42:44.752218+0000","last_undegraded":"2024-04-26T12:42:44.752218+0000","last_fullsized":"2024-04-26T12:42:44.752218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071038+0000","last_change":"2024-04-26T12:38:20.516171+0000","last_active":"2024-04-26T12:42:41.071038+0000","last_peered":"2024-04-26T12:42:41.071038+0000","last_clean":"2024-04-26T12:42:41.071038+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:42:41.071038+0000","last_undegraded":"2024-04-26T12:42:41.071038+0000","last_fullsized":"2024-04-26T12:42:41.071038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.481710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072483+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:42:41.072483+0000","last_peered":"2024-04-26T12:42:41.072483+0000","last_clean":"2024-04-26T12:42:41.072483+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:42:41.072483+0000","last_undegraded":"2024-04-26T12:42:41.072483+0000","last_fullsized":"2024-04-26T12:42:41.072483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:55:28.284458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'18","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122964+0000","last_change":"2024-04-26T12:42:21.959737+0000","last_active":"2024-04-26T12:42:42.122964+0000","last_peered":"2024-04-26T12:42:42.122964+0000","last_clean":"2024-04-26T12:42:42.122964+0000","last_became_active":"2024-04-26T12:42:21.959122+0000","last_became_peered":"2024-04-26T12:42:21.959122+0000","last_unstale":"2024-04-26T12:42:42.122964+0000","last_undegraded":"2024-04-26T12:42:42.122964+0000","last_fullsized":"2024-04-26T12:42:42.122964+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:53.425209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976180+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:42:41.976180+0000","last_peered":"2024-04-26T12:42:41.976180+0000","last_clean":"2024-04-26T12:42:41.976180+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:42:41.976180+0000","last_undegraded":"2024-04-26T12:42:41.976180+0000","last_fullsized":"2024-04-26T12:42:41.976180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:39.418411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"117'29","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070847+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:42:41.070847+0000","last_peered":"2024-04-26T12:42:41.070847+0000","last_clean":"2024-04-26T12:42:41.070847+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:42:41.070847+0000","last_undegraded":"2024-04-26T12:42:41.070847+0000","last_fullsized":"2024-04-26T12:42:41.070847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:02.854006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975732+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:42:41.975732+0000","last_peered":"2024-04-26T12:42:41.975732+0000","last_clean":"2024-04-26T12:42:41.975732+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:42:41.975732+0000","last_undegraded":"2024-04-26T12:42:41.975732+0000","last_fullsized":"2024-04-26T12:42:41.975732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:25.902236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'7","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409967+0000","last_change":"2024-04-26T12:42:21.935665+0000","last_active":"2024-04-26T12:42:41.409967+0000","last_peered":"2024-04-26T12:42:41.409967+0000","last_clean":"2024-04-26T12:42:41.409967+0000","last_became_active":"2024-04-26T12:42:21.934686+0000","last_became_peered":"2024-04-26T12:42:21.934686+0000","last_unstale":"2024-04-26T12:42:41.409967+0000","last_undegraded":"2024-04-26T12:42:41.409967+0000","last_fullsized":"2024-04-26T12:42:41.409967+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:39.070102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"117'4","reported_seq":230,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067873+0000","last_change":"2024-04-26T12:42:34.032506+0000","last_active":"2024-04-26T12:42:41.067873+0000","last_peered":"2024-04-26T12:42:41.067873+0000","last_clean":"2024-04-26T12:42:41.067873+0000","last_became_active":"2024-04-26T12:42:34.031776+0000","last_became_peered":"2024-04-26T12:42:34.031776+0000","last_unstale":"2024-04-26T12:42:41.067873+0000","last_undegraded":"2024-04-26T12:42:41.067873+0000","last_fullsized":"2024-04-26T12:42:41.067873+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:40.297834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'26","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069641+0000","last_change":"2024-04-26T12:42:21.974477+0000","last_active":"2024-04-26T12:42:41.069641+0000","last_peered":"2024-04-26T12:42:41.069641+0000","last_clean":"2024-04-26T12:42:41.069641+0000","last_became_active":"2024-04-26T12:42:21.967072+0000","last_became_peered":"2024-04-26T12:42:21.967072+0000","last_unstale":"2024-04-26T12:42:41.069641+0000","last_undegraded":"2024-04-26T12:42:41.069641+0000","last_fullsized":"2024-04-26T12:42:41.069641+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.202160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976323+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:42:41.976323+0000","last_peered":"2024-04-26T12:42:41.976323+0000","last_clean":"2024-04-26T12:42:41.976323+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:42:41.976323+0000","last_undegraded":"2024-04-26T12:42:41.976323+0000","last_fullsized":"2024-04-26T12:42:41.976323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:29.161348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"117'19","reported_seq":65,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066738+0000","last_change":"2024-04-26T12:42:34.028589+0000","last_active":"2024-04-26T12:42:41.066738+0000","last_peered":"2024-04-26T12:42:41.066738+0000","last_clean":"2024-04-26T12:42:41.066738+0000","last_became_active":"2024-04-26T12:42:34.027524+0000","last_became_peered":"2024-04-26T12:42:34.027524+0000","last_unstale":"2024-04-26T12:42:41.066738+0000","last_undegraded":"2024-04-26T12:42:41.066738+0000","last_fullsized":"2024-04-26T12:42:41.066738+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:11.088686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070014+0000","last_change":"2024-04-26T12:42:21.938337+0000","last_active":"2024-04-26T12:42:41.070014+0000","last_peered":"2024-04-26T12:42:41.070014+0000","last_clean":"2024-04-26T12:42:41.070014+0000","last_became_active":"2024-04-26T12:42:21.937057+0000","last_became_peered":"2024-04-26T12:42:21.937057+0000","last_unstale":"2024-04-26T12:42:41.070014+0000","last_undegraded":"2024-04-26T12:42:41.070014+0000","last_fullsized":"2024-04-26T12:42:41.070014+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:16.894082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072835+0000","last_change":"2024-04-26T12:42:21.957634+0000","last_active":"2024-04-26T12:42:41.072835+0000","last_peered":"2024-04-26T12:42:41.072835+0000","last_clean":"2024-04-26T12:42:41.072835+0000","last_became_active":"2024-04-26T12:42:21.948878+0000","last_became_peered":"2024-04-26T12:42:21.948878+0000","last_unstale":"2024-04-26T12:42:41.072835+0000","last_undegraded":"2024-04-26T12:42:41.072835+0000","last_fullsized":"2024-04-26T12:42:41.072835+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:38.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067852+0000","last_change":"2024-04-26T12:42:34.019680+0000","last_active":"2024-04-26T12:42:41.067852+0000","last_peered":"2024-04-26T12:42:41.067852+0000","last_clean":"2024-04-26T12:42:41.067852+0000","last_became_active":"2024-04-26T12:42:34.018540+0000","last_became_peered":"2024-04-26T12:42:34.018540+0000","last_unstale":"2024-04-26T12:42:41.067852+0000","last_undegraded":"2024-04-26T12:42:41.067852+0000","last_fullsized":"2024-04-26T12:42:41.067852+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:44.798659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'20","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514187+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:42:42.514187+0000","last_peered":"2024-04-26T12:42:42.514187+0000","last_clean":"2024-04-26T12:42:42.514187+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:42:42.514187+0000","last_undegraded":"2024-04-26T12:42:42.514187+0000","last_fullsized":"2024-04-26T12:42:42.514187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408883+0000","last_change":"2024-04-26T12:38:14.458650+0000","last_active":"2024-04-26T12:42:41.408883+0000","last_peered":"2024-04-26T12:42:41.408883+0000","last_clean":"2024-04-26T12:42:41.408883+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:42:41.408883+0000","last_undegraded":"2024-04-26T12:42:41.408883+0000","last_fullsized":"2024-04-26T12:42:41.408883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:55.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"117'23","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977855+0000","last_change":"2024-04-26T12:42:21.959840+0000","last_active":"2024-04-26T12:42:41.977855+0000","last_peered":"2024-04-26T12:42:41.977855+0000","last_clean":"2024-04-26T12:42:41.977855+0000","last_became_active":"2024-04-26T12:42:21.958977+0000","last_became_peered":"2024-04-26T12:42:21.958977+0000","last_unstale":"2024-04-26T12:42:41.977855+0000","last_undegraded":"2024-04-26T12:42:41.977855+0000","last_fullsized":"2024-04-26T12:42:41.977855+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:54.837056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"139'135","reported_seq":440,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:45.557364+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:42:45.557364+0000","last_peered":"2024-04-26T12:42:45.557364+0000","last_clean":"2024-04-26T12:42:45.557364+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:42:45.557364+0000","last_undegraded":"2024-04-26T12:42:45.557364+0000","last_fullsized":"2024-04-26T12:42:45.557364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:57.858674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408500+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:42:41.408500+0000","last_peered":"2024-04-26T12:42:41.408500+0000","last_clean":"2024-04-26T12:42:41.408500+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:42:41.408500+0000","last_undegraded":"2024-04-26T12:42:41.408500+0000","last_fullsized":"2024-04-26T12:42:41.408500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:23.155573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":180,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068000+0000","last_change":"2024-04-26T12:42:34.026595+0000","last_active":"2024-04-26T12:42:41.068000+0000","last_peered":"2024-04-26T12:42:41.068000+0000","last_clean":"2024-04-26T12:42:41.068000+0000","last_became_active":"2024-04-26T12:42:34.025094+0000","last_became_peered":"2024-04-26T12:42:34.025094+0000","last_unstale":"2024-04-26T12:42:41.068000+0000","last_undegraded":"2024-04-26T12:42:41.068000+0000","last_fullsized":"2024-04-26T12:42:41.068000+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:15.877357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"117'35","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066995+0000","last_change":"2024-04-26T12:42:34.021002+0000","last_active":"2024-04-26T12:42:41.066995+0000","last_peered":"2024-04-26T12:42:41.066995+0000","last_clean":"2024-04-26T12:42:41.066995+0000","last_became_active":"2024-04-26T12:42:34.019821+0000","last_became_peered":"2024-04-26T12:42:34.019821+0000","last_unstale":"2024-04-26T12:42:41.066995+0000","last_undegraded":"2024-04-26T12:42:41.066995+0000","last_fullsized":"2024-04-26T12:42:41.066995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:02.705267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":426,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123009+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:42:42.123009+0000","last_peered":"2024-04-26T12:42:42.123009+0000","last_clean":"2024-04-26T12:42:42.123009+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:42:42.123009+0000","last_undegraded":"2024-04-26T12:42:42.123009+0000","last_fullsized":"2024-04-26T12:42:42.123009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073443+0000","last_change":"2024-04-26T12:42:21.962837+0000","last_active":"2024-04-26T12:42:41.073443+0000","last_peered":"2024-04-26T12:42:41.073443+0000","last_clean":"2024-04-26T12:42:41.073443+0000","last_became_active":"2024-04-26T12:42:21.952480+0000","last_became_peered":"2024-04-26T12:42:21.952480+0000","last_unstale":"2024-04-26T12:42:41.073443+0000","last_undegraded":"2024-04-26T12:42:41.073443+0000","last_fullsized":"2024-04-26T12:42:41.073443+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:55.807987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"139'135","reported_seq":472,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:45.559133+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:42:45.559133+0000","last_peered":"2024-04-26T12:42:45.559133+0000","last_clean":"2024-04-26T12:42:45.559133+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:42:45.559133+0000","last_undegraded":"2024-04-26T12:42:45.559133+0000","last_fullsized":"2024-04-26T12:42:45.559133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066666+0000","last_change":"2024-04-26T12:42:34.020098+0000","last_active":"2024-04-26T12:42:41.066666+0000","last_peered":"2024-04-26T12:42:41.066666+0000","last_clean":"2024-04-26T12:42:41.066666+0000","last_became_active":"2024-04-26T12:42:34.015095+0000","last_became_peered":"2024-04-26T12:42:34.015095+0000","last_unstale":"2024-04-26T12:42:41.066666+0000","last_undegraded":"2024-04-26T12:42:41.066666+0000","last_fullsized":"2024-04-26T12:42:41.066666+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:05.746648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410249+0000","last_change":"2024-04-26T12:42:21.953982+0000","last_active":"2024-04-26T12:42:41.410249+0000","last_peered":"2024-04-26T12:42:41.410249+0000","last_clean":"2024-04-26T12:42:41.410249+0000","last_became_active":"2024-04-26T12:42:21.953253+0000","last_became_peered":"2024-04-26T12:42:21.953253+0000","last_unstale":"2024-04-26T12:42:41.410249+0000","last_undegraded":"2024-04-26T12:42:41.410249+0000","last_fullsized":"2024-04-26T12:42:41.410249+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:23:24.067594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"115'20","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067138+0000","last_change":"2024-04-26T12:42:21.949610+0000","last_active":"2024-04-26T12:42:41.067138+0000","last_peered":"2024-04-26T12:42:41.067138+0000","last_clean":"2024-04-26T12:42:41.067138+0000","last_became_active":"2024-04-26T12:42:21.940512+0000","last_became_peered":"2024-04-26T12:42:21.940512+0000","last_unstale":"2024-04-26T12:42:41.067138+0000","last_undegraded":"2024-04-26T12:42:41.067138+0000","last_fullsized":"2024-04-26T12:42:41.067138+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:19.966458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067393+0000","last_change":"2024-04-26T12:42:34.007412+0000","last_active":"2024-04-26T12:42:41.067393+0000","last_peered":"2024-04-26T12:42:41.067393+0000","last_clean":"2024-04-26T12:42:41.067393+0000","last_became_active":"2024-04-26T12:42:34.005897+0000","last_became_peered":"2024-04-26T12:42:34.005897+0000","last_unstale":"2024-04-26T12:42:41.067393+0000","last_undegraded":"2024-04-26T12:42:41.067393+0000","last_fullsized":"2024-04-26T12:42:41.067393+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:22.483984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"117'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123154+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:42:42.123154+0000","last_peered":"2024-04-26T12:42:42.123154+0000","last_clean":"2024-04-26T12:42:42.123154+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:42:42.123154+0000","last_undegraded":"2024-04-26T12:42:42.123154+0000","last_fullsized":"2024-04-26T12:42:42.123154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520237+0000","last_change":"2024-04-26T12:42:21.947536+0000","last_active":"2024-04-26T12:42:42.520237+0000","last_peered":"2024-04-26T12:42:42.520237+0000","last_clean":"2024-04-26T12:42:42.520237+0000","last_became_active":"2024-04-26T12:42:21.946663+0000","last_became_peered":"2024-04-26T12:42:21.946663+0000","last_unstale":"2024-04-26T12:42:42.520237+0000","last_undegraded":"2024-04-26T12:42:42.520237+0000","last_fullsized":"2024-04-26T12:42:42.520237+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:31.336436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":232,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408441+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:42:41.408441+0000","last_peered":"2024-04-26T12:42:41.408441+0000","last_clean":"2024-04-26T12:42:41.408441+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:42:41.408441+0000","last_undegraded":"2024-04-26T12:42:41.408441+0000","last_fullsized":"2024-04-26T12:42:41.408441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:19.030638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520346+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:42:42.520346+0000","last_peered":"2024-04-26T12:42:42.520346+0000","last_clean":"2024-04-26T12:42:42.520346+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:42:42.520346+0000","last_undegraded":"2024-04-26T12:42:42.520346+0000","last_fullsized":"2024-04-26T12:42:42.520346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":406,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516883+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:42:42.516883+0000","last_peered":"2024-04-26T12:42:42.516883+0000","last_clean":"2024-04-26T12:42:42.516883+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:42:42.516883+0000","last_undegraded":"2024-04-26T12:42:42.516883+0000","last_fullsized":"2024-04-26T12:42:42.516883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122546+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:42:42.122546+0000","last_peered":"2024-04-26T12:42:42.122546+0000","last_clean":"2024-04-26T12:42:42.122546+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:42:42.122546+0000","last_undegraded":"2024-04-26T12:42:42.122546+0000","last_fullsized":"2024-04-26T12:42:42.122546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"117'33","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067725+0000","last_change":"2024-04-26T12:42:21.931544+0000","last_active":"2024-04-26T12:42:41.067725+0000","last_peered":"2024-04-26T12:42:41.067725+0000","last_clean":"2024-04-26T12:42:41.067725+0000","last_became_active":"2024-04-26T12:42:21.929093+0000","last_became_peered":"2024-04-26T12:42:21.929093+0000","last_unstale":"2024-04-26T12:42:41.067725+0000","last_undegraded":"2024-04-26T12:42:41.067725+0000","last_fullsized":"2024-04-26T12:42:41.067725+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:06.052469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518900+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:42:42.518900+0000","last_peered":"2024-04-26T12:42:42.518900+0000","last_clean":"2024-04-26T12:42:42.518900+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:42:42.518900+0000","last_undegraded":"2024-04-26T12:42:42.518900+0000","last_fullsized":"2024-04-26T12:42:42.518900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"117'39","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123490+0000","last_change":"2024-04-26T12:42:21.932409+0000","last_active":"2024-04-26T12:42:42.123490+0000","last_peered":"2024-04-26T12:42:42.123490+0000","last_clean":"2024-04-26T12:42:42.123490+0000","last_became_active":"2024-04-26T12:42:21.931114+0000","last_became_peered":"2024-04-26T12:42:21.931114+0000","last_unstale":"2024-04-26T12:42:42.123490+0000","last_undegraded":"2024-04-26T12:42:42.123490+0000","last_fullsized":"2024-04-26T12:42:42.123490+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:31.083567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182602,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071191+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:42:41.071191+0000","last_peered":"2024-04-26T12:42:41.071191+0000","last_clean":"2024-04-26T12:42:41.071191+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:42:41.071191+0000","last_undegraded":"2024-04-26T12:42:41.071191+0000","last_fullsized":"2024-04-26T12:42:41.071191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:29.397583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517357+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:42:42.517357+0000","last_peered":"2024-04-26T12:42:42.517357+0000","last_clean":"2024-04-26T12:42:42.517357+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:42:42.517357+0000","last_undegraded":"2024-04-26T12:42:42.517357+0000","last_fullsized":"2024-04-26T12:42:42.517357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071947+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:42:41.071947+0000","last_peered":"2024-04-26T12:42:41.071947+0000","last_clean":"2024-04-26T12:42:41.071947+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:42:41.071947+0000","last_undegraded":"2024-04-26T12:42:41.071947+0000","last_fullsized":"2024-04-26T12:42:41.071947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:38.050152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516595+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:42:42.516595+0000","last_peered":"2024-04-26T12:42:42.516595+0000","last_clean":"2024-04-26T12:42:42.516595+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:42:42.516595+0000","last_undegraded":"2024-04-26T12:42:42.516595+0000","last_fullsized":"2024-04-26T12:42:42.516595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"115'18","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071136+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:42:41.071136+0000","last_peered":"2024-04-26T12:42:41.071136+0000","last_clean":"2024-04-26T12:42:41.071136+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:42:41.071136+0000","last_undegraded":"2024-04-26T12:42:41.071136+0000","last_fullsized":"2024-04-26T12:42:41.071136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123676+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:42:42.123676+0000","last_peered":"2024-04-26T12:42:42.123676+0000","last_clean":"2024-04-26T12:42:42.123676+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:42:42.123676+0000","last_undegraded":"2024-04-26T12:42:42.123676+0000","last_fullsized":"2024-04-26T12:42:42.123676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"139'137","reported_seq":493,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.752091+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:42:44.752091+0000","last_peered":"2024-04-26T12:42:44.752091+0000","last_clean":"2024-04-26T12:42:44.752091+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:42:44.752091+0000","last_undegraded":"2024-04-26T12:42:44.752091+0000","last_fullsized":"2024-04-26T12:42:44.752091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:38.808455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4901,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514992+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:42:42.514992+0000","last_peered":"2024-04-26T12:42:42.514992+0000","last_clean":"2024-04-26T12:42:42.514992+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:42:42.514992+0000","last_undegraded":"2024-04-26T12:42:42.514992+0000","last_fullsized":"2024-04-26T12:42:42.514992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"117'2","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408083+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:42:41.408083+0000","last_peered":"2024-04-26T12:42:41.408083+0000","last_clean":"2024-04-26T12:42:41.408083+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:42:41.408083+0000","last_undegraded":"2024-04-26T12:42:41.408083+0000","last_fullsized":"2024-04-26T12:42:41.408083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:58.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410330+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:42:41.410330+0000","last_peered":"2024-04-26T12:42:41.410330+0000","last_clean":"2024-04-26T12:42:41.410330+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:42:41.410330+0000","last_undegraded":"2024-04-26T12:42:41.410330+0000","last_fullsized":"2024-04-26T12:42:41.410330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:39.796538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977561+0000","last_change":"2024-04-26T12:42:21.939098+0000","last_active":"2024-04-26T12:42:41.977561+0000","last_peered":"2024-04-26T12:42:41.977561+0000","last_clean":"2024-04-26T12:42:41.977561+0000","last_became_active":"2024-04-26T12:42:21.938117+0000","last_became_peered":"2024-04-26T12:42:21.938117+0000","last_unstale":"2024-04-26T12:42:41.977561+0000","last_undegraded":"2024-04-26T12:42:41.977561+0000","last_fullsized":"2024-04-26T12:42:41.977561+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:15.636096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'34","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408092+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:42:41.408092+0000","last_peered":"2024-04-26T12:42:41.408092+0000","last_clean":"2024-04-26T12:42:41.408092+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:42:41.408092+0000","last_undegraded":"2024-04-26T12:42:41.408092+0000","last_fullsized":"2024-04-26T12:42:41.408092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":44,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":335,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976702+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:42:41.976702+0000","last_peered":"2024-04-26T12:42:41.976702+0000","last_clean":"2024-04-26T12:42:41.976702+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:42:41.976702+0000","last_undegraded":"2024-04-26T12:42:41.976702+0000","last_fullsized":"2024-04-26T12:42:41.976702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.455313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"139'18","reported_seq":316,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.750561+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:42:44.750561+0000","last_peered":"2024-04-26T12:42:44.750561+0000","last_clean":"2024-04-26T12:42:44.750561+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:42:44.750561+0000","last_undegraded":"2024-04-26T12:42:44.750561+0000","last_fullsized":"2024-04-26T12:42:44.750561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069911+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:42:41.069911+0000","last_peered":"2024-04-26T12:42:41.069911+0000","last_clean":"2024-04-26T12:42:41.069911+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:42:41.069911+0000","last_undegraded":"2024-04-26T12:42:41.069911+0000","last_fullsized":"2024-04-26T12:42:41.069911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:50.203114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070589+0000","last_change":"2024-04-26T12:42:21.942734+0000","last_active":"2024-04-26T12:42:41.070589+0000","last_peered":"2024-04-26T12:42:41.070589+0000","last_clean":"2024-04-26T12:42:41.070589+0000","last_became_active":"2024-04-26T12:42:21.928602+0000","last_became_peered":"2024-04-26T12:42:21.928602+0000","last_unstale":"2024-04-26T12:42:41.070589+0000","last_undegraded":"2024-04-26T12:42:41.070589+0000","last_fullsized":"2024-04-26T12:42:41.070589+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:45.167813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409089+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:42:41.409089+0000","last_peered":"2024-04-26T12:42:41.409089+0000","last_clean":"2024-04-26T12:42:41.409089+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:42:41.409089+0000","last_undegraded":"2024-04-26T12:42:41.409089+0000","last_fullsized":"2024-04-26T12:42:41.409089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122667+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:42:42.122667+0000","last_peered":"2024-04-26T12:42:42.122667+0000","last_clean":"2024-04-26T12:42:42.122667+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:42:42.122667+0000","last_undegraded":"2024-04-26T12:42:42.122667+0000","last_fullsized":"2024-04-26T12:42:42.122667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'18","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067370+0000","last_change":"2024-04-26T12:42:34.006811+0000","last_active":"2024-04-26T12:42:41.067370+0000","last_peered":"2024-04-26T12:42:41.067370+0000","last_clean":"2024-04-26T12:42:41.067370+0000","last_became_active":"2024-04-26T12:42:34.004041+0000","last_became_peered":"2024-04-26T12:42:34.004041+0000","last_unstale":"2024-04-26T12:42:41.067370+0000","last_undegraded":"2024-04-26T12:42:41.067370+0000","last_fullsized":"2024-04-26T12:42:41.067370+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:08.613547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069460+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:42:41.069460+0000","last_peered":"2024-04-26T12:42:41.069460+0000","last_clean":"2024-04-26T12:42:41.069460+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:42:41.069460+0000","last_undegraded":"2024-04-26T12:42:41.069460+0000","last_fullsized":"2024-04-26T12:42:41.069460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073574+0000","last_change":"2024-04-26T12:42:21.946073+0000","last_active":"2024-04-26T12:42:41.073574+0000","last_peered":"2024-04-26T12:42:41.073574+0000","last_clean":"2024-04-26T12:42:41.073574+0000","last_became_active":"2024-04-26T12:42:21.942937+0000","last_became_peered":"2024-04-26T12:42:21.942937+0000","last_unstale":"2024-04-26T12:42:41.073574+0000","last_undegraded":"2024-04-26T12:42:41.073574+0000","last_fullsized":"2024-04-26T12:42:41.073574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:30.907752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515300+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:42:42.515300+0000","last_peered":"2024-04-26T12:42:42.515300+0000","last_clean":"2024-04-26T12:42:42.515300+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:42:42.515300+0000","last_undegraded":"2024-04-26T12:42:42.515300+0000","last_fullsized":"2024-04-26T12:42:42.515300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121144+0000","last_change":"2024-04-26T12:42:21.942893+0000","last_active":"2024-04-26T12:42:42.121144+0000","last_peered":"2024-04-26T12:42:42.121144+0000","last_clean":"2024-04-26T12:42:42.121144+0000","last_became_active":"2024-04-26T12:42:21.941954+0000","last_became_peered":"2024-04-26T12:42:21.941954+0000","last_unstale":"2024-04-26T12:42:42.121144+0000","last_undegraded":"2024-04-26T12:42:42.121144+0000","last_fullsized":"2024-04-26T12:42:42.121144+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408457+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:42:41.408457+0000","last_peered":"2024-04-26T12:42:41.408457+0000","last_clean":"2024-04-26T12:42:41.408457+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:42:41.408457+0000","last_undegraded":"2024-04-26T12:42:41.408457+0000","last_fullsized":"2024-04-26T12:42:41.408457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'26","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.124036+0000","last_change":"2024-04-26T12:42:21.924370+0000","last_active":"2024-04-26T12:42:42.124036+0000","last_peered":"2024-04-26T12:42:42.124036+0000","last_clean":"2024-04-26T12:42:42.124036+0000","last_became_active":"2024-04-26T12:42:21.923345+0000","last_became_peered":"2024-04-26T12:42:21.923345+0000","last_unstale":"2024-04-26T12:42:42.124036+0000","last_undegraded":"2024-04-26T12:42:42.124036+0000","last_fullsized":"2024-04-26T12:42:42.124036+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:11.162289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409328+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:42:41.409328+0000","last_peered":"2024-04-26T12:42:41.409328+0000","last_clean":"2024-04-26T12:42:41.409328+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:42:41.409328+0000","last_undegraded":"2024-04-26T12:42:41.409328+0000","last_fullsized":"2024-04-26T12:42:41.409328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071121+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:42:41.071121+0000","last_peered":"2024-04-26T12:42:41.071121+0000","last_clean":"2024-04-26T12:42:41.071121+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:42:41.071121+0000","last_undegraded":"2024-04-26T12:42:41.071121+0000","last_fullsized":"2024-04-26T12:42:41.071121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"117'34","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071421+0000","last_change":"2024-04-26T12:42:21.957374+0000","last_active":"2024-04-26T12:42:41.071421+0000","last_peered":"2024-04-26T12:42:41.071421+0000","last_clean":"2024-04-26T12:42:41.071421+0000","last_became_active":"2024-04-26T12:42:21.956451+0000","last_became_peered":"2024-04-26T12:42:21.956451+0000","last_unstale":"2024-04-26T12:42:41.071421+0000","last_undegraded":"2024-04-26T12:42:41.071421+0000","last_fullsized":"2024-04-26T12:42:41.071421+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:20.865765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":204,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065521+0000","last_change":"2024-04-26T12:42:34.015627+0000","last_active":"2024-04-26T12:42:41.065521+0000","last_peered":"2024-04-26T12:42:41.065521+0000","last_clean":"2024-04-26T12:42:41.065521+0000","last_became_active":"2024-04-26T12:42:34.014949+0000","last_became_peered":"2024-04-26T12:42:34.014949+0000","last_unstale":"2024-04-26T12:42:41.065521+0000","last_undegraded":"2024-04-26T12:42:41.065521+0000","last_fullsized":"2024-04-26T12:42:41.065521+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:46.390226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070165+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:42:41.070165+0000","last_peered":"2024-04-26T12:42:41.070165+0000","last_clean":"2024-04-26T12:42:41.070165+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:42:41.070165+0000","last_undegraded":"2024-04-26T12:42:41.070165+0000","last_fullsized":"2024-04-26T12:42:41.070165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:21.785380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072305+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:42:41.072305+0000","last_peered":"2024-04-26T12:42:41.072305+0000","last_clean":"2024-04-26T12:42:41.072305+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:42:41.072305+0000","last_undegraded":"2024-04-26T12:42:41.072305+0000","last_fullsized":"2024-04-26T12:42:41.072305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'31","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409224+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:42:41.409224+0000","last_peered":"2024-04-26T12:42:41.409224+0000","last_clean":"2024-04-26T12:42:41.409224+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:42:41.409224+0000","last_undegraded":"2024-04-26T12:42:41.409224+0000","last_fullsized":"2024-04-26T12:42:41.409224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519825+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:42:42.519825+0000","last_peered":"2024-04-26T12:42:42.519825+0000","last_clean":"2024-04-26T12:42:42.519825+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:42:42.519825+0000","last_undegraded":"2024-04-26T12:42:42.519825+0000","last_fullsized":"2024-04-26T12:42:42.519825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518456+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:42:42.518456+0000","last_peered":"2024-04-26T12:42:42.518456+0000","last_clean":"2024-04-26T12:42:42.518456+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:42:42.518456+0000","last_undegraded":"2024-04-26T12:42:42.518456+0000","last_fullsized":"2024-04-26T12:42:42.518456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408014+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:42:41.408014+0000","last_peered":"2024-04-26T12:42:41.408014+0000","last_clean":"2024-04-26T12:42:41.408014+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:42:41.408014+0000","last_undegraded":"2024-04-26T12:42:41.408014+0000","last_fullsized":"2024-04-26T12:42:41.408014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:32.551534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"139'135","reported_seq":427,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751022+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:42:44.751022+0000","last_peered":"2024-04-26T12:42:44.751022+0000","last_clean":"2024-04-26T12:42:44.751022+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:42:44.751022+0000","last_undegraded":"2024-04-26T12:42:44.751022+0000","last_fullsized":"2024-04-26T12:42:44.751022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073784+0000","last_change":"2024-04-26T12:42:21.962241+0000","last_active":"2024-04-26T12:42:41.073784+0000","last_peered":"2024-04-26T12:42:41.073784+0000","last_clean":"2024-04-26T12:42:41.073784+0000","last_became_active":"2024-04-26T12:42:21.960618+0000","last_became_peered":"2024-04-26T12:42:21.960618+0000","last_unstale":"2024-04-26T12:42:41.073784+0000","last_undegraded":"2024-04-26T12:42:41.073784+0000","last_fullsized":"2024-04-26T12:42:41.073784+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:39.076778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067522+0000","last_change":"2024-04-26T12:42:21.965811+0000","last_active":"2024-04-26T12:42:41.067522+0000","last_peered":"2024-04-26T12:42:41.067522+0000","last_clean":"2024-04-26T12:42:41.067522+0000","last_became_active":"2024-04-26T12:42:21.960998+0000","last_became_peered":"2024-04-26T12:42:21.960998+0000","last_unstale":"2024-04-26T12:42:41.067522+0000","last_undegraded":"2024-04-26T12:42:41.067522+0000","last_fullsized":"2024-04-26T12:42:41.067522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.081118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"116'27","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074564+0000","last_change":"2024-04-26T12:42:21.971344+0000","last_active":"2024-04-26T12:42:41.074564+0000","last_peered":"2024-04-26T12:42:41.074564+0000","last_clean":"2024-04-26T12:42:41.074564+0000","last_became_active":"2024-04-26T12:42:21.968901+0000","last_became_peered":"2024-04-26T12:42:21.968901+0000","last_unstale":"2024-04-26T12:42:41.074564+0000","last_undegraded":"2024-04-26T12:42:41.074564+0000","last_fullsized":"2024-04-26T12:42:41.074564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:04.596971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409908+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:42:41.409908+0000","last_peered":"2024-04-26T12:42:41.409908+0000","last_clean":"2024-04-26T12:42:41.409908+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:42:41.409908+0000","last_undegraded":"2024-04-26T12:42:41.409908+0000","last_fullsized":"2024-04-26T12:42:41.409908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065795+0000","last_change":"2024-04-26T12:42:34.016582+0000","last_active":"2024-04-26T12:42:41.065795+0000","last_peered":"2024-04-26T12:42:41.065795+0000","last_clean":"2024-04-26T12:42:41.065795+0000","last_became_active":"2024-04-26T12:42:34.015774+0000","last_became_peered":"2024-04-26T12:42:34.015774+0000","last_unstale":"2024-04-26T12:42:41.065795+0000","last_undegraded":"2024-04-26T12:42:41.065795+0000","last_fullsized":"2024-04-26T12:42:41.065795+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:09.670527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":71,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067390+0000","last_change":"2024-04-26T12:42:34.031336+0000","last_active":"2024-04-26T12:42:41.067390+0000","last_peered":"2024-04-26T12:42:41.067390+0000","last_clean":"2024-04-26T12:42:41.067390+0000","last_became_active":"2024-04-26T12:42:34.029037+0000","last_became_peered":"2024-04-26T12:42:34.029037+0000","last_unstale":"2024-04-26T12:42:41.067390+0000","last_undegraded":"2024-04-26T12:42:41.067390+0000","last_fullsized":"2024-04-26T12:42:41.067390+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:10.304468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"139'137","reported_seq":414,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751750+0000","last_change":"2024-04-26T12:42:21.972386+0000","last_active":"2024-04-26T12:42:44.751750+0000","last_peered":"2024-04-26T12:42:44.751750+0000","last_clean":"2024-04-26T12:42:44.751750+0000","last_became_active":"2024-04-26T12:42:21.962332+0000","last_became_peered":"2024-04-26T12:42:21.962332+0000","last_unstale":"2024-04-26T12:42:44.751750+0000","last_undegraded":"2024-04-26T12:42:44.751750+0000","last_fullsized":"2024-04-26T12:42:44.751750+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:50.916736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071272+0000","last_change":"2024-04-26T12:42:21.957370+0000","last_active":"2024-04-26T12:42:41.071272+0000","last_peered":"2024-04-26T12:42:41.071272+0000","last_clean":"2024-04-26T12:42:41.071272+0000","last_became_active":"2024-04-26T12:42:21.956715+0000","last_became_peered":"2024-04-26T12:42:21.956715+0000","last_unstale":"2024-04-26T12:42:41.071272+0000","last_undegraded":"2024-04-26T12:42:41.071272+0000","last_fullsized":"2024-04-26T12:42:41.071272+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:22.834872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066049+0000","last_change":"2024-04-26T12:42:34.013472+0000","last_active":"2024-04-26T12:42:41.066049+0000","last_peered":"2024-04-26T12:42:41.066049+0000","last_clean":"2024-04-26T12:42:41.066049+0000","last_became_active":"2024-04-26T12:42:34.010800+0000","last_became_peered":"2024-04-26T12:42:34.010800+0000","last_unstale":"2024-04-26T12:42:41.066049+0000","last_undegraded":"2024-04-26T12:42:41.066049+0000","last_fullsized":"2024-04-26T12:42:41.066049+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:43.861494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"117'24","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072776+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:42:41.072776+0000","last_peered":"2024-04-26T12:42:41.072776+0000","last_clean":"2024-04-26T12:42:41.072776+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:42:41.072776+0000","last_undegraded":"2024-04-26T12:42:41.072776+0000","last_fullsized":"2024-04-26T12:42:41.072776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":34,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521218+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:42:42.521218+0000","last_peered":"2024-04-26T12:42:42.521218+0000","last_clean":"2024-04-26T12:42:42.521218+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:42:42.521218+0000","last_undegraded":"2024-04-26T12:42:42.521218+0000","last_fullsized":"2024-04-26T12:42:42.521218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068515+0000","last_change":"2024-04-26T12:42:21.941484+0000","last_active":"2024-04-26T12:42:41.068515+0000","last_peered":"2024-04-26T12:42:41.068515+0000","last_clean":"2024-04-26T12:42:41.068515+0000","last_became_active":"2024-04-26T12:42:21.926472+0000","last_became_peered":"2024-04-26T12:42:21.926472+0000","last_unstale":"2024-04-26T12:42:41.068515+0000","last_undegraded":"2024-04-26T12:42:41.068515+0000","last_fullsized":"2024-04-26T12:42:41.068515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.214353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"117'43","reported_seq":298,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519477+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:42:42.519477+0000","last_peered":"2024-04-26T12:42:42.519477+0000","last_clean":"2024-04-26T12:42:42.519477+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:42:42.519477+0000","last_undegraded":"2024-04-26T12:42:42.519477+0000","last_fullsized":"2024-04-26T12:42:42.519477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068343+0000","last_change":"2024-04-26T12:42:21.919160+0000","last_active":"2024-04-26T12:42:41.068343+0000","last_peered":"2024-04-26T12:42:41.068343+0000","last_clean":"2024-04-26T12:42:41.068343+0000","last_became_active":"2024-04-26T12:42:21.918031+0000","last_became_peered":"2024-04-26T12:42:21.918031+0000","last_unstale":"2024-04-26T12:42:41.068343+0000","last_undegraded":"2024-04-26T12:42:41.068343+0000","last_fullsized":"2024-04-26T12:42:41.068343+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:35.941555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122585+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:42:42.122585+0000","last_peered":"2024-04-26T12:42:42.122585+0000","last_clean":"2024-04-26T12:42:42.122585+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:42:42.122585+0000","last_undegraded":"2024-04-26T12:42:42.122585+0000","last_fullsized":"2024-04-26T12:42:42.122585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069566+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:42:41.069566+0000","last_peered":"2024-04-26T12:42:41.069566+0000","last_clean":"2024-04-26T12:42:41.069566+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:42:41.069566+0000","last_undegraded":"2024-04-26T12:42:41.069566+0000","last_fullsized":"2024-04-26T12:42:41.069566+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:19.357431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":186,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066912+0000","last_change":"2024-04-26T12:42:34.023953+0000","last_active":"2024-04-26T12:42:41.066912+0000","last_peered":"2024-04-26T12:42:41.066912+0000","last_clean":"2024-04-26T12:42:41.066912+0000","last_became_active":"2024-04-26T12:42:34.022792+0000","last_became_peered":"2024-04-26T12:42:34.022792+0000","last_unstale":"2024-04-26T12:42:41.066912+0000","last_undegraded":"2024-04-26T12:42:41.066912+0000","last_fullsized":"2024-04-26T12:42:41.066912+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:16.851419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'20","reported_seq":221,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066522+0000","last_change":"2024-04-26T12:42:34.012055+0000","last_active":"2024-04-26T12:42:41.066522+0000","last_peered":"2024-04-26T12:42:41.066522+0000","last_clean":"2024-04-26T12:42:41.066522+0000","last_became_active":"2024-04-26T12:42:34.008295+0000","last_became_peered":"2024-04-26T12:42:34.008295+0000","last_unstale":"2024-04-26T12:42:41.066522+0000","last_undegraded":"2024-04-26T12:42:41.066522+0000","last_fullsized":"2024-04-26T12:42:41.066522+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:59.626034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408588+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:42:41.408588+0000","last_peered":"2024-04-26T12:42:41.408588+0000","last_clean":"2024-04-26T12:42:41.408588+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:42:41.408588+0000","last_undegraded":"2024-04-26T12:42:41.408588+0000","last_fullsized":"2024-04-26T12:42:41.408588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070334+0000","last_change":"2024-04-26T12:42:21.967112+0000","last_active":"2024-04-26T12:42:41.070334+0000","last_peered":"2024-04-26T12:42:41.070334+0000","last_clean":"2024-04-26T12:42:41.070334+0000","last_became_active":"2024-04-26T12:42:21.964467+0000","last_became_peered":"2024-04-26T12:42:21.964467+0000","last_unstale":"2024-04-26T12:42:41.070334+0000","last_undegraded":"2024-04-26T12:42:41.070334+0000","last_fullsized":"2024-04-26T12:42:41.070334+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:41.170576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072547+0000","last_change":"2024-04-26T12:42:21.964141+0000","last_active":"2024-04-26T12:42:41.072547+0000","last_peered":"2024-04-26T12:42:41.072547+0000","last_clean":"2024-04-26T12:42:41.072547+0000","last_became_active":"2024-04-26T12:42:21.959360+0000","last_became_peered":"2024-04-26T12:42:21.959360+0000","last_unstale":"2024-04-26T12:42:41.072547+0000","last_undegraded":"2024-04-26T12:42:41.072547+0000","last_fullsized":"2024-04-26T12:42:41.072547+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:57.964968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074053+0000","last_change":"2024-04-26T12:42:21.970393+0000","last_active":"2024-04-26T12:42:41.074053+0000","last_peered":"2024-04-26T12:42:41.074053+0000","last_clean":"2024-04-26T12:42:41.074053+0000","last_became_active":"2024-04-26T12:42:21.968658+0000","last_became_peered":"2024-04-26T12:42:21.968658+0000","last_unstale":"2024-04-26T12:42:41.074053+0000","last_undegraded":"2024-04-26T12:42:41.074053+0000","last_fullsized":"2024-04-26T12:42:41.074053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:45.400045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408339+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:42:41.408339+0000","last_peered":"2024-04-26T12:42:41.408339+0000","last_clean":"2024-04-26T12:42:41.408339+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:42:41.408339+0000","last_undegraded":"2024-04-26T12:42:41.408339+0000","last_fullsized":"2024-04-26T12:42:41.408339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"117'23","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519528+0000","last_change":"2024-04-26T12:42:21.956317+0000","last_active":"2024-04-26T12:42:42.519528+0000","last_peered":"2024-04-26T12:42:42.519528+0000","last_clean":"2024-04-26T12:42:42.519528+0000","last_became_active":"2024-04-26T12:42:21.955428+0000","last_became_peered":"2024-04-26T12:42:21.955428+0000","last_unstale":"2024-04-26T12:42:42.519528+0000","last_undegraded":"2024-04-26T12:42:42.519528+0000","last_fullsized":"2024-04-26T12:42:42.519528+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:50.243608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067590+0000","last_change":"2024-04-26T12:42:21.973314+0000","last_active":"2024-04-26T12:42:41.067590+0000","last_peered":"2024-04-26T12:42:41.067590+0000","last_clean":"2024-04-26T12:42:41.067590+0000","last_became_active":"2024-04-26T12:42:21.964554+0000","last_became_peered":"2024-04-26T12:42:21.964554+0000","last_unstale":"2024-04-26T12:42:41.067590+0000","last_undegraded":"2024-04-26T12:42:41.067590+0000","last_fullsized":"2024-04-26T12:42:41.067590+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:20.524995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"120'9","reported_seq":250,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070910+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:42:41.070910+0000","last_peered":"2024-04-26T12:42:41.070910+0000","last_clean":"2024-04-26T12:42:41.070910+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:42:41.070910+0000","last_undegraded":"2024-04-26T12:42:41.070910+0000","last_fullsized":"2024-04-26T12:42:41.070910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517854+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:42:42.517854+0000","last_peered":"2024-04-26T12:42:42.517854+0000","last_clean":"2024-04-26T12:42:42.517854+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:42:42.517854+0000","last_undegraded":"2024-04-26T12:42:42.517854+0000","last_fullsized":"2024-04-26T12:42:42.517854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069199+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:42:41.069199+0000","last_peered":"2024-04-26T12:42:41.069199+0000","last_clean":"2024-04-26T12:42:41.069199+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:42:41.069199+0000","last_undegraded":"2024-04-26T12:42:41.069199+0000","last_fullsized":"2024-04-26T12:42:41.069199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069067+0000","last_change":"2024-04-26T12:42:21.967538+0000","last_active":"2024-04-26T12:42:41.069067+0000","last_peered":"2024-04-26T12:42:41.069067+0000","last_clean":"2024-04-26T12:42:41.069067+0000","last_became_active":"2024-04-26T12:42:21.965760+0000","last_became_peered":"2024-04-26T12:42:21.965760+0000","last_unstale":"2024-04-26T12:42:41.069067+0000","last_undegraded":"2024-04-26T12:42:41.069067+0000","last_fullsized":"2024-04-26T12:42:41.069067+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:34.724137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'27","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123766+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:42:42.123766+0000","last_peered":"2024-04-26T12:42:42.123766+0000","last_clean":"2024-04-26T12:42:42.123766+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:42:42.123766+0000","last_undegraded":"2024-04-26T12:42:42.123766+0000","last_fullsized":"2024-04-26T12:42:42.123766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516156+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:42:42.516156+0000","last_peered":"2024-04-26T12:42:42.516156+0000","last_clean":"2024-04-26T12:42:42.516156+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:42:42.516156+0000","last_undegraded":"2024-04-26T12:42:42.516156+0000","last_fullsized":"2024-04-26T12:42:42.516156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069367+0000","last_change":"2024-04-26T12:42:21.974557+0000","last_active":"2024-04-26T12:42:41.069367+0000","last_peered":"2024-04-26T12:42:41.069367+0000","last_clean":"2024-04-26T12:42:41.069367+0000","last_became_active":"2024-04-26T12:42:21.967735+0000","last_became_peered":"2024-04-26T12:42:21.967735+0000","last_unstale":"2024-04-26T12:42:41.069367+0000","last_undegraded":"2024-04-26T12:42:41.069367+0000","last_fullsized":"2024-04-26T12:42:41.069367+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:01.266925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514760+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:42:42.514760+0000","last_peered":"2024-04-26T12:42:42.514760+0000","last_clean":"2024-04-26T12:42:42.514760+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:42:42.514760+0000","last_undegraded":"2024-04-26T12:42:42.514760+0000","last_fullsized":"2024-04-26T12:42:42.514760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121837+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:42:42.121837+0000","last_peered":"2024-04-26T12:42:42.121837+0000","last_clean":"2024-04-26T12:42:42.121837+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:42:42.121837+0000","last_undegraded":"2024-04-26T12:42:42.121837+0000","last_fullsized":"2024-04-26T12:42:42.121837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068104+0000","last_change":"2024-04-26T12:42:21.946016+0000","last_active":"2024-04-26T12:42:41.068104+0000","last_peered":"2024-04-26T12:42:41.068104+0000","last_clean":"2024-04-26T12:42:41.068104+0000","last_became_active":"2024-04-26T12:42:21.927785+0000","last_became_peered":"2024-04-26T12:42:21.927785+0000","last_unstale":"2024-04-26T12:42:41.068104+0000","last_undegraded":"2024-04-26T12:42:41.068104+0000","last_fullsized":"2024-04-26T12:42:41.068104+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:08.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'20","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072117+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:42:41.072117+0000","last_peered":"2024-04-26T12:42:41.072117+0000","last_clean":"2024-04-26T12:42:41.072117+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:42:41.072117+0000","last_undegraded":"2024-04-26T12:42:41.072117+0000","last_fullsized":"2024-04-26T12:42:41.072117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:46.859329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518072+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:42:42.518072+0000","last_peered":"2024-04-26T12:42:42.518072+0000","last_clean":"2024-04-26T12:42:42.518072+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:42:42.518072+0000","last_undegraded":"2024-04-26T12:42:42.518072+0000","last_fullsized":"2024-04-26T12:42:42.518072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"117'20","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517863+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:42:42.517863+0000","last_peered":"2024-04-26T12:42:42.517863+0000","last_clean":"2024-04-26T12:42:42.517863+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:42:42.517863+0000","last_undegraded":"2024-04-26T12:42:42.517863+0000","last_fullsized":"2024-04-26T12:42:42.517863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068567+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:42:41.068567+0000","last_peered":"2024-04-26T12:42:41.068567+0000","last_clean":"2024-04-26T12:42:41.068567+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:42:41.068567+0000","last_undegraded":"2024-04-26T12:42:41.068567+0000","last_fullsized":"2024-04-26T12:42:41.068567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521075+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:42:42.521075+0000","last_peered":"2024-04-26T12:42:42.521075+0000","last_clean":"2024-04-26T12:42:42.521075+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:42:42.521075+0000","last_undegraded":"2024-04-26T12:42:42.521075+0000","last_fullsized":"2024-04-26T12:42:42.521075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'15","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067129+0000","last_change":"2024-04-26T12:42:21.967299+0000","last_active":"2024-04-26T12:42:41.067129+0000","last_peered":"2024-04-26T12:42:41.067129+0000","last_clean":"2024-04-26T12:42:41.067129+0000","last_became_active":"2024-04-26T12:42:21.964241+0000","last_became_peered":"2024-04-26T12:42:21.964241+0000","last_unstale":"2024-04-26T12:42:41.067129+0000","last_undegraded":"2024-04-26T12:42:41.067129+0000","last_fullsized":"2024-04-26T12:42:41.067129+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:24.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071446+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:42:41.071446+0000","last_peered":"2024-04-26T12:42:41.071446+0000","last_clean":"2024-04-26T12:42:41.071446+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:42:41.071446+0000","last_undegraded":"2024-04-26T12:42:41.071446+0000","last_fullsized":"2024-04-26T12:42:41.071446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:16.790248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"117'28","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409065+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:42:41.409065+0000","last_peered":"2024-04-26T12:42:41.409065+0000","last_clean":"2024-04-26T12:42:41.409065+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:42:41.409065+0000","last_undegraded":"2024-04-26T12:42:41.409065+0000","last_fullsized":"2024-04-26T12:42:41.409065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:55.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122126+0000","last_change":"2024-04-26T12:42:21.947268+0000","last_active":"2024-04-26T12:42:42.122126+0000","last_peered":"2024-04-26T12:42:42.122126+0000","last_clean":"2024-04-26T12:42:42.122126+0000","last_became_active":"2024-04-26T12:42:21.946664+0000","last_became_peered":"2024-04-26T12:42:21.946664+0000","last_unstale":"2024-04-26T12:42:42.122126+0000","last_undegraded":"2024-04-26T12:42:42.122126+0000","last_fullsized":"2024-04-26T12:42:42.122126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:21.575803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067833+0000","last_change":"2024-04-26T12:42:21.973393+0000","last_active":"2024-04-26T12:42:41.067833+0000","last_peered":"2024-04-26T12:42:41.067833+0000","last_clean":"2024-04-26T12:42:41.067833+0000","last_became_active":"2024-04-26T12:42:21.963727+0000","last_became_peered":"2024-04-26T12:42:21.963727+0000","last_unstale":"2024-04-26T12:42:41.067833+0000","last_undegraded":"2024-04-26T12:42:41.067833+0000","last_fullsized":"2024-04-26T12:42:41.067833+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:52.960136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072465+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:42:41.072465+0000","last_peered":"2024-04-26T12:42:41.072465+0000","last_clean":"2024-04-26T12:42:41.072465+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:42:41.072465+0000","last_undegraded":"2024-04-26T12:42:41.072465+0000","last_fullsized":"2024-04-26T12:42:41.072465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'32","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408983+0000","last_change":"2024-04-26T12:42:21.934786+0000","last_active":"2024-04-26T12:42:41.408983+0000","last_peered":"2024-04-26T12:42:41.408983+0000","last_clean":"2024-04-26T12:42:41.408983+0000","last_became_active":"2024-04-26T12:42:21.933941+0000","last_became_peered":"2024-04-26T12:42:21.933941+0000","last_unstale":"2024-04-26T12:42:41.408983+0000","last_undegraded":"2024-04-26T12:42:41.408983+0000","last_fullsized":"2024-04-26T12:42:41.408983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:56.359990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520965+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:42:42.520965+0000","last_peered":"2024-04-26T12:42:42.520965+0000","last_clean":"2024-04-26T12:42:42.520965+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:42:42.520965+0000","last_undegraded":"2024-04-26T12:42:42.520965+0000","last_fullsized":"2024-04-26T12:42:42.520965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"117'23","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518241+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:42:42.518241+0000","last_peered":"2024-04-26T12:42:42.518241+0000","last_clean":"2024-04-26T12:42:42.518241+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:42:42.518241+0000","last_undegraded":"2024-04-26T12:42:42.518241+0000","last_fullsized":"2024-04-26T12:42:42.518241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409160+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:42:41.409160+0000","last_peered":"2024-04-26T12:42:41.409160+0000","last_clean":"2024-04-26T12:42:41.409160+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:42:41.409160+0000","last_undegraded":"2024-04-26T12:42:41.409160+0000","last_fullsized":"2024-04-26T12:42:41.409160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:44.663947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518124+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:42:42.518124+0000","last_peered":"2024-04-26T12:42:42.518124+0000","last_clean":"2024-04-26T12:42:42.518124+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:42:42.518124+0000","last_undegraded":"2024-04-26T12:42:42.518124+0000","last_fullsized":"2024-04-26T12:42:42.518124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072909+0000","last_change":"2024-04-26T12:42:21.925516+0000","last_active":"2024-04-26T12:42:41.072909+0000","last_peered":"2024-04-26T12:42:41.072909+0000","last_clean":"2024-04-26T12:42:41.072909+0000","last_became_active":"2024-04-26T12:42:21.924628+0000","last_became_peered":"2024-04-26T12:42:21.924628+0000","last_unstale":"2024-04-26T12:42:41.072909+0000","last_undegraded":"2024-04-26T12:42:41.072909+0000","last_fullsized":"2024-04-26T12:42:41.072909+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.079347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'21","reported_seq":223,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068512+0000","last_change":"2024-04-26T12:42:34.034805+0000","last_active":"2024-04-26T12:42:41.068512+0000","last_peered":"2024-04-26T12:42:41.068512+0000","last_clean":"2024-04-26T12:42:41.068512+0000","last_became_active":"2024-04-26T12:42:34.034029+0000","last_became_peered":"2024-04-26T12:42:34.034029+0000","last_unstale":"2024-04-26T12:42:41.068512+0000","last_undegraded":"2024-04-26T12:42:41.068512+0000","last_fullsized":"2024-04-26T12:42:41.068512+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:41.159253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":203,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068554+0000","last_change":"2024-04-26T12:42:34.032136+0000","last_active":"2024-04-26T12:42:41.068554+0000","last_peered":"2024-04-26T12:42:41.068554+0000","last_clean":"2024-04-26T12:42:41.068554+0000","last_became_active":"2024-04-26T12:42:34.031261+0000","last_became_peered":"2024-04-26T12:42:34.031261+0000","last_unstale":"2024-04-26T12:42:41.068554+0000","last_undegraded":"2024-04-26T12:42:41.068554+0000","last_fullsized":"2024-04-26T12:42:41.068554+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:12.726095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"117'19","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074100+0000","last_change":"2024-04-26T12:42:21.932892+0000","last_active":"2024-04-26T12:42:41.074100+0000","last_peered":"2024-04-26T12:42:41.074100+0000","last_clean":"2024-04-26T12:42:41.074100+0000","last_became_active":"2024-04-26T12:42:21.931947+0000","last_became_peered":"2024-04-26T12:42:21.931947+0000","last_unstale":"2024-04-26T12:42:41.074100+0000","last_undegraded":"2024-04-26T12:42:41.074100+0000","last_fullsized":"2024-04-26T12:42:41.074100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:26.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409372+0000","last_change":"2024-04-26T12:42:21.935064+0000","last_active":"2024-04-26T12:42:41.409372+0000","last_peered":"2024-04-26T12:42:41.409372+0000","last_clean":"2024-04-26T12:42:41.409372+0000","last_became_active":"2024-04-26T12:42:21.933611+0000","last_became_peered":"2024-04-26T12:42:21.933611+0000","last_unstale":"2024-04-26T12:42:41.409372+0000","last_undegraded":"2024-04-26T12:42:41.409372+0000","last_fullsized":"2024-04-26T12:42:41.409372+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:10.425425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122185+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:42:42.122185+0000","last_peered":"2024-04-26T12:42:42.122185+0000","last_clean":"2024-04-26T12:42:42.122185+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:42:42.122185+0000","last_undegraded":"2024-04-26T12:42:42.122185+0000","last_fullsized":"2024-04-26T12:42:42.122185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976329+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:42:41.976329+0000","last_peered":"2024-04-26T12:42:41.976329+0000","last_clean":"2024-04-26T12:42:41.976329+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:42:41.976329+0000","last_undegraded":"2024-04-26T12:42:41.976329+0000","last_fullsized":"2024-04-26T12:42:41.976329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:15.022982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"114'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068827+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:42:41.068827+0000","last_peered":"2024-04-26T12:42:41.068827+0000","last_clean":"2024-04-26T12:42:41.068827+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:42:41.068827+0000","last_undegraded":"2024-04-26T12:42:41.068827+0000","last_fullsized":"2024-04-26T12:42:41.068827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:46.457813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409671+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:42:41.409671+0000","last_peered":"2024-04-26T12:42:41.409671+0000","last_clean":"2024-04-26T12:42:41.409671+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:42:41.409671+0000","last_undegraded":"2024-04-26T12:42:41.409671+0000","last_fullsized":"2024-04-26T12:42:41.409671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"117'12","reported_seq":61,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067261+0000","last_change":"2024-04-26T12:42:34.023030+0000","last_active":"2024-04-26T12:42:41.067261+0000","last_peered":"2024-04-26T12:42:41.067261+0000","last_clean":"2024-04-26T12:42:41.067261+0000","last_became_active":"2024-04-26T12:42:34.022362+0000","last_became_peered":"2024-04-26T12:42:34.022362+0000","last_unstale":"2024-04-26T12:42:41.067261+0000","last_undegraded":"2024-04-26T12:42:41.067261+0000","last_fullsized":"2024-04-26T12:42:41.067261+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:14.876710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"139'135","reported_seq":427,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.751193+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:42:44.751193+0000","last_peered":"2024-04-26T12:42:44.751193+0000","last_clean":"2024-04-26T12:42:44.751193+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:42:44.751193+0000","last_undegraded":"2024-04-26T12:42:44.751193+0000","last_fullsized":"2024-04-26T12:42:44.751193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"117'4","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515862+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:42:42.515862+0000","last_peered":"2024-04-26T12:42:42.515862+0000","last_clean":"2024-04-26T12:42:42.515862+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:42:42.515862+0000","last_undegraded":"2024-04-26T12:42:42.515862+0000","last_fullsized":"2024-04-26T12:42:42.515862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066160+0000","last_change":"2024-04-26T12:42:34.029194+0000","last_active":"2024-04-26T12:42:41.066160+0000","last_peered":"2024-04-26T12:42:41.066160+0000","last_clean":"2024-04-26T12:42:41.066160+0000","last_became_active":"2024-04-26T12:42:34.028313+0000","last_became_peered":"2024-04-26T12:42:34.028313+0000","last_unstale":"2024-04-26T12:42:41.066160+0000","last_undegraded":"2024-04-26T12:42:41.066160+0000","last_fullsized":"2024-04-26T12:42:41.066160+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:01.651376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"117'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122475+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:42:42.122475+0000","last_peered":"2024-04-26T12:42:42.122475+0000","last_clean":"2024-04-26T12:42:42.122475+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:42:42.122475+0000","last_undegraded":"2024-04-26T12:42:42.122475+0000","last_fullsized":"2024-04-26T12:42:42.122475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518145+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:42:42.518145+0000","last_peered":"2024-04-26T12:42:42.518145+0000","last_clean":"2024-04-26T12:42:42.518145+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:42:42.518145+0000","last_undegraded":"2024-04-26T12:42:42.518145+0000","last_fullsized":"2024-04-26T12:42:42.518145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"117'24","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122039+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:42:42.122039+0000","last_peered":"2024-04-26T12:42:42.122039+0000","last_clean":"2024-04-26T12:42:42.122039+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:42:42.122039+0000","last_undegraded":"2024-04-26T12:42:42.122039+0000","last_fullsized":"2024-04-26T12:42:42.122039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070022+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:42:41.070022+0000","last_peered":"2024-04-26T12:42:41.070022+0000","last_clean":"2024-04-26T12:42:41.070022+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:42:41.070022+0000","last_undegraded":"2024-04-26T12:42:41.070022+0000","last_fullsized":"2024-04-26T12:42:41.070022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":229,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519271+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:42:42.519271+0000","last_peered":"2024-04-26T12:42:42.519271+0000","last_clean":"2024-04-26T12:42:42.519271+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:42:42.519271+0000","last_undegraded":"2024-04-26T12:42:42.519271+0000","last_fullsized":"2024-04-26T12:42:42.519271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"117'14","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067733+0000","last_change":"2024-04-26T12:42:34.032654+0000","last_active":"2024-04-26T12:42:41.067733+0000","last_peered":"2024-04-26T12:42:41.067733+0000","last_clean":"2024-04-26T12:42:41.067733+0000","last_became_active":"2024-04-26T12:42:34.031426+0000","last_became_peered":"2024-04-26T12:42:34.031426+0000","last_unstale":"2024-04-26T12:42:41.067733+0000","last_undegraded":"2024-04-26T12:42:41.067733+0000","last_fullsized":"2024-04-26T12:42:41.067733+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:08.054625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'38","reported_seq":291,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123903+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:42:42.123903+0000","last_peered":"2024-04-26T12:42:42.123903+0000","last_clean":"2024-04-26T12:42:42.123903+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:42:42.123903+0000","last_undegraded":"2024-04-26T12:42:42.123903+0000","last_fullsized":"2024-04-26T12:42:42.123903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122227+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:42:42.122227+0000","last_peered":"2024-04-26T12:42:42.122227+0000","last_clean":"2024-04-26T12:42:42.122227+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:42:42.122227+0000","last_undegraded":"2024-04-26T12:42:42.122227+0000","last_fullsized":"2024-04-26T12:42:42.122227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"117'18","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070299+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:42:41.070299+0000","last_peered":"2024-04-26T12:42:41.070299+0000","last_clean":"2024-04-26T12:42:41.070299+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:42:41.070299+0000","last_undegraded":"2024-04-26T12:42:41.070299+0000","last_fullsized":"2024-04-26T12:42:41.070299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120745,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517640+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:42:42.517640+0000","last_peered":"2024-04-26T12:42:42.517640+0000","last_clean":"2024-04-26T12:42:42.517640+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:42:42.517640+0000","last_undegraded":"2024-04-26T12:42:42.517640+0000","last_fullsized":"2024-04-26T12:42:42.517640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":183,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073883+0000","last_change":"2024-04-26T12:42:21.961763+0000","last_active":"2024-04-26T12:42:41.073883+0000","last_peered":"2024-04-26T12:42:41.073883+0000","last_clean":"2024-04-26T12:42:41.073883+0000","last_became_active":"2024-04-26T12:42:21.951213+0000","last_became_peered":"2024-04-26T12:42:21.951213+0000","last_unstale":"2024-04-26T12:42:41.073883+0000","last_undegraded":"2024-04-26T12:42:41.073883+0000","last_fullsized":"2024-04-26T12:42:41.073883+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:11.260016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069763+0000","last_change":"2024-04-26T12:42:21.963634+0000","last_active":"2024-04-26T12:42:41.069763+0000","last_peered":"2024-04-26T12:42:41.069763+0000","last_clean":"2024-04-26T12:42:41.069763+0000","last_became_active":"2024-04-26T12:42:21.952291+0000","last_became_peered":"2024-04-26T12:42:21.952291+0000","last_unstale":"2024-04-26T12:42:41.069763+0000","last_undegraded":"2024-04-26T12:42:41.069763+0000","last_fullsized":"2024-04-26T12:42:41.069763+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:54.609591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"117'27","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072915+0000","last_change":"2024-04-26T12:42:21.929252+0000","last_active":"2024-04-26T12:42:41.072915+0000","last_peered":"2024-04-26T12:42:41.072915+0000","last_clean":"2024-04-26T12:42:41.072915+0000","last_became_active":"2024-04-26T12:42:21.928247+0000","last_became_peered":"2024-04-26T12:42:21.928247+0000","last_unstale":"2024-04-26T12:42:41.072915+0000","last_undegraded":"2024-04-26T12:42:41.072915+0000","last_fullsized":"2024-04-26T12:42:41.072915+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:45.518571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":50,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065498+0000","last_change":"2024-04-26T12:42:34.022643+0000","last_active":"2024-04-26T12:42:41.065498+0000","last_peered":"2024-04-26T12:42:41.065498+0000","last_clean":"2024-04-26T12:42:41.065498+0000","last_became_active":"2024-04-26T12:42:34.022065+0000","last_became_peered":"2024-04-26T12:42:34.022065+0000","last_unstale":"2024-04-26T12:42:41.065498+0000","last_undegraded":"2024-04-26T12:42:41.065498+0000","last_fullsized":"2024-04-26T12:42:41.065498+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:59.260776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"117'14","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068905+0000","last_change":"2024-04-26T12:42:21.975843+0000","last_active":"2024-04-26T12:42:41.068905+0000","last_peered":"2024-04-26T12:42:41.068905+0000","last_clean":"2024-04-26T12:42:41.068905+0000","last_became_active":"2024-04-26T12:42:21.971062+0000","last_became_peered":"2024-04-26T12:42:21.971062+0000","last_unstale":"2024-04-26T12:42:41.068905+0000","last_undegraded":"2024-04-26T12:42:41.068905+0000","last_fullsized":"2024-04-26T12:42:41.068905+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:19.436937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":42,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065759+0000","last_change":"2024-04-26T12:42:34.025446+0000","last_active":"2024-04-26T12:42:41.065759+0000","last_peered":"2024-04-26T12:42:41.065759+0000","last_clean":"2024-04-26T12:42:41.065759+0000","last_became_active":"2024-04-26T12:42:34.024706+0000","last_became_peered":"2024-04-26T12:42:34.024706+0000","last_unstale":"2024-04-26T12:42:41.065759+0000","last_undegraded":"2024-04-26T12:42:41.065759+0000","last_fullsized":"2024-04-26T12:42:41.065759+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:54.762146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518863+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:42:42.518863+0000","last_peered":"2024-04-26T12:42:42.518863+0000","last_clean":"2024-04-26T12:42:42.518863+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:42:42.518863+0000","last_undegraded":"2024-04-26T12:42:42.518863+0000","last_fullsized":"2024-04-26T12:42:42.518863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":225,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066300+0000","last_change":"2024-04-26T12:42:34.023824+0000","last_active":"2024-04-26T12:42:41.066300+0000","last_peered":"2024-04-26T12:42:41.066300+0000","last_clean":"2024-04-26T12:42:41.066300+0000","last_became_active":"2024-04-26T12:42:34.022553+0000","last_became_peered":"2024-04-26T12:42:34.022553+0000","last_unstale":"2024-04-26T12:42:41.066300+0000","last_undegraded":"2024-04-26T12:42:41.066300+0000","last_fullsized":"2024-04-26T12:42:41.066300+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:14.772228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'26","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071804+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:42:41.071804+0000","last_peered":"2024-04-26T12:42:41.071804+0000","last_clean":"2024-04-26T12:42:41.071804+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:42:41.071804+0000","last_undegraded":"2024-04-26T12:42:41.071804+0000","last_fullsized":"2024-04-26T12:42:41.071804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":334,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408101+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:42:41.408101+0000","last_peered":"2024-04-26T12:42:41.408101+0000","last_clean":"2024-04-26T12:42:41.408101+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:42:41.408101+0000","last_undegraded":"2024-04-26T12:42:41.408101+0000","last_fullsized":"2024-04-26T12:42:41.408101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:51.703929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"117'17","reported_seq":62,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066047+0000","last_change":"2024-04-26T12:42:34.021259+0000","last_active":"2024-04-26T12:42:41.066047+0000","last_peered":"2024-04-26T12:42:41.066047+0000","last_clean":"2024-04-26T12:42:41.066047+0000","last_became_active":"2024-04-26T12:42:34.017996+0000","last_became_peered":"2024-04-26T12:42:34.017996+0000","last_unstale":"2024-04-26T12:42:41.066047+0000","last_undegraded":"2024-04-26T12:42:41.066047+0000","last_fullsized":"2024-04-26T12:42:41.066047+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:25.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068303+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:42:41.068303+0000","last_peered":"2024-04-26T12:42:41.068303+0000","last_clean":"2024-04-26T12:42:41.068303+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:42:41.068303+0000","last_undegraded":"2024-04-26T12:42:41.068303+0000","last_fullsized":"2024-04-26T12:42:41.068303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068670+0000","last_change":"2024-04-26T12:42:34.015473+0000","last_active":"2024-04-26T12:42:41.068670+0000","last_peered":"2024-04-26T12:42:41.068670+0000","last_clean":"2024-04-26T12:42:41.068670+0000","last_became_active":"2024-04-26T12:42:34.011472+0000","last_became_peered":"2024-04-26T12:42:34.011472+0000","last_unstale":"2024-04-26T12:42:41.068670+0000","last_undegraded":"2024-04-26T12:42:41.068670+0000","last_fullsized":"2024-04-26T12:42:41.068670+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"117'8","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410161+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:42:41.410161+0000","last_peered":"2024-04-26T12:42:41.410161+0000","last_clean":"2024-04-26T12:42:41.410161+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:42:41.410161+0000","last_undegraded":"2024-04-26T12:42:41.410161+0000","last_fullsized":"2024-04-26T12:42:41.410161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:55.546764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"115'18","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.513972+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:42:42.513972+0000","last_peered":"2024-04-26T12:42:42.513972+0000","last_clean":"2024-04-26T12:42:42.513972+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:42:42.513972+0000","last_undegraded":"2024-04-26T12:42:42.513972+0000","last_fullsized":"2024-04-26T12:42:42.513972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409722+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:42:41.409722+0000","last_peered":"2024-04-26T12:42:41.409722+0000","last_clean":"2024-04-26T12:42:41.409722+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:42:41.409722+0000","last_undegraded":"2024-04-26T12:42:41.409722+0000","last_fullsized":"2024-04-26T12:42:41.409722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"117'28","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977334+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:42:41.977334+0000","last_peered":"2024-04-26T12:42:41.977334+0000","last_clean":"2024-04-26T12:42:41.977334+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:42:41.977334+0000","last_undegraded":"2024-04-26T12:42:41.977334+0000","last_fullsized":"2024-04-26T12:42:41.977334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:36.620728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123354+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:42:42.123354+0000","last_peered":"2024-04-26T12:42:42.123354+0000","last_clean":"2024-04-26T12:42:42.123354+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:42:42.123354+0000","last_undegraded":"2024-04-26T12:42:42.123354+0000","last_fullsized":"2024-04-26T12:42:42.123354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'25","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122527+0000","last_change":"2024-04-26T12:42:21.926395+0000","last_active":"2024-04-26T12:42:42.122527+0000","last_peered":"2024-04-26T12:42:42.122527+0000","last_clean":"2024-04-26T12:42:42.122527+0000","last_became_active":"2024-04-26T12:42:21.925708+0000","last_became_peered":"2024-04-26T12:42:21.925708+0000","last_unstale":"2024-04-26T12:42:42.122527+0000","last_undegraded":"2024-04-26T12:42:42.122527+0000","last_fullsized":"2024-04-26T12:42:42.122527+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:41.849994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102760448,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"117'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409207+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:42:41.409207+0000","last_peered":"2024-04-26T12:42:41.409207+0000","last_clean":"2024-04-26T12:42:41.409207+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:42:41.409207+0000","last_undegraded":"2024-04-26T12:42:41.409207+0000","last_fullsized":"2024-04-26T12:42:41.409207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:56.538144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'28","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069354+0000","last_change":"2024-04-26T12:42:21.959563+0000","last_active":"2024-04-26T12:42:41.069354+0000","last_peered":"2024-04-26T12:42:41.069354+0000","last_clean":"2024-04-26T12:42:41.069354+0000","last_became_active":"2024-04-26T12:42:21.957515+0000","last_became_peered":"2024-04-26T12:42:21.957515+0000","last_unstale":"2024-04-26T12:42:41.069354+0000","last_undegraded":"2024-04-26T12:42:41.069354+0000","last_fullsized":"2024-04-26T12:42:41.069354+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:46.718927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068640+0000","last_change":"2024-04-26T12:42:21.975117+0000","last_active":"2024-04-26T12:42:41.068640+0000","last_peered":"2024-04-26T12:42:41.068640+0000","last_clean":"2024-04-26T12:42:41.068640+0000","last_became_active":"2024-04-26T12:42:21.970669+0000","last_became_peered":"2024-04-26T12:42:21.970669+0000","last_unstale":"2024-04-26T12:42:41.068640+0000","last_undegraded":"2024-04-26T12:42:41.068640+0000","last_fullsized":"2024-04-26T12:42:41.068640+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:18.013624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'23","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071983+0000","last_change":"2024-04-26T12:42:21.964762+0000","last_active":"2024-04-26T12:42:41.071983+0000","last_peered":"2024-04-26T12:42:41.071983+0000","last_clean":"2024-04-26T12:42:41.071983+0000","last_became_active":"2024-04-26T12:42:21.961965+0000","last_became_peered":"2024-04-26T12:42:21.961965+0000","last_unstale":"2024-04-26T12:42:41.071983+0000","last_undegraded":"2024-04-26T12:42:41.071983+0000","last_fullsized":"2024-04-26T12:42:41.071983+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:11.098641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":54,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068239+0000","last_change":"2024-04-26T12:42:34.025570+0000","last_active":"2024-04-26T12:42:41.068239+0000","last_peered":"2024-04-26T12:42:41.068239+0000","last_clean":"2024-04-26T12:42:41.068239+0000","last_became_active":"2024-04-26T12:42:34.024880+0000","last_became_peered":"2024-04-26T12:42:34.024880+0000","last_unstale":"2024-04-26T12:42:41.068239+0000","last_undegraded":"2024-04-26T12:42:41.068239+0000","last_fullsized":"2024-04-26T12:42:41.068239+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:55.070371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"117'19","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410111+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:42:41.410111+0000","last_peered":"2024-04-26T12:42:41.410111+0000","last_clean":"2024-04-26T12:42:41.410111+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:42:41.410111+0000","last_undegraded":"2024-04-26T12:42:41.410111+0000","last_fullsized":"2024-04-26T12:42:41.410111+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:36.011280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":185,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070064+0000","last_change":"2024-04-26T12:42:21.942927+0000","last_active":"2024-04-26T12:42:41.070064+0000","last_peered":"2024-04-26T12:42:41.070064+0000","last_clean":"2024-04-26T12:42:41.070064+0000","last_became_active":"2024-04-26T12:42:21.941594+0000","last_became_peered":"2024-04-26T12:42:21.941594+0000","last_unstale":"2024-04-26T12:42:41.070064+0000","last_undegraded":"2024-04-26T12:42:41.070064+0000","last_fullsized":"2024-04-26T12:42:41.070064+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:04.021398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'27","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520265+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:42:42.520265+0000","last_peered":"2024-04-26T12:42:42.520265+0000","last_clean":"2024-04-26T12:42:42.520265+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:42:42.520265+0000","last_undegraded":"2024-04-26T12:42:42.520265+0000","last_fullsized":"2024-04-26T12:42:42.520265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"117'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517260+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:42:42.517260+0000","last_peered":"2024-04-26T12:42:42.517260+0000","last_clean":"2024-04-26T12:42:42.517260+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:42:42.517260+0000","last_undegraded":"2024-04-26T12:42:42.517260+0000","last_fullsized":"2024-04-26T12:42:42.517260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"117'32","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073767+0000","last_change":"2024-04-26T12:42:21.951944+0000","last_active":"2024-04-26T12:42:41.073767+0000","last_peered":"2024-04-26T12:42:41.073767+0000","last_clean":"2024-04-26T12:42:41.073767+0000","last_became_active":"2024-04-26T12:42:21.948694+0000","last_became_peered":"2024-04-26T12:42:21.948694+0000","last_unstale":"2024-04-26T12:42:41.073767+0000","last_undegraded":"2024-04-26T12:42:41.073767+0000","last_fullsized":"2024-04-26T12:42:41.073767+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:27.567798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132120576,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":289,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071522+0000","last_change":"2024-04-26T12:42:21.957965+0000","last_active":"2024-04-26T12:42:41.071522+0000","last_peered":"2024-04-26T12:42:41.071522+0000","last_clean":"2024-04-26T12:42:41.071522+0000","last_became_active":"2024-04-26T12:42:21.956925+0000","last_became_peered":"2024-04-26T12:42:21.956925+0000","last_unstale":"2024-04-26T12:42:41.071522+0000","last_undegraded":"2024-04-26T12:42:41.071522+0000","last_fullsized":"2024-04-26T12:42:41.071522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:03:23.520692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'29","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123130+0000","last_change":"2024-04-26T12:42:21.950280+0000","last_active":"2024-04-26T12:42:42.123130+0000","last_peered":"2024-04-26T12:42:42.123130+0000","last_clean":"2024-04-26T12:42:42.123130+0000","last_became_active":"2024-04-26T12:42:21.949469+0000","last_became_peered":"2024-04-26T12:42:21.949469+0000","last_unstale":"2024-04-26T12:42:42.123130+0000","last_undegraded":"2024-04-26T12:42:42.123130+0000","last_fullsized":"2024-04-26T12:42:42.123130+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:05.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067819+0000","last_change":"2024-04-26T12:42:34.019992+0000","last_active":"2024-04-26T12:42:41.067819+0000","last_peered":"2024-04-26T12:42:41.067819+0000","last_clean":"2024-04-26T12:42:41.067819+0000","last_became_active":"2024-04-26T12:42:34.018659+0000","last_became_peered":"2024-04-26T12:42:34.018659+0000","last_unstale":"2024-04-26T12:42:41.067819+0000","last_undegraded":"2024-04-26T12:42:41.067819+0000","last_fullsized":"2024-04-26T12:42:41.067819+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:46:24.593225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'18","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069486+0000","last_change":"2024-04-26T12:42:21.933174+0000","last_active":"2024-04-26T12:42:41.069486+0000","last_peered":"2024-04-26T12:42:41.069486+0000","last_clean":"2024-04-26T12:42:41.069486+0000","last_became_active":"2024-04-26T12:42:21.932263+0000","last_became_peered":"2024-04-26T12:42:21.932263+0000","last_unstale":"2024-04-26T12:42:41.069486+0000","last_undegraded":"2024-04-26T12:42:41.069486+0000","last_fullsized":"2024-04-26T12:42:41.069486+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:26.946555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"117'4","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976542+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:42:41.976542+0000","last_peered":"2024-04-26T12:42:41.976542+0000","last_clean":"2024-04-26T12:42:41.976542+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:42:41.976542+0000","last_undegraded":"2024-04-26T12:42:41.976542+0000","last_fullsized":"2024-04-26T12:42:41.976542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:52:48.469313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"112'16","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122214+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:42:42.122214+0000","last_peered":"2024-04-26T12:42:42.122214+0000","last_clean":"2024-04-26T12:42:42.122214+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:42:42.122214+0000","last_undegraded":"2024-04-26T12:42:42.122214+0000","last_fullsized":"2024-04-26T12:42:42.122214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"117'8","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068189+0000","last_change":"2024-04-26T12:42:34.024717+0000","last_active":"2024-04-26T12:42:41.068189+0000","last_peered":"2024-04-26T12:42:41.068189+0000","last_clean":"2024-04-26T12:42:41.068189+0000","last_became_active":"2024-04-26T12:42:34.023978+0000","last_became_peered":"2024-04-26T12:42:34.023978+0000","last_unstale":"2024-04-26T12:42:41.068189+0000","last_undegraded":"2024-04-26T12:42:41.068189+0000","last_fullsized":"2024-04-26T12:42:41.068189+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:55.618071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'23","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071543+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:42:41.071543+0000","last_peered":"2024-04-26T12:42:41.071543+0000","last_clean":"2024-04-26T12:42:41.071543+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:42:41.071543+0000","last_undegraded":"2024-04-26T12:42:41.071543+0000","last_fullsized":"2024-04-26T12:42:41.071543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520003+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:42:42.520003+0000","last_peered":"2024-04-26T12:42:42.520003+0000","last_clean":"2024-04-26T12:42:42.520003+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:42:42.520003+0000","last_undegraded":"2024-04-26T12:42:42.520003+0000","last_fullsized":"2024-04-26T12:42:42.520003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'17","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514500+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:42:42.514500+0000","last_peered":"2024-04-26T12:42:42.514500+0000","last_clean":"2024-04-26T12:42:42.514500+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:42:42.514500+0000","last_undegraded":"2024-04-26T12:42:42.514500+0000","last_fullsized":"2024-04-26T12:42:42.514500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068613+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:42:41.068613+0000","last_peered":"2024-04-26T12:42:41.068613+0000","last_clean":"2024-04-26T12:42:41.068613+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:42:41.068613+0000","last_undegraded":"2024-04-26T12:42:41.068613+0000","last_fullsized":"2024-04-26T12:42:41.068613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:32.125454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'24","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514550+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:42:42.514550+0000","last_peered":"2024-04-26T12:42:42.514550+0000","last_clean":"2024-04-26T12:42:42.514550+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:42:42.514550+0000","last_undegraded":"2024-04-26T12:42:42.514550+0000","last_fullsized":"2024-04-26T12:42:42.514550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070772+0000","last_change":"2024-04-26T12:42:21.967040+0000","last_active":"2024-04-26T12:42:41.070772+0000","last_peered":"2024-04-26T12:42:41.070772+0000","last_clean":"2024-04-26T12:42:41.070772+0000","last_became_active":"2024-04-26T12:42:21.965634+0000","last_became_peered":"2024-04-26T12:42:21.965634+0000","last_unstale":"2024-04-26T12:42:41.070772+0000","last_undegraded":"2024-04-26T12:42:41.070772+0000","last_fullsized":"2024-04-26T12:42:41.070772+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:58.603311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'16","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976821+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:42:41.976821+0000","last_peered":"2024-04-26T12:42:41.976821+0000","last_clean":"2024-04-26T12:42:41.976821+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:42:41.976821+0000","last_undegraded":"2024-04-26T12:42:41.976821+0000","last_fullsized":"2024-04-26T12:42:41.976821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:29.476115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516557+0000","last_change":"2024-04-26T12:42:21.967682+0000","last_active":"2024-04-26T12:42:42.516557+0000","last_peered":"2024-04-26T12:42:42.516557+0000","last_clean":"2024-04-26T12:42:42.516557+0000","last_became_active":"2024-04-26T12:42:21.967048+0000","last_became_peered":"2024-04-26T12:42:21.967048+0000","last_unstale":"2024-04-26T12:42:42.516557+0000","last_undegraded":"2024-04-26T12:42:42.516557+0000","last_fullsized":"2024-04-26T12:42:42.516557+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:43.288294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"117'15","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123879+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:42:42.123879+0000","last_peered":"2024-04-26T12:42:42.123879+0000","last_clean":"2024-04-26T12:42:42.123879+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:42:42.123879+0000","last_undegraded":"2024-04-26T12:42:42.123879+0000","last_fullsized":"2024-04-26T12:42:42.123879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"116'24","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122836+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:42:42.122836+0000","last_peered":"2024-04-26T12:42:42.122836+0000","last_clean":"2024-04-26T12:42:42.122836+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:42:42.122836+0000","last_undegraded":"2024-04-26T12:42:42.122836+0000","last_fullsized":"2024-04-26T12:42:42.122836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070164+0000","last_change":"2024-04-26T12:42:21.937768+0000","last_active":"2024-04-26T12:42:41.070164+0000","last_peered":"2024-04-26T12:42:41.070164+0000","last_clean":"2024-04-26T12:42:41.070164+0000","last_became_active":"2024-04-26T12:42:21.936930+0000","last_became_peered":"2024-04-26T12:42:21.936930+0000","last_unstale":"2024-04-26T12:42:41.070164+0000","last_undegraded":"2024-04-26T12:42:41.070164+0000","last_fullsized":"2024-04-26T12:42:41.070164+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:57.253226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"117'25","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408802+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:42:41.408802+0000","last_peered":"2024-04-26T12:42:41.408802+0000","last_clean":"2024-04-26T12:42:41.408802+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:42:41.408802+0000","last_undegraded":"2024-04-26T12:42:41.408802+0000","last_fullsized":"2024-04-26T12:42:41.408802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"117'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123586+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:42:42.123586+0000","last_peered":"2024-04-26T12:42:42.123586+0000","last_clean":"2024-04-26T12:42:42.123586+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:42:42.123586+0000","last_undegraded":"2024-04-26T12:42:42.123586+0000","last_fullsized":"2024-04-26T12:42:42.123586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":336,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1084,"ondisk_log_size":1084,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382929,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":845,"num_read_kb":607,"num_write":463,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":444,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1275,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1700576,"kb_used_data":1669396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92671264,"statfs":{"total":96636764160,"available":94895374336,"internally_reserved":0,"allocated":1709461504,"data_stored":1708741343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1136704,"kb_used_data":1105528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93235136,"statfs":{"total":96636764160,"available":95472779264,"internally_reserved":0,"allocated":1132060672,"data_stored":1131374253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1950060,"kb_used_data":1914724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92421780,"statfs":{"total":96636764160,"available":94639902720,"internally_reserved":0,"allocated":1960677376,"data_stored":1959926964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1808444,"kb_used_data":1777264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92563396,"statfs":{"total":96636764160,"available":94784917504,"internally_reserved":0,"allocated":1819918336,"data_stored":1819239618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":122,"seq":523986010120,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1942860,"kb_used_data":1906500,"kb_used_omap":6,"kb_used_meta":36345,"kb_avail":92428980,"statfs":{"total":96636764160,"available":94647275520,"internally_reserved":0,"allocated":1952256000,"data_stored":1951536896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6715,"internal_metadata":37217733},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163384,"kb_used_data":1128048,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93208456,"statfs":{"total":96636764160,"available":95445458944,"internally_reserved":0,"allocated":1155121152,"data_stored":1154442923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1130836,"kb_used_data":1091340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93241004,"statfs":{"total":96636764160,"available":95478788096,"internally_reserved":0,"allocated":1117532160,"data_stored":1116813587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1762172,"kb_used_data":1726832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92609668,"statfs":{"total":96636764160,"available":94832300032,"internally_reserved":0,"allocated":1768275968,"data_stored":1767576542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1765801984,"data_stored":1765801984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1115684864,"data_stored":1115684864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1153433600,"data_stored":1153433600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1818230784,"data_stored":1818230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1958739968,"data_stored":1958739968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1130364928,"data_stored":1130364928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1707081728,"data_stored":1707081728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":175679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":176622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":176872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":60736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:42:54.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T12:42:54.374 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:42:54.375 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":139,"fsid":"4374a7a0-1dca-4b47-945f-16be0ea888cb","created":"2024-04-26T12:37:51.731809+0000","modified":"2024-04-26T12:42:41.059776+0000","last_up_change":"2024-04-26T12:42:20.880303+0000","last_in_change":"2024-04-26T12:37:54.098182+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T12:38:02.737185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T12:38:02.884644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-26T12:38:09.255239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-26T12:38:10.811482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-26T12:38:12.713614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-26T12:38:14.612453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-26T12:38:16.519071+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-26T12:38:18.667939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90a13ba3-26fb-4d53-bc0e-3583fa4cb8db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6809","nonce":389368420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6811","nonce":389368420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6815","nonce":389368420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":389368420},{"type":"v1","addr":"172.21.15.16:6813","nonce":389368420}]},"public_addr":"172.21.15.16:6809/389368420","cluster_addr":"172.21.15.16:6811/389368420","heartbeat_back_addr":"172.21.15.16:6815/389368420","heartbeat_front_addr":"172.21.15.16:6813/389368420","state":["exists","up"]},{"osd":1,"uuid":"60315ae7-75f7-42f0-ab6b-f0fe033f1b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6801","nonce":1763484355}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6803","nonce":1763484355}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6807","nonce":1763484355}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":1763484355},{"type":"v1","addr":"172.21.15.16:6805","nonce":1763484355}]},"public_addr":"172.21.15.16:6801/1763484355","cluster_addr":"172.21.15.16:6803/1763484355","heartbeat_back_addr":"172.21.15.16:6807/1763484355","heartbeat_front_addr":"172.21.15.16:6805/1763484355","state":["exists","up"]},{"osd":2,"uuid":"e28bef44-fbf9-4f45-b0da-c32cf691116c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6825","nonce":732776315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6827","nonce":732776315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6831","nonce":732776315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":732776315},{"type":"v1","addr":"172.21.15.16:6829","nonce":732776315}]},"public_addr":"172.21.15.16:6825/732776315","cluster_addr":"172.21.15.16:6827/732776315","heartbeat_back_addr":"172.21.15.16:6831/732776315","heartbeat_front_addr":"172.21.15.16:6829/732776315","state":["exists","up"]},{"osd":3,"uuid":"70916512-1197-4640-9b97-8347d50bf4ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":117,"up_from":122,"up_thru":122,"down_at":118,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6817","nonce":3161207406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6819","nonce":3161207406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6823","nonce":3161207406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":3161207406},{"type":"v1","addr":"172.21.15.16:6821","nonce":3161207406}]},"public_addr":"172.21.15.16:6817/3161207406","cluster_addr":"172.21.15.16:6819/3161207406","heartbeat_back_addr":"172.21.15.16:6823/3161207406","heartbeat_front_addr":"172.21.15.16:6821/3161207406","state":["exists","up"]},{"osd":4,"uuid":"15c55012-eac6-4672-b905-d5cc0bf1979c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":131,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6801","nonce":4277454900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6803","nonce":4277454900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6807","nonce":4277454900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":4277454900},{"type":"v1","addr":"172.21.15.131:6805","nonce":4277454900}]},"public_addr":"172.21.15.131:6801/4277454900","cluster_addr":"172.21.15.131:6803/4277454900","heartbeat_back_addr":"172.21.15.131:6807/4277454900","heartbeat_front_addr":"172.21.15.131:6805/4277454900","state":["exists","up"]},{"osd":5,"uuid":"7d4bbd49-33e4-43b2-a28b-891d83bf482a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6809","nonce":1890605084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6811","nonce":1890605084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6815","nonce":1890605084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":1890605084},{"type":"v1","addr":"172.21.15.131:6813","nonce":1890605084}]},"public_addr":"172.21.15.131:6809/1890605084","cluster_addr":"172.21.15.131:6811/1890605084","heartbeat_back_addr":"172.21.15.131:6815/1890605084","heartbeat_front_addr":"172.21.15.131:6813/1890605084","state":["exists","up"]},{"osd":6,"uuid":"3f455889-5a74-491d-b799-9703cfeed14a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6825","nonce":2862642741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6827","nonce":2862642741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6831","nonce":2862642741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2862642741},{"type":"v1","addr":"172.21.15.131:6829","nonce":2862642741}]},"public_addr":"172.21.15.131:6825/2862642741","cluster_addr":"172.21.15.131:6827/2862642741","heartbeat_back_addr":"172.21.15.131:6831/2862642741","heartbeat_front_addr":"172.21.15.131:6829/2862642741","state":["exists","up"]},{"osd":7,"uuid":"22f42260-a14c-4667-95d6-b6392596f262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6817","nonce":2576109125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6819","nonce":2576109125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6823","nonce":2576109125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2576109125},{"type":"v1","addr":"172.21.15.131:6821","nonce":2576109125}]},"public_addr":"172.21.15.131:6817/2576109125","cluster_addr":"172.21.15.131:6819/2576109125","heartbeat_back_addr":"172.21.15.131:6823/2576109125","heartbeat_front_addr":"172.21.15.131:6821/2576109125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.696345+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.654165+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.655130+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.669673+0000","dead_epoch":118},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.496810+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.595760+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.713008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T12:37:59.560060+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T12:42:55.395 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T12:42:55.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:42:55.558 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:42:55.559 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:42:55.559 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:42:55.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T12:42:55.870 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T12:42:55.889 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T12:42:55.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:42:56.045 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:42:56.046 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:42:56.046 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:42:56.062 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T12:42:56.344 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T12:42:56.363 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T12:42:56.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:42:56.503 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:42:56.503 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:42:56.504 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:42:56.518 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T12:42:56.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-26T12:42:56.815 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T12:42:56.836 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T12:42:56.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:42:56.988 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:42:56.988 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T12:42:56.988 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:42:57.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T12:42:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T12:42:57.317 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T12:42:57.317 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:42:57.464 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:42:57.464 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:42:57.464 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:42:57.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T12:42:57.777 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T12:42:57.796 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T12:42:57.796 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:42:57.954 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:42:57.955 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:42:57.955 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:42:57.971 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T12:42:58.267 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T12:42:58.285 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T12:42:58.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:42:58.427 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:42:58.427 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:42:58.427 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:42:58.442 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T12:42:58.724 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T12:42:58.741 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T12:42:58.742 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T12:42:58.886 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-26T12:42:58.886 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T12:42:58.886 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-26T12:42:58.901 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T12:42:59.185 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T12:42:59.206 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:42:59.518 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:42:59.524 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:42:59.537 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-04-26T12:42:58.790668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623988,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4830,"num_read_kb":3732,"num_write":4425,"num_write_kb":6187917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5541,"ondisk_log_size":5541,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":310904,"kb_used_data":14520,"kb_used_omap":17,"kb_used_meta":296110,"kb_avail":754663816,"statfs":{"total":773094113280,"available":772775747584,"internally_reserved":0,"allocated":14868480,"data_stored":9260260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17874,"internal_metadata":303217198},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195933,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1730,"num_read_kb":946,"num_write":1582,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006241"},"pg_stats":[{"pgid":"3.3f","version":"139'42","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.748693+0000","last_change":"2024-04-26T12:38:10.476480+0000","last_active":"2024-04-26T12:42:52.748693+0000","last_peered":"2024-04-26T12:42:52.748693+0000","last_clean":"2024-04-26T12:42:52.748693+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:42:52.748693+0000","last_undegraded":"2024-04-26T12:42:52.748693+0000","last_fullsized":"2024-04-26T12:42:52.748693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:01.779683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"117'6","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121480+0000","last_change":"2024-04-26T12:38:12.455713+0000","last_active":"2024-04-26T12:42:42.121480+0000","last_peered":"2024-04-26T12:42:42.121480+0000","last_clean":"2024-04-26T12:42:42.121480+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:42:42.121480+0000","last_undegraded":"2024-04-26T12:42:42.121480+0000","last_fullsized":"2024-04-26T12:42:42.121480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:51.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"139'32","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.661472+0000","last_change":"2024-04-26T12:38:10.435816+0000","last_active":"2024-04-26T12:42:52.661472+0000","last_peered":"2024-04-26T12:42:52.661472+0000","last_clean":"2024-04-26T12:42:52.661472+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:42:52.661472+0000","last_undegraded":"2024-04-26T12:42:52.661472+0000","last_fullsized":"2024-04-26T12:42:52.661472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518093+0000","last_change":"2024-04-26T12:38:12.467744+0000","last_active":"2024-04-26T12:42:42.518093+0000","last_peered":"2024-04-26T12:42:42.518093+0000","last_clean":"2024-04-26T12:42:42.518093+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:42:42.518093+0000","last_undegraded":"2024-04-26T12:42:42.518093+0000","last_fullsized":"2024-04-26T12:42:42.518093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:51.826956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"139'36","reported_seq":289,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.787869+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:42:52.787869+0000","last_peered":"2024-04-26T12:42:52.787869+0000","last_clean":"2024-04-26T12:42:52.787869+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:42:52.787869+0000","last_undegraded":"2024-04-26T12:42:52.787869+0000","last_fullsized":"2024-04-26T12:42:52.787869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":55,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068376+0000","last_change":"2024-04-26T12:42:34.019445+0000","last_active":"2024-04-26T12:42:41.068376+0000","last_peered":"2024-04-26T12:42:41.068376+0000","last_clean":"2024-04-26T12:42:41.068376+0000","last_became_active":"2024-04-26T12:42:34.016025+0000","last_became_peered":"2024-04-26T12:42:34.016025+0000","last_unstale":"2024-04-26T12:42:41.068376+0000","last_undegraded":"2024-04-26T12:42:41.068376+0000","last_fullsized":"2024-04-26T12:42:41.068376+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"139'62","reported_seq":323,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.766718+0000","last_change":"2024-04-26T12:42:21.947248+0000","last_active":"2024-04-26T12:42:52.766718+0000","last_peered":"2024-04-26T12:42:52.766718+0000","last_clean":"2024-04-26T12:42:52.766718+0000","last_became_active":"2024-04-26T12:42:21.946477+0000","last_became_peered":"2024-04-26T12:42:21.946477+0000","last_unstale":"2024-04-26T12:42:52.766718+0000","last_undegraded":"2024-04-26T12:42:52.766718+0000","last_fullsized":"2024-04-26T12:42:52.766718+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.347007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069213+0000","last_change":"2024-04-26T12:42:21.958105+0000","last_active":"2024-04-26T12:42:41.069213+0000","last_peered":"2024-04-26T12:42:41.069213+0000","last_clean":"2024-04-26T12:42:41.069213+0000","last_became_active":"2024-04-26T12:42:21.956507+0000","last_became_peered":"2024-04-26T12:42:21.956507+0000","last_unstale":"2024-04-26T12:42:41.069213+0000","last_undegraded":"2024-04-26T12:42:41.069213+0000","last_fullsized":"2024-04-26T12:42:41.069213+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"139'50","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.772724+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:42:52.772724+0000","last_peered":"2024-04-26T12:42:52.772724+0000","last_clean":"2024-04-26T12:42:52.772724+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:42:52.772724+0000","last_undegraded":"2024-04-26T12:42:52.772724+0000","last_fullsized":"2024-04-26T12:42:52.772724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:29.073383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520555+0000","last_change":"2024-04-26T12:38:12.449073+0000","last_active":"2024-04-26T12:42:42.520555+0000","last_peered":"2024-04-26T12:42:42.520555+0000","last_clean":"2024-04-26T12:42:42.520555+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:42:42.520555+0000","last_undegraded":"2024-04-26T12:42:42.520555+0000","last_fullsized":"2024-04-26T12:42:42.520555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:27.153799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"139'50","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.831475+0000","last_change":"2024-04-26T12:38:58.160530+0000","last_active":"2024-04-26T12:42:52.831475+0000","last_peered":"2024-04-26T12:42:52.831475+0000","last_clean":"2024-04-26T12:42:52.831475+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:42:52.831475+0000","last_undegraded":"2024-04-26T12:42:52.831475+0000","last_fullsized":"2024-04-26T12:42:52.831475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":123,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067947+0000","last_change":"2024-04-26T12:42:34.007918+0000","last_active":"2024-04-26T12:42:41.067947+0000","last_peered":"2024-04-26T12:42:41.067947+0000","last_clean":"2024-04-26T12:42:41.067947+0000","last_became_active":"2024-04-26T12:42:34.006179+0000","last_became_peered":"2024-04-26T12:42:34.006179+0000","last_unstale":"2024-04-26T12:42:41.067947+0000","last_undegraded":"2024-04-26T12:42:41.067947+0000","last_fullsized":"2024-04-26T12:42:41.067947+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"139'44","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.753323+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:42:52.753323+0000","last_peered":"2024-04-26T12:42:52.753323+0000","last_clean":"2024-04-26T12:42:52.753323+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:42:52.753323+0000","last_undegraded":"2024-04-26T12:42:52.753323+0000","last_fullsized":"2024-04-26T12:42:52.753323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:15.955696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123326+0000","last_change":"2024-04-26T12:38:12.458659+0000","last_active":"2024-04-26T12:42:42.123326+0000","last_peered":"2024-04-26T12:42:42.123326+0000","last_clean":"2024-04-26T12:42:42.123326+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:42:42.123326+0000","last_undegraded":"2024-04-26T12:42:42.123326+0000","last_fullsized":"2024-04-26T12:42:42.123326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:24.622463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"139'26","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.682505+0000","last_change":"2024-04-26T12:42:21.952625+0000","last_active":"2024-04-26T12:42:52.682505+0000","last_peered":"2024-04-26T12:42:52.682505+0000","last_clean":"2024-04-26T12:42:52.682505+0000","last_became_active":"2024-04-26T12:42:21.948971+0000","last_became_peered":"2024-04-26T12:42:21.948971+0000","last_unstale":"2024-04-26T12:42:52.682505+0000","last_undegraded":"2024-04-26T12:42:52.682505+0000","last_fullsized":"2024-04-26T12:42:52.682505+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:55.735297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.978013+0000","last_change":"2024-04-26T12:42:21.965782+0000","last_active":"2024-04-26T12:42:41.978013+0000","last_peered":"2024-04-26T12:42:41.978013+0000","last_clean":"2024-04-26T12:42:41.978013+0000","last_became_active":"2024-04-26T12:42:21.964820+0000","last_became_peered":"2024-04-26T12:42:21.964820+0000","last_unstale":"2024-04-26T12:42:41.978013+0000","last_undegraded":"2024-04-26T12:42:41.978013+0000","last_fullsized":"2024-04-26T12:42:41.978013+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":169,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066158+0000","last_change":"2024-04-26T12:42:34.005982+0000","last_active":"2024-04-26T12:42:41.066158+0000","last_peered":"2024-04-26T12:42:41.066158+0000","last_clean":"2024-04-26T12:42:41.066158+0000","last_became_active":"2024-04-26T12:42:34.003575+0000","last_became_peered":"2024-04-26T12:42:34.003575+0000","last_unstale":"2024-04-26T12:42:41.066158+0000","last_undegraded":"2024-04-26T12:42:41.066158+0000","last_fullsized":"2024-04-26T12:42:41.066158+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"139'50","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.766631+0000","last_change":"2024-04-26T12:38:10.473361+0000","last_active":"2024-04-26T12:42:52.766631+0000","last_peered":"2024-04-26T12:42:52.766631+0000","last_clean":"2024-04-26T12:42:52.766631+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:42:52.766631+0000","last_undegraded":"2024-04-26T12:42:52.766631+0000","last_fullsized":"2024-04-26T12:42:52.766631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.436263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"117'4","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518509+0000","last_change":"2024-04-26T12:38:12.467460+0000","last_active":"2024-04-26T12:42:42.518509+0000","last_peered":"2024-04-26T12:42:42.518509+0000","last_clean":"2024-04-26T12:42:42.518509+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:42:42.518509+0000","last_undegraded":"2024-04-26T12:42:42.518509+0000","last_fullsized":"2024-04-26T12:42:42.518509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:17.971782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"139'68","reported_seq":319,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.824245+0000","last_change":"2024-04-26T12:38:10.450185+0000","last_active":"2024-04-26T12:42:52.824245+0000","last_peered":"2024-04-26T12:42:52.824245+0000","last_clean":"2024-04-26T12:42:52.824245+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:42:52.824245+0000","last_undegraded":"2024-04-26T12:42:52.824245+0000","last_fullsized":"2024-04-26T12:42:52.824245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:10.760939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":3,"num_write":78,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":250,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122528+0000","last_change":"2024-04-26T12:38:12.455432+0000","last_active":"2024-04-26T12:42:42.122528+0000","last_peered":"2024-04-26T12:42:42.122528+0000","last_clean":"2024-04-26T12:42:42.122528+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:42:42.122528+0000","last_undegraded":"2024-04-26T12:42:42.122528+0000","last_fullsized":"2024-04-26T12:42:42.122528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:53.801630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"139'54","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.817779+0000","last_change":"2024-04-26T12:38:10.453738+0000","last_active":"2024-04-26T12:42:52.817779+0000","last_peered":"2024-04-26T12:42:52.817779+0000","last_clean":"2024-04-26T12:42:52.817779+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:42:52.817779+0000","last_undegraded":"2024-04-26T12:42:52.817779+0000","last_fullsized":"2024-04-26T12:42:52.817779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:38.518536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976626+0000","last_change":"2024-04-26T12:42:21.957465+0000","last_active":"2024-04-26T12:42:41.976626+0000","last_peered":"2024-04-26T12:42:41.976626+0000","last_clean":"2024-04-26T12:42:41.976626+0000","last_became_active":"2024-04-26T12:42:21.956566+0000","last_became_peered":"2024-04-26T12:42:21.956566+0000","last_unstale":"2024-04-26T12:42:41.976626+0000","last_undegraded":"2024-04-26T12:42:41.976626+0000","last_fullsized":"2024-04-26T12:42:41.976626+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"139'38","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.806009+0000","last_change":"2024-04-26T12:42:34.024102+0000","last_active":"2024-04-26T12:42:52.806009+0000","last_peered":"2024-04-26T12:42:52.806009+0000","last_clean":"2024-04-26T12:42:52.806009+0000","last_became_active":"2024-04-26T12:42:34.022426+0000","last_became_peered":"2024-04-26T12:42:34.022426+0000","last_unstale":"2024-04-26T12:42:52.806009+0000","last_undegraded":"2024-04-26T12:42:52.806009+0000","last_fullsized":"2024-04-26T12:42:52.806009+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976278+0000","last_change":"2024-04-26T12:38:12.451017+0000","last_active":"2024-04-26T12:42:41.976278+0000","last_peered":"2024-04-26T12:42:41.976278+0000","last_clean":"2024-04-26T12:42:41.976278+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:42:41.976278+0000","last_undegraded":"2024-04-26T12:42:41.976278+0000","last_fullsized":"2024-04-26T12:42:41.976278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"139'42","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.811835+0000","last_change":"2024-04-26T12:42:21.946507+0000","last_active":"2024-04-26T12:42:52.811835+0000","last_peered":"2024-04-26T12:42:52.811835+0000","last_clean":"2024-04-26T12:42:52.811835+0000","last_became_active":"2024-04-26T12:42:21.932303+0000","last_became_peered":"2024-04-26T12:42:21.932303+0000","last_unstale":"2024-04-26T12:42:52.811835+0000","last_undegraded":"2024-04-26T12:42:52.811835+0000","last_fullsized":"2024-04-26T12:42:52.811835+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:48.132898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":114,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067579+0000","last_change":"2024-04-26T12:42:34.027080+0000","last_active":"2024-04-26T12:42:41.067579+0000","last_peered":"2024-04-26T12:42:41.067579+0000","last_clean":"2024-04-26T12:42:41.067579+0000","last_became_active":"2024-04-26T12:42:34.025281+0000","last_became_peered":"2024-04-26T12:42:34.025281+0000","last_unstale":"2024-04-26T12:42:41.067579+0000","last_undegraded":"2024-04-26T12:42:41.067579+0000","last_fullsized":"2024-04-26T12:42:41.067579+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"139'44","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.842581+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:42:52.842581+0000","last_peered":"2024-04-26T12:42:52.842581+0000","last_clean":"2024-04-26T12:42:52.842581+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:42:52.842581+0000","last_undegraded":"2024-04-26T12:42:52.842581+0000","last_fullsized":"2024-04-26T12:42:52.842581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":119,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065691+0000","last_change":"2024-04-26T12:42:34.014303+0000","last_active":"2024-04-26T12:42:41.065691+0000","last_peered":"2024-04-26T12:42:41.065691+0000","last_clean":"2024-04-26T12:42:41.065691+0000","last_became_active":"2024-04-26T12:42:34.013263+0000","last_became_peered":"2024-04-26T12:42:34.013263+0000","last_unstale":"2024-04-26T12:42:41.065691+0000","last_undegraded":"2024-04-26T12:42:41.065691+0000","last_fullsized":"2024-04-26T12:42:41.065691+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072787+0000","last_change":"2024-04-26T12:42:21.967042+0000","last_active":"2024-04-26T12:42:41.072787+0000","last_peered":"2024-04-26T12:42:41.072787+0000","last_clean":"2024-04-26T12:42:41.072787+0000","last_became_active":"2024-04-26T12:42:21.961909+0000","last_became_peered":"2024-04-26T12:42:21.961909+0000","last_unstale":"2024-04-26T12:42:41.072787+0000","last_undegraded":"2024-04-26T12:42:41.072787+0000","last_fullsized":"2024-04-26T12:42:41.072787+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:33.810933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"139'36","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.812276+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:42:52.812276+0000","last_peered":"2024-04-26T12:42:52.812276+0000","last_clean":"2024-04-26T12:42:52.812276+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:42:52.812276+0000","last_undegraded":"2024-04-26T12:42:52.812276+0000","last_fullsized":"2024-04-26T12:42:52.812276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122848+0000","last_change":"2024-04-26T12:38:14.447622+0000","last_active":"2024-04-26T12:42:42.122848+0000","last_peered":"2024-04-26T12:42:42.122848+0000","last_clean":"2024-04-26T12:42:42.122848+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:42:42.122848+0000","last_undegraded":"2024-04-26T12:42:42.122848+0000","last_fullsized":"2024-04-26T12:42:42.122848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:31.311859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"139'21","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.068939+0000","last_change":"2024-04-26T12:38:16.469626+0000","last_active":"2024-04-26T12:42:52.068939+0000","last_peered":"2024-04-26T12:42:52.068939+0000","last_clean":"2024-04-26T12:42:52.068939+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:42:52.068939+0000","last_undegraded":"2024-04-26T12:42:52.068939+0000","last_fullsized":"2024-04-26T12:42:52.068939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516269+0000","last_change":"2024-04-26T12:38:18.490792+0000","last_active":"2024-04-26T12:42:42.516269+0000","last_peered":"2024-04-26T12:42:42.516269+0000","last_clean":"2024-04-26T12:42:42.516269+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:42:42.516269+0000","last_undegraded":"2024-04-26T12:42:42.516269+0000","last_fullsized":"2024-04-26T12:42:42.516269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:29.929570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"117'48","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121554+0000","last_change":"2024-04-26T12:38:20.523674+0000","last_active":"2024-04-26T12:42:42.121554+0000","last_peered":"2024-04-26T12:42:42.121554+0000","last_clean":"2024-04-26T12:42:42.121554+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:42:42.121554+0000","last_undegraded":"2024-04-26T12:42:42.121554+0000","last_fullsized":"2024-04-26T12:42:42.121554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:21.028927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123831+0000","last_change":"2024-04-26T12:38:12.464549+0000","last_active":"2024-04-26T12:42:42.123831+0000","last_peered":"2024-04-26T12:42:42.123831+0000","last_clean":"2024-04-26T12:42:42.123831+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:42:42.123831+0000","last_undegraded":"2024-04-26T12:42:42.123831+0000","last_fullsized":"2024-04-26T12:42:42.123831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:18.817151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"139'68","reported_seq":321,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.846955+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:42:52.846955+0000","last_peered":"2024-04-26T12:42:52.846955+0000","last_clean":"2024-04-26T12:42:52.846955+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:42:52.846955+0000","last_undegraded":"2024-04-26T12:42:52.846955+0000","last_fullsized":"2024-04-26T12:42:52.846955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074395+0000","last_change":"2024-04-26T12:42:21.970469+0000","last_active":"2024-04-26T12:42:41.074395+0000","last_peered":"2024-04-26T12:42:41.074395+0000","last_clean":"2024-04-26T12:42:41.074395+0000","last_became_active":"2024-04-26T12:42:21.968825+0000","last_became_peered":"2024-04-26T12:42:21.968825+0000","last_unstale":"2024-04-26T12:42:41.074395+0000","last_undegraded":"2024-04-26T12:42:41.074395+0000","last_fullsized":"2024-04-26T12:42:41.074395+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:54.280455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"29'6","reported_seq":56,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067600+0000","last_change":"2024-04-26T12:42:34.021039+0000","last_active":"2024-04-26T12:42:41.067600+0000","last_peered":"2024-04-26T12:42:41.067600+0000","last_clean":"2024-04-26T12:42:41.067600+0000","last_became_active":"2024-04-26T12:42:34.018809+0000","last_became_peered":"2024-04-26T12:42:34.018809+0000","last_unstale":"2024-04-26T12:42:41.067600+0000","last_undegraded":"2024-04-26T12:42:41.067600+0000","last_fullsized":"2024-04-26T12:42:41.067600+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":43,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067100+0000","last_change":"2024-04-26T12:42:34.007481+0000","last_active":"2024-04-26T12:42:41.067100+0000","last_peered":"2024-04-26T12:42:41.067100+0000","last_clean":"2024-04-26T12:42:41.067100+0000","last_became_active":"2024-04-26T12:42:34.004534+0000","last_became_peered":"2024-04-26T12:42:34.004534+0000","last_unstale":"2024-04-26T12:42:41.067100+0000","last_undegraded":"2024-04-26T12:42:41.067100+0000","last_fullsized":"2024-04-26T12:42:41.067100+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.177542+0000","last_change":"2024-04-26T12:42:57.177605+0000","last_active":"2024-04-26T12:42:57.177542+0000","last_peered":"2024-04-26T12:42:57.177542+0000","last_clean":"2024-04-26T12:42:57.177542+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:42:57.177542+0000","last_undegraded":"2024-04-26T12:42:57.177542+0000","last_fullsized":"2024-04-26T12:42:57.177542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:57.177175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:57.177175+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.177175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:47.735046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072620+0000","last_change":"2024-04-26T12:42:21.937320+0000","last_active":"2024-04-26T12:42:41.072620+0000","last_peered":"2024-04-26T12:42:41.072620+0000","last_clean":"2024-04-26T12:42:41.072620+0000","last_became_active":"2024-04-26T12:42:21.936393+0000","last_became_peered":"2024-04-26T12:42:21.936393+0000","last_unstale":"2024-04-26T12:42:41.072620+0000","last_undegraded":"2024-04-26T12:42:41.072620+0000","last_fullsized":"2024-04-26T12:42:41.072620+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"139'42","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.814996+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:42:52.814996+0000","last_peered":"2024-04-26T12:42:52.814996+0000","last_clean":"2024-04-26T12:42:52.814996+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:42:52.814996+0000","last_undegraded":"2024-04-26T12:42:52.814996+0000","last_fullsized":"2024-04-26T12:42:52.814996+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:33.443336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074226+0000","last_change":"2024-04-26T12:42:21.961567+0000","last_active":"2024-04-26T12:42:41.074226+0000","last_peered":"2024-04-26T12:42:41.074226+0000","last_clean":"2024-04-26T12:42:41.074226+0000","last_became_active":"2024-04-26T12:42:21.957657+0000","last_became_peered":"2024-04-26T12:42:21.957657+0000","last_unstale":"2024-04-26T12:42:41.074226+0000","last_undegraded":"2024-04-26T12:42:41.074226+0000","last_fullsized":"2024-04-26T12:42:41.074226+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:05:50.723405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"139'15","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.642454+0000","last_change":"2024-04-26T12:42:57.642454+0000","last_active":"2024-04-26T12:42:57.642454+0000","last_peered":"2024-04-26T12:42:57.642454+0000","last_clean":"2024-04-26T12:42:57.642454+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:42:57.642454+0000","last_undegraded":"2024-04-26T12:42:57.642454+0000","last_fullsized":"2024-04-26T12:42:57.642454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'15","last_scrub_stamp":"2024-04-26T12:42:57.642311+0000","last_deep_scrub":"139'15","last_deep_scrub_stamp":"2024-04-26T12:42:57.642311+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.642311+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:59.889605+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"139'138","reported_seq":503,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:51.773600+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:42:51.773600+0000","last_peered":"2024-04-26T12:42:51.773600+0000","last_clean":"2024-04-26T12:42:51.773600+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:42:51.773600+0000","last_undegraded":"2024-04-26T12:42:51.773600+0000","last_fullsized":"2024-04-26T12:42:51.773600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:23.562249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":116,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066174+0000","last_change":"2024-04-26T12:42:34.015888+0000","last_active":"2024-04-26T12:42:41.066174+0000","last_peered":"2024-04-26T12:42:41.066174+0000","last_clean":"2024-04-26T12:42:41.066174+0000","last_became_active":"2024-04-26T12:42:34.015101+0000","last_became_peered":"2024-04-26T12:42:34.015101+0000","last_unstale":"2024-04-26T12:42:41.066174+0000","last_undegraded":"2024-04-26T12:42:41.066174+0000","last_fullsized":"2024-04-26T12:42:41.066174+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074777+0000","last_change":"2024-04-26T12:42:21.971692+0000","last_active":"2024-04-26T12:42:41.074777+0000","last_peered":"2024-04-26T12:42:41.074777+0000","last_clean":"2024-04-26T12:42:41.074777+0000","last_became_active":"2024-04-26T12:42:21.970815+0000","last_became_peered":"2024-04-26T12:42:21.970815+0000","last_unstale":"2024-04-26T12:42:41.074777+0000","last_undegraded":"2024-04-26T12:42:41.074777+0000","last_fullsized":"2024-04-26T12:42:41.074777+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:03.033305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"139'54","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.810166+0000","last_change":"2024-04-26T12:38:10.450306+0000","last_active":"2024-04-26T12:42:52.810166+0000","last_peered":"2024-04-26T12:42:52.810166+0000","last_clean":"2024-04-26T12:42:52.810166+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:42:52.810166+0000","last_undegraded":"2024-04-26T12:42:52.810166+0000","last_fullsized":"2024-04-26T12:42:52.810166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:40.218598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123181+0000","last_change":"2024-04-26T12:42:21.926752+0000","last_active":"2024-04-26T12:42:42.123181+0000","last_peered":"2024-04-26T12:42:42.123181+0000","last_clean":"2024-04-26T12:42:42.123181+0000","last_became_active":"2024-04-26T12:42:21.926086+0000","last_became_peered":"2024-04-26T12:42:21.926086+0000","last_unstale":"2024-04-26T12:42:42.123181+0000","last_undegraded":"2024-04-26T12:42:42.123181+0000","last_fullsized":"2024-04-26T12:42:42.123181+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:03.645084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"139'20","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.876746+0000","last_change":"2024-04-26T12:38:16.530074+0000","last_active":"2024-04-26T12:42:52.876746+0000","last_peered":"2024-04-26T12:42:52.876746+0000","last_clean":"2024-04-26T12:42:52.876746+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:42:52.876746+0000","last_undegraded":"2024-04-26T12:42:52.876746+0000","last_fullsized":"2024-04-26T12:42:52.876746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:05.725251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"139'140","reported_seq":417,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:51.781584+0000","last_change":"2024-04-26T12:42:21.973003+0000","last_active":"2024-04-26T12:42:51.781584+0000","last_peered":"2024-04-26T12:42:51.781584+0000","last_clean":"2024-04-26T12:42:51.781584+0000","last_became_active":"2024-04-26T12:42:21.972298+0000","last_became_peered":"2024-04-26T12:42:21.972298+0000","last_unstale":"2024-04-26T12:42:51.781584+0000","last_undegraded":"2024-04-26T12:42:51.781584+0000","last_fullsized":"2024-04-26T12:42:51.781584+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:09.716281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122553+0000","last_change":"2024-04-26T12:38:12.465058+0000","last_active":"2024-04-26T12:42:42.122553+0000","last_peered":"2024-04-26T12:42:42.122553+0000","last_clean":"2024-04-26T12:42:42.122553+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:42:42.122553+0000","last_undegraded":"2024-04-26T12:42:42.122553+0000","last_fullsized":"2024-04-26T12:42:42.122553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.696379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"139'48","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.845277+0000","last_change":"2024-04-26T12:38:57.838558+0000","last_active":"2024-04-26T12:42:52.845277+0000","last_peered":"2024-04-26T12:42:52.845277+0000","last_clean":"2024-04-26T12:42:52.845277+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:42:52.845277+0000","last_undegraded":"2024-04-26T12:42:52.845277+0000","last_fullsized":"2024-04-26T12:42:52.845277+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517468+0000","last_change":"2024-04-26T12:38:14.465586+0000","last_active":"2024-04-26T12:42:42.517468+0000","last_peered":"2024-04-26T12:42:42.517468+0000","last_clean":"2024-04-26T12:42:42.517468+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:42:42.517468+0000","last_undegraded":"2024-04-26T12:42:42.517468+0000","last_fullsized":"2024-04-26T12:42:42.517468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:34.031553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"139'30","reported_seq":288,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.356984+0000","last_change":"2024-04-26T12:38:16.529850+0000","last_active":"2024-04-26T12:42:52.356984+0000","last_peered":"2024-04-26T12:42:52.356984+0000","last_clean":"2024-04-26T12:42:52.356984+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:42:52.356984+0000","last_undegraded":"2024-04-26T12:42:52.356984+0000","last_fullsized":"2024-04-26T12:42:52.356984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:54.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:47.842358+0000","last_change":"2024-04-26T12:38:18.503272+0000","last_active":"2024-04-26T12:42:47.842358+0000","last_peered":"2024-04-26T12:42:47.842358+0000","last_clean":"2024-04-26T12:42:47.842358+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:42:47.842358+0000","last_undegraded":"2024-04-26T12:42:47.842358+0000","last_fullsized":"2024-04-26T12:42:47.842358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121946+0000","last_change":"2024-04-26T12:38:20.524854+0000","last_active":"2024-04-26T12:42:42.121946+0000","last_peered":"2024-04-26T12:42:42.121946+0000","last_clean":"2024-04-26T12:42:42.121946+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:42:42.121946+0000","last_undegraded":"2024-04-26T12:42:42.121946+0000","last_fullsized":"2024-04-26T12:42:42.121946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:01.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"117'8","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066125+0000","last_change":"2024-04-26T12:42:34.029770+0000","last_active":"2024-04-26T12:42:41.066125+0000","last_peered":"2024-04-26T12:42:41.066125+0000","last_clean":"2024-04-26T12:42:41.066125+0000","last_became_active":"2024-04-26T12:42:34.027515+0000","last_became_peered":"2024-04-26T12:42:34.027515+0000","last_unstale":"2024-04-26T12:42:41.066125+0000","last_undegraded":"2024-04-26T12:42:41.066125+0000","last_fullsized":"2024-04-26T12:42:41.066125+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"139'40","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.737742+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:42:52.737742+0000","last_peered":"2024-04-26T12:42:52.737742+0000","last_clean":"2024-04-26T12:42:52.737742+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:42:52.737742+0000","last_undegraded":"2024-04-26T12:42:52.737742+0000","last_fullsized":"2024-04-26T12:42:52.737742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975949+0000","last_change":"2024-04-26T12:38:14.445162+0000","last_active":"2024-04-26T12:42:41.975949+0000","last_peered":"2024-04-26T12:42:41.975949+0000","last_clean":"2024-04-26T12:42:41.975949+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:42:41.975949+0000","last_undegraded":"2024-04-26T12:42:41.975949+0000","last_fullsized":"2024-04-26T12:42:41.975949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"139'23","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.704286+0000","last_change":"2024-04-26T12:42:21.974974+0000","last_active":"2024-04-26T12:42:52.704286+0000","last_peered":"2024-04-26T12:42:52.704286+0000","last_clean":"2024-04-26T12:42:52.704286+0000","last_became_active":"2024-04-26T12:42:21.968492+0000","last_became_peered":"2024-04-26T12:42:21.968492+0000","last_unstale":"2024-04-26T12:42:52.704286+0000","last_undegraded":"2024-04-26T12:42:52.704286+0000","last_fullsized":"2024-04-26T12:42:52.704286+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:59.480511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068594+0000","last_change":"2024-04-26T12:42:21.943962+0000","last_active":"2024-04-26T12:42:41.068594+0000","last_peered":"2024-04-26T12:42:41.068594+0000","last_clean":"2024-04-26T12:42:41.068594+0000","last_became_active":"2024-04-26T12:42:21.942925+0000","last_became_peered":"2024-04-26T12:42:21.942925+0000","last_unstale":"2024-04-26T12:42:41.068594+0000","last_undegraded":"2024-04-26T12:42:41.068594+0000","last_fullsized":"2024-04-26T12:42:41.068594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:17.453438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519637+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:42:42.519637+0000","last_peered":"2024-04-26T12:42:42.519637+0000","last_clean":"2024-04-26T12:42:42.519637+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:42:42.519637+0000","last_undegraded":"2024-04-26T12:42:42.519637+0000","last_fullsized":"2024-04-26T12:42:42.519637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:43.771953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518899+0000","last_change":"2024-04-26T12:38:12.449521+0000","last_active":"2024-04-26T12:42:42.518899+0000","last_peered":"2024-04-26T12:42:42.518899+0000","last_clean":"2024-04-26T12:42:42.518899+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:42:42.518899+0000","last_undegraded":"2024-04-26T12:42:42.518899+0000","last_fullsized":"2024-04-26T12:42:42.518899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:37.410861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"139'38","reported_seq":288,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.762230+0000","last_change":"2024-04-26T12:38:10.475918+0000","last_active":"2024-04-26T12:42:52.762230+0000","last_peered":"2024-04-26T12:42:52.762230+0000","last_clean":"2024-04-26T12:42:52.762230+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:42:52.762230+0000","last_undegraded":"2024-04-26T12:42:52.762230+0000","last_fullsized":"2024-04-26T12:42:52.762230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:47.832633+0000","last_change":"2024-04-26T12:38:14.456778+0000","last_active":"2024-04-26T12:42:47.832633+0000","last_peered":"2024-04-26T12:42:47.832633+0000","last_clean":"2024-04-26T12:42:47.832633+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:42:47.832633+0000","last_undegraded":"2024-04-26T12:42:47.832633+0000","last_fullsized":"2024-04-26T12:42:47.832633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"139'27","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.364600+0000","last_change":"2024-04-26T12:38:16.467092+0000","last_active":"2024-04-26T12:42:52.364600+0000","last_peered":"2024-04-26T12:42:52.364600+0000","last_clean":"2024-04-26T12:42:52.364600+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:42:52.364600+0000","last_undegraded":"2024-04-26T12:42:52.364600+0000","last_fullsized":"2024-04-26T12:42:52.364600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:39.723656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"139'138","reported_seq":459,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.895586+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:42:52.895586+0000","last_peered":"2024-04-26T12:42:52.895586+0000","last_clean":"2024-04-26T12:42:52.895586+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:42:52.895586+0000","last_undegraded":"2024-04-26T12:42:52.895586+0000","last_fullsized":"2024-04-26T12:42:52.895586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.132746+0000","last_change":"2024-04-26T12:42:56.132770+0000","last_active":"2024-04-26T12:42:56.132746+0000","last_peered":"2024-04-26T12:42:56.132746+0000","last_clean":"2024-04-26T12:42:56.132746+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:42:56.132746+0000","last_undegraded":"2024-04-26T12:42:56.132746+0000","last_fullsized":"2024-04-26T12:42:56.132746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:42:56.132663+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:42:56.132663+0000","last_clean_scrub_stamp":"2024-04-26T12:42:56.132663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:50.436843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.015918+0000","last_change":"2024-04-26T12:38:12.457731+0000","last_active":"2024-04-26T12:42:42.015918+0000","last_peered":"2024-04-26T12:42:42.015918+0000","last_clean":"2024-04-26T12:42:42.015918+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:42:42.015918+0000","last_undegraded":"2024-04-26T12:42:42.015918+0000","last_fullsized":"2024-04-26T12:42:42.015918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"139'36","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.830128+0000","last_change":"2024-04-26T12:42:21.959737+0000","last_active":"2024-04-26T12:42:52.830128+0000","last_peered":"2024-04-26T12:42:52.830128+0000","last_clean":"2024-04-26T12:42:52.830128+0000","last_became_active":"2024-04-26T12:42:21.959122+0000","last_became_peered":"2024-04-26T12:42:21.959122+0000","last_unstale":"2024-04-26T12:42:52.830128+0000","last_undegraded":"2024-04-26T12:42:52.830128+0000","last_fullsized":"2024-04-26T12:42:52.830128+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:53.425209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976220+0000","last_change":"2024-04-26T12:38:14.464166+0000","last_active":"2024-04-26T12:42:41.976220+0000","last_peered":"2024-04-26T12:42:41.976220+0000","last_clean":"2024-04-26T12:42:41.976220+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:42:41.976220+0000","last_undegraded":"2024-04-26T12:42:41.976220+0000","last_fullsized":"2024-04-26T12:42:41.976220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"139'36","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.852325+0000","last_change":"2024-04-26T12:38:16.470802+0000","last_active":"2024-04-26T12:42:52.852325+0000","last_peered":"2024-04-26T12:42:52.852325+0000","last_clean":"2024-04-26T12:42:52.852325+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:42:52.852325+0000","last_undegraded":"2024-04-26T12:42:52.852325+0000","last_fullsized":"2024-04-26T12:42:52.852325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.975789+0000","last_change":"2024-04-26T12:38:18.473908+0000","last_active":"2024-04-26T12:42:41.975789+0000","last_peered":"2024-04-26T12:42:41.975789+0000","last_clean":"2024-04-26T12:42:41.975789+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:42:41.975789+0000","last_undegraded":"2024-04-26T12:42:41.975789+0000","last_fullsized":"2024-04-26T12:42:41.975789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'7","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.006686+0000","last_change":"2024-04-26T12:42:21.935665+0000","last_active":"2024-04-26T12:42:42.006686+0000","last_peered":"2024-04-26T12:42:42.006686+0000","last_clean":"2024-04-26T12:42:42.006686+0000","last_became_active":"2024-04-26T12:42:21.934686+0000","last_became_peered":"2024-04-26T12:42:21.934686+0000","last_unstale":"2024-04-26T12:42:42.006686+0000","last_undegraded":"2024-04-26T12:42:42.006686+0000","last_fullsized":"2024-04-26T12:42:42.006686+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"117'4","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068037+0000","last_change":"2024-04-26T12:42:34.032506+0000","last_active":"2024-04-26T12:42:41.068037+0000","last_peered":"2024-04-26T12:42:41.068037+0000","last_clean":"2024-04-26T12:42:41.068037+0000","last_became_active":"2024-04-26T12:42:34.031776+0000","last_became_peered":"2024-04-26T12:42:34.031776+0000","last_unstale":"2024-04-26T12:42:41.068037+0000","last_undegraded":"2024-04-26T12:42:41.068037+0000","last_fullsized":"2024-04-26T12:42:41.068037+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"139'52","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.812302+0000","last_change":"2024-04-26T12:42:21.974477+0000","last_active":"2024-04-26T12:42:52.812302+0000","last_peered":"2024-04-26T12:42:52.812302+0000","last_clean":"2024-04-26T12:42:52.812302+0000","last_became_active":"2024-04-26T12:42:21.967072+0000","last_became_peered":"2024-04-26T12:42:21.967072+0000","last_unstale":"2024-04-26T12:42:52.812302+0000","last_undegraded":"2024-04-26T12:42:52.812302+0000","last_fullsized":"2024-04-26T12:42:52.812302+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:55:06.202160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:47.832684+0000","last_change":"2024-04-26T12:38:14.453099+0000","last_active":"2024-04-26T12:42:47.832684+0000","last_peered":"2024-04-26T12:42:47.832684+0000","last_clean":"2024-04-26T12:42:47.832684+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:42:47.832684+0000","last_undegraded":"2024-04-26T12:42:47.832684+0000","last_fullsized":"2024-04-26T12:42:47.832684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"139'22","reported_seq":73,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.854570+0000","last_change":"2024-04-26T12:42:34.028589+0000","last_active":"2024-04-26T12:42:52.854570+0000","last_peered":"2024-04-26T12:42:52.854570+0000","last_clean":"2024-04-26T12:42:52.854570+0000","last_became_active":"2024-04-26T12:42:34.027524+0000","last_became_peered":"2024-04-26T12:42:34.027524+0000","last_unstale":"2024-04-26T12:42:52.854570+0000","last_undegraded":"2024-04-26T12:42:52.854570+0000","last_fullsized":"2024-04-26T12:42:52.854570+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:47.841428+0000","last_change":"2024-04-26T12:42:21.938337+0000","last_active":"2024-04-26T12:42:47.841428+0000","last_peered":"2024-04-26T12:42:47.841428+0000","last_clean":"2024-04-26T12:42:47.841428+0000","last_became_active":"2024-04-26T12:42:21.937057+0000","last_became_peered":"2024-04-26T12:42:21.937057+0000","last_unstale":"2024-04-26T12:42:47.841428+0000","last_undegraded":"2024-04-26T12:42:47.841428+0000","last_fullsized":"2024-04-26T12:42:47.841428+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072835+0000","last_change":"2024-04-26T12:42:21.957634+0000","last_active":"2024-04-26T12:42:41.072835+0000","last_peered":"2024-04-26T12:42:41.072835+0000","last_clean":"2024-04-26T12:42:41.072835+0000","last_became_active":"2024-04-26T12:42:21.948878+0000","last_became_peered":"2024-04-26T12:42:21.948878+0000","last_unstale":"2024-04-26T12:42:41.072835+0000","last_undegraded":"2024-04-26T12:42:41.072835+0000","last_fullsized":"2024-04-26T12:42:41.072835+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:38.853021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":132,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067992+0000","last_change":"2024-04-26T12:42:34.019680+0000","last_active":"2024-04-26T12:42:41.067992+0000","last_peered":"2024-04-26T12:42:41.067992+0000","last_clean":"2024-04-26T12:42:41.067992+0000","last_became_active":"2024-04-26T12:42:34.018540+0000","last_became_peered":"2024-04-26T12:42:34.018540+0000","last_unstale":"2024-04-26T12:42:41.067992+0000","last_undegraded":"2024-04-26T12:42:41.067992+0000","last_fullsized":"2024-04-26T12:42:41.067992+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"139'40","reported_seq":291,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.823197+0000","last_change":"2024-04-26T12:38:10.454424+0000","last_active":"2024-04-26T12:42:52.823197+0000","last_peered":"2024-04-26T12:42:52.823197+0000","last_clean":"2024-04-26T12:42:52.823197+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:42:52.823197+0000","last_undegraded":"2024-04-26T12:42:52.823197+0000","last_fullsized":"2024-04-26T12:42:52.823197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:04.547776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.900868+0000","last_change":"2024-04-26T12:42:56.900889+0000","last_active":"2024-04-26T12:42:56.900868+0000","last_peered":"2024-04-26T12:42:56.900868+0000","last_clean":"2024-04-26T12:42:56.900868+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:42:56.900868+0000","last_undegraded":"2024-04-26T12:42:56.900868+0000","last_fullsized":"2024-04-26T12:42:56.900868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:56.900773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:56.900773+0000","last_clean_scrub_stamp":"2024-04-26T12:42:56.900773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:47.129042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"139'26","reported_seq":288,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.397143+0000","last_change":"2024-04-26T12:42:21.959840+0000","last_active":"2024-04-26T12:42:52.397143+0000","last_peered":"2024-04-26T12:42:52.397143+0000","last_clean":"2024-04-26T12:42:52.397143+0000","last_became_active":"2024-04-26T12:42:21.958977+0000","last_became_peered":"2024-04-26T12:42:21.958977+0000","last_unstale":"2024-04-26T12:42:52.397143+0000","last_undegraded":"2024-04-26T12:42:52.397143+0000","last_fullsized":"2024-04-26T12:42:52.397143+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"139'138","reported_seq":444,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.890489+0000","last_change":"2024-04-26T12:38:18.490028+0000","last_active":"2024-04-26T12:42:52.890489+0000","last_peered":"2024-04-26T12:42:52.890489+0000","last_clean":"2024-04-26T12:42:52.890489+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:42:52.890489+0000","last_undegraded":"2024-04-26T12:42:52.890489+0000","last_fullsized":"2024-04-26T12:42:52.890489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408657+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:42:41.408657+0000","last_peered":"2024-04-26T12:42:41.408657+0000","last_clean":"2024-04-26T12:42:41.408657+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:42:41.408657+0000","last_undegraded":"2024-04-26T12:42:41.408657+0000","last_fullsized":"2024-04-26T12:42:41.408657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":181,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068115+0000","last_change":"2024-04-26T12:42:34.026595+0000","last_active":"2024-04-26T12:42:41.068115+0000","last_peered":"2024-04-26T12:42:41.068115+0000","last_clean":"2024-04-26T12:42:41.068115+0000","last_became_active":"2024-04-26T12:42:34.025094+0000","last_became_peered":"2024-04-26T12:42:34.025094+0000","last_unstale":"2024-04-26T12:42:41.068115+0000","last_undegraded":"2024-04-26T12:42:41.068115+0000","last_fullsized":"2024-04-26T12:42:41.068115+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"139'70","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.824042+0000","last_change":"2024-04-26T12:42:34.021002+0000","last_active":"2024-04-26T12:42:52.824042+0000","last_peered":"2024-04-26T12:42:52.824042+0000","last_clean":"2024-04-26T12:42:52.824042+0000","last_became_active":"2024-04-26T12:42:34.019821+0000","last_became_peered":"2024-04-26T12:42:34.019821+0000","last_unstale":"2024-04-26T12:42:52.824042+0000","last_undegraded":"2024-04-26T12:42:52.824042+0000","last_fullsized":"2024-04-26T12:42:52.824042+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"22'2","reported_seq":430,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:51.740316+0000","last_change":"2024-04-26T12:38:14.459112+0000","last_active":"2024-04-26T12:42:51.740316+0000","last_peered":"2024-04-26T12:42:51.740316+0000","last_clean":"2024-04-26T12:42:51.740316+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:42:51.740316+0000","last_undegraded":"2024-04-26T12:42:51.740316+0000","last_fullsized":"2024-04-26T12:42:51.740316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:37.716859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073443+0000","last_change":"2024-04-26T12:42:21.962837+0000","last_active":"2024-04-26T12:42:41.073443+0000","last_peered":"2024-04-26T12:42:41.073443+0000","last_clean":"2024-04-26T12:42:41.073443+0000","last_became_active":"2024-04-26T12:42:21.952480+0000","last_became_peered":"2024-04-26T12:42:21.952480+0000","last_unstale":"2024-04-26T12:42:41.073443+0000","last_undegraded":"2024-04-26T12:42:41.073443+0000","last_fullsized":"2024-04-26T12:42:41.073443+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:55.807987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"139'138","reported_seq":475,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:51.777459+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:42:51.777459+0000","last_peered":"2024-04-26T12:42:51.777459+0000","last_clean":"2024-04-26T12:42:51.777459+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:42:51.777459+0000","last_undegraded":"2024-04-26T12:42:51.777459+0000","last_fullsized":"2024-04-26T12:42:51.777459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:20.814417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067232+0000","last_change":"2024-04-26T12:42:34.020098+0000","last_active":"2024-04-26T12:42:41.067232+0000","last_peered":"2024-04-26T12:42:41.067232+0000","last_clean":"2024-04-26T12:42:41.067232+0000","last_became_active":"2024-04-26T12:42:34.015095+0000","last_became_peered":"2024-04-26T12:42:34.015095+0000","last_unstale":"2024-04-26T12:42:41.067232+0000","last_undegraded":"2024-04-26T12:42:41.067232+0000","last_fullsized":"2024-04-26T12:42:41.067232+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.841560+0000","last_change":"2024-04-26T12:42:21.953982+0000","last_active":"2024-04-26T12:42:42.841560+0000","last_peered":"2024-04-26T12:42:42.841560+0000","last_clean":"2024-04-26T12:42:42.841560+0000","last_became_active":"2024-04-26T12:42:21.953253+0000","last_became_peered":"2024-04-26T12:42:21.953253+0000","last_unstale":"2024-04-26T12:42:42.841560+0000","last_undegraded":"2024-04-26T12:42:42.841560+0000","last_fullsized":"2024-04-26T12:42:42.841560+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"139'40","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.816247+0000","last_change":"2024-04-26T12:42:21.949610+0000","last_active":"2024-04-26T12:42:52.816247+0000","last_peered":"2024-04-26T12:42:52.816247+0000","last_clean":"2024-04-26T12:42:52.816247+0000","last_became_active":"2024-04-26T12:42:21.940512+0000","last_became_peered":"2024-04-26T12:42:21.940512+0000","last_unstale":"2024-04-26T12:42:52.816247+0000","last_undegraded":"2024-04-26T12:42:52.816247+0000","last_fullsized":"2024-04-26T12:42:52.816247+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:19.966458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":51,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067526+0000","last_change":"2024-04-26T12:42:34.007412+0000","last_active":"2024-04-26T12:42:41.067526+0000","last_peered":"2024-04-26T12:42:41.067526+0000","last_clean":"2024-04-26T12:42:41.067526+0000","last_became_active":"2024-04-26T12:42:34.005897+0000","last_became_peered":"2024-04-26T12:42:34.005897+0000","last_unstale":"2024-04-26T12:42:41.067526+0000","last_undegraded":"2024-04-26T12:42:41.067526+0000","last_fullsized":"2024-04-26T12:42:41.067526+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"139'29","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.069804+0000","last_change":"2024-04-26T12:38:16.474976+0000","last_active":"2024-04-26T12:42:52.069804+0000","last_peered":"2024-04-26T12:42:52.069804+0000","last_clean":"2024-04-26T12:42:52.069804+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:42:52.069804+0000","last_undegraded":"2024-04-26T12:42:52.069804+0000","last_fullsized":"2024-04-26T12:42:52.069804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:19.107276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520237+0000","last_change":"2024-04-26T12:42:21.947536+0000","last_active":"2024-04-26T12:42:42.520237+0000","last_peered":"2024-04-26T12:42:42.520237+0000","last_clean":"2024-04-26T12:42:42.520237+0000","last_became_active":"2024-04-26T12:42:21.946663+0000","last_became_peered":"2024-04-26T12:42:21.946663+0000","last_unstale":"2024-04-26T12:42:42.520237+0000","last_undegraded":"2024-04-26T12:42:42.520237+0000","last_fullsized":"2024-04-26T12:42:42.520237+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:31.336436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408569+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:42:41.408569+0000","last_peered":"2024-04-26T12:42:41.408569+0000","last_clean":"2024-04-26T12:42:41.408569+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:42:41.408569+0000","last_undegraded":"2024-04-26T12:42:41.408569+0000","last_fullsized":"2024-04-26T12:42:41.408569+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520346+0000","last_change":"2024-04-26T12:38:12.452053+0000","last_active":"2024-04-26T12:42:42.520346+0000","last_peered":"2024-04-26T12:42:42.520346+0000","last_clean":"2024-04-26T12:42:42.520346+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:42:42.520346+0000","last_undegraded":"2024-04-26T12:42:42.520346+0000","last_fullsized":"2024-04-26T12:42:42.520346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:28.447764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":406,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516883+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:42:42.516883+0000","last_peered":"2024-04-26T12:42:42.516883+0000","last_clean":"2024-04-26T12:42:42.516883+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:42:42.516883+0000","last_undegraded":"2024-04-26T12:42:42.516883+0000","last_fullsized":"2024-04-26T12:42:42.516883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:15.385698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122546+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:42:42.122546+0000","last_peered":"2024-04-26T12:42:42.122546+0000","last_clean":"2024-04-26T12:42:42.122546+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:42:42.122546+0000","last_undegraded":"2024-04-26T12:42:42.122546+0000","last_fullsized":"2024-04-26T12:42:42.122546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"139'66","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.832300+0000","last_change":"2024-04-26T12:42:21.931544+0000","last_active":"2024-04-26T12:42:52.832300+0000","last_peered":"2024-04-26T12:42:52.832300+0000","last_clean":"2024-04-26T12:42:52.832300+0000","last_became_active":"2024-04-26T12:42:21.929093+0000","last_became_peered":"2024-04-26T12:42:21.929093+0000","last_unstale":"2024-04-26T12:42:52.832300+0000","last_undegraded":"2024-04-26T12:42:52.832300+0000","last_fullsized":"2024-04-26T12:42:52.832300+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:06.052469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518900+0000","last_change":"2024-04-26T12:38:14.452963+0000","last_active":"2024-04-26T12:42:42.518900+0000","last_peered":"2024-04-26T12:42:42.518900+0000","last_clean":"2024-04-26T12:42:42.518900+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:42:42.518900+0000","last_undegraded":"2024-04-26T12:42:42.518900+0000","last_fullsized":"2024-04-26T12:42:42.518900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:35.394726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"139'50","reported_seq":325,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.387182+0000","last_change":"2024-04-26T12:42:21.932409+0000","last_active":"2024-04-26T12:42:52.387182+0000","last_peered":"2024-04-26T12:42:52.387182+0000","last_clean":"2024-04-26T12:42:52.387182+0000","last_became_active":"2024-04-26T12:42:21.931114+0000","last_became_peered":"2024-04-26T12:42:21.931114+0000","last_unstale":"2024-04-26T12:42:52.387182+0000","last_undegraded":"2024-04-26T12:42:52.387182+0000","last_fullsized":"2024-04-26T12:42:52.387182+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:31.083567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":397,"num_write":30,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071307+0000","last_change":"2024-04-26T12:38:18.488829+0000","last_active":"2024-04-26T12:42:41.071307+0000","last_peered":"2024-04-26T12:42:41.071307+0000","last_clean":"2024-04-26T12:42:41.071307+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:42:41.071307+0000","last_undegraded":"2024-04-26T12:42:41.071307+0000","last_fullsized":"2024-04-26T12:42:41.071307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517357+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:42:42.517357+0000","last_peered":"2024-04-26T12:42:42.517357+0000","last_clean":"2024-04-26T12:42:42.517357+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:42:42.517357+0000","last_undegraded":"2024-04-26T12:42:42.517357+0000","last_fullsized":"2024-04-26T12:42:42.517357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:37.366954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072103+0000","last_change":"2024-04-26T12:38:12.461930+0000","last_active":"2024-04-26T12:42:41.072103+0000","last_peered":"2024-04-26T12:42:41.072103+0000","last_clean":"2024-04-26T12:42:41.072103+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:42:41.072103+0000","last_undegraded":"2024-04-26T12:42:41.072103+0000","last_fullsized":"2024-04-26T12:42:41.072103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516595+0000","last_change":"2024-04-26T12:38:04.385131+0000","last_active":"2024-04-26T12:42:42.516595+0000","last_peered":"2024-04-26T12:42:42.516595+0000","last_clean":"2024-04-26T12:42:42.516595+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:42:42.516595+0000","last_undegraded":"2024-04-26T12:42:42.516595+0000","last_fullsized":"2024-04-26T12:42:42.516595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:53.042604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'36","reported_seq":289,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.815691+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:42:52.815691+0000","last_peered":"2024-04-26T12:42:52.815691+0000","last_clean":"2024-04-26T12:42:52.815691+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:42:52.815691+0000","last_undegraded":"2024-04-26T12:42:52.815691+0000","last_fullsized":"2024-04-26T12:42:52.815691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123676+0000","last_change":"2024-04-26T12:38:14.456345+0000","last_active":"2024-04-26T12:42:42.123676+0000","last_peered":"2024-04-26T12:42:42.123676+0000","last_clean":"2024-04-26T12:42:42.123676+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:42:42.123676+0000","last_undegraded":"2024-04-26T12:42:42.123676+0000","last_fullsized":"2024-04-26T12:42:42.123676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:50.987457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"139'149","reported_seq":519,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.885092+0000","last_change":"2024-04-26T12:38:16.474752+0000","last_active":"2024-04-26T12:42:52.885092+0000","last_peered":"2024-04-26T12:42:52.885092+0000","last_clean":"2024-04-26T12:42:52.885092+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:42:52.885092+0000","last_undegraded":"2024-04-26T12:42:52.885092+0000","last_fullsized":"2024-04-26T12:42:52.885092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":191,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514992+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:42:42.514992+0000","last_peered":"2024-04-26T12:42:42.514992+0000","last_clean":"2024-04-26T12:42:42.514992+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:42:42.514992+0000","last_undegraded":"2024-04-26T12:42:42.514992+0000","last_fullsized":"2024-04-26T12:42:42.514992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"117'2","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.841396+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:42:42.841396+0000","last_peered":"2024-04-26T12:42:42.841396+0000","last_clean":"2024-04-26T12:42:42.841396+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:42:42.841396+0000","last_undegraded":"2024-04-26T12:42:42.841396+0000","last_fullsized":"2024-04-26T12:42:42.841396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410427+0000","last_change":"2024-04-26T12:38:12.462081+0000","last_active":"2024-04-26T12:42:41.410427+0000","last_peered":"2024-04-26T12:42:41.410427+0000","last_clean":"2024-04-26T12:42:41.410427+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:42:41.410427+0000","last_undegraded":"2024-04-26T12:42:41.410427+0000","last_fullsized":"2024-04-26T12:42:41.410427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.977593+0000","last_change":"2024-04-26T12:42:21.939098+0000","last_active":"2024-04-26T12:42:41.977593+0000","last_peered":"2024-04-26T12:42:41.977593+0000","last_clean":"2024-04-26T12:42:41.977593+0000","last_became_active":"2024-04-26T12:42:21.938117+0000","last_became_peered":"2024-04-26T12:42:21.938117+0000","last_unstale":"2024-04-26T12:42:41.977593+0000","last_undegraded":"2024-04-26T12:42:41.977593+0000","last_fullsized":"2024-04-26T12:42:41.977593+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"139'66","reported_seq":320,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.847893+0000","last_change":"2024-04-26T12:38:10.429259+0000","last_active":"2024-04-26T12:42:52.847893+0000","last_peered":"2024-04-26T12:42:52.847893+0000","last_clean":"2024-04-26T12:42:52.847893+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:42:52.847893+0000","last_undegraded":"2024-04-26T12:42:52.847893+0000","last_fullsized":"2024-04-26T12:42:52.847893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":76,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"22'2","reported_seq":338,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:51.764257+0000","last_change":"2024-04-26T12:38:14.448317+0000","last_active":"2024-04-26T12:42:51.764257+0000","last_peered":"2024-04-26T12:42:51.764257+0000","last_clean":"2024-04-26T12:42:51.764257+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:42:51.764257+0000","last_undegraded":"2024-04-26T12:42:51.764257+0000","last_fullsized":"2024-04-26T12:42:51.764257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"139'18","reported_seq":316,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:44.750561+0000","last_change":"2024-04-26T12:38:16.530295+0000","last_active":"2024-04-26T12:42:44.750561+0000","last_peered":"2024-04-26T12:42:44.750561+0000","last_clean":"2024-04-26T12:42:44.750561+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:42:44.750561+0000","last_undegraded":"2024-04-26T12:42:44.750561+0000","last_fullsized":"2024-04-26T12:42:44.750561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:10.032752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070025+0000","last_change":"2024-04-26T12:38:18.488977+0000","last_active":"2024-04-26T12:42:41.070025+0000","last_peered":"2024-04-26T12:42:41.070025+0000","last_clean":"2024-04-26T12:42:41.070025+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:42:41.070025+0000","last_undegraded":"2024-04-26T12:42:41.070025+0000","last_fullsized":"2024-04-26T12:42:41.070025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070589+0000","last_change":"2024-04-26T12:42:21.942734+0000","last_active":"2024-04-26T12:42:41.070589+0000","last_peered":"2024-04-26T12:42:41.070589+0000","last_clean":"2024-04-26T12:42:41.070589+0000","last_became_active":"2024-04-26T12:42:21.928602+0000","last_became_peered":"2024-04-26T12:42:21.928602+0000","last_unstale":"2024-04-26T12:42:41.070589+0000","last_undegraded":"2024-04-26T12:42:41.070589+0000","last_fullsized":"2024-04-26T12:42:41.070589+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:45.167813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409146+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:42:41.409146+0000","last_peered":"2024-04-26T12:42:41.409146+0000","last_clean":"2024-04-26T12:42:41.409146+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:42:41.409146+0000","last_undegraded":"2024-04-26T12:42:41.409146+0000","last_fullsized":"2024-04-26T12:42:41.409146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122667+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:42:42.122667+0000","last_peered":"2024-04-26T12:42:42.122667+0000","last_clean":"2024-04-26T12:42:42.122667+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:42:42.122667+0000","last_undegraded":"2024-04-26T12:42:42.122667+0000","last_fullsized":"2024-04-26T12:42:42.122667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:11.026343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"139'36","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.773197+0000","last_change":"2024-04-26T12:42:34.006811+0000","last_active":"2024-04-26T12:42:52.773197+0000","last_peered":"2024-04-26T12:42:52.773197+0000","last_clean":"2024-04-26T12:42:52.773197+0000","last_became_active":"2024-04-26T12:42:34.004041+0000","last_became_peered":"2024-04-26T12:42:34.004041+0000","last_unstale":"2024-04-26T12:42:52.773197+0000","last_undegraded":"2024-04-26T12:42:52.773197+0000","last_fullsized":"2024-04-26T12:42:52.773197+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069585+0000","last_change":"2024-04-26T12:38:14.446703+0000","last_active":"2024-04-26T12:42:41.069585+0000","last_peered":"2024-04-26T12:42:41.069585+0000","last_clean":"2024-04-26T12:42:41.069585+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:42:41.069585+0000","last_undegraded":"2024-04-26T12:42:41.069585+0000","last_fullsized":"2024-04-26T12:42:41.069585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073574+0000","last_change":"2024-04-26T12:42:21.946073+0000","last_active":"2024-04-26T12:42:41.073574+0000","last_peered":"2024-04-26T12:42:41.073574+0000","last_clean":"2024-04-26T12:42:41.073574+0000","last_became_active":"2024-04-26T12:42:21.942937+0000","last_became_peered":"2024-04-26T12:42:21.942937+0000","last_unstale":"2024-04-26T12:42:41.073574+0000","last_undegraded":"2024-04-26T12:42:41.073574+0000","last_fullsized":"2024-04-26T12:42:41.073574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:30.907752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515300+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:42:42.515300+0000","last_peered":"2024-04-26T12:42:42.515300+0000","last_clean":"2024-04-26T12:42:42.515300+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:42:42.515300+0000","last_undegraded":"2024-04-26T12:42:42.515300+0000","last_fullsized":"2024-04-26T12:42:42.515300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:53:34.568906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121144+0000","last_change":"2024-04-26T12:42:21.942893+0000","last_active":"2024-04-26T12:42:42.121144+0000","last_peered":"2024-04-26T12:42:42.121144+0000","last_clean":"2024-04-26T12:42:42.121144+0000","last_became_active":"2024-04-26T12:42:21.941954+0000","last_became_peered":"2024-04-26T12:42:21.941954+0000","last_unstale":"2024-04-26T12:42:42.121144+0000","last_undegraded":"2024-04-26T12:42:42.121144+0000","last_fullsized":"2024-04-26T12:42:42.121144+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:42.014601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":258,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408508+0000","last_change":"2024-04-26T12:38:12.456776+0000","last_active":"2024-04-26T12:42:41.408508+0000","last_peered":"2024-04-26T12:42:41.408508+0000","last_clean":"2024-04-26T12:42:41.408508+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:42:41.408508+0000","last_undegraded":"2024-04-26T12:42:41.408508+0000","last_fullsized":"2024-04-26T12:42:41.408508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'52","reported_seq":313,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.786322+0000","last_change":"2024-04-26T12:42:21.924370+0000","last_active":"2024-04-26T12:42:52.786322+0000","last_peered":"2024-04-26T12:42:52.786322+0000","last_clean":"2024-04-26T12:42:52.786322+0000","last_became_active":"2024-04-26T12:42:21.923345+0000","last_became_peered":"2024-04-26T12:42:21.923345+0000","last_unstale":"2024-04-26T12:42:52.786322+0000","last_undegraded":"2024-04-26T12:42:52.786322+0000","last_fullsized":"2024-04-26T12:42:52.786322+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:11.162289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409372+0000","last_change":"2024-04-26T12:38:04.410988+0000","last_active":"2024-04-26T12:42:41.409372+0000","last_peered":"2024-04-26T12:42:41.409372+0000","last_clean":"2024-04-26T12:42:41.409372+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:42:41.409372+0000","last_undegraded":"2024-04-26T12:42:41.409372+0000","last_fullsized":"2024-04-26T12:42:41.409372+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071244+0000","last_change":"2024-04-26T12:38:14.463232+0000","last_active":"2024-04-26T12:42:41.071244+0000","last_peered":"2024-04-26T12:42:41.071244+0000","last_clean":"2024-04-26T12:42:41.071244+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:42:41.071244+0000","last_undegraded":"2024-04-26T12:42:41.071244+0000","last_fullsized":"2024-04-26T12:42:41.071244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"139'40","reported_seq":310,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.882697+0000","last_change":"2024-04-26T12:42:21.957374+0000","last_active":"2024-04-26T12:42:52.882697+0000","last_peered":"2024-04-26T12:42:52.882697+0000","last_clean":"2024-04-26T12:42:52.882697+0000","last_became_active":"2024-04-26T12:42:21.956451+0000","last_became_peered":"2024-04-26T12:42:21.956451+0000","last_unstale":"2024-04-26T12:42:52.882697+0000","last_undegraded":"2024-04-26T12:42:52.882697+0000","last_fullsized":"2024-04-26T12:42:52.882697+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":205,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065655+0000","last_change":"2024-04-26T12:42:34.015627+0000","last_active":"2024-04-26T12:42:41.065655+0000","last_peered":"2024-04-26T12:42:41.065655+0000","last_clean":"2024-04-26T12:42:41.065655+0000","last_became_active":"2024-04-26T12:42:34.014949+0000","last_became_peered":"2024-04-26T12:42:34.014949+0000","last_unstale":"2024-04-26T12:42:41.065655+0000","last_undegraded":"2024-04-26T12:42:41.065655+0000","last_fullsized":"2024-04-26T12:42:41.065655+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.844369+0000","last_change":"2024-04-26T12:38:20.713750+0000","last_active":"2024-04-26T12:42:52.844369+0000","last_peered":"2024-04-26T12:42:52.844369+0000","last_clean":"2024-04-26T12:42:52.844369+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:42:52.844369+0000","last_undegraded":"2024-04-26T12:42:52.844369+0000","last_fullsized":"2024-04-26T12:42:52.844369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072454+0000","last_change":"2024-04-26T12:38:12.457796+0000","last_active":"2024-04-26T12:42:41.072454+0000","last_peered":"2024-04-26T12:42:41.072454+0000","last_clean":"2024-04-26T12:42:41.072454+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:42:41.072454+0000","last_undegraded":"2024-04-26T12:42:41.072454+0000","last_fullsized":"2024-04-26T12:42:41.072454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"139'62","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.842288+0000","last_change":"2024-04-26T12:38:10.428525+0000","last_active":"2024-04-26T12:42:52.842288+0000","last_peered":"2024-04-26T12:42:52.842288+0000","last_clean":"2024-04-26T12:42:52.842288+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:42:52.842288+0000","last_undegraded":"2024-04-26T12:42:52.842288+0000","last_fullsized":"2024-04-26T12:42:52.842288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519825+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:42:42.519825+0000","last_peered":"2024-04-26T12:42:42.519825+0000","last_clean":"2024-04-26T12:42:42.519825+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:42:42.519825+0000","last_undegraded":"2024-04-26T12:42:42.519825+0000","last_fullsized":"2024-04-26T12:42:42.519825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:26.687613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518456+0000","last_change":"2024-04-26T12:38:14.453126+0000","last_active":"2024-04-26T12:42:42.518456+0000","last_peered":"2024-04-26T12:42:42.518456+0000","last_clean":"2024-04-26T12:42:42.518456+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:42:42.518456+0000","last_undegraded":"2024-04-26T12:42:42.518456+0000","last_fullsized":"2024-04-26T12:42:42.518456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.545694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"29'14","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408171+0000","last_change":"2024-04-26T12:38:16.527238+0000","last_active":"2024-04-26T12:42:41.408171+0000","last_peered":"2024-04-26T12:42:41.408171+0000","last_clean":"2024-04-26T12:42:41.408171+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:42:41.408171+0000","last_undegraded":"2024-04-26T12:42:41.408171+0000","last_fullsized":"2024-04-26T12:42:41.408171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"139'138","reported_seq":430,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:51.771617+0000","last_change":"2024-04-26T12:38:18.496909+0000","last_active":"2024-04-26T12:42:51.771617+0000","last_peered":"2024-04-26T12:42:51.771617+0000","last_clean":"2024-04-26T12:42:51.771617+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:42:51.771617+0000","last_undegraded":"2024-04-26T12:42:51.771617+0000","last_fullsized":"2024-04-26T12:42:51.771617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:49.777712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":219,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073784+0000","last_change":"2024-04-26T12:42:21.962241+0000","last_active":"2024-04-26T12:42:41.073784+0000","last_peered":"2024-04-26T12:42:41.073784+0000","last_clean":"2024-04-26T12:42:41.073784+0000","last_became_active":"2024-04-26T12:42:21.960618+0000","last_became_peered":"2024-04-26T12:42:21.960618+0000","last_unstale":"2024-04-26T12:42:41.073784+0000","last_undegraded":"2024-04-26T12:42:41.073784+0000","last_fullsized":"2024-04-26T12:42:41.073784+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:50:39.076778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067522+0000","last_change":"2024-04-26T12:42:21.965811+0000","last_active":"2024-04-26T12:42:41.067522+0000","last_peered":"2024-04-26T12:42:41.067522+0000","last_clean":"2024-04-26T12:42:41.067522+0000","last_became_active":"2024-04-26T12:42:21.960998+0000","last_became_peered":"2024-04-26T12:42:21.960998+0000","last_unstale":"2024-04-26T12:42:41.067522+0000","last_undegraded":"2024-04-26T12:42:41.067522+0000","last_fullsized":"2024-04-26T12:42:41.067522+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.081118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"139'54","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.682260+0000","last_change":"2024-04-26T12:42:21.971344+0000","last_active":"2024-04-26T12:42:52.682260+0000","last_peered":"2024-04-26T12:42:52.682260+0000","last_clean":"2024-04-26T12:42:52.682260+0000","last_became_active":"2024-04-26T12:42:21.968901+0000","last_became_peered":"2024-04-26T12:42:21.968901+0000","last_unstale":"2024-04-26T12:42:52.682260+0000","last_undegraded":"2024-04-26T12:42:52.682260+0000","last_fullsized":"2024-04-26T12:42:52.682260+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:04.596971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409949+0000","last_change":"2024-04-26T12:38:04.382121+0000","last_active":"2024-04-26T12:42:41.409949+0000","last_peered":"2024-04-26T12:42:41.409949+0000","last_clean":"2024-04-26T12:42:41.409949+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:42:41.409949+0000","last_undegraded":"2024-04-26T12:42:41.409949+0000","last_fullsized":"2024-04-26T12:42:41.409949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":204,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065913+0000","last_change":"2024-04-26T12:42:34.016582+0000","last_active":"2024-04-26T12:42:41.065913+0000","last_peered":"2024-04-26T12:42:41.065913+0000","last_clean":"2024-04-26T12:42:41.065913+0000","last_became_active":"2024-04-26T12:42:34.015774+0000","last_became_peered":"2024-04-26T12:42:34.015774+0000","last_unstale":"2024-04-26T12:42:41.065913+0000","last_undegraded":"2024-04-26T12:42:41.065913+0000","last_fullsized":"2024-04-26T12:42:41.065913+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":72,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067532+0000","last_change":"2024-04-26T12:42:34.031336+0000","last_active":"2024-04-26T12:42:41.067532+0000","last_peered":"2024-04-26T12:42:41.067532+0000","last_clean":"2024-04-26T12:42:41.067532+0000","last_became_active":"2024-04-26T12:42:34.029037+0000","last_became_peered":"2024-04-26T12:42:34.029037+0000","last_unstale":"2024-04-26T12:42:41.067532+0000","last_undegraded":"2024-04-26T12:42:41.067532+0000","last_fullsized":"2024-04-26T12:42:41.067532+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"139'140","reported_seq":417,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:51.779874+0000","last_change":"2024-04-26T12:42:21.972386+0000","last_active":"2024-04-26T12:42:51.779874+0000","last_peered":"2024-04-26T12:42:51.779874+0000","last_clean":"2024-04-26T12:42:51.779874+0000","last_became_active":"2024-04-26T12:42:21.962332+0000","last_became_peered":"2024-04-26T12:42:21.962332+0000","last_unstale":"2024-04-26T12:42:51.779874+0000","last_undegraded":"2024-04-26T12:42:51.779874+0000","last_fullsized":"2024-04-26T12:42:51.779874+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:50.916736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.844341+0000","last_change":"2024-04-26T12:42:21.957370+0000","last_active":"2024-04-26T12:42:52.844341+0000","last_peered":"2024-04-26T12:42:52.844341+0000","last_clean":"2024-04-26T12:42:52.844341+0000","last_became_active":"2024-04-26T12:42:21.956715+0000","last_became_peered":"2024-04-26T12:42:21.956715+0000","last_unstale":"2024-04-26T12:42:52.844341+0000","last_undegraded":"2024-04-26T12:42:52.844341+0000","last_fullsized":"2024-04-26T12:42:52.844341+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":116,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067762+0000","last_change":"2024-04-26T12:42:34.013472+0000","last_active":"2024-04-26T12:42:41.067762+0000","last_peered":"2024-04-26T12:42:41.067762+0000","last_clean":"2024-04-26T12:42:41.067762+0000","last_became_active":"2024-04-26T12:42:34.010800+0000","last_became_peered":"2024-04-26T12:42:34.010800+0000","last_unstale":"2024-04-26T12:42:41.067762+0000","last_undegraded":"2024-04-26T12:42:41.067762+0000","last_fullsized":"2024-04-26T12:42:41.067762+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"139'46","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.807333+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:42:52.807333+0000","last_peered":"2024-04-26T12:42:52.807333+0000","last_clean":"2024-04-26T12:42:52.807333+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:42:52.807333+0000","last_undegraded":"2024-04-26T12:42:52.807333+0000","last_fullsized":"2024-04-26T12:42:52.807333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521218+0000","last_change":"2024-04-26T12:38:04.386207+0000","last_active":"2024-04-26T12:42:42.521218+0000","last_peered":"2024-04-26T12:42:42.521218+0000","last_clean":"2024-04-26T12:42:42.521218+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:42:42.521218+0000","last_undegraded":"2024-04-26T12:42:42.521218+0000","last_fullsized":"2024-04-26T12:42:42.521218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:04.346660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068515+0000","last_change":"2024-04-26T12:42:21.941484+0000","last_active":"2024-04-26T12:42:41.068515+0000","last_peered":"2024-04-26T12:42:41.068515+0000","last_clean":"2024-04-26T12:42:41.068515+0000","last_became_active":"2024-04-26T12:42:21.926472+0000","last_became_peered":"2024-04-26T12:42:21.926472+0000","last_unstale":"2024-04-26T12:42:41.068515+0000","last_undegraded":"2024-04-26T12:42:41.068515+0000","last_fullsized":"2024-04-26T12:42:41.068515+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:33:46.214353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"139'52","reported_seq":319,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.869377+0000","last_change":"2024-04-26T12:38:16.528710+0000","last_active":"2024-04-26T12:42:52.869377+0000","last_peered":"2024-04-26T12:42:52.869377+0000","last_clean":"2024-04-26T12:42:52.869377+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:42:52.869377+0000","last_undegraded":"2024-04-26T12:42:52.869377+0000","last_fullsized":"2024-04-26T12:42:52.869377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:42.646574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068343+0000","last_change":"2024-04-26T12:42:21.919160+0000","last_active":"2024-04-26T12:42:41.068343+0000","last_peered":"2024-04-26T12:42:41.068343+0000","last_clean":"2024-04-26T12:42:41.068343+0000","last_became_active":"2024-04-26T12:42:21.918031+0000","last_became_peered":"2024-04-26T12:42:21.918031+0000","last_unstale":"2024-04-26T12:42:41.068343+0000","last_undegraded":"2024-04-26T12:42:41.068343+0000","last_fullsized":"2024-04-26T12:42:41.068343+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:35.941555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122700+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:42:42.122700+0000","last_peered":"2024-04-26T12:42:42.122700+0000","last_clean":"2024-04-26T12:42:42.122700+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:42:42.122700+0000","last_undegraded":"2024-04-26T12:42:42.122700+0000","last_fullsized":"2024-04-26T12:42:42.122700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:28.051316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069715+0000","last_change":"2024-04-26T12:38:20.515240+0000","last_active":"2024-04-26T12:42:41.069715+0000","last_peered":"2024-04-26T12:42:41.069715+0000","last_clean":"2024-04-26T12:42:41.069715+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:42:41.069715+0000","last_undegraded":"2024-04-26T12:42:41.069715+0000","last_fullsized":"2024-04-26T12:42:41.069715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":187,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067070+0000","last_change":"2024-04-26T12:42:34.023953+0000","last_active":"2024-04-26T12:42:41.067070+0000","last_peered":"2024-04-26T12:42:41.067070+0000","last_clean":"2024-04-26T12:42:41.067070+0000","last_became_active":"2024-04-26T12:42:34.022792+0000","last_became_peered":"2024-04-26T12:42:34.022792+0000","last_unstale":"2024-04-26T12:42:41.067070+0000","last_undegraded":"2024-04-26T12:42:41.067070+0000","last_fullsized":"2024-04-26T12:42:41.067070+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"139'40","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.823754+0000","last_change":"2024-04-26T12:42:34.012055+0000","last_active":"2024-04-26T12:42:52.823754+0000","last_peered":"2024-04-26T12:42:52.823754+0000","last_clean":"2024-04-26T12:42:52.823754+0000","last_became_active":"2024-04-26T12:42:34.008295+0000","last_became_peered":"2024-04-26T12:42:34.008295+0000","last_unstale":"2024-04-26T12:42:52.823754+0000","last_undegraded":"2024-04-26T12:42:52.823754+0000","last_fullsized":"2024-04-26T12:42:52.823754+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.348223+0000","last_change":"2024-04-26T12:38:14.455947+0000","last_active":"2024-04-26T12:42:56.348223+0000","last_peered":"2024-04-26T12:42:56.348223+0000","last_clean":"2024-04-26T12:42:56.348223+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:42:56.348223+0000","last_undegraded":"2024-04-26T12:42:56.348223+0000","last_fullsized":"2024-04-26T12:42:56.348223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"139'22","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.362597+0000","last_change":"2024-04-26T12:42:21.967112+0000","last_active":"2024-04-26T12:42:52.362597+0000","last_peered":"2024-04-26T12:42:52.362597+0000","last_clean":"2024-04-26T12:42:52.362597+0000","last_became_active":"2024-04-26T12:42:21.964467+0000","last_became_peered":"2024-04-26T12:42:21.964467+0000","last_unstale":"2024-04-26T12:42:52.362597+0000","last_undegraded":"2024-04-26T12:42:52.362597+0000","last_fullsized":"2024-04-26T12:42:52.362597+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:41.170576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072547+0000","last_change":"2024-04-26T12:42:21.964141+0000","last_active":"2024-04-26T12:42:41.072547+0000","last_peered":"2024-04-26T12:42:41.072547+0000","last_clean":"2024-04-26T12:42:41.072547+0000","last_became_active":"2024-04-26T12:42:21.959360+0000","last_became_peered":"2024-04-26T12:42:21.959360+0000","last_unstale":"2024-04-26T12:42:41.072547+0000","last_undegraded":"2024-04-26T12:42:41.072547+0000","last_fullsized":"2024-04-26T12:42:41.072547+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:57.964968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074053+0000","last_change":"2024-04-26T12:42:21.970393+0000","last_active":"2024-04-26T12:42:41.074053+0000","last_peered":"2024-04-26T12:42:41.074053+0000","last_clean":"2024-04-26T12:42:41.074053+0000","last_became_active":"2024-04-26T12:42:21.968658+0000","last_became_peered":"2024-04-26T12:42:21.968658+0000","last_unstale":"2024-04-26T12:42:41.074053+0000","last_undegraded":"2024-04-26T12:42:41.074053+0000","last_fullsized":"2024-04-26T12:42:41.074053+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:45.400045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.843384+0000","last_change":"2024-04-26T12:38:12.466596+0000","last_active":"2024-04-26T12:42:52.843384+0000","last_peered":"2024-04-26T12:42:52.843384+0000","last_clean":"2024-04-26T12:42:52.843384+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:42:52.843384+0000","last_undegraded":"2024-04-26T12:42:52.843384+0000","last_fullsized":"2024-04-26T12:42:52.843384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"139'46","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.685954+0000","last_change":"2024-04-26T12:42:21.956317+0000","last_active":"2024-04-26T12:42:52.685954+0000","last_peered":"2024-04-26T12:42:52.685954+0000","last_clean":"2024-04-26T12:42:52.685954+0000","last_became_active":"2024-04-26T12:42:21.955428+0000","last_became_peered":"2024-04-26T12:42:21.955428+0000","last_unstale":"2024-04-26T12:42:52.685954+0000","last_undegraded":"2024-04-26T12:42:52.685954+0000","last_fullsized":"2024-04-26T12:42:52.685954+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:50.243608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067590+0000","last_change":"2024-04-26T12:42:21.973314+0000","last_active":"2024-04-26T12:42:41.067590+0000","last_peered":"2024-04-26T12:42:41.067590+0000","last_clean":"2024-04-26T12:42:41.067590+0000","last_became_active":"2024-04-26T12:42:21.964554+0000","last_became_peered":"2024-04-26T12:42:21.964554+0000","last_unstale":"2024-04-26T12:42:41.067590+0000","last_undegraded":"2024-04-26T12:42:41.067590+0000","last_fullsized":"2024-04-26T12:42:41.067590+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:20.524995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"120'9","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:55.874164+0000","last_change":"2024-04-26T12:38:16.475501+0000","last_active":"2024-04-26T12:42:55.874164+0000","last_peered":"2024-04-26T12:42:55.874164+0000","last_clean":"2024-04-26T12:42:55.874164+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:42:55.874164+0000","last_undegraded":"2024-04-26T12:42:55.874164+0000","last_fullsized":"2024-04-26T12:42:55.874164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517959+0000","last_change":"2024-04-26T12:38:18.490946+0000","last_active":"2024-04-26T12:42:42.517959+0000","last_peered":"2024-04-26T12:42:42.517959+0000","last_clean":"2024-04-26T12:42:42.517959+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:42:42.517959+0000","last_undegraded":"2024-04-26T12:42:42.517959+0000","last_fullsized":"2024-04-26T12:42:42.517959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:49.511900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069364+0000","last_change":"2024-04-26T12:38:20.501912+0000","last_active":"2024-04-26T12:42:41.069364+0000","last_peered":"2024-04-26T12:42:41.069364+0000","last_clean":"2024-04-26T12:42:41.069364+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:42:41.069364+0000","last_undegraded":"2024-04-26T12:42:41.069364+0000","last_fullsized":"2024-04-26T12:42:41.069364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069067+0000","last_change":"2024-04-26T12:42:21.967538+0000","last_active":"2024-04-26T12:42:41.069067+0000","last_peered":"2024-04-26T12:42:41.069067+0000","last_clean":"2024-04-26T12:42:41.069067+0000","last_became_active":"2024-04-26T12:42:21.965760+0000","last_became_peered":"2024-04-26T12:42:21.965760+0000","last_unstale":"2024-04-26T12:42:41.069067+0000","last_undegraded":"2024-04-26T12:42:41.069067+0000","last_fullsized":"2024-04-26T12:42:41.069067+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:34.724137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"139'54","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.775736+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:42:52.775736+0000","last_peered":"2024-04-26T12:42:52.775736+0000","last_clean":"2024-04-26T12:42:52.775736+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:42:52.775736+0000","last_undegraded":"2024-04-26T12:42:52.775736+0000","last_fullsized":"2024-04-26T12:42:52.775736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:35.399361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516284+0000","last_change":"2024-04-26T12:38:14.451803+0000","last_active":"2024-04-26T12:42:42.516284+0000","last_peered":"2024-04-26T12:42:42.516284+0000","last_clean":"2024-04-26T12:42:42.516284+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:42:42.516284+0000","last_undegraded":"2024-04-26T12:42:42.516284+0000","last_fullsized":"2024-04-26T12:42:42.516284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:20.824700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"139'22","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.874616+0000","last_change":"2024-04-26T12:42:21.974557+0000","last_active":"2024-04-26T12:42:52.874616+0000","last_peered":"2024-04-26T12:42:52.874616+0000","last_clean":"2024-04-26T12:42:52.874616+0000","last_became_active":"2024-04-26T12:42:21.967735+0000","last_became_peered":"2024-04-26T12:42:21.967735+0000","last_unstale":"2024-04-26T12:42:52.874616+0000","last_undegraded":"2024-04-26T12:42:52.874616+0000","last_fullsized":"2024-04-26T12:42:52.874616+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:01.266925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.514868+0000","last_change":"2024-04-26T12:38:18.491480+0000","last_active":"2024-04-26T12:42:42.514868+0000","last_peered":"2024-04-26T12:42:42.514868+0000","last_clean":"2024-04-26T12:42:42.514868+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:42:42.514868+0000","last_undegraded":"2024-04-26T12:42:42.514868+0000","last_fullsized":"2024-04-26T12:42:42.514868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:30.654181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121837+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:42:42.121837+0000","last_peered":"2024-04-26T12:42:42.121837+0000","last_clean":"2024-04-26T12:42:42.121837+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:42:42.121837+0000","last_undegraded":"2024-04-26T12:42:42.121837+0000","last_fullsized":"2024-04-26T12:42:42.121837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:31.149079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068104+0000","last_change":"2024-04-26T12:42:21.946016+0000","last_active":"2024-04-26T12:42:41.068104+0000","last_peered":"2024-04-26T12:42:41.068104+0000","last_clean":"2024-04-26T12:42:41.068104+0000","last_became_active":"2024-04-26T12:42:21.927785+0000","last_became_peered":"2024-04-26T12:42:21.927785+0000","last_unstale":"2024-04-26T12:42:41.068104+0000","last_undegraded":"2024-04-26T12:42:41.068104+0000","last_fullsized":"2024-04-26T12:42:41.068104+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:08.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'40","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.837717+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:42:52.837717+0000","last_peered":"2024-04-26T12:42:52.837717+0000","last_clean":"2024-04-26T12:42:52.837717+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:42:52.837717+0000","last_undegraded":"2024-04-26T12:42:52.837717+0000","last_fullsized":"2024-04-26T12:42:52.837717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518182+0000","last_change":"2024-04-26T12:38:14.464636+0000","last_active":"2024-04-26T12:42:42.518182+0000","last_peered":"2024-04-26T12:42:42.518182+0000","last_clean":"2024-04-26T12:42:42.518182+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:42:42.518182+0000","last_undegraded":"2024-04-26T12:42:42.518182+0000","last_fullsized":"2024-04-26T12:42:42.518182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:41.804087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"139'23","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.862085+0000","last_change":"2024-04-26T12:38:16.473474+0000","last_active":"2024-04-26T12:42:52.862085+0000","last_peered":"2024-04-26T12:42:52.862085+0000","last_clean":"2024-04-26T12:42:52.862085+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:42:52.862085+0000","last_undegraded":"2024-04-26T12:42:52.862085+0000","last_fullsized":"2024-04-26T12:42:52.862085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:52.994254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:55.874302+0000","last_change":"2024-04-26T12:38:18.496247+0000","last_active":"2024-04-26T12:42:55.874302+0000","last_peered":"2024-04-26T12:42:55.874302+0000","last_clean":"2024-04-26T12:42:55.874302+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:42:55.874302+0000","last_undegraded":"2024-04-26T12:42:55.874302+0000","last_fullsized":"2024-04-26T12:42:55.874302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.521075+0000","last_change":"2024-04-26T12:38:12.458053+0000","last_active":"2024-04-26T12:42:42.521075+0000","last_peered":"2024-04-26T12:42:42.521075+0000","last_clean":"2024-04-26T12:42:42.521075+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:42:42.521075+0000","last_undegraded":"2024-04-26T12:42:42.521075+0000","last_fullsized":"2024-04-26T12:42:42.521075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:03.791183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"139'30","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.800186+0000","last_change":"2024-04-26T12:42:21.967299+0000","last_active":"2024-04-26T12:42:52.800186+0000","last_peered":"2024-04-26T12:42:52.800186+0000","last_clean":"2024-04-26T12:42:52.800186+0000","last_became_active":"2024-04-26T12:42:21.964241+0000","last_became_peered":"2024-04-26T12:42:21.964241+0000","last_unstale":"2024-04-26T12:42:52.800186+0000","last_undegraded":"2024-04-26T12:42:52.800186+0000","last_fullsized":"2024-04-26T12:42:52.800186+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:24.434946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.071561+0000","last_change":"2024-04-26T12:38:14.458159+0000","last_active":"2024-04-26T12:42:41.071561+0000","last_peered":"2024-04-26T12:42:41.071561+0000","last_clean":"2024-04-26T12:42:41.071561+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:42:41.071561+0000","last_undegraded":"2024-04-26T12:42:41.071561+0000","last_fullsized":"2024-04-26T12:42:41.071561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"139'34","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.859721+0000","last_change":"2024-04-26T12:38:16.477445+0000","last_active":"2024-04-26T12:42:52.859721+0000","last_peered":"2024-04-26T12:42:52.859721+0000","last_clean":"2024-04-26T12:42:52.859721+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:42:52.859721+0000","last_undegraded":"2024-04-26T12:42:52.859721+0000","last_fullsized":"2024-04-26T12:42:52.859721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122126+0000","last_change":"2024-04-26T12:42:21.947268+0000","last_active":"2024-04-26T12:42:42.122126+0000","last_peered":"2024-04-26T12:42:42.122126+0000","last_clean":"2024-04-26T12:42:42.122126+0000","last_became_active":"2024-04-26T12:42:21.946664+0000","last_became_peered":"2024-04-26T12:42:21.946664+0000","last_unstale":"2024-04-26T12:42:42.122126+0000","last_undegraded":"2024-04-26T12:42:42.122126+0000","last_fullsized":"2024-04-26T12:42:42.122126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:21.575803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067833+0000","last_change":"2024-04-26T12:42:21.973393+0000","last_active":"2024-04-26T12:42:41.067833+0000","last_peered":"2024-04-26T12:42:41.067833+0000","last_clean":"2024-04-26T12:42:41.067833+0000","last_became_active":"2024-04-26T12:42:21.963727+0000","last_became_peered":"2024-04-26T12:42:21.963727+0000","last_unstale":"2024-04-26T12:42:41.067833+0000","last_undegraded":"2024-04-26T12:42:41.067833+0000","last_fullsized":"2024-04-26T12:42:41.067833+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:52.960136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.074470+0000","last_change":"2024-04-26T12:38:12.462735+0000","last_active":"2024-04-26T12:42:41.074470+0000","last_peered":"2024-04-26T12:42:41.074470+0000","last_clean":"2024-04-26T12:42:41.074470+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:42:41.074470+0000","last_undegraded":"2024-04-26T12:42:41.074470+0000","last_fullsized":"2024-04-26T12:42:41.074470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"139'64","reported_seq":323,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.838949+0000","last_change":"2024-04-26T12:42:21.934786+0000","last_active":"2024-04-26T12:42:52.838949+0000","last_peered":"2024-04-26T12:42:52.838949+0000","last_clean":"2024-04-26T12:42:52.838949+0000","last_became_active":"2024-04-26T12:42:21.933941+0000","last_became_peered":"2024-04-26T12:42:21.933941+0000","last_unstale":"2024-04-26T12:42:52.838949+0000","last_undegraded":"2024-04-26T12:42:52.838949+0000","last_fullsized":"2024-04-26T12:42:52.838949+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520965+0000","last_change":"2024-04-26T12:38:14.465377+0000","last_active":"2024-04-26T12:42:42.520965+0000","last_peered":"2024-04-26T12:42:42.520965+0000","last_clean":"2024-04-26T12:42:42.520965+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:42:42.520965+0000","last_undegraded":"2024-04-26T12:42:42.520965+0000","last_fullsized":"2024-04-26T12:42:42.520965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:19.979331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"139'26","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.865002+0000","last_change":"2024-04-26T12:38:16.465737+0000","last_active":"2024-04-26T12:42:52.865002+0000","last_peered":"2024-04-26T12:42:52.865002+0000","last_clean":"2024-04-26T12:42:52.865002+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:42:52.865002+0000","last_undegraded":"2024-04-26T12:42:52.865002+0000","last_fullsized":"2024-04-26T12:42:52.865002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:58.391087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409274+0000","last_change":"2024-04-26T12:38:18.491709+0000","last_active":"2024-04-26T12:42:41.409274+0000","last_peered":"2024-04-26T12:42:41.409274+0000","last_clean":"2024-04-26T12:42:41.409274+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:42:41.409274+0000","last_undegraded":"2024-04-26T12:42:41.409274+0000","last_fullsized":"2024-04-26T12:42:41.409274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518124+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:42:42.518124+0000","last_peered":"2024-04-26T12:42:42.518124+0000","last_clean":"2024-04-26T12:42:42.518124+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:42:42.518124+0000","last_undegraded":"2024-04-26T12:42:42.518124+0000","last_fullsized":"2024-04-26T12:42:42.518124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:31:06.902303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":217,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072909+0000","last_change":"2024-04-26T12:42:21.925516+0000","last_active":"2024-04-26T12:42:41.072909+0000","last_peered":"2024-04-26T12:42:41.072909+0000","last_clean":"2024-04-26T12:42:41.072909+0000","last_became_active":"2024-04-26T12:42:21.924628+0000","last_became_peered":"2024-04-26T12:42:21.924628+0000","last_unstale":"2024-04-26T12:42:41.072909+0000","last_undegraded":"2024-04-26T12:42:41.072909+0000","last_fullsized":"2024-04-26T12:42:41.072909+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:18.079347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"139'42","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.842130+0000","last_change":"2024-04-26T12:42:34.034805+0000","last_active":"2024-04-26T12:42:52.842130+0000","last_peered":"2024-04-26T12:42:52.842130+0000","last_clean":"2024-04-26T12:42:52.842130+0000","last_became_active":"2024-04-26T12:42:34.034029+0000","last_became_peered":"2024-04-26T12:42:34.034029+0000","last_unstale":"2024-04-26T12:42:52.842130+0000","last_undegraded":"2024-04-26T12:42:52.842130+0000","last_fullsized":"2024-04-26T12:42:52.842130+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":204,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068607+0000","last_change":"2024-04-26T12:42:34.032136+0000","last_active":"2024-04-26T12:42:41.068607+0000","last_peered":"2024-04-26T12:42:41.068607+0000","last_clean":"2024-04-26T12:42:41.068607+0000","last_became_active":"2024-04-26T12:42:34.031261+0000","last_became_peered":"2024-04-26T12:42:34.031261+0000","last_unstale":"2024-04-26T12:42:41.068607+0000","last_undegraded":"2024-04-26T12:42:41.068607+0000","last_fullsized":"2024-04-26T12:42:41.068607+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"139'22","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.376973+0000","last_change":"2024-04-26T12:42:21.932892+0000","last_active":"2024-04-26T12:42:52.376973+0000","last_peered":"2024-04-26T12:42:52.376973+0000","last_clean":"2024-04-26T12:42:52.376973+0000","last_became_active":"2024-04-26T12:42:21.931947+0000","last_became_peered":"2024-04-26T12:42:21.931947+0000","last_unstale":"2024-04-26T12:42:52.376973+0000","last_undegraded":"2024-04-26T12:42:52.376973+0000","last_fullsized":"2024-04-26T12:42:52.376973+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:39:26.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409477+0000","last_change":"2024-04-26T12:42:21.935064+0000","last_active":"2024-04-26T12:42:41.409477+0000","last_peered":"2024-04-26T12:42:41.409477+0000","last_clean":"2024-04-26T12:42:41.409477+0000","last_became_active":"2024-04-26T12:42:21.933611+0000","last_became_peered":"2024-04-26T12:42:21.933611+0000","last_unstale":"2024-04-26T12:42:41.409477+0000","last_undegraded":"2024-04-26T12:42:41.409477+0000","last_fullsized":"2024-04-26T12:42:41.409477+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122185+0000","last_change":"2024-04-26T12:38:20.522619+0000","last_active":"2024-04-26T12:42:42.122185+0000","last_peered":"2024-04-26T12:42:42.122185+0000","last_clean":"2024-04-26T12:42:42.122185+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:42:42.122185+0000","last_undegraded":"2024-04-26T12:42:42.122185+0000","last_fullsized":"2024-04-26T12:42:42.122185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:04.666473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.976374+0000","last_change":"2024-04-26T12:38:12.460291+0000","last_active":"2024-04-26T12:42:41.976374+0000","last_peered":"2024-04-26T12:42:41.976374+0000","last_clean":"2024-04-26T12:42:41.976374+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:42:41.976374+0000","last_undegraded":"2024-04-26T12:42:41.976374+0000","last_fullsized":"2024-04-26T12:42:41.976374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"139'44","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.822203+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:42:52.822203+0000","last_peered":"2024-04-26T12:42:52.822203+0000","last_clean":"2024-04-26T12:42:52.822203+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:42:52.822203+0000","last_undegraded":"2024-04-26T12:42:52.822203+0000","last_fullsized":"2024-04-26T12:42:52.822203+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409786+0000","last_change":"2024-04-26T12:38:14.461705+0000","last_active":"2024-04-26T12:42:41.409786+0000","last_peered":"2024-04-26T12:42:41.409786+0000","last_clean":"2024-04-26T12:42:41.409786+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:42:41.409786+0000","last_undegraded":"2024-04-26T12:42:41.409786+0000","last_fullsized":"2024-04-26T12:42:41.409786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"117'12","reported_seq":62,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067390+0000","last_change":"2024-04-26T12:42:34.023030+0000","last_active":"2024-04-26T12:42:41.067390+0000","last_peered":"2024-04-26T12:42:41.067390+0000","last_clean":"2024-04-26T12:42:41.067390+0000","last_became_active":"2024-04-26T12:42:34.022362+0000","last_became_peered":"2024-04-26T12:42:34.022362+0000","last_unstale":"2024-04-26T12:42:41.067390+0000","last_undegraded":"2024-04-26T12:42:41.067390+0000","last_fullsized":"2024-04-26T12:42:41.067390+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"139'138","reported_seq":430,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:51.769715+0000","last_change":"2024-04-26T12:38:18.481802+0000","last_active":"2024-04-26T12:42:51.769715+0000","last_peered":"2024-04-26T12:42:51.769715+0000","last_clean":"2024-04-26T12:42:51.769715+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:42:51.769715+0000","last_undegraded":"2024-04-26T12:42:51.769715+0000","last_fullsized":"2024-04-26T12:42:51.769715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:34.267877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"117'4","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515862+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:42:42.515862+0000","last_peered":"2024-04-26T12:42:42.515862+0000","last_clean":"2024-04-26T12:42:42.515862+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:42:42.515862+0000","last_undegraded":"2024-04-26T12:42:42.515862+0000","last_fullsized":"2024-04-26T12:42:42.515862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:52.043226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066319+0000","last_change":"2024-04-26T12:42:34.029194+0000","last_active":"2024-04-26T12:42:41.066319+0000","last_peered":"2024-04-26T12:42:41.066319+0000","last_clean":"2024-04-26T12:42:41.066319+0000","last_became_active":"2024-04-26T12:42:34.028313+0000","last_became_peered":"2024-04-26T12:42:34.028313+0000","last_unstale":"2024-04-26T12:42:41.066319+0000","last_undegraded":"2024-04-26T12:42:41.066319+0000","last_fullsized":"2024-04-26T12:42:41.066319+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"139'52","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.607668+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:42:52.607668+0000","last_peered":"2024-04-26T12:42:52.607668+0000","last_clean":"2024-04-26T12:42:52.607668+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:42:52.607668+0000","last_undegraded":"2024-04-26T12:42:52.607668+0000","last_fullsized":"2024-04-26T12:42:52.607668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518145+0000","last_change":"2024-04-26T12:38:14.453419+0000","last_active":"2024-04-26T12:42:42.518145+0000","last_peered":"2024-04-26T12:42:42.518145+0000","last_clean":"2024-04-26T12:42:42.518145+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:42:42.518145+0000","last_undegraded":"2024-04-26T12:42:42.518145+0000","last_fullsized":"2024-04-26T12:42:42.518145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:26.630012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"139'28","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.402305+0000","last_change":"2024-04-26T12:38:16.475133+0000","last_active":"2024-04-26T12:42:52.402305+0000","last_peered":"2024-04-26T12:42:52.402305+0000","last_clean":"2024-04-26T12:42:52.402305+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:42:52.402305+0000","last_undegraded":"2024-04-26T12:42:52.402305+0000","last_fullsized":"2024-04-26T12:42:52.402305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:14.982340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070155+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:42:41.070155+0000","last_peered":"2024-04-26T12:42:41.070155+0000","last_clean":"2024-04-26T12:42:41.070155+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:42:41.070155+0000","last_undegraded":"2024-04-26T12:42:41.070155+0000","last_fullsized":"2024-04-26T12:42:41.070155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":229,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519271+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:42:42.519271+0000","last_peered":"2024-04-26T12:42:42.519271+0000","last_clean":"2024-04-26T12:42:42.519271+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:42:42.519271+0000","last_undegraded":"2024-04-26T12:42:42.519271+0000","last_fullsized":"2024-04-26T12:42:42.519271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:47.839601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"117'14","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067874+0000","last_change":"2024-04-26T12:42:34.032654+0000","last_active":"2024-04-26T12:42:41.067874+0000","last_peered":"2024-04-26T12:42:41.067874+0000","last_clean":"2024-04-26T12:42:41.067874+0000","last_became_active":"2024-04-26T12:42:34.031426+0000","last_became_peered":"2024-04-26T12:42:34.031426+0000","last_unstale":"2024-04-26T12:42:41.067874+0000","last_undegraded":"2024-04-26T12:42:41.067874+0000","last_fullsized":"2024-04-26T12:42:41.067874+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"139'76","reported_seq":329,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.818239+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:42:52.818239+0000","last_peered":"2024-04-26T12:42:52.818239+0000","last_clean":"2024-04-26T12:42:52.818239+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:42:52.818239+0000","last_undegraded":"2024-04-26T12:42:52.818239+0000","last_fullsized":"2024-04-26T12:42:52.818239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:49.190334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":76,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122227+0000","last_change":"2024-04-26T12:38:14.459149+0000","last_active":"2024-04-26T12:42:42.122227+0000","last_peered":"2024-04-26T12:42:42.122227+0000","last_clean":"2024-04-26T12:42:42.122227+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:42:42.122227+0000","last_undegraded":"2024-04-26T12:42:42.122227+0000","last_fullsized":"2024-04-26T12:42:42.122227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:04.053137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"139'22","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.693045+0000","last_change":"2024-04-26T12:38:16.477179+0000","last_active":"2024-04-26T12:42:52.693045+0000","last_peered":"2024-04-26T12:42:52.693045+0000","last_clean":"2024-04-26T12:42:52.693045+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:42:52.693045+0000","last_undegraded":"2024-04-26T12:42:52.693045+0000","last_fullsized":"2024-04-26T12:42:52.693045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":254,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517640+0000","last_change":"2024-04-26T12:38:18.482461+0000","last_active":"2024-04-26T12:42:42.517640+0000","last_peered":"2024-04-26T12:42:42.517640+0000","last_clean":"2024-04-26T12:42:42.517640+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:42:42.517640+0000","last_undegraded":"2024-04-26T12:42:42.517640+0000","last_fullsized":"2024-04-26T12:42:42.517640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:24.848869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":183,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073883+0000","last_change":"2024-04-26T12:42:21.961763+0000","last_active":"2024-04-26T12:42:41.073883+0000","last_peered":"2024-04-26T12:42:41.073883+0000","last_clean":"2024-04-26T12:42:41.073883+0000","last_became_active":"2024-04-26T12:42:21.951213+0000","last_became_peered":"2024-04-26T12:42:21.951213+0000","last_unstale":"2024-04-26T12:42:41.073883+0000","last_undegraded":"2024-04-26T12:42:41.073883+0000","last_fullsized":"2024-04-26T12:42:41.073883+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:11.260016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069763+0000","last_change":"2024-04-26T12:42:21.963634+0000","last_active":"2024-04-26T12:42:41.069763+0000","last_peered":"2024-04-26T12:42:41.069763+0000","last_clean":"2024-04-26T12:42:41.069763+0000","last_became_active":"2024-04-26T12:42:21.952291+0000","last_became_peered":"2024-04-26T12:42:21.952291+0000","last_unstale":"2024-04-26T12:42:41.069763+0000","last_undegraded":"2024-04-26T12:42:41.069763+0000","last_fullsized":"2024-04-26T12:42:41.069763+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:54.609591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"139'54","reported_seq":303,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.759418+0000","last_change":"2024-04-26T12:42:21.929252+0000","last_active":"2024-04-26T12:42:52.759418+0000","last_peered":"2024-04-26T12:42:52.759418+0000","last_clean":"2024-04-26T12:42:52.759418+0000","last_became_active":"2024-04-26T12:42:21.928247+0000","last_became_peered":"2024-04-26T12:42:21.928247+0000","last_unstale":"2024-04-26T12:42:52.759418+0000","last_undegraded":"2024-04-26T12:42:52.759418+0000","last_fullsized":"2024-04-26T12:42:52.759418+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:45.518571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":51,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065645+0000","last_change":"2024-04-26T12:42:34.022643+0000","last_active":"2024-04-26T12:42:41.065645+0000","last_peered":"2024-04-26T12:42:41.065645+0000","last_clean":"2024-04-26T12:42:41.065645+0000","last_became_active":"2024-04-26T12:42:34.022065+0000","last_became_peered":"2024-04-26T12:42:34.022065+0000","last_unstale":"2024-04-26T12:42:41.065645+0000","last_undegraded":"2024-04-26T12:42:41.065645+0000","last_fullsized":"2024-04-26T12:42:41.065645+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"139'17","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.369567+0000","last_change":"2024-04-26T12:42:21.975843+0000","last_active":"2024-04-26T12:42:52.369567+0000","last_peered":"2024-04-26T12:42:52.369567+0000","last_clean":"2024-04-26T12:42:52.369567+0000","last_became_active":"2024-04-26T12:42:21.971062+0000","last_became_peered":"2024-04-26T12:42:21.971062+0000","last_unstale":"2024-04-26T12:42:52.369567+0000","last_undegraded":"2024-04-26T12:42:52.369567+0000","last_fullsized":"2024-04-26T12:42:52.369567+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:19.436937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":43,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065892+0000","last_change":"2024-04-26T12:42:34.025446+0000","last_active":"2024-04-26T12:42:41.065892+0000","last_peered":"2024-04-26T12:42:41.065892+0000","last_clean":"2024-04-26T12:42:41.065892+0000","last_became_active":"2024-04-26T12:42:34.024706+0000","last_became_peered":"2024-04-26T12:42:34.024706+0000","last_unstale":"2024-04-26T12:42:41.065892+0000","last_undegraded":"2024-04-26T12:42:41.065892+0000","last_fullsized":"2024-04-26T12:42:41.065892+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.518863+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:42:42.518863+0000","last_peered":"2024-04-26T12:42:42.518863+0000","last_clean":"2024-04-26T12:42:42.518863+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:42:42.518863+0000","last_undegraded":"2024-04-26T12:42:42.518863+0000","last_fullsized":"2024-04-26T12:42:42.518863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:42:17.655513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066441+0000","last_change":"2024-04-26T12:42:34.023824+0000","last_active":"2024-04-26T12:42:41.066441+0000","last_peered":"2024-04-26T12:42:41.066441+0000","last_clean":"2024-04-26T12:42:41.066441+0000","last_became_active":"2024-04-26T12:42:34.022553+0000","last_became_peered":"2024-04-26T12:42:34.022553+0000","last_unstale":"2024-04-26T12:42:41.066441+0000","last_undegraded":"2024-04-26T12:42:41.066441+0000","last_fullsized":"2024-04-26T12:42:41.066441+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"139'50","reported_seq":304,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.830307+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:42:52.830307+0000","last_peered":"2024-04-26T12:42:52.830307+0000","last_clean":"2024-04-26T12:42:52.830307+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:42:52.830307+0000","last_undegraded":"2024-04-26T12:42:52.830307+0000","last_fullsized":"2024-04-26T12:42:52.830307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"22'2","reported_seq":337,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:51.742211+0000","last_change":"2024-04-26T12:38:14.452503+0000","last_active":"2024-04-26T12:42:51.742211+0000","last_peered":"2024-04-26T12:42:51.742211+0000","last_clean":"2024-04-26T12:42:51.742211+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:42:51.742211+0000","last_undegraded":"2024-04-26T12:42:51.742211+0000","last_fullsized":"2024-04-26T12:42:51.742211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"139'20","reported_seq":70,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.380801+0000","last_change":"2024-04-26T12:42:34.021259+0000","last_active":"2024-04-26T12:42:52.380801+0000","last_peered":"2024-04-26T12:42:52.380801+0000","last_clean":"2024-04-26T12:42:52.380801+0000","last_became_active":"2024-04-26T12:42:34.017996+0000","last_became_peered":"2024-04-26T12:42:34.017996+0000","last_unstale":"2024-04-26T12:42:52.380801+0000","last_undegraded":"2024-04-26T12:42:52.380801+0000","last_fullsized":"2024-04-26T12:42:52.380801+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068430+0000","last_change":"2024-04-26T12:38:18.497705+0000","last_active":"2024-04-26T12:42:41.068430+0000","last_peered":"2024-04-26T12:42:41.068430+0000","last_clean":"2024-04-26T12:42:41.068430+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:42:41.068430+0000","last_undegraded":"2024-04-26T12:42:41.068430+0000","last_fullsized":"2024-04-26T12:42:41.068430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068781+0000","last_change":"2024-04-26T12:42:34.015473+0000","last_active":"2024-04-26T12:42:41.068781+0000","last_peered":"2024-04-26T12:42:41.068781+0000","last_clean":"2024-04-26T12:42:41.068781+0000","last_became_active":"2024-04-26T12:42:34.011472+0000","last_became_peered":"2024-04-26T12:42:34.011472+0000","last_unstale":"2024-04-26T12:42:41.068781+0000","last_undegraded":"2024-04-26T12:42:41.068781+0000","last_fullsized":"2024-04-26T12:42:41.068781+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"117'8","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.410224+0000","last_change":"2024-04-26T12:38:12.466571+0000","last_active":"2024-04-26T12:42:41.410224+0000","last_peered":"2024-04-26T12:42:41.410224+0000","last_clean":"2024-04-26T12:42:41.410224+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:42:41.410224+0000","last_undegraded":"2024-04-26T12:42:41.410224+0000","last_fullsized":"2024-04-26T12:42:41.410224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"139'36","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.793361+0000","last_change":"2024-04-26T12:38:10.452052+0000","last_active":"2024-04-26T12:42:52.793361+0000","last_peered":"2024-04-26T12:42:52.793361+0000","last_clean":"2024-04-26T12:42:52.793361+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:42:52.793361+0000","last_undegraded":"2024-04-26T12:42:52.793361+0000","last_fullsized":"2024-04-26T12:42:52.793361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:50.392653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":298,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409830+0000","last_change":"2024-04-26T12:38:12.455727+0000","last_active":"2024-04-26T12:42:41.409830+0000","last_peered":"2024-04-26T12:42:41.409830+0000","last_clean":"2024-04-26T12:42:41.409830+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:42:41.409830+0000","last_undegraded":"2024-04-26T12:42:41.409830+0000","last_fullsized":"2024-04-26T12:42:41.409830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"139'54","reported_seq":313,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.839716+0000","last_change":"2024-04-26T12:38:57.841846+0000","last_active":"2024-04-26T12:42:52.839716+0000","last_peered":"2024-04-26T12:42:52.839716+0000","last_clean":"2024-04-26T12:42:52.839716+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:42:52.839716+0000","last_undegraded":"2024-04-26T12:42:52.839716+0000","last_fullsized":"2024-04-26T12:42:52.839716+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123354+0000","last_change":"2024-04-26T12:38:12.464573+0000","last_active":"2024-04-26T12:42:42.123354+0000","last_peered":"2024-04-26T12:42:42.123354+0000","last_clean":"2024-04-26T12:42:42.123354+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:42:42.123354+0000","last_undegraded":"2024-04-26T12:42:42.123354+0000","last_fullsized":"2024-04-26T12:42:42.123354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:32.024003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"139'50","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.809782+0000","last_change":"2024-04-26T12:42:21.926395+0000","last_active":"2024-04-26T12:42:52.809782+0000","last_peered":"2024-04-26T12:42:52.809782+0000","last_clean":"2024-04-26T12:42:52.809782+0000","last_became_active":"2024-04-26T12:42:21.925708+0000","last_became_peered":"2024-04-26T12:42:21.925708+0000","last_unstale":"2024-04-26T12:42:52.809782+0000","last_undegraded":"2024-04-26T12:42:52.809782+0000","last_fullsized":"2024-04-26T12:42:52.809782+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:51:41.849994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"117'4","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409260+0000","last_change":"2024-04-26T12:38:12.463744+0000","last_active":"2024-04-26T12:42:41.409260+0000","last_peered":"2024-04-26T12:42:41.409260+0000","last_clean":"2024-04-26T12:42:41.409260+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:42:41.409260+0000","last_undegraded":"2024-04-26T12:42:41.409260+0000","last_fullsized":"2024-04-26T12:42:41.409260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"139'56","reported_seq":316,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.847311+0000","last_change":"2024-04-26T12:42:21.959563+0000","last_active":"2024-04-26T12:42:52.847311+0000","last_peered":"2024-04-26T12:42:52.847311+0000","last_clean":"2024-04-26T12:42:52.847311+0000","last_became_active":"2024-04-26T12:42:21.957515+0000","last_became_peered":"2024-04-26T12:42:21.957515+0000","last_unstale":"2024-04-26T12:42:52.847311+0000","last_undegraded":"2024-04-26T12:42:52.847311+0000","last_fullsized":"2024-04-26T12:42:52.847311+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068640+0000","last_change":"2024-04-26T12:42:21.975117+0000","last_active":"2024-04-26T12:42:41.068640+0000","last_peered":"2024-04-26T12:42:41.068640+0000","last_clean":"2024-04-26T12:42:41.068640+0000","last_became_active":"2024-04-26T12:42:21.970669+0000","last_became_peered":"2024-04-26T12:42:21.970669+0000","last_unstale":"2024-04-26T12:42:41.068640+0000","last_undegraded":"2024-04-26T12:42:41.068640+0000","last_fullsized":"2024-04-26T12:42:41.068640+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:18.013624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"139'46","reported_seq":294,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.761173+0000","last_change":"2024-04-26T12:42:21.964762+0000","last_active":"2024-04-26T12:42:52.761173+0000","last_peered":"2024-04-26T12:42:52.761173+0000","last_clean":"2024-04-26T12:42:52.761173+0000","last_became_active":"2024-04-26T12:42:21.961965+0000","last_became_peered":"2024-04-26T12:42:21.961965+0000","last_unstale":"2024-04-26T12:42:52.761173+0000","last_undegraded":"2024-04-26T12:42:52.761173+0000","last_fullsized":"2024-04-26T12:42:52.761173+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:11.098641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":55,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068372+0000","last_change":"2024-04-26T12:42:34.025570+0000","last_active":"2024-04-26T12:42:41.068372+0000","last_peered":"2024-04-26T12:42:41.068372+0000","last_clean":"2024-04-26T12:42:41.068372+0000","last_became_active":"2024-04-26T12:42:34.024880+0000","last_became_peered":"2024-04-26T12:42:34.024880+0000","last_unstale":"2024-04-26T12:42:41.068372+0000","last_undegraded":"2024-04-26T12:42:41.068372+0000","last_fullsized":"2024-04-26T12:42:41.068372+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"139'38","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.778929+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:42:52.778929+0000","last_peered":"2024-04-26T12:42:52.778929+0000","last_clean":"2024-04-26T12:42:52.778929+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:42:52.778929+0000","last_undegraded":"2024-04-26T12:42:52.778929+0000","last_fullsized":"2024-04-26T12:42:52.778929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":185,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070064+0000","last_change":"2024-04-26T12:42:21.942927+0000","last_active":"2024-04-26T12:42:41.070064+0000","last_peered":"2024-04-26T12:42:41.070064+0000","last_clean":"2024-04-26T12:42:41.070064+0000","last_became_active":"2024-04-26T12:42:21.941594+0000","last_became_peered":"2024-04-26T12:42:21.941594+0000","last_unstale":"2024-04-26T12:42:41.070064+0000","last_undegraded":"2024-04-26T12:42:41.070064+0000","last_fullsized":"2024-04-26T12:42:41.070064+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:04.021398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"139'54","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.791401+0000","last_change":"2024-04-26T12:38:10.476135+0000","last_active":"2024-04-26T12:42:52.791401+0000","last_peered":"2024-04-26T12:42:52.791401+0000","last_clean":"2024-04-26T12:42:52.791401+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:42:52.791401+0000","last_undegraded":"2024-04-26T12:42:52.791401+0000","last_fullsized":"2024-04-26T12:42:52.791401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:05.363314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"117'12","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517260+0000","last_change":"2024-04-26T12:38:12.442927+0000","last_active":"2024-04-26T12:42:42.517260+0000","last_peered":"2024-04-26T12:42:42.517260+0000","last_clean":"2024-04-26T12:42:42.517260+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:42:42.517260+0000","last_undegraded":"2024-04-26T12:42:42.517260+0000","last_fullsized":"2024-04-26T12:42:42.517260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:51.201834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"139'64","reported_seq":313,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.801260+0000","last_change":"2024-04-26T12:42:21.951944+0000","last_active":"2024-04-26T12:42:52.801260+0000","last_peered":"2024-04-26T12:42:52.801260+0000","last_clean":"2024-04-26T12:42:52.801260+0000","last_became_active":"2024-04-26T12:42:21.948694+0000","last_became_peered":"2024-04-26T12:42:21.948694+0000","last_unstale":"2024-04-26T12:42:52.801260+0000","last_undegraded":"2024-04-26T12:42:52.801260+0000","last_fullsized":"2024-04-26T12:42:52.801260+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:27.567798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":291,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.844411+0000","last_change":"2024-04-26T12:42:21.957965+0000","last_active":"2024-04-26T12:42:52.844411+0000","last_peered":"2024-04-26T12:42:52.844411+0000","last_clean":"2024-04-26T12:42:52.844411+0000","last_became_active":"2024-04-26T12:42:21.956925+0000","last_became_peered":"2024-04-26T12:42:21.956925+0000","last_unstale":"2024-04-26T12:42:52.844411+0000","last_undegraded":"2024-04-26T12:42:52.844411+0000","last_fullsized":"2024-04-26T12:42:52.844411+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"139'58","reported_seq":319,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.782897+0000","last_change":"2024-04-26T12:42:21.950280+0000","last_active":"2024-04-26T12:42:52.782897+0000","last_peered":"2024-04-26T12:42:52.782897+0000","last_clean":"2024-04-26T12:42:52.782897+0000","last_became_active":"2024-04-26T12:42:21.949469+0000","last_became_peered":"2024-04-26T12:42:21.949469+0000","last_unstale":"2024-04-26T12:42:52.782897+0000","last_undegraded":"2024-04-26T12:42:52.782897+0000","last_fullsized":"2024-04-26T12:42:52.782897+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:47:05.651477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":115,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068023+0000","last_change":"2024-04-26T12:42:34.019992+0000","last_active":"2024-04-26T12:42:41.068023+0000","last_peered":"2024-04-26T12:42:41.068023+0000","last_clean":"2024-04-26T12:42:41.068023+0000","last_became_active":"2024-04-26T12:42:34.018659+0000","last_became_peered":"2024-04-26T12:42:34.018659+0000","last_unstale":"2024-04-26T12:42:41.068023+0000","last_undegraded":"2024-04-26T12:42:41.068023+0000","last_fullsized":"2024-04-26T12:42:41.068023+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"139'36","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.774630+0000","last_change":"2024-04-26T12:42:21.933174+0000","last_active":"2024-04-26T12:42:52.774630+0000","last_peered":"2024-04-26T12:42:52.774630+0000","last_clean":"2024-04-26T12:42:52.774630+0000","last_became_active":"2024-04-26T12:42:21.932263+0000","last_became_peered":"2024-04-26T12:42:21.932263+0000","last_unstale":"2024-04-26T12:42:52.774630+0000","last_undegraded":"2024-04-26T12:42:52.774630+0000","last_fullsized":"2024-04-26T12:42:52.774630+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:26.946555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"117'4","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.831792+0000","last_change":"2024-04-26T12:38:12.458075+0000","last_active":"2024-04-26T12:42:42.831792+0000","last_peered":"2024-04-26T12:42:42.831792+0000","last_clean":"2024-04-26T12:42:42.831792+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:42:42.831792+0000","last_undegraded":"2024-04-26T12:42:42.831792+0000","last_fullsized":"2024-04-26T12:42:42.831792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"139'32","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.682980+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:42:52.682980+0000","last_peered":"2024-04-26T12:42:52.682980+0000","last_clean":"2024-04-26T12:42:52.682980+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:42:52.682980+0000","last_undegraded":"2024-04-26T12:42:52.682980+0000","last_fullsized":"2024-04-26T12:42:52.682980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:42.906165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"117'8","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068320+0000","last_change":"2024-04-26T12:42:34.024717+0000","last_active":"2024-04-26T12:42:41.068320+0000","last_peered":"2024-04-26T12:42:41.068320+0000","last_clean":"2024-04-26T12:42:41.068320+0000","last_became_active":"2024-04-26T12:42:34.023978+0000","last_became_peered":"2024-04-26T12:42:34.023978+0000","last_unstale":"2024-04-26T12:42:41.068320+0000","last_undegraded":"2024-04-26T12:42:41.068320+0000","last_fullsized":"2024-04-26T12:42:41.068320+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"139'46","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.847605+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:42:52.847605+0000","last_peered":"2024-04-26T12:42:52.847605+0000","last_clean":"2024-04-26T12:42:52.847605+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:42:52.847605+0000","last_undegraded":"2024-04-26T12:42:52.847605+0000","last_fullsized":"2024-04-26T12:42:52.847605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520003+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:42:42.520003+0000","last_peered":"2024-04-26T12:42:42.520003+0000","last_clean":"2024-04-26T12:42:42.520003+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:42:42.520003+0000","last_undegraded":"2024-04-26T12:42:42.520003+0000","last_fullsized":"2024-04-26T12:42:42.520003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:17.609504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"139'34","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.728614+0000","last_change":"2024-04-26T12:38:10.453292+0000","last_active":"2024-04-26T12:42:52.728614+0000","last_peered":"2024-04-26T12:42:52.728614+0000","last_clean":"2024-04-26T12:42:52.728614+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:42:52.728614+0000","last_undegraded":"2024-04-26T12:42:52.728614+0000","last_fullsized":"2024-04-26T12:42:52.728614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.011481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.015836+0000","last_change":"2024-04-26T12:38:12.458832+0000","last_active":"2024-04-26T12:42:42.015836+0000","last_peered":"2024-04-26T12:42:42.015836+0000","last_clean":"2024-04-26T12:42:42.015836+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:42:42.015836+0000","last_undegraded":"2024-04-26T12:42:42.015836+0000","last_fullsized":"2024-04-26T12:42:42.015836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"139'48","reported_seq":298,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.822577+0000","last_change":"2024-04-26T12:38:10.476107+0000","last_active":"2024-04-26T12:42:52.822577+0000","last_peered":"2024-04-26T12:42:52.822577+0000","last_clean":"2024-04-26T12:42:52.822577+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:42:52.822577+0000","last_undegraded":"2024-04-26T12:42:52.822577+0000","last_fullsized":"2024-04-26T12:42:52.822577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:43.061487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070772+0000","last_change":"2024-04-26T12:42:21.967040+0000","last_active":"2024-04-26T12:42:41.070772+0000","last_peered":"2024-04-26T12:42:41.070772+0000","last_clean":"2024-04-26T12:42:41.070772+0000","last_became_active":"2024-04-26T12:42:21.965634+0000","last_became_peered":"2024-04-26T12:42:21.965634+0000","last_unstale":"2024-04-26T12:42:41.070772+0000","last_undegraded":"2024-04-26T12:42:41.070772+0000","last_fullsized":"2024-04-26T12:42:41.070772+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:58.603311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"139'32","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.837877+0000","last_change":"2024-04-26T12:38:10.450905+0000","last_active":"2024-04-26T12:42:52.837877+0000","last_peered":"2024-04-26T12:42:52.837877+0000","last_clean":"2024-04-26T12:42:52.837877+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:42:52.837877+0000","last_undegraded":"2024-04-26T12:42:52.837877+0000","last_fullsized":"2024-04-26T12:42:52.837877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516557+0000","last_change":"2024-04-26T12:42:21.967682+0000","last_active":"2024-04-26T12:42:42.516557+0000","last_peered":"2024-04-26T12:42:42.516557+0000","last_clean":"2024-04-26T12:42:42.516557+0000","last_became_active":"2024-04-26T12:42:21.967048+0000","last_became_peered":"2024-04-26T12:42:21.967048+0000","last_unstale":"2024-04-26T12:42:42.516557+0000","last_undegraded":"2024-04-26T12:42:42.516557+0000","last_fullsized":"2024-04-26T12:42:42.516557+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:43.288294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"139'30","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.842433+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:42:52.842433+0000","last_peered":"2024-04-26T12:42:52.842433+0000","last_clean":"2024-04-26T12:42:52.842433+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:42:52.842433+0000","last_undegraded":"2024-04-26T12:42:52.842433+0000","last_fullsized":"2024-04-26T12:42:52.842433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.535264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"139'48","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.818240+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:42:52.818240+0000","last_peered":"2024-04-26T12:42:52.818240+0000","last_clean":"2024-04-26T12:42:52.818240+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:42:52.818240+0000","last_undegraded":"2024-04-26T12:42:52.818240+0000","last_fullsized":"2024-04-26T12:42:52.818240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:25.142298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072332+0000","last_change":"2024-04-26T12:42:21.937768+0000","last_active":"2024-04-26T12:42:41.072332+0000","last_peered":"2024-04-26T12:42:41.072332+0000","last_clean":"2024-04-26T12:42:41.072332+0000","last_became_active":"2024-04-26T12:42:21.936930+0000","last_became_peered":"2024-04-26T12:42:21.936930+0000","last_unstale":"2024-04-26T12:42:41.072332+0000","last_undegraded":"2024-04-26T12:42:41.072332+0000","last_fullsized":"2024-04-26T12:42:41.072332+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"139'50","reported_seq":303,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.844179+0000","last_change":"2024-04-26T12:38:10.424327+0000","last_active":"2024-04-26T12:42:52.844179+0000","last_peered":"2024-04-26T12:42:52.844179+0000","last_clean":"2024-04-26T12:42:52.844179+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:42:52.844179+0000","last_undegraded":"2024-04-26T12:42:52.844179+0000","last_fullsized":"2024-04-26T12:42:52.844179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"117'2","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.123586+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:42:42.123586+0000","last_peered":"2024-04-26T12:42:42.123586+0000","last_clean":"2024-04-26T12:42:42.123586+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:42:42.123586+0000","last_undegraded":"2024-04-26T12:42:42.123586+0000","last_fullsized":"2024-04-26T12:42:42.123586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:33.387177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":336,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1108,"ondisk_log_size":1108,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1061,"num_read_kb":1543,"num_write":541,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1275,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37660,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334180,"statfs":{"total":96636764160,"available":96598200320,"internally_reserved":0,"allocated":2314240,"data_stored":1600353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1695744,"data_stored":1009325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1748992,"data_stored":1011582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1687552,"data_stored":1008834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":122,"seq":523986010121,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42204,"kb_used_data":1680,"kb_used_omap":6,"kb_used_meta":40505,"kb_avail":94329636,"statfs":{"total":96636764160,"available":96593547264,"internally_reserved":0,"allocated":1720320,"data_stored":1010124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6715,"internal_metadata":41477573},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41144,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330696,"statfs":{"total":96636764160,"available":96594632704,"internally_reserved":0,"allocated":1687552,"data_stored":1009323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41296,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330544,"statfs":{"total":96636764160,"available":96594477056,"internally_reserved":0,"allocated":1720320,"data_stored":1010960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41736,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330104,"statfs":{"total":96636764160,"available":96594026496,"internally_reserved":0,"allocated":2293760,"data_stored":1599759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:42:59.550 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.550 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.550 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.550 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.550 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.550 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.551 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.552 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.553 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.553 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.553 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.553 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.553 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.553 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.553 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.553 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.553 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.554 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.554 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.554 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.554 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.554 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.554 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.554 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.554 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.555 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.556 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.557 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.557 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.557 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.557 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.557 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.557 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.557 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.557 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.557 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.558 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.558 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.558 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.558 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.558 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.558 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.558 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.558 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.558 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.559 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.560 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.561 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.562 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.563 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.564 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.565 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.566 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.567 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.567 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.567 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.567 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.567 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.567 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.567 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.567 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.567 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.568 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.569 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.570 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.571 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.572 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.573 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.573 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.573 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.573 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.573 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.573 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.573 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.573 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.573 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.574 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.575 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.576 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.577 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.577 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:42:59.577 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:43:19.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:43:19.943 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:43:19.949 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:43:19.970 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-04-26T12:43:18.801246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623988,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4830,"num_read_kb":3732,"num_write":4425,"num_write_kb":6187917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5653,"ondisk_log_size":5653,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":310712,"kb_used_data":14520,"kb_used_omap":17,"kb_used_meta":296110,"kb_avail":754664008,"statfs":{"total":773094113280,"available":772775944192,"internally_reserved":0,"allocated":14868480,"data_stored":9260260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17874,"internal_metadata":303217198},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006347"},"pg_stats":[{"pgid":"3.3f","version":"139'42","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.845729+0000","last_change":"2024-04-26T12:43:10.845789+0000","last_active":"2024-04-26T12:43:10.845729+0000","last_peered":"2024-04-26T12:43:10.845729+0000","last_clean":"2024-04-26T12:43:10.845729+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:43:10.845729+0000","last_undegraded":"2024-04-26T12:43:10.845729+0000","last_fullsized":"2024-04-26T12:43:10.845729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'42","last_scrub_stamp":"2024-04-26T12:43:10.845487+0000","last_deep_scrub":"139'42","last_deep_scrub_stamp":"2024-04-26T12:43:10.845487+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.845487+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:42.606975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"117'6","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.145242+0000","last_change":"2024-04-26T12:43:15.145305+0000","last_active":"2024-04-26T12:43:15.145242+0000","last_peered":"2024-04-26T12:43:15.145242+0000","last_clean":"2024-04-26T12:43:15.145242+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:43:15.145242+0000","last_undegraded":"2024-04-26T12:43:15.145242+0000","last_fullsized":"2024-04-26T12:43:15.145242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6","last_scrub_stamp":"2024-04-26T12:43:15.145028+0000","last_deep_scrub":"117'6","last_deep_scrub_stamp":"2024-04-26T12:43:15.145028+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.145028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:13.794591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"139'32","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.033857+0000","last_change":"2024-04-26T12:43:16.033919+0000","last_active":"2024-04-26T12:43:16.033857+0000","last_peered":"2024-04-26T12:43:16.033857+0000","last_clean":"2024-04-26T12:43:16.033857+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:43:16.033857+0000","last_undegraded":"2024-04-26T12:43:16.033857+0000","last_fullsized":"2024-04-26T12:43:16.033857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:16.033646+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:16.033646+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.033646+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:48.143330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.801901+0000","last_change":"2024-04-26T12:43:06.801901+0000","last_active":"2024-04-26T12:43:06.801901+0000","last_peered":"2024-04-26T12:43:06.801901+0000","last_clean":"2024-04-26T12:43:06.801901+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:43:06.801901+0000","last_undegraded":"2024-04-26T12:43:06.801901+0000","last_fullsized":"2024-04-26T12:43:06.801901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:06.801644+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:06.801644+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.801644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:11.269736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"139'36","reported_seq":289,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.787869+0000","last_change":"2024-04-26T12:38:10.443509+0000","last_active":"2024-04-26T12:42:52.787869+0000","last_peered":"2024-04-26T12:42:52.787869+0000","last_clean":"2024-04-26T12:42:52.787869+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:42:52.787869+0000","last_undegraded":"2024-04-26T12:42:52.787869+0000","last_fullsized":"2024-04-26T12:42:52.787869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":63,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.698608+0000","last_change":"2024-04-26T12:43:10.698662+0000","last_active":"2024-04-26T12:43:10.698608+0000","last_peered":"2024-04-26T12:43:10.698608+0000","last_clean":"2024-04-26T12:43:10.698608+0000","last_became_active":"2024-04-26T12:42:34.016025+0000","last_became_peered":"2024-04-26T12:42:34.016025+0000","last_unstale":"2024-04-26T12:43:10.698608+0000","last_undegraded":"2024-04-26T12:43:10.698608+0000","last_fullsized":"2024-04-26T12:43:10.698608+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:10.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:10.698381+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:37.659849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"139'62","reported_seq":324,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.812682+0000","last_change":"2024-04-26T12:42:21.947248+0000","last_active":"2024-04-26T12:42:52.812682+0000","last_peered":"2024-04-26T12:42:52.812682+0000","last_clean":"2024-04-26T12:42:52.812682+0000","last_became_active":"2024-04-26T12:42:21.946477+0000","last_became_peered":"2024-04-26T12:42:21.946477+0000","last_unstale":"2024-04-26T12:42:52.812682+0000","last_undegraded":"2024-04-26T12:42:52.812682+0000","last_fullsized":"2024-04-26T12:42:52.812682+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:55.874064+0000","last_change":"2024-04-26T12:42:21.958105+0000","last_active":"2024-04-26T12:42:55.874064+0000","last_peered":"2024-04-26T12:42:55.874064+0000","last_clean":"2024-04-26T12:42:55.874064+0000","last_became_active":"2024-04-26T12:42:21.956507+0000","last_became_peered":"2024-04-26T12:42:21.956507+0000","last_unstale":"2024-04-26T12:42:55.874064+0000","last_undegraded":"2024-04-26T12:42:55.874064+0000","last_fullsized":"2024-04-26T12:42:55.874064+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"139'50","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.187946+0000","last_change":"2024-04-26T12:38:10.467667+0000","last_active":"2024-04-26T12:42:59.187946+0000","last_peered":"2024-04-26T12:42:59.187946+0000","last_clean":"2024-04-26T12:42:59.187946+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:42:59.187946+0000","last_undegraded":"2024-04-26T12:42:59.187946+0000","last_fullsized":"2024-04-26T12:42:59.187946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.542893+0000","last_change":"2024-04-26T12:43:05.542954+0000","last_active":"2024-04-26T12:43:05.542893+0000","last_peered":"2024-04-26T12:43:05.542893+0000","last_clean":"2024-04-26T12:43:05.542893+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:43:05.542893+0000","last_undegraded":"2024-04-26T12:43:05.542893+0000","last_fullsized":"2024-04-26T12:43:05.542893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'4","last_scrub_stamp":"2024-04-26T12:43:05.542698+0000","last_deep_scrub":"104'4","last_deep_scrub_stamp":"2024-04-26T12:43:05.542698+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.542698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:07.307221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"139'50","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.525453+0000","last_change":"2024-04-26T12:43:11.525518+0000","last_active":"2024-04-26T12:43:11.525453+0000","last_peered":"2024-04-26T12:43:11.525453+0000","last_clean":"2024-04-26T12:43:11.525453+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:43:11.525453+0000","last_undegraded":"2024-04-26T12:43:11.525453+0000","last_fullsized":"2024-04-26T12:43:11.525453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:11.525255+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:11.525255+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.525255+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:57.799993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":123,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067947+0000","last_change":"2024-04-26T12:42:34.007918+0000","last_active":"2024-04-26T12:42:41.067947+0000","last_peered":"2024-04-26T12:42:41.067947+0000","last_clean":"2024-04-26T12:42:41.067947+0000","last_became_active":"2024-04-26T12:42:34.006179+0000","last_became_peered":"2024-04-26T12:42:34.006179+0000","last_unstale":"2024-04-26T12:42:41.067947+0000","last_undegraded":"2024-04-26T12:42:41.067947+0000","last_fullsized":"2024-04-26T12:42:41.067947+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"139'44","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.187958+0000","last_change":"2024-04-26T12:38:10.468136+0000","last_active":"2024-04-26T12:42:59.187958+0000","last_peered":"2024-04-26T12:42:59.187958+0000","last_clean":"2024-04-26T12:42:59.187958+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:42:59.187958+0000","last_undegraded":"2024-04-26T12:42:59.187958+0000","last_fullsized":"2024-04-26T12:42:59.187958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.107464+0000","last_change":"2024-04-26T12:43:13.107601+0000","last_active":"2024-04-26T12:43:13.107464+0000","last_peered":"2024-04-26T12:43:13.107464+0000","last_clean":"2024-04-26T12:43:13.107464+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:43:13.107464+0000","last_undegraded":"2024-04-26T12:43:13.107464+0000","last_fullsized":"2024-04-26T12:43:13.107464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:13.107156+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:13.107156+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.107156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:42.824560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"139'26","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.249898+0000","last_change":"2024-04-26T12:43:10.250029+0000","last_active":"2024-04-26T12:43:10.249898+0000","last_peered":"2024-04-26T12:43:10.249898+0000","last_clean":"2024-04-26T12:43:10.249898+0000","last_became_active":"2024-04-26T12:42:21.948971+0000","last_became_peered":"2024-04-26T12:42:21.948971+0000","last_unstale":"2024-04-26T12:43:10.249898+0000","last_undegraded":"2024-04-26T12:43:10.249898+0000","last_fullsized":"2024-04-26T12:43:10.249898+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:10.249582+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:10.249582+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.249582+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:31.064088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.547691+0000","last_change":"2024-04-26T12:43:15.547759+0000","last_active":"2024-04-26T12:43:15.547691+0000","last_peered":"2024-04-26T12:43:15.547691+0000","last_clean":"2024-04-26T12:43:15.547691+0000","last_became_active":"2024-04-26T12:42:21.964820+0000","last_became_peered":"2024-04-26T12:42:21.964820+0000","last_unstale":"2024-04-26T12:43:15.547691+0000","last_undegraded":"2024-04-26T12:43:15.547691+0000","last_fullsized":"2024-04-26T12:43:15.547691+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:15.547471+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:15.547471+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.547471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:52.868633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":169,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066158+0000","last_change":"2024-04-26T12:42:34.005982+0000","last_active":"2024-04-26T12:42:41.066158+0000","last_peered":"2024-04-26T12:42:41.066158+0000","last_clean":"2024-04-26T12:42:41.066158+0000","last_became_active":"2024-04-26T12:42:34.003575+0000","last_became_peered":"2024-04-26T12:42:34.003575+0000","last_unstale":"2024-04-26T12:42:41.066158+0000","last_undegraded":"2024-04-26T12:42:41.066158+0000","last_fullsized":"2024-04-26T12:42:41.066158+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"139'50","reported_seq":309,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.834868+0000","last_change":"2024-04-26T12:43:16.834932+0000","last_active":"2024-04-26T12:43:16.834868+0000","last_peered":"2024-04-26T12:43:16.834868+0000","last_clean":"2024-04-26T12:43:16.834868+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:43:16.834868+0000","last_undegraded":"2024-04-26T12:43:16.834868+0000","last_fullsized":"2024-04-26T12:43:16.834868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:16.834665+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:16.834665+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.834665+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:45.581387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"117'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.754487+0000","last_change":"2024-04-26T12:43:08.754548+0000","last_active":"2024-04-26T12:43:08.754487+0000","last_peered":"2024-04-26T12:43:08.754487+0000","last_clean":"2024-04-26T12:43:08.754487+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:43:08.754487+0000","last_undegraded":"2024-04-26T12:43:08.754487+0000","last_fullsized":"2024-04-26T12:43:08.754487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:08.754281+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:08.754281+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.754281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:21.843729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"139'68","reported_seq":329,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.511231+0000","last_change":"2024-04-26T12:43:09.511361+0000","last_active":"2024-04-26T12:43:09.511231+0000","last_peered":"2024-04-26T12:43:09.511231+0000","last_clean":"2024-04-26T12:43:09.511231+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:43:09.511231+0000","last_undegraded":"2024-04-26T12:43:09.511231+0000","last_fullsized":"2024-04-26T12:43:09.511231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'68","last_scrub_stamp":"2024-04-26T12:43:09.510988+0000","last_deep_scrub":"139'68","last_deep_scrub_stamp":"2024-04-26T12:43:09.510988+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.510988+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:42.900382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":3,"num_write":78,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.179647+0000","last_change":"2024-04-26T12:43:17.179706+0000","last_active":"2024-04-26T12:43:17.179647+0000","last_peered":"2024-04-26T12:43:17.179647+0000","last_clean":"2024-04-26T12:43:17.179647+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:43:17.179647+0000","last_undegraded":"2024-04-26T12:43:17.179647+0000","last_fullsized":"2024-04-26T12:43:17.179647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:17.179433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:17.179433+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.179433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:22.968301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"139'54","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.530981+0000","last_change":"2024-04-26T12:43:13.531047+0000","last_active":"2024-04-26T12:43:13.530981+0000","last_peered":"2024-04-26T12:43:13.530981+0000","last_clean":"2024-04-26T12:43:13.530981+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:43:13.530981+0000","last_undegraded":"2024-04-26T12:43:13.530981+0000","last_fullsized":"2024-04-26T12:43:13.530981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:13.530753+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:13.530753+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.530753+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:25.642179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.510125+0000","last_change":"2024-04-26T12:43:13.510188+0000","last_active":"2024-04-26T12:43:13.510125+0000","last_peered":"2024-04-26T12:43:13.510125+0000","last_clean":"2024-04-26T12:43:13.510125+0000","last_became_active":"2024-04-26T12:42:21.956566+0000","last_became_peered":"2024-04-26T12:42:21.956566+0000","last_unstale":"2024-04-26T12:43:13.510125+0000","last_undegraded":"2024-04-26T12:43:13.510125+0000","last_fullsized":"2024-04-26T12:43:13.510125+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'8","last_scrub_stamp":"2024-04-26T12:43:13.509891+0000","last_deep_scrub":"104'8","last_deep_scrub_stamp":"2024-04-26T12:43:13.509891+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.509891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:12.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"139'38","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.745631+0000","last_change":"2024-04-26T12:43:17.745776+0000","last_active":"2024-04-26T12:43:17.745631+0000","last_peered":"2024-04-26T12:43:17.745631+0000","last_clean":"2024-04-26T12:43:17.745631+0000","last_became_active":"2024-04-26T12:42:34.022426+0000","last_became_peered":"2024-04-26T12:42:34.022426+0000","last_unstale":"2024-04-26T12:43:17.745631+0000","last_undegraded":"2024-04-26T12:43:17.745631+0000","last_fullsized":"2024-04-26T12:43:17.745631+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:17.745359+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:17.745359+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.745359+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:51.957445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.577896+0000","last_change":"2024-04-26T12:43:01.577896+0000","last_active":"2024-04-26T12:43:01.577896+0000","last_peered":"2024-04-26T12:43:01.577896+0000","last_clean":"2024-04-26T12:43:01.577896+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:43:01.577896+0000","last_undegraded":"2024-04-26T12:43:01.577896+0000","last_fullsized":"2024-04-26T12:43:01.577896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-04-26T12:43:01.577628+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-04-26T12:43:01.577628+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.577628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:42.423471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"139'42","reported_seq":291,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.824895+0000","last_change":"2024-04-26T12:42:21.946507+0000","last_active":"2024-04-26T12:42:52.824895+0000","last_peered":"2024-04-26T12:42:52.824895+0000","last_clean":"2024-04-26T12:42:52.824895+0000","last_became_active":"2024-04-26T12:42:21.932303+0000","last_became_peered":"2024-04-26T12:42:21.932303+0000","last_unstale":"2024-04-26T12:42:52.824895+0000","last_undegraded":"2024-04-26T12:42:52.824895+0000","last_fullsized":"2024-04-26T12:42:52.824895+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":122,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.668127+0000","last_change":"2024-04-26T12:42:58.668192+0000","last_active":"2024-04-26T12:42:58.668127+0000","last_peered":"2024-04-26T12:42:58.668127+0000","last_clean":"2024-04-26T12:42:58.668127+0000","last_became_active":"2024-04-26T12:42:34.025281+0000","last_became_peered":"2024-04-26T12:42:34.025281+0000","last_unstale":"2024-04-26T12:42:58.668127+0000","last_undegraded":"2024-04-26T12:42:58.668127+0000","last_fullsized":"2024-04-26T12:42:58.668127+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:42:58.667924+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:42:58.667924+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.667924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:02.409734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"139'44","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.842581+0000","last_change":"2024-04-26T12:38:10.455339+0000","last_active":"2024-04-26T12:42:52.842581+0000","last_peered":"2024-04-26T12:42:52.842581+0000","last_clean":"2024-04-26T12:42:52.842581+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:42:52.842581+0000","last_undegraded":"2024-04-26T12:42:52.842581+0000","last_fullsized":"2024-04-26T12:42:52.842581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":119,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.065691+0000","last_change":"2024-04-26T12:42:34.014303+0000","last_active":"2024-04-26T12:42:41.065691+0000","last_peered":"2024-04-26T12:42:41.065691+0000","last_clean":"2024-04-26T12:42:41.065691+0000","last_became_active":"2024-04-26T12:42:34.013263+0000","last_became_peered":"2024-04-26T12:42:34.013263+0000","last_unstale":"2024-04-26T12:42:41.065691+0000","last_undegraded":"2024-04-26T12:42:41.065691+0000","last_fullsized":"2024-04-26T12:42:41.065691+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.312435+0000","last_change":"2024-04-26T12:43:02.312583+0000","last_active":"2024-04-26T12:43:02.312435+0000","last_peered":"2024-04-26T12:43:02.312435+0000","last_clean":"2024-04-26T12:43:02.312435+0000","last_became_active":"2024-04-26T12:42:21.961909+0000","last_became_peered":"2024-04-26T12:42:21.961909+0000","last_unstale":"2024-04-26T12:43:02.312435+0000","last_undegraded":"2024-04-26T12:43:02.312435+0000","last_fullsized":"2024-04-26T12:43:02.312435+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:02.312195+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:02.312195+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.312195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:15.538824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"139'36","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.858039+0000","last_change":"2024-04-26T12:38:10.467998+0000","last_active":"2024-04-26T12:42:52.858039+0000","last_peered":"2024-04-26T12:42:52.858039+0000","last_clean":"2024-04-26T12:42:52.858039+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:42:52.858039+0000","last_undegraded":"2024-04-26T12:42:52.858039+0000","last_fullsized":"2024-04-26T12:42:52.858039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.194144+0000","last_change":"2024-04-26T12:43:05.194144+0000","last_active":"2024-04-26T12:43:05.194144+0000","last_peered":"2024-04-26T12:43:05.194144+0000","last_clean":"2024-04-26T12:43:05.194144+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:43:05.194144+0000","last_undegraded":"2024-04-26T12:43:05.194144+0000","last_fullsized":"2024-04-26T12:43:05.194144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:05.193896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:05.193896+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.193896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:55.023402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"139'24","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.205866+0000","last_change":"2024-04-26T12:43:06.205866+0000","last_active":"2024-04-26T12:43:06.205866+0000","last_peered":"2024-04-26T12:43:06.205866+0000","last_clean":"2024-04-26T12:43:06.205866+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:43:06.205866+0000","last_undegraded":"2024-04-26T12:43:06.205866+0000","last_fullsized":"2024-04-26T12:43:06.205866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'24","last_scrub_stamp":"2024-04-26T12:43:06.205548+0000","last_deep_scrub":"139'24","last_deep_scrub_stamp":"2024-04-26T12:43:06.205548+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.205548+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:35.922951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.909934+0000","last_change":"2024-04-26T12:43:00.909934+0000","last_active":"2024-04-26T12:43:00.909934+0000","last_peered":"2024-04-26T12:43:00.909934+0000","last_clean":"2024-04-26T12:43:00.909934+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:43:00.909934+0000","last_undegraded":"2024-04-26T12:43:00.909934+0000","last_fullsized":"2024-04-26T12:43:00.909934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.909677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.909677+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.909677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:34.299071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"139'49","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.234487+0000","last_change":"2024-04-26T12:43:01.234487+0000","last_active":"2024-04-26T12:43:01.234487+0000","last_peered":"2024-04-26T12:43:01.234487+0000","last_clean":"2024-04-26T12:43:01.234487+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:43:01.234487+0000","last_undegraded":"2024-04-26T12:43:01.234487+0000","last_fullsized":"2024-04-26T12:43:01.234487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'49","last_scrub_stamp":"2024-04-26T12:43:01.234232+0000","last_deep_scrub":"139'49","last_deep_scrub_stamp":"2024-04-26T12:43:01.234232+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.234232+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:57.879592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.145410+0000","last_change":"2024-04-26T12:43:09.145461+0000","last_active":"2024-04-26T12:43:09.145410+0000","last_peered":"2024-04-26T12:43:09.145410+0000","last_clean":"2024-04-26T12:43:09.145410+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:43:09.145410+0000","last_undegraded":"2024-04-26T12:43:09.145410+0000","last_fullsized":"2024-04-26T12:43:09.145410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:09.145209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:09.145209+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.145209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:43.568311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"139'68","reported_seq":321,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.846955+0000","last_change":"2024-04-26T12:38:10.474577+0000","last_active":"2024-04-26T12:42:52.846955+0000","last_peered":"2024-04-26T12:42:52.846955+0000","last_clean":"2024-04-26T12:42:52.846955+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:42:52.846955+0000","last_undegraded":"2024-04-26T12:42:52.846955+0000","last_fullsized":"2024-04-26T12:42:52.846955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.289308+0000","last_change":"2024-04-26T12:43:00.289382+0000","last_active":"2024-04-26T12:43:00.289308+0000","last_peered":"2024-04-26T12:43:00.289308+0000","last_clean":"2024-04-26T12:43:00.289308+0000","last_became_active":"2024-04-26T12:42:21.968825+0000","last_became_peered":"2024-04-26T12:42:21.968825+0000","last_unstale":"2024-04-26T12:43:00.289308+0000","last_undegraded":"2024-04-26T12:43:00.289308+0000","last_fullsized":"2024-04-26T12:43:00.289308+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.289104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.289104+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.289104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:56.967299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"139'9","reported_seq":67,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.683447+0000","last_change":"2024-04-26T12:43:05.683527+0000","last_active":"2024-04-26T12:43:05.683447+0000","last_peered":"2024-04-26T12:43:05.683447+0000","last_clean":"2024-04-26T12:43:05.683447+0000","last_became_active":"2024-04-26T12:42:34.018809+0000","last_became_peered":"2024-04-26T12:42:34.018809+0000","last_unstale":"2024-04-26T12:43:05.683447+0000","last_undegraded":"2024-04-26T12:43:05.683447+0000","last_fullsized":"2024-04-26T12:43:05.683447+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'9","last_scrub_stamp":"2024-04-26T12:43:05.683254+0000","last_deep_scrub":"139'9","last_deep_scrub_stamp":"2024-04-26T12:43:05.683254+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.683254+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:12.806602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":43,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067100+0000","last_change":"2024-04-26T12:42:34.007481+0000","last_active":"2024-04-26T12:42:41.067100+0000","last_peered":"2024-04-26T12:42:41.067100+0000","last_clean":"2024-04-26T12:42:41.067100+0000","last_became_active":"2024-04-26T12:42:34.004534+0000","last_became_peered":"2024-04-26T12:42:34.004534+0000","last_unstale":"2024-04-26T12:42:41.067100+0000","last_undegraded":"2024-04-26T12:42:41.067100+0000","last_fullsized":"2024-04-26T12:42:41.067100+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.177542+0000","last_change":"2024-04-26T12:42:57.177605+0000","last_active":"2024-04-26T12:42:57.177542+0000","last_peered":"2024-04-26T12:42:57.177542+0000","last_clean":"2024-04-26T12:42:57.177542+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:42:57.177542+0000","last_undegraded":"2024-04-26T12:42:57.177542+0000","last_fullsized":"2024-04-26T12:42:57.177542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:57.177175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:57.177175+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.177175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:47.735046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.236288+0000","last_change":"2024-04-26T12:43:02.236288+0000","last_active":"2024-04-26T12:43:02.236288+0000","last_peered":"2024-04-26T12:43:02.236288+0000","last_clean":"2024-04-26T12:43:02.236288+0000","last_became_active":"2024-04-26T12:42:21.936393+0000","last_became_peered":"2024-04-26T12:42:21.936393+0000","last_unstale":"2024-04-26T12:43:02.236288+0000","last_undegraded":"2024-04-26T12:43:02.236288+0000","last_fullsized":"2024-04-26T12:43:02.236288+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T12:43:02.236023+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T12:43:02.236023+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.236023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:36.659124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"139'42","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.858020+0000","last_change":"2024-04-26T12:38:10.473349+0000","last_active":"2024-04-26T12:42:52.858020+0000","last_peered":"2024-04-26T12:42:52.858020+0000","last_clean":"2024-04-26T12:42:52.858020+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:42:52.858020+0000","last_undegraded":"2024-04-26T12:42:52.858020+0000","last_fullsized":"2024-04-26T12:42:52.858020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.290463+0000","last_change":"2024-04-26T12:43:11.290524+0000","last_active":"2024-04-26T12:43:11.290463+0000","last_peered":"2024-04-26T12:43:11.290463+0000","last_clean":"2024-04-26T12:43:11.290463+0000","last_became_active":"2024-04-26T12:42:21.957657+0000","last_became_peered":"2024-04-26T12:42:21.957657+0000","last_unstale":"2024-04-26T12:43:11.290463+0000","last_undegraded":"2024-04-26T12:43:11.290463+0000","last_fullsized":"2024-04-26T12:43:11.290463+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:11.290245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:11.290245+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.290245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:11.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"139'15","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.642454+0000","last_change":"2024-04-26T12:42:57.642454+0000","last_active":"2024-04-26T12:42:57.642454+0000","last_peered":"2024-04-26T12:42:57.642454+0000","last_clean":"2024-04-26T12:42:57.642454+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:42:57.642454+0000","last_undegraded":"2024-04-26T12:42:57.642454+0000","last_fullsized":"2024-04-26T12:42:57.642454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'15","last_scrub_stamp":"2024-04-26T12:42:57.642311+0000","last_deep_scrub":"139'15","last_deep_scrub_stamp":"2024-04-26T12:42:57.642311+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.642311+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:59.889605+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"139'138","reported_seq":505,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.188829+0000","last_change":"2024-04-26T12:38:18.497476+0000","last_active":"2024-04-26T12:42:59.188829+0000","last_peered":"2024-04-26T12:42:59.188829+0000","last_clean":"2024-04-26T12:42:59.188829+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:42:59.188829+0000","last_undegraded":"2024-04-26T12:42:59.188829+0000","last_fullsized":"2024-04-26T12:42:59.188829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":124,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.717290+0000","last_change":"2024-04-26T12:43:14.717385+0000","last_active":"2024-04-26T12:43:14.717290+0000","last_peered":"2024-04-26T12:43:14.717290+0000","last_clean":"2024-04-26T12:43:14.717290+0000","last_became_active":"2024-04-26T12:42:34.015101+0000","last_became_peered":"2024-04-26T12:42:34.015101+0000","last_unstale":"2024-04-26T12:43:14.717290+0000","last_undegraded":"2024-04-26T12:43:14.717290+0000","last_fullsized":"2024-04-26T12:43:14.717290+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-04-26T12:43:14.717066+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-04-26T12:43:14.717066+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.717066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:11.824082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.303797+0000","last_change":"2024-04-26T12:42:59.303860+0000","last_active":"2024-04-26T12:42:59.303797+0000","last_peered":"2024-04-26T12:42:59.303797+0000","last_clean":"2024-04-26T12:42:59.303797+0000","last_became_active":"2024-04-26T12:42:21.970815+0000","last_became_peered":"2024-04-26T12:42:21.970815+0000","last_unstale":"2024-04-26T12:42:59.303797+0000","last_undegraded":"2024-04-26T12:42:59.303797+0000","last_fullsized":"2024-04-26T12:42:59.303797+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:42:59.303603+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:42:59.303603+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.303603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:40.944638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"139'54","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.524488+0000","last_change":"2024-04-26T12:43:10.524556+0000","last_active":"2024-04-26T12:43:10.524488+0000","last_peered":"2024-04-26T12:43:10.524488+0000","last_clean":"2024-04-26T12:43:10.524488+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:43:10.524488+0000","last_undegraded":"2024-04-26T12:43:10.524488+0000","last_fullsized":"2024-04-26T12:43:10.524488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:10.524282+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:10.524282+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.524282+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:56.799020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.270149+0000","last_change":"2024-04-26T12:42:21.926752+0000","last_active":"2024-04-26T12:42:58.270149+0000","last_peered":"2024-04-26T12:42:58.270149+0000","last_clean":"2024-04-26T12:42:58.270149+0000","last_became_active":"2024-04-26T12:42:21.926086+0000","last_became_peered":"2024-04-26T12:42:21.926086+0000","last_unstale":"2024-04-26T12:42:58.270149+0000","last_undegraded":"2024-04-26T12:42:58.270149+0000","last_fullsized":"2024-04-26T12:42:58.270149+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"139'23","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.854610+0000","last_change":"2024-04-26T12:43:13.854683+0000","last_active":"2024-04-26T12:43:13.854610+0000","last_peered":"2024-04-26T12:43:13.854610+0000","last_clean":"2024-04-26T12:43:13.854610+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:43:13.854610+0000","last_undegraded":"2024-04-26T12:43:13.854610+0000","last_fullsized":"2024-04-26T12:43:13.854610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'23","last_scrub_stamp":"2024-04-26T12:43:13.854420+0000","last_deep_scrub":"139'23","last_deep_scrub_stamp":"2024-04-26T12:43:13.854420+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.854420+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:04.412292+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"139'140","reported_seq":426,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.369300+0000","last_change":"2024-04-26T12:43:07.369369+0000","last_active":"2024-04-26T12:43:07.369300+0000","last_peered":"2024-04-26T12:43:07.369300+0000","last_clean":"2024-04-26T12:43:07.369300+0000","last_became_active":"2024-04-26T12:42:21.972298+0000","last_became_peered":"2024-04-26T12:42:21.972298+0000","last_unstale":"2024-04-26T12:43:07.369300+0000","last_undegraded":"2024-04-26T12:43:07.369300+0000","last_fullsized":"2024-04-26T12:43:07.369300+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'140","last_scrub_stamp":"2024-04-26T12:43:07.369106+0000","last_deep_scrub":"139'140","last_deep_scrub_stamp":"2024-04-26T12:43:07.369106+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.369106+0000","objects_scrubbed":1,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:18.564273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.202926+0000","last_change":"2024-04-26T12:43:07.203044+0000","last_active":"2024-04-26T12:43:07.202926+0000","last_peered":"2024-04-26T12:43:07.202926+0000","last_clean":"2024-04-26T12:43:07.202926+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:43:07.202926+0000","last_undegraded":"2024-04-26T12:43:07.202926+0000","last_fullsized":"2024-04-26T12:43:07.202926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:07.202604+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:07.202604+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.202604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:23.435288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"139'48","reported_seq":260,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.578474+0000","last_change":"2024-04-26T12:43:09.578616+0000","last_active":"2024-04-26T12:43:09.578474+0000","last_peered":"2024-04-26T12:43:09.578474+0000","last_clean":"2024-04-26T12:43:09.578474+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:43:09.578474+0000","last_undegraded":"2024-04-26T12:43:09.578474+0000","last_fullsized":"2024-04-26T12:43:09.578474+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:09.578188+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:09.578188+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.578188+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:05.831900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.835576+0000","last_change":"2024-04-26T12:43:03.835690+0000","last_active":"2024-04-26T12:43:03.835576+0000","last_peered":"2024-04-26T12:43:03.835576+0000","last_clean":"2024-04-26T12:43:03.835576+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:43:03.835576+0000","last_undegraded":"2024-04-26T12:43:03.835576+0000","last_fullsized":"2024-04-26T12:43:03.835576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.835273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.835273+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.835273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:03.288371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"139'38","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.147364+0000","last_change":"2024-04-26T12:43:14.147450+0000","last_active":"2024-04-26T12:43:14.147364+0000","last_peered":"2024-04-26T12:43:14.147364+0000","last_clean":"2024-04-26T12:43:14.147364+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:43:14.147364+0000","last_undegraded":"2024-04-26T12:43:14.147364+0000","last_fullsized":"2024-04-26T12:43:14.147364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:14.147135+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:14.147135+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.147135+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:24.485106+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.973887+0000","last_change":"2024-04-26T12:43:08.973943+0000","last_active":"2024-04-26T12:43:08.973887+0000","last_peered":"2024-04-26T12:43:08.973887+0000","last_clean":"2024-04-26T12:43:08.973887+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:43:08.973887+0000","last_undegraded":"2024-04-26T12:43:08.973887+0000","last_fullsized":"2024-04-26T12:43:08.973887+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:08.973679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:08.973679+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.973679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.619038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.199675+0000","last_change":"2024-04-26T12:43:00.199712+0000","last_active":"2024-04-26T12:43:00.199675+0000","last_peered":"2024-04-26T12:43:00.199675+0000","last_clean":"2024-04-26T12:43:00.199675+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:43:00.199675+0000","last_undegraded":"2024-04-26T12:43:00.199675+0000","last_fullsized":"2024-04-26T12:43:00.199675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.199539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.199539+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.199539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:59.508818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"117'8","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066125+0000","last_change":"2024-04-26T12:42:34.029770+0000","last_active":"2024-04-26T12:42:41.066125+0000","last_peered":"2024-04-26T12:42:41.066125+0000","last_clean":"2024-04-26T12:42:41.066125+0000","last_became_active":"2024-04-26T12:42:34.027515+0000","last_became_peered":"2024-04-26T12:42:34.027515+0000","last_unstale":"2024-04-26T12:42:41.066125+0000","last_undegraded":"2024-04-26T12:42:41.066125+0000","last_fullsized":"2024-04-26T12:42:41.066125+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"139'40","reported_seq":291,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.776630+0000","last_change":"2024-04-26T12:38:10.467982+0000","last_active":"2024-04-26T12:42:52.776630+0000","last_peered":"2024-04-26T12:42:52.776630+0000","last_clean":"2024-04-26T12:42:52.776630+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:42:52.776630+0000","last_undegraded":"2024-04-26T12:42:52.776630+0000","last_fullsized":"2024-04-26T12:42:52.776630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.577417+0000","last_change":"2024-04-26T12:43:04.577525+0000","last_active":"2024-04-26T12:43:04.577417+0000","last_peered":"2024-04-26T12:43:04.577417+0000","last_clean":"2024-04-26T12:43:04.577417+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:43:04.577417+0000","last_undegraded":"2024-04-26T12:43:04.577417+0000","last_fullsized":"2024-04-26T12:43:04.577417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.577199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.577199+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.577199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:12.782935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"139'23","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.705250+0000","last_change":"2024-04-26T12:42:21.974974+0000","last_active":"2024-04-26T12:42:52.705250+0000","last_peered":"2024-04-26T12:42:52.705250+0000","last_clean":"2024-04-26T12:42:52.705250+0000","last_became_active":"2024-04-26T12:42:21.968492+0000","last_became_peered":"2024-04-26T12:42:21.968492+0000","last_unstale":"2024-04-26T12:42:52.705250+0000","last_undegraded":"2024-04-26T12:42:52.705250+0000","last_fullsized":"2024-04-26T12:42:52.705250+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068702+0000","last_change":"2024-04-26T12:42:21.943962+0000","last_active":"2024-04-26T12:42:41.068702+0000","last_peered":"2024-04-26T12:42:41.068702+0000","last_clean":"2024-04-26T12:42:41.068702+0000","last_became_active":"2024-04-26T12:42:21.942925+0000","last_became_peered":"2024-04-26T12:42:21.942925+0000","last_unstale":"2024-04-26T12:42:41.068702+0000","last_undegraded":"2024-04-26T12:42:41.068702+0000","last_fullsized":"2024-04-26T12:42:41.068702+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519792+0000","last_change":"2024-04-26T12:38:20.523106+0000","last_active":"2024-04-26T12:42:42.519792+0000","last_peered":"2024-04-26T12:42:42.519792+0000","last_clean":"2024-04-26T12:42:42.519792+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:42:42.519792+0000","last_undegraded":"2024-04-26T12:42:42.519792+0000","last_fullsized":"2024-04-26T12:42:42.519792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.597598+0000","last_change":"2024-04-26T12:43:03.597659+0000","last_active":"2024-04-26T12:43:03.597598+0000","last_peered":"2024-04-26T12:43:03.597598+0000","last_clean":"2024-04-26T12:43:03.597598+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:43:03.597598+0000","last_undegraded":"2024-04-26T12:43:03.597598+0000","last_fullsized":"2024-04-26T12:43:03.597598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-04-26T12:43:03.597397+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-04-26T12:43:03.597397+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.597397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:49.371415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"139'38","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.850437+0000","last_change":"2024-04-26T12:43:14.850502+0000","last_active":"2024-04-26T12:43:14.850437+0000","last_peered":"2024-04-26T12:43:14.850437+0000","last_clean":"2024-04-26T12:43:14.850437+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:43:14.850437+0000","last_undegraded":"2024-04-26T12:43:14.850437+0000","last_fullsized":"2024-04-26T12:43:14.850437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:14.850229+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:14.850229+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.850229+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:18.592039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.624596+0000","last_change":"2024-04-26T12:43:07.624649+0000","last_active":"2024-04-26T12:43:07.624596+0000","last_peered":"2024-04-26T12:43:07.624596+0000","last_clean":"2024-04-26T12:43:07.624596+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:43:07.624596+0000","last_undegraded":"2024-04-26T12:43:07.624596+0000","last_fullsized":"2024-04-26T12:43:07.624596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:07.624397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:07.624397+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.624397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:57.852666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"139'33","reported_seq":294,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.793798+0000","last_change":"2024-04-26T12:43:07.793894+0000","last_active":"2024-04-26T12:43:07.793798+0000","last_peered":"2024-04-26T12:43:07.793798+0000","last_clean":"2024-04-26T12:43:07.793798+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:43:07.793798+0000","last_undegraded":"2024-04-26T12:43:07.793798+0000","last_fullsized":"2024-04-26T12:43:07.793798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'33","last_scrub_stamp":"2024-04-26T12:43:07.793623+0000","last_deep_scrub":"139'33","last_deep_scrub_stamp":"2024-04-26T12:43:07.793623+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.793623+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:03.458697+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"139'138","reported_seq":459,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.895586+0000","last_change":"2024-04-26T12:38:18.495967+0000","last_active":"2024-04-26T12:42:52.895586+0000","last_peered":"2024-04-26T12:42:52.895586+0000","last_clean":"2024-04-26T12:42:52.895586+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:42:52.895586+0000","last_undegraded":"2024-04-26T12:42:52.895586+0000","last_fullsized":"2024-04-26T12:42:52.895586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.132746+0000","last_change":"2024-04-26T12:42:56.132770+0000","last_active":"2024-04-26T12:42:56.132746+0000","last_peered":"2024-04-26T12:42:56.132746+0000","last_clean":"2024-04-26T12:42:56.132746+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:42:56.132746+0000","last_undegraded":"2024-04-26T12:42:56.132746+0000","last_fullsized":"2024-04-26T12:42:56.132746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:42:56.132663+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:42:56.132663+0000","last_clean_scrub_stamp":"2024-04-26T12:42:56.132663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:50.436843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.440872+0000","last_change":"2024-04-26T12:43:17.440934+0000","last_active":"2024-04-26T12:43:17.440872+0000","last_peered":"2024-04-26T12:43:17.440872+0000","last_clean":"2024-04-26T12:43:17.440872+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:43:17.440872+0000","last_undegraded":"2024-04-26T12:43:17.440872+0000","last_fullsized":"2024-04-26T12:43:17.440872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:17.440639+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:17.440639+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.440639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:32.950498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"139'36","reported_seq":298,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.848232+0000","last_change":"2024-04-26T12:42:21.959737+0000","last_active":"2024-04-26T12:42:52.848232+0000","last_peered":"2024-04-26T12:42:52.848232+0000","last_clean":"2024-04-26T12:42:52.848232+0000","last_became_active":"2024-04-26T12:42:21.959122+0000","last_became_peered":"2024-04-26T12:42:21.959122+0000","last_unstale":"2024-04-26T12:42:52.848232+0000","last_undegraded":"2024-04-26T12:42:52.848232+0000","last_fullsized":"2024-04-26T12:42:52.848232+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.579314+0000","last_change":"2024-04-26T12:42:59.579343+0000","last_active":"2024-04-26T12:42:59.579314+0000","last_peered":"2024-04-26T12:42:59.579314+0000","last_clean":"2024-04-26T12:42:59.579314+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:42:59.579314+0000","last_undegraded":"2024-04-26T12:42:59.579314+0000","last_fullsized":"2024-04-26T12:42:59.579314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:59.579187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:59.579187+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.579187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:52.115646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"139'39","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.253479+0000","last_change":"2024-04-26T12:43:08.253556+0000","last_active":"2024-04-26T12:43:08.253479+0000","last_peered":"2024-04-26T12:43:08.253479+0000","last_clean":"2024-04-26T12:43:08.253479+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:43:08.253479+0000","last_undegraded":"2024-04-26T12:43:08.253479+0000","last_fullsized":"2024-04-26T12:43:08.253479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'39","last_scrub_stamp":"2024-04-26T12:43:08.253296+0000","last_deep_scrub":"139'39","last_deep_scrub_stamp":"2024-04-26T12:43:08.253296+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.253296+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:50.352734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.623885+0000","last_change":"2024-04-26T12:42:58.623924+0000","last_active":"2024-04-26T12:42:58.623885+0000","last_peered":"2024-04-26T12:42:58.623885+0000","last_clean":"2024-04-26T12:42:58.623885+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:42:58.623885+0000","last_undegraded":"2024-04-26T12:42:58.623885+0000","last_fullsized":"2024-04-26T12:42:58.623885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:58.623773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:58.623773+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.623773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:57.930708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"108'7","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.006686+0000","last_change":"2024-04-26T12:42:21.935665+0000","last_active":"2024-04-26T12:42:42.006686+0000","last_peered":"2024-04-26T12:42:42.006686+0000","last_clean":"2024-04-26T12:42:42.006686+0000","last_became_active":"2024-04-26T12:42:21.934686+0000","last_became_peered":"2024-04-26T12:42:21.934686+0000","last_unstale":"2024-04-26T12:42:42.006686+0000","last_undegraded":"2024-04-26T12:42:42.006686+0000","last_fullsized":"2024-04-26T12:42:42.006686+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"117'4","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068037+0000","last_change":"2024-04-26T12:42:34.032506+0000","last_active":"2024-04-26T12:42:41.068037+0000","last_peered":"2024-04-26T12:42:41.068037+0000","last_clean":"2024-04-26T12:42:41.068037+0000","last_became_active":"2024-04-26T12:42:34.031776+0000","last_became_peered":"2024-04-26T12:42:34.031776+0000","last_unstale":"2024-04-26T12:42:41.068037+0000","last_undegraded":"2024-04-26T12:42:41.068037+0000","last_fullsized":"2024-04-26T12:42:41.068037+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"139'52","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.831772+0000","last_change":"2024-04-26T12:42:21.974477+0000","last_active":"2024-04-26T12:42:52.831772+0000","last_peered":"2024-04-26T12:42:52.831772+0000","last_clean":"2024-04-26T12:42:52.831772+0000","last_became_active":"2024-04-26T12:42:21.967072+0000","last_became_peered":"2024-04-26T12:42:21.967072+0000","last_unstale":"2024-04-26T12:42:52.831772+0000","last_undegraded":"2024-04-26T12:42:52.831772+0000","last_fullsized":"2024-04-26T12:42:52.831772+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.671500+0000","last_change":"2024-04-26T12:43:06.671553+0000","last_active":"2024-04-26T12:43:06.671500+0000","last_peered":"2024-04-26T12:43:06.671500+0000","last_clean":"2024-04-26T12:43:06.671500+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:43:06.671500+0000","last_undegraded":"2024-04-26T12:43:06.671500+0000","last_fullsized":"2024-04-26T12:43:06.671500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:06.671308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:06.671308+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.671308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:08.435831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"139'26","reported_seq":85,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.723100+0000","last_change":"2024-04-26T12:43:01.723178+0000","last_active":"2024-04-26T12:43:01.723100+0000","last_peered":"2024-04-26T12:43:01.723100+0000","last_clean":"2024-04-26T12:43:01.723100+0000","last_became_active":"2024-04-26T12:42:34.027524+0000","last_became_peered":"2024-04-26T12:42:34.027524+0000","last_unstale":"2024-04-26T12:43:01.723100+0000","last_undegraded":"2024-04-26T12:43:01.723100+0000","last_fullsized":"2024-04-26T12:43:01.723100+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:01.722913+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:01.722913+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.722913+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:33.832597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:47.841428+0000","last_change":"2024-04-26T12:42:21.938337+0000","last_active":"2024-04-26T12:42:47.841428+0000","last_peered":"2024-04-26T12:42:47.841428+0000","last_clean":"2024-04-26T12:42:47.841428+0000","last_became_active":"2024-04-26T12:42:21.937057+0000","last_became_peered":"2024-04-26T12:42:21.937057+0000","last_unstale":"2024-04-26T12:42:47.841428+0000","last_undegraded":"2024-04-26T12:42:47.841428+0000","last_fullsized":"2024-04-26T12:42:47.841428+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":227,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.277903+0000","last_change":"2024-04-26T12:43:09.278044+0000","last_active":"2024-04-26T12:43:09.277903+0000","last_peered":"2024-04-26T12:43:09.277903+0000","last_clean":"2024-04-26T12:43:09.277903+0000","last_became_active":"2024-04-26T12:42:21.948878+0000","last_became_peered":"2024-04-26T12:42:21.948878+0000","last_unstale":"2024-04-26T12:43:09.277903+0000","last_undegraded":"2024-04-26T12:43:09.277903+0000","last_fullsized":"2024-04-26T12:43:09.277903+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:09.277669+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:09.277669+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.277669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:05.039552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":140,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.726264+0000","last_change":"2024-04-26T12:43:08.726414+0000","last_active":"2024-04-26T12:43:08.726264+0000","last_peered":"2024-04-26T12:43:08.726264+0000","last_clean":"2024-04-26T12:43:08.726264+0000","last_became_active":"2024-04-26T12:42:34.018540+0000","last_became_peered":"2024-04-26T12:42:34.018540+0000","last_unstale":"2024-04-26T12:43:08.726264+0000","last_undegraded":"2024-04-26T12:43:08.726264+0000","last_fullsized":"2024-04-26T12:43:08.726264+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-04-26T12:43:08.726036+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-04-26T12:43:08.726036+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.726036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:26.448825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"139'40","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.495420+0000","last_change":"2024-04-26T12:43:14.495545+0000","last_active":"2024-04-26T12:43:14.495420+0000","last_peered":"2024-04-26T12:43:14.495420+0000","last_clean":"2024-04-26T12:43:14.495420+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:43:14.495420+0000","last_undegraded":"2024-04-26T12:43:14.495420+0000","last_fullsized":"2024-04-26T12:43:14.495420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:14.495095+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:14.495095+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.495095+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:51.816257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.900868+0000","last_change":"2024-04-26T12:42:56.900889+0000","last_active":"2024-04-26T12:42:56.900868+0000","last_peered":"2024-04-26T12:42:56.900868+0000","last_clean":"2024-04-26T12:42:56.900868+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:42:56.900868+0000","last_undegraded":"2024-04-26T12:42:56.900868+0000","last_fullsized":"2024-04-26T12:42:56.900868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:56.900773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:56.900773+0000","last_clean_scrub_stamp":"2024-04-26T12:42:56.900773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:47.129042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"139'32","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.531746+0000","last_change":"2024-04-26T12:43:14.531831+0000","last_active":"2024-04-26T12:43:14.531746+0000","last_peered":"2024-04-26T12:43:14.531746+0000","last_clean":"2024-04-26T12:43:14.531746+0000","last_became_active":"2024-04-26T12:42:21.958977+0000","last_became_peered":"2024-04-26T12:42:21.958977+0000","last_unstale":"2024-04-26T12:43:14.531746+0000","last_undegraded":"2024-04-26T12:43:14.531746+0000","last_fullsized":"2024-04-26T12:43:14.531746+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:14.531555+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:14.531555+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.531555+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:26.642981+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"139'138","reported_seq":452,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.622736+0000","last_change":"2024-04-26T12:43:08.622800+0000","last_active":"2024-04-26T12:43:08.622736+0000","last_peered":"2024-04-26T12:43:08.622736+0000","last_clean":"2024-04-26T12:43:08.622736+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:43:08.622736+0000","last_undegraded":"2024-04-26T12:43:08.622736+0000","last_fullsized":"2024-04-26T12:43:08.622736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:08.622527+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:08.622527+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.622527+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:37.571768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408657+0000","last_change":"2024-04-26T12:38:20.502354+0000","last_active":"2024-04-26T12:42:41.408657+0000","last_peered":"2024-04-26T12:42:41.408657+0000","last_clean":"2024-04-26T12:42:41.408657+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:42:41.408657+0000","last_undegraded":"2024-04-26T12:42:41.408657+0000","last_fullsized":"2024-04-26T12:42:41.408657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":189,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.705327+0000","last_change":"2024-04-26T12:42:59.705388+0000","last_active":"2024-04-26T12:42:59.705327+0000","last_peered":"2024-04-26T12:42:59.705327+0000","last_clean":"2024-04-26T12:42:59.705327+0000","last_became_active":"2024-04-26T12:42:34.025094+0000","last_became_peered":"2024-04-26T12:42:34.025094+0000","last_unstale":"2024-04-26T12:42:59.705327+0000","last_undegraded":"2024-04-26T12:42:59.705327+0000","last_fullsized":"2024-04-26T12:42:59.705327+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-04-26T12:42:59.705118+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-04-26T12:42:59.705118+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.705118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:42.842126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"139'70","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.692554+0000","last_change":"2024-04-26T12:43:03.692616+0000","last_active":"2024-04-26T12:43:03.692554+0000","last_peered":"2024-04-26T12:43:03.692554+0000","last_clean":"2024-04-26T12:43:03.692554+0000","last_became_active":"2024-04-26T12:42:34.019821+0000","last_became_peered":"2024-04-26T12:42:34.019821+0000","last_unstale":"2024-04-26T12:43:03.692554+0000","last_undegraded":"2024-04-26T12:43:03.692554+0000","last_fullsized":"2024-04-26T12:43:03.692554+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'70","last_scrub_stamp":"2024-04-26T12:43:03.692350+0000","last_deep_scrub":"139'70","last_deep_scrub_stamp":"2024-04-26T12:43:03.692350+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.692350+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:15.436633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"139'4","reported_seq":441,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.217077+0000","last_change":"2024-04-26T12:43:06.217156+0000","last_active":"2024-04-26T12:43:06.217077+0000","last_peered":"2024-04-26T12:43:06.217077+0000","last_clean":"2024-04-26T12:43:06.217077+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:43:06.217077+0000","last_undegraded":"2024-04-26T12:43:06.217077+0000","last_fullsized":"2024-04-26T12:43:06.217077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'4","last_scrub_stamp":"2024-04-26T12:43:06.216848+0000","last_deep_scrub":"139'4","last_deep_scrub_stamp":"2024-04-26T12:43:06.216848+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.216848+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.585068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"29'10","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073575+0000","last_change":"2024-04-26T12:42:21.962837+0000","last_active":"2024-04-26T12:42:41.073575+0000","last_peered":"2024-04-26T12:42:41.073575+0000","last_clean":"2024-04-26T12:42:41.073575+0000","last_became_active":"2024-04-26T12:42:21.952480+0000","last_became_peered":"2024-04-26T12:42:21.952480+0000","last_unstale":"2024-04-26T12:42:41.073575+0000","last_undegraded":"2024-04-26T12:42:41.073575+0000","last_fullsized":"2024-04-26T12:42:41.073575+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"139'138","reported_seq":476,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.890437+0000","last_change":"2024-04-26T12:38:18.496754+0000","last_active":"2024-04-26T12:42:52.890437+0000","last_peered":"2024-04-26T12:42:52.890437+0000","last_clean":"2024-04-26T12:42:52.890437+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:42:52.890437+0000","last_undegraded":"2024-04-26T12:42:52.890437+0000","last_fullsized":"2024-04-26T12:42:52.890437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.696476+0000","last_change":"2024-04-26T12:43:04.696540+0000","last_active":"2024-04-26T12:43:04.696476+0000","last_peered":"2024-04-26T12:43:04.696476+0000","last_clean":"2024-04-26T12:43:04.696476+0000","last_became_active":"2024-04-26T12:42:34.015095+0000","last_became_peered":"2024-04-26T12:42:34.015095+0000","last_unstale":"2024-04-26T12:43:04.696476+0000","last_undegraded":"2024-04-26T12:43:04.696476+0000","last_fullsized":"2024-04-26T12:43:04.696476+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:04.696255+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:04.696255+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.696255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:25.482856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.841560+0000","last_change":"2024-04-26T12:42:21.953982+0000","last_active":"2024-04-26T12:42:42.841560+0000","last_peered":"2024-04-26T12:42:42.841560+0000","last_clean":"2024-04-26T12:42:42.841560+0000","last_became_active":"2024-04-26T12:42:21.953253+0000","last_became_peered":"2024-04-26T12:42:21.953253+0000","last_unstale":"2024-04-26T12:42:42.841560+0000","last_undegraded":"2024-04-26T12:42:42.841560+0000","last_fullsized":"2024-04-26T12:42:42.841560+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"139'40","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.337604+0000","last_change":"2024-04-26T12:43:14.337667+0000","last_active":"2024-04-26T12:43:14.337604+0000","last_peered":"2024-04-26T12:43:14.337604+0000","last_clean":"2024-04-26T12:43:14.337604+0000","last_became_active":"2024-04-26T12:42:21.940512+0000","last_became_peered":"2024-04-26T12:42:21.940512+0000","last_unstale":"2024-04-26T12:43:14.337604+0000","last_undegraded":"2024-04-26T12:43:14.337604+0000","last_fullsized":"2024-04-26T12:43:14.337604+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:14.337382+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:14.337382+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.337382+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:29.589516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":51,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067526+0000","last_change":"2024-04-26T12:42:34.007412+0000","last_active":"2024-04-26T12:42:41.067526+0000","last_peered":"2024-04-26T12:42:41.067526+0000","last_clean":"2024-04-26T12:42:41.067526+0000","last_became_active":"2024-04-26T12:42:34.005897+0000","last_became_peered":"2024-04-26T12:42:34.005897+0000","last_unstale":"2024-04-26T12:42:41.067526+0000","last_undegraded":"2024-04-26T12:42:41.067526+0000","last_fullsized":"2024-04-26T12:42:41.067526+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"139'36","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.106269+0000","last_change":"2024-04-26T12:43:10.106352+0000","last_active":"2024-04-26T12:43:10.106269+0000","last_peered":"2024-04-26T12:43:10.106269+0000","last_clean":"2024-04-26T12:43:10.106269+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:43:10.106269+0000","last_undegraded":"2024-04-26T12:43:10.106269+0000","last_fullsized":"2024-04-26T12:43:10.106269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:10.106078+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:10.106078+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.106078+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:26.424587+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:47.846138+0000","last_change":"2024-04-26T12:42:21.947536+0000","last_active":"2024-04-26T12:42:47.846138+0000","last_peered":"2024-04-26T12:42:47.846138+0000","last_clean":"2024-04-26T12:42:47.846138+0000","last_became_active":"2024-04-26T12:42:21.946663+0000","last_became_peered":"2024-04-26T12:42:21.946663+0000","last_unstale":"2024-04-26T12:42:47.846138+0000","last_undegraded":"2024-04-26T12:42:47.846138+0000","last_fullsized":"2024-04-26T12:42:47.846138+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":233,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.408569+0000","last_change":"2024-04-26T12:38:20.517441+0000","last_active":"2024-04-26T12:42:41.408569+0000","last_peered":"2024-04-26T12:42:41.408569+0000","last_clean":"2024-04-26T12:42:41.408569+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:42:41.408569+0000","last_undegraded":"2024-04-26T12:42:41.408569+0000","last_fullsized":"2024-04-26T12:42:41.408569+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.612572+0000","last_change":"2024-04-26T12:43:01.612636+0000","last_active":"2024-04-26T12:43:01.612572+0000","last_peered":"2024-04-26T12:43:01.612572+0000","last_clean":"2024-04-26T12:43:01.612572+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:43:01.612572+0000","last_undegraded":"2024-04-26T12:43:01.612572+0000","last_fullsized":"2024-04-26T12:43:01.612572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-04-26T12:43:01.612356+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-04-26T12:43:01.612356+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.612356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:33.491385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":407,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517022+0000","last_change":"2024-04-26T12:38:04.413735+0000","last_active":"2024-04-26T12:42:42.517022+0000","last_peered":"2024-04-26T12:42:42.517022+0000","last_clean":"2024-04-26T12:42:42.517022+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:42:42.517022+0000","last_undegraded":"2024-04-26T12:42:42.517022+0000","last_fullsized":"2024-04-26T12:42:42.517022+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122666+0000","last_change":"2024-04-26T12:38:04.385537+0000","last_active":"2024-04-26T12:42:42.122666+0000","last_peered":"2024-04-26T12:42:42.122666+0000","last_clean":"2024-04-26T12:42:42.122666+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:42:42.122666+0000","last_undegraded":"2024-04-26T12:42:42.122666+0000","last_fullsized":"2024-04-26T12:42:42.122666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"139'66","reported_seq":316,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.848993+0000","last_change":"2024-04-26T12:42:21.931544+0000","last_active":"2024-04-26T12:42:52.848993+0000","last_peered":"2024-04-26T12:42:52.848993+0000","last_clean":"2024-04-26T12:42:52.848993+0000","last_became_active":"2024-04-26T12:42:21.929093+0000","last_became_peered":"2024-04-26T12:42:21.929093+0000","last_unstale":"2024-04-26T12:42:52.848993+0000","last_undegraded":"2024-04-26T12:42:52.848993+0000","last_fullsized":"2024-04-26T12:42:52.848993+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.856821+0000","last_change":"2024-04-26T12:43:02.856875+0000","last_active":"2024-04-26T12:43:02.856821+0000","last_peered":"2024-04-26T12:43:02.856821+0000","last_clean":"2024-04-26T12:43:02.856821+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:43:02.856821+0000","last_undegraded":"2024-04-26T12:43:02.856821+0000","last_fullsized":"2024-04-26T12:43:02.856821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:02.856629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:02.856629+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.856629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:13.235151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"139'50","reported_seq":326,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.388849+0000","last_change":"2024-04-26T12:42:21.932409+0000","last_active":"2024-04-26T12:42:52.388849+0000","last_peered":"2024-04-26T12:42:52.388849+0000","last_clean":"2024-04-26T12:42:52.388849+0000","last_became_active":"2024-04-26T12:42:21.931114+0000","last_became_peered":"2024-04-26T12:42:21.931114+0000","last_unstale":"2024-04-26T12:42:52.388849+0000","last_undegraded":"2024-04-26T12:42:52.388849+0000","last_fullsized":"2024-04-26T12:42:52.388849+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":397,"num_write":30,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.391393+0000","last_change":"2024-04-26T12:43:14.391532+0000","last_active":"2024-04-26T12:43:14.391393+0000","last_peered":"2024-04-26T12:43:14.391393+0000","last_clean":"2024-04-26T12:43:14.391393+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:43:14.391393+0000","last_undegraded":"2024-04-26T12:43:14.391393+0000","last_fullsized":"2024-04-26T12:43:14.391393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:14.391148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:14.391148+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.391148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:43.733621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":232,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.517499+0000","last_change":"2024-04-26T12:38:20.521650+0000","last_active":"2024-04-26T12:42:42.517499+0000","last_peered":"2024-04-26T12:42:42.517499+0000","last_clean":"2024-04-26T12:42:42.517499+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:42:42.517499+0000","last_undegraded":"2024-04-26T12:42:42.517499+0000","last_fullsized":"2024-04-26T12:42:42.517499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.286255+0000","last_change":"2024-04-26T12:43:11.286324+0000","last_active":"2024-04-26T12:43:11.286255+0000","last_peered":"2024-04-26T12:43:11.286255+0000","last_clean":"2024-04-26T12:43:11.286255+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:43:11.286255+0000","last_undegraded":"2024-04-26T12:43:11.286255+0000","last_fullsized":"2024-04-26T12:43:11.286255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:11.286038+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:11.286038+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.286038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:49.168408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.862484+0000","last_change":"2024-04-26T12:43:17.862535+0000","last_active":"2024-04-26T12:43:17.862484+0000","last_peered":"2024-04-26T12:43:17.862484+0000","last_clean":"2024-04-26T12:43:17.862484+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:43:17.862484+0000","last_undegraded":"2024-04-26T12:43:17.862484+0000","last_fullsized":"2024-04-26T12:43:17.862484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:17.862271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:17.862271+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.862271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:49.971956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'36","reported_seq":289,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.815691+0000","last_change":"2024-04-26T12:38:10.460440+0000","last_active":"2024-04-26T12:42:52.815691+0000","last_peered":"2024-04-26T12:42:52.815691+0000","last_clean":"2024-04-26T12:42:52.815691+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:42:52.815691+0000","last_undegraded":"2024-04-26T12:42:52.815691+0000","last_fullsized":"2024-04-26T12:42:52.815691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.233009+0000","last_change":"2024-04-26T12:43:04.233068+0000","last_active":"2024-04-26T12:43:04.233009+0000","last_peered":"2024-04-26T12:43:04.233009+0000","last_clean":"2024-04-26T12:43:04.233009+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:43:04.233009+0000","last_undegraded":"2024-04-26T12:43:04.233009+0000","last_fullsized":"2024-04-26T12:43:04.233009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.232754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.232754+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.232754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:54.790626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"139'155","reported_seq":533,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.901929+0000","last_change":"2024-04-26T12:43:00.902011+0000","last_active":"2024-04-26T12:43:00.901929+0000","last_peered":"2024-04-26T12:43:00.901929+0000","last_clean":"2024-04-26T12:43:00.901929+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:43:00.901929+0000","last_undegraded":"2024-04-26T12:43:00.901929+0000","last_fullsized":"2024-04-26T12:43:00.901929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'155","last_scrub_stamp":"2024-04-26T12:43:00.901702+0000","last_deep_scrub":"139'155","last_deep_scrub_stamp":"2024-04-26T12:43:00.901702+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.901702+0000","objects_scrubbed":10,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:47.176440+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":191,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515093+0000","last_change":"2024-04-26T12:38:18.480657+0000","last_active":"2024-04-26T12:42:42.515093+0000","last_peered":"2024-04-26T12:42:42.515093+0000","last_clean":"2024-04-26T12:42:42.515093+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:42:42.515093+0000","last_undegraded":"2024-04-26T12:42:42.515093+0000","last_fullsized":"2024-04-26T12:42:42.515093+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"117'2","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.841396+0000","last_change":"2024-04-26T12:38:20.715857+0000","last_active":"2024-04-26T12:42:42.841396+0000","last_peered":"2024-04-26T12:42:42.841396+0000","last_clean":"2024-04-26T12:42:42.841396+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:42:42.841396+0000","last_undegraded":"2024-04-26T12:42:42.841396+0000","last_fullsized":"2024-04-26T12:42:42.841396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.945417+0000","last_change":"2024-04-26T12:43:07.945480+0000","last_active":"2024-04-26T12:43:07.945417+0000","last_peered":"2024-04-26T12:43:07.945417+0000","last_clean":"2024-04-26T12:43:07.945417+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:43:07.945417+0000","last_undegraded":"2024-04-26T12:43:07.945417+0000","last_fullsized":"2024-04-26T12:43:07.945417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'10","last_scrub_stamp":"2024-04-26T12:43:07.945203+0000","last_deep_scrub":"104'10","last_deep_scrub_stamp":"2024-04-26T12:43:07.945203+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.945203+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:02.826059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.490419+0000","last_change":"2024-04-26T12:43:12.490476+0000","last_active":"2024-04-26T12:43:12.490419+0000","last_peered":"2024-04-26T12:43:12.490419+0000","last_clean":"2024-04-26T12:43:12.490419+0000","last_became_active":"2024-04-26T12:42:21.938117+0000","last_became_peered":"2024-04-26T12:42:21.938117+0000","last_unstale":"2024-04-26T12:43:12.490419+0000","last_undegraded":"2024-04-26T12:43:12.490419+0000","last_fullsized":"2024-04-26T12:43:12.490419+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:12.490218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:12.490218+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.490218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:24.981091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"139'66","reported_seq":328,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.024378+0000","last_change":"2024-04-26T12:43:15.024525+0000","last_active":"2024-04-26T12:43:15.024378+0000","last_peered":"2024-04-26T12:43:15.024378+0000","last_clean":"2024-04-26T12:43:15.024378+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:43:15.024378+0000","last_undegraded":"2024-04-26T12:43:15.024378+0000","last_fullsized":"2024-04-26T12:43:15.024378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'66","last_scrub_stamp":"2024-04-26T12:43:15.024133+0000","last_deep_scrub":"139'66","last_deep_scrub_stamp":"2024-04-26T12:43:15.024133+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.024133+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:43.770855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":76,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"139'4","reported_seq":348,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.632383+0000","last_change":"2024-04-26T12:43:05.632454+0000","last_active":"2024-04-26T12:43:05.632383+0000","last_peered":"2024-04-26T12:43:05.632383+0000","last_clean":"2024-04-26T12:43:05.632383+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:43:05.632383+0000","last_undegraded":"2024-04-26T12:43:05.632383+0000","last_fullsized":"2024-04-26T12:43:05.632383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'4","last_scrub_stamp":"2024-04-26T12:43:05.632196+0000","last_deep_scrub":"139'4","last_deep_scrub_stamp":"2024-04-26T12:43:05.632196+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.632196+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:14.699365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"139'26","reported_seq":333,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.882265+0000","last_change":"2024-04-26T12:43:15.882347+0000","last_active":"2024-04-26T12:43:15.882265+0000","last_peered":"2024-04-26T12:43:15.882265+0000","last_clean":"2024-04-26T12:43:15.882265+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:43:15.882265+0000","last_undegraded":"2024-04-26T12:43:15.882265+0000","last_fullsized":"2024-04-26T12:43:15.882265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:15.882042+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:15.882042+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.882042+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:59.019050+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.442092+0000","last_change":"2024-04-26T12:43:16.442222+0000","last_active":"2024-04-26T12:43:16.442092+0000","last_peered":"2024-04-26T12:43:16.442092+0000","last_clean":"2024-04-26T12:43:16.442092+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:43:16.442092+0000","last_undegraded":"2024-04-26T12:43:16.442092+0000","last_fullsized":"2024-04-26T12:43:16.442092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:16.441866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:16.441866+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.441866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:46.860759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"66'1","reported_seq":213,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070740+0000","last_change":"2024-04-26T12:42:21.942734+0000","last_active":"2024-04-26T12:42:41.070740+0000","last_peered":"2024-04-26T12:42:41.070740+0000","last_clean":"2024-04-26T12:42:41.070740+0000","last_became_active":"2024-04-26T12:42:21.928602+0000","last_became_peered":"2024-04-26T12:42:21.928602+0000","last_unstale":"2024-04-26T12:42:41.070740+0000","last_undegraded":"2024-04-26T12:42:41.070740+0000","last_fullsized":"2024-04-26T12:42:41.070740+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409146+0000","last_change":"2024-04-26T12:38:12.455892+0000","last_active":"2024-04-26T12:42:41.409146+0000","last_peered":"2024-04-26T12:42:41.409146+0000","last_clean":"2024-04-26T12:42:41.409146+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:42:41.409146+0000","last_undegraded":"2024-04-26T12:42:41.409146+0000","last_fullsized":"2024-04-26T12:42:41.409146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.122845+0000","last_change":"2024-04-26T12:38:04.383102+0000","last_active":"2024-04-26T12:42:42.122845+0000","last_peered":"2024-04-26T12:42:42.122845+0000","last_clean":"2024-04-26T12:42:42.122845+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:42:42.122845+0000","last_undegraded":"2024-04-26T12:42:42.122845+0000","last_fullsized":"2024-04-26T12:42:42.122845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"139'36","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.773197+0000","last_change":"2024-04-26T12:42:34.006811+0000","last_active":"2024-04-26T12:42:52.773197+0000","last_peered":"2024-04-26T12:42:52.773197+0000","last_clean":"2024-04-26T12:42:52.773197+0000","last_became_active":"2024-04-26T12:42:34.004041+0000","last_became_peered":"2024-04-26T12:42:34.004041+0000","last_unstale":"2024-04-26T12:42:52.773197+0000","last_undegraded":"2024-04-26T12:42:52.773197+0000","last_fullsized":"2024-04-26T12:42:52.773197+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.229773+0000","last_change":"2024-04-26T12:43:07.229827+0000","last_active":"2024-04-26T12:43:07.229773+0000","last_peered":"2024-04-26T12:43:07.229773+0000","last_clean":"2024-04-26T12:43:07.229773+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:43:07.229773+0000","last_undegraded":"2024-04-26T12:43:07.229773+0000","last_fullsized":"2024-04-26T12:43:07.229773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:07.229566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:07.229566+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.229566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:05.835538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"67'13","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073729+0000","last_change":"2024-04-26T12:42:21.946073+0000","last_active":"2024-04-26T12:42:41.073729+0000","last_peered":"2024-04-26T12:42:41.073729+0000","last_clean":"2024-04-26T12:42:41.073729+0000","last_became_active":"2024-04-26T12:42:21.942937+0000","last_became_peered":"2024-04-26T12:42:21.942937+0000","last_unstale":"2024-04-26T12:42:41.073729+0000","last_undegraded":"2024-04-26T12:42:41.073729+0000","last_fullsized":"2024-04-26T12:42:41.073729+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.515409+0000","last_change":"2024-04-26T12:38:18.501077+0000","last_active":"2024-04-26T12:42:42.515409+0000","last_peered":"2024-04-26T12:42:42.515409+0000","last_clean":"2024-04-26T12:42:42.515409+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:42:42.515409+0000","last_undegraded":"2024-04-26T12:42:42.515409+0000","last_fullsized":"2024-04-26T12:42:42.515409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121313+0000","last_change":"2024-04-26T12:42:21.942893+0000","last_active":"2024-04-26T12:42:42.121313+0000","last_peered":"2024-04-26T12:42:42.121313+0000","last_clean":"2024-04-26T12:42:42.121313+0000","last_became_active":"2024-04-26T12:42:21.941954+0000","last_became_peered":"2024-04-26T12:42:21.941954+0000","last_unstale":"2024-04-26T12:42:42.121313+0000","last_undegraded":"2024-04-26T12:42:42.121313+0000","last_fullsized":"2024-04-26T12:42:42.121313+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.935762+0000","last_change":"2024-04-26T12:43:09.935829+0000","last_active":"2024-04-26T12:43:09.935762+0000","last_peered":"2024-04-26T12:43:09.935762+0000","last_clean":"2024-04-26T12:43:09.935762+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:43:09.935762+0000","last_undegraded":"2024-04-26T12:43:09.935762+0000","last_fullsized":"2024-04-26T12:43:09.935762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:43:09.935517+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:43:09.935517+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.935517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:29.052334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'52","reported_seq":322,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.228505+0000","last_change":"2024-04-26T12:42:59.228566+0000","last_active":"2024-04-26T12:42:59.228505+0000","last_peered":"2024-04-26T12:42:59.228505+0000","last_clean":"2024-04-26T12:42:59.228505+0000","last_became_active":"2024-04-26T12:42:21.923345+0000","last_became_peered":"2024-04-26T12:42:21.923345+0000","last_unstale":"2024-04-26T12:42:59.228505+0000","last_undegraded":"2024-04-26T12:42:59.228505+0000","last_fullsized":"2024-04-26T12:42:59.228505+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'52","last_scrub_stamp":"2024-04-26T12:42:59.228284+0000","last_deep_scrub":"139'52","last_deep_scrub_stamp":"2024-04-26T12:42:59.228284+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.228284+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:49.470394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.939391+0000","last_change":"2024-04-26T12:43:11.939446+0000","last_active":"2024-04-26T12:43:11.939391+0000","last_peered":"2024-04-26T12:43:11.939391+0000","last_clean":"2024-04-26T12:43:11.939391+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:43:11.939391+0000","last_undegraded":"2024-04-26T12:43:11.939391+0000","last_fullsized":"2024-04-26T12:43:11.939391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:11.939178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:11.939178+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.939178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:02.497049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.212612+0000","last_change":"2024-04-26T12:43:04.212666+0000","last_active":"2024-04-26T12:43:04.212612+0000","last_peered":"2024-04-26T12:43:04.212612+0000","last_clean":"2024-04-26T12:43:04.212612+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:43:04.212612+0000","last_undegraded":"2024-04-26T12:43:04.212612+0000","last_fullsized":"2024-04-26T12:43:04.212612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.212416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.212416+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.212416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:24.999017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"139'40","reported_seq":310,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.882697+0000","last_change":"2024-04-26T12:42:21.957374+0000","last_active":"2024-04-26T12:42:52.882697+0000","last_peered":"2024-04-26T12:42:52.882697+0000","last_clean":"2024-04-26T12:42:52.882697+0000","last_became_active":"2024-04-26T12:42:21.956451+0000","last_became_peered":"2024-04-26T12:42:21.956451+0000","last_unstale":"2024-04-26T12:42:52.882697+0000","last_undegraded":"2024-04-26T12:42:52.882697+0000","last_fullsized":"2024-04-26T12:42:52.882697+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":213,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.697649+0000","last_change":"2024-04-26T12:43:16.697707+0000","last_active":"2024-04-26T12:43:16.697649+0000","last_peered":"2024-04-26T12:43:16.697649+0000","last_clean":"2024-04-26T12:43:16.697649+0000","last_became_active":"2024-04-26T12:42:34.014949+0000","last_became_peered":"2024-04-26T12:42:34.014949+0000","last_unstale":"2024-04-26T12:43:16.697649+0000","last_undegraded":"2024-04-26T12:43:16.697649+0000","last_fullsized":"2024-04-26T12:43:16.697649+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:16.697451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:16.697451+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.697451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:32.207309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.161144+0000","last_change":"2024-04-26T12:42:58.161182+0000","last_active":"2024-04-26T12:42:58.161144+0000","last_peered":"2024-04-26T12:42:58.161144+0000","last_clean":"2024-04-26T12:42:58.161144+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:42:58.161144+0000","last_undegraded":"2024-04-26T12:42:58.161144+0000","last_fullsized":"2024-04-26T12:42:58.161144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:58.160999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:58.160999+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.160999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:47.990505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.352611+0000","last_change":"2024-04-26T12:43:13.352776+0000","last_active":"2024-04-26T12:43:13.352611+0000","last_peered":"2024-04-26T12:43:13.352611+0000","last_clean":"2024-04-26T12:43:13.352611+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:43:13.352611+0000","last_undegraded":"2024-04-26T12:43:13.352611+0000","last_fullsized":"2024-04-26T12:43:13.352611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:13.352310+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:13.352310+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.352310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:13.713815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"139'62","reported_seq":323,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.028784+0000","last_change":"2024-04-26T12:43:14.028907+0000","last_active":"2024-04-26T12:43:14.028784+0000","last_peered":"2024-04-26T12:43:14.028784+0000","last_clean":"2024-04-26T12:43:14.028784+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:43:14.028784+0000","last_undegraded":"2024-04-26T12:43:14.028784+0000","last_fullsized":"2024-04-26T12:43:14.028784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'62","last_scrub_stamp":"2024-04-26T12:43:14.028520+0000","last_deep_scrub":"139'62","last_deep_scrub_stamp":"2024-04-26T12:43:14.028520+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.028520+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:57.165528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.519933+0000","last_change":"2024-04-26T12:38:04.412333+0000","last_active":"2024-04-26T12:42:42.519933+0000","last_peered":"2024-04-26T12:42:42.519933+0000","last_clean":"2024-04-26T12:42:42.519933+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:42:42.519933+0000","last_undegraded":"2024-04-26T12:42:42.519933+0000","last_fullsized":"2024-04-26T12:42:42.519933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:03.355260+0000","last_clean_scrub_stamp":"2024-04-26T12:38:03.355260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.573429+0000","last_change":"2024-04-26T12:43:00.573485+0000","last_active":"2024-04-26T12:43:00.573429+0000","last_peered":"2024-04-26T12:43:00.573429+0000","last_clean":"2024-04-26T12:43:00.573429+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:43:00.573429+0000","last_undegraded":"2024-04-26T12:43:00.573429+0000","last_fullsized":"2024-04-26T12:43:00.573429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.573216+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:13.231544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"139'21","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.883931+0000","last_change":"2024-04-26T12:43:04.884109+0000","last_active":"2024-04-26T12:43:04.883931+0000","last_peered":"2024-04-26T12:43:04.883931+0000","last_clean":"2024-04-26T12:43:04.883931+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:43:04.883931+0000","last_undegraded":"2024-04-26T12:43:04.883931+0000","last_fullsized":"2024-04-26T12:43:04.883931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'21","last_scrub_stamp":"2024-04-26T12:43:04.883646+0000","last_deep_scrub":"139'21","last_deep_scrub_stamp":"2024-04-26T12:43:04.883646+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.883646+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:42.204808+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"139'138","reported_seq":439,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.159003+0000","last_change":"2024-04-26T12:43:16.159078+0000","last_active":"2024-04-26T12:43:16.159003+0000","last_peered":"2024-04-26T12:43:16.159003+0000","last_clean":"2024-04-26T12:43:16.159003+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:43:16.159003+0000","last_undegraded":"2024-04-26T12:43:16.159003+0000","last_fullsized":"2024-04-26T12:43:16.159003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:16.158784+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:16.158784+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.158784+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:27.113662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":220,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073926+0000","last_change":"2024-04-26T12:42:21.962241+0000","last_active":"2024-04-26T12:42:41.073926+0000","last_peered":"2024-04-26T12:42:41.073926+0000","last_clean":"2024-04-26T12:42:41.073926+0000","last_became_active":"2024-04-26T12:42:21.960618+0000","last_became_peered":"2024-04-26T12:42:21.960618+0000","last_unstale":"2024-04-26T12:42:41.073926+0000","last_undegraded":"2024-04-26T12:42:41.073926+0000","last_fullsized":"2024-04-26T12:42:41.073926+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067659+0000","last_change":"2024-04-26T12:42:21.965811+0000","last_active":"2024-04-26T12:42:41.067659+0000","last_peered":"2024-04-26T12:42:41.067659+0000","last_clean":"2024-04-26T12:42:41.067659+0000","last_became_active":"2024-04-26T12:42:21.960998+0000","last_became_peered":"2024-04-26T12:42:21.960998+0000","last_unstale":"2024-04-26T12:42:41.067659+0000","last_undegraded":"2024-04-26T12:42:41.067659+0000","last_fullsized":"2024-04-26T12:42:41.067659+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"139'54","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.266517+0000","last_change":"2024-04-26T12:42:58.266580+0000","last_active":"2024-04-26T12:42:58.266517+0000","last_peered":"2024-04-26T12:42:58.266517+0000","last_clean":"2024-04-26T12:42:58.266517+0000","last_became_active":"2024-04-26T12:42:21.968901+0000","last_became_peered":"2024-04-26T12:42:21.968901+0000","last_unstale":"2024-04-26T12:42:58.266517+0000","last_undegraded":"2024-04-26T12:42:58.266517+0000","last_fullsized":"2024-04-26T12:42:58.266517+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:42:58.266315+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:42:58.266315+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.266315+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:20.120407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.909328+0000","last_change":"2024-04-26T12:43:10.909424+0000","last_active":"2024-04-26T12:43:10.909328+0000","last_peered":"2024-04-26T12:43:10.909328+0000","last_clean":"2024-04-26T12:43:10.909328+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:43:10.909328+0000","last_undegraded":"2024-04-26T12:43:10.909328+0000","last_fullsized":"2024-04-26T12:43:10.909328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:10.909043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:10.909043+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.909043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:58.975101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.736160+0000","last_change":"2024-04-26T12:43:12.736215+0000","last_active":"2024-04-26T12:43:12.736160+0000","last_peered":"2024-04-26T12:43:12.736160+0000","last_clean":"2024-04-26T12:43:12.736160+0000","last_became_active":"2024-04-26T12:42:34.015774+0000","last_became_peered":"2024-04-26T12:42:34.015774+0000","last_unstale":"2024-04-26T12:43:12.736160+0000","last_undegraded":"2024-04-26T12:43:12.736160+0000","last_fullsized":"2024-04-26T12:43:12.736160+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:12.735961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:12.735961+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.735961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:59.671904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"29'10","reported_seq":72,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067532+0000","last_change":"2024-04-26T12:42:34.031336+0000","last_active":"2024-04-26T12:42:41.067532+0000","last_peered":"2024-04-26T12:42:41.067532+0000","last_clean":"2024-04-26T12:42:41.067532+0000","last_became_active":"2024-04-26T12:42:34.029037+0000","last_became_peered":"2024-04-26T12:42:34.029037+0000","last_unstale":"2024-04-26T12:42:41.067532+0000","last_undegraded":"2024-04-26T12:42:41.067532+0000","last_fullsized":"2024-04-26T12:42:41.067532+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"139'140","reported_seq":426,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.362564+0000","last_change":"2024-04-26T12:43:03.362634+0000","last_active":"2024-04-26T12:43:03.362564+0000","last_peered":"2024-04-26T12:43:03.362564+0000","last_clean":"2024-04-26T12:43:03.362564+0000","last_became_active":"2024-04-26T12:42:21.962332+0000","last_became_peered":"2024-04-26T12:42:21.962332+0000","last_unstale":"2024-04-26T12:43:03.362564+0000","last_undegraded":"2024-04-26T12:43:03.362564+0000","last_fullsized":"2024-04-26T12:43:03.362564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'140","last_scrub_stamp":"2024-04-26T12:43:03.362373+0000","last_deep_scrub":"139'140","last_deep_scrub_stamp":"2024-04-26T12:43:03.362373+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.362373+0000","objects_scrubbed":1,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:17.592743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.844341+0000","last_change":"2024-04-26T12:42:21.957370+0000","last_active":"2024-04-26T12:42:52.844341+0000","last_peered":"2024-04-26T12:42:52.844341+0000","last_clean":"2024-04-26T12:42:52.844341+0000","last_became_active":"2024-04-26T12:42:21.956715+0000","last_became_peered":"2024-04-26T12:42:21.956715+0000","last_unstale":"2024-04-26T12:42:52.844341+0000","last_undegraded":"2024-04-26T12:42:52.844341+0000","last_fullsized":"2024-04-26T12:42:52.844341+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":116,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067762+0000","last_change":"2024-04-26T12:42:34.013472+0000","last_active":"2024-04-26T12:42:41.067762+0000","last_peered":"2024-04-26T12:42:41.067762+0000","last_clean":"2024-04-26T12:42:41.067762+0000","last_became_active":"2024-04-26T12:42:34.010800+0000","last_became_peered":"2024-04-26T12:42:34.010800+0000","last_unstale":"2024-04-26T12:42:41.067762+0000","last_undegraded":"2024-04-26T12:42:41.067762+0000","last_fullsized":"2024-04-26T12:42:41.067762+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"139'46","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.807333+0000","last_change":"2024-04-26T12:38:10.441760+0000","last_active":"2024-04-26T12:42:52.807333+0000","last_peered":"2024-04-26T12:42:52.807333+0000","last_clean":"2024-04-26T12:42:52.807333+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:42:52.807333+0000","last_undegraded":"2024-04-26T12:42:52.807333+0000","last_fullsized":"2024-04-26T12:42:52.807333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.546974+0000","last_change":"2024-04-26T12:43:08.547033+0000","last_active":"2024-04-26T12:43:08.546974+0000","last_peered":"2024-04-26T12:43:08.546974+0000","last_clean":"2024-04-26T12:43:08.546974+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:43:08.546974+0000","last_undegraded":"2024-04-26T12:43:08.546974+0000","last_fullsized":"2024-04-26T12:43:08.546974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:08.546762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:08.546762+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.546762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:04.800474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068617+0000","last_change":"2024-04-26T12:42:21.941484+0000","last_active":"2024-04-26T12:42:41.068617+0000","last_peered":"2024-04-26T12:42:41.068617+0000","last_clean":"2024-04-26T12:42:41.068617+0000","last_became_active":"2024-04-26T12:42:21.926472+0000","last_became_peered":"2024-04-26T12:42:21.926472+0000","last_unstale":"2024-04-26T12:42:41.068617+0000","last_undegraded":"2024-04-26T12:42:41.068617+0000","last_fullsized":"2024-04-26T12:42:41.068617+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"139'57","reported_seq":333,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.815299+0000","last_change":"2024-04-26T12:43:11.815386+0000","last_active":"2024-04-26T12:43:11.815299+0000","last_peered":"2024-04-26T12:43:11.815299+0000","last_clean":"2024-04-26T12:43:11.815299+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:43:11.815299+0000","last_undegraded":"2024-04-26T12:43:11.815299+0000","last_fullsized":"2024-04-26T12:43:11.815299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'57","last_scrub_stamp":"2024-04-26T12:43:11.815105+0000","last_deep_scrub":"139'57","last_deep_scrub_stamp":"2024-04-26T12:43:11.815105+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.815105+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:24.120399+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068460+0000","last_change":"2024-04-26T12:42:21.919160+0000","last_active":"2024-04-26T12:42:41.068460+0000","last_peered":"2024-04-26T12:42:41.068460+0000","last_clean":"2024-04-26T12:42:41.068460+0000","last_became_active":"2024-04-26T12:42:21.918031+0000","last_became_peered":"2024-04-26T12:42:21.918031+0000","last_unstale":"2024-04-26T12:42:41.068460+0000","last_undegraded":"2024-04-26T12:42:41.068460+0000","last_fullsized":"2024-04-26T12:42:41.068460+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.856918+0000","last_change":"2024-04-26T12:38:20.522623+0000","last_active":"2024-04-26T12:42:52.856918+0000","last_peered":"2024-04-26T12:42:52.856918+0000","last_clean":"2024-04-26T12:42:52.856918+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:42:52.856918+0000","last_undegraded":"2024-04-26T12:42:52.856918+0000","last_fullsized":"2024-04-26T12:42:52.856918+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.204130+0000","last_change":"2024-04-26T12:42:59.204187+0000","last_active":"2024-04-26T12:42:59.204130+0000","last_peered":"2024-04-26T12:42:59.204130+0000","last_clean":"2024-04-26T12:42:59.204130+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:42:59.204130+0000","last_undegraded":"2024-04-26T12:42:59.204130+0000","last_fullsized":"2024-04-26T12:42:59.204130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'7","last_scrub_stamp":"2024-04-26T12:42:59.203938+0000","last_deep_scrub":"91'7","last_deep_scrub_stamp":"2024-04-26T12:42:59.203938+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.203938+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:17.572158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":195,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.697773+0000","last_change":"2024-04-26T12:43:15.697902+0000","last_active":"2024-04-26T12:43:15.697773+0000","last_peered":"2024-04-26T12:43:15.697773+0000","last_clean":"2024-04-26T12:43:15.697773+0000","last_became_active":"2024-04-26T12:42:34.022792+0000","last_became_peered":"2024-04-26T12:42:34.022792+0000","last_unstale":"2024-04-26T12:43:15.697773+0000","last_undegraded":"2024-04-26T12:43:15.697773+0000","last_fullsized":"2024-04-26T12:43:15.697773+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'2","last_scrub_stamp":"2024-04-26T12:43:15.697480+0000","last_deep_scrub":"104'2","last_deep_scrub_stamp":"2024-04-26T12:43:15.697480+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.697480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:46.116374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"139'40","reported_seq":242,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.823754+0000","last_change":"2024-04-26T12:42:34.012055+0000","last_active":"2024-04-26T12:42:52.823754+0000","last_peered":"2024-04-26T12:42:52.823754+0000","last_clean":"2024-04-26T12:42:52.823754+0000","last_became_active":"2024-04-26T12:42:34.008295+0000","last_became_peered":"2024-04-26T12:42:34.008295+0000","last_unstale":"2024-04-26T12:42:52.823754+0000","last_undegraded":"2024-04-26T12:42:52.823754+0000","last_fullsized":"2024-04-26T12:42:52.823754+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.925045+0000","last_change":"2024-04-26T12:42:57.925077+0000","last_active":"2024-04-26T12:42:57.925045+0000","last_peered":"2024-04-26T12:42:57.925045+0000","last_clean":"2024-04-26T12:42:57.925045+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:42:57.925045+0000","last_undegraded":"2024-04-26T12:42:57.925045+0000","last_fullsized":"2024-04-26T12:42:57.925045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:57.924946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:57.924946+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.924946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:20.467638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"139'26","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.331838+0000","last_change":"2024-04-26T12:43:06.331924+0000","last_active":"2024-04-26T12:43:06.331838+0000","last_peered":"2024-04-26T12:43:06.331838+0000","last_clean":"2024-04-26T12:43:06.331838+0000","last_became_active":"2024-04-26T12:42:21.964467+0000","last_became_peered":"2024-04-26T12:42:21.964467+0000","last_unstale":"2024-04-26T12:43:06.331838+0000","last_undegraded":"2024-04-26T12:43:06.331838+0000","last_fullsized":"2024-04-26T12:43:06.331838+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:06.331620+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:06.331620+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.331620+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:10.579086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.072671+0000","last_change":"2024-04-26T12:42:21.964141+0000","last_active":"2024-04-26T12:42:41.072671+0000","last_peered":"2024-04-26T12:42:41.072671+0000","last_clean":"2024-04-26T12:42:41.072671+0000","last_became_active":"2024-04-26T12:42:21.959360+0000","last_became_peered":"2024-04-26T12:42:21.959360+0000","last_unstale":"2024-04-26T12:42:41.072671+0000","last_undegraded":"2024-04-26T12:42:41.072671+0000","last_fullsized":"2024-04-26T12:42:41.072671+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.309941+0000","last_change":"2024-04-26T12:43:01.310002+0000","last_active":"2024-04-26T12:43:01.309941+0000","last_peered":"2024-04-26T12:43:01.309941+0000","last_clean":"2024-04-26T12:43:01.309941+0000","last_became_active":"2024-04-26T12:42:21.968658+0000","last_became_peered":"2024-04-26T12:42:21.968658+0000","last_unstale":"2024-04-26T12:43:01.309941+0000","last_undegraded":"2024-04-26T12:43:01.309941+0000","last_fullsized":"2024-04-26T12:43:01.309941+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.309721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.309721+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.309721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:16.498477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.889190+0000","last_change":"2024-04-26T12:43:01.889248+0000","last_active":"2024-04-26T12:43:01.889190+0000","last_peered":"2024-04-26T12:43:01.889190+0000","last_clean":"2024-04-26T12:43:01.889190+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:43:01.889190+0000","last_undegraded":"2024-04-26T12:43:01.889190+0000","last_fullsized":"2024-04-26T12:43:01.889190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.888989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.888989+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.888989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:12.267511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"139'46","reported_seq":304,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.188372+0000","last_change":"2024-04-26T12:42:21.956317+0000","last_active":"2024-04-26T12:42:59.188372+0000","last_peered":"2024-04-26T12:42:59.188372+0000","last_clean":"2024-04-26T12:42:59.188372+0000","last_became_active":"2024-04-26T12:42:21.955428+0000","last_became_peered":"2024-04-26T12:42:21.955428+0000","last_unstale":"2024-04-26T12:42:59.188372+0000","last_undegraded":"2024-04-26T12:42:59.188372+0000","last_fullsized":"2024-04-26T12:42:59.188372+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067701+0000","last_change":"2024-04-26T12:42:21.973314+0000","last_active":"2024-04-26T12:42:41.067701+0000","last_peered":"2024-04-26T12:42:41.067701+0000","last_clean":"2024-04-26T12:42:41.067701+0000","last_became_active":"2024-04-26T12:42:21.964554+0000","last_became_peered":"2024-04-26T12:42:21.964554+0000","last_unstale":"2024-04-26T12:42:41.067701+0000","last_undegraded":"2024-04-26T12:42:41.067701+0000","last_fullsized":"2024-04-26T12:42:41.067701+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"139'12","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.249419+0000","last_change":"2024-04-26T12:43:10.249501+0000","last_active":"2024-04-26T12:43:10.249419+0000","last_peered":"2024-04-26T12:43:10.249419+0000","last_clean":"2024-04-26T12:43:10.249419+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:43:10.249419+0000","last_undegraded":"2024-04-26T12:43:10.249419+0000","last_fullsized":"2024-04-26T12:43:10.249419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'12","last_scrub_stamp":"2024-04-26T12:43:10.249209+0000","last_deep_scrub":"139'12","last_deep_scrub_stamp":"2024-04-26T12:43:10.249209+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.249209+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:37.644219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.904953+0000","last_change":"2024-04-26T12:42:59.905038+0000","last_active":"2024-04-26T12:42:59.904953+0000","last_peered":"2024-04-26T12:42:59.904953+0000","last_clean":"2024-04-26T12:42:59.904953+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:42:59.904953+0000","last_undegraded":"2024-04-26T12:42:59.904953+0000","last_fullsized":"2024-04-26T12:42:59.904953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:59.904710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:59.904710+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.904710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:56.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.245095+0000","last_change":"2024-04-26T12:43:00.245163+0000","last_active":"2024-04-26T12:43:00.245095+0000","last_peered":"2024-04-26T12:43:00.245095+0000","last_clean":"2024-04-26T12:43:00.245095+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:43:00.245095+0000","last_undegraded":"2024-04-26T12:43:00.245095+0000","last_fullsized":"2024-04-26T12:43:00.245095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:00.244880+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:00.244880+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.244880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.477564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.350436+0000","last_change":"2024-04-26T12:43:04.350508+0000","last_active":"2024-04-26T12:43:04.350436+0000","last_peered":"2024-04-26T12:43:04.350436+0000","last_clean":"2024-04-26T12:43:04.350436+0000","last_became_active":"2024-04-26T12:42:21.965760+0000","last_became_peered":"2024-04-26T12:42:21.965760+0000","last_unstale":"2024-04-26T12:43:04.350436+0000","last_undegraded":"2024-04-26T12:43:04.350436+0000","last_fullsized":"2024-04-26T12:43:04.350436+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'10","last_scrub_stamp":"2024-04-26T12:43:04.350211+0000","last_deep_scrub":"74'10","last_deep_scrub_stamp":"2024-04-26T12:43:04.350211+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.350211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.688741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"139'54","reported_seq":309,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.269569+0000","last_change":"2024-04-26T12:38:10.440500+0000","last_active":"2024-04-26T12:42:58.269569+0000","last_peered":"2024-04-26T12:42:58.269569+0000","last_clean":"2024-04-26T12:42:58.269569+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:42:58.269569+0000","last_undegraded":"2024-04-26T12:42:58.269569+0000","last_fullsized":"2024-04-26T12:42:58.269569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.815707+0000","last_change":"2024-04-26T12:43:04.815767+0000","last_active":"2024-04-26T12:43:04.815707+0000","last_peered":"2024-04-26T12:43:04.815707+0000","last_clean":"2024-04-26T12:43:04.815707+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:43:04.815707+0000","last_undegraded":"2024-04-26T12:43:04.815707+0000","last_fullsized":"2024-04-26T12:43:04.815707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.815514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.815514+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.815514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:16.926940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"139'22","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.875637+0000","last_change":"2024-04-26T12:42:21.974557+0000","last_active":"2024-04-26T12:42:52.875637+0000","last_peered":"2024-04-26T12:42:52.875637+0000","last_clean":"2024-04-26T12:42:52.875637+0000","last_became_active":"2024-04-26T12:42:21.967735+0000","last_became_peered":"2024-04-26T12:42:21.967735+0000","last_unstale":"2024-04-26T12:42:52.875637+0000","last_undegraded":"2024-04-26T12:42:52.875637+0000","last_fullsized":"2024-04-26T12:42:52.875637+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.609437+0000","last_change":"2024-04-26T12:43:17.609493+0000","last_active":"2024-04-26T12:43:17.609437+0000","last_peered":"2024-04-26T12:43:17.609437+0000","last_clean":"2024-04-26T12:43:17.609437+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:43:17.609437+0000","last_undegraded":"2024-04-26T12:43:17.609437+0000","last_fullsized":"2024-04-26T12:43:17.609437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:17.609242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:17.609242+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.609242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:30.698690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.121970+0000","last_change":"2024-04-26T12:38:20.515742+0000","last_active":"2024-04-26T12:42:42.121970+0000","last_peered":"2024-04-26T12:42:42.121970+0000","last_clean":"2024-04-26T12:42:42.121970+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:42:42.121970+0000","last_undegraded":"2024-04-26T12:42:42.121970+0000","last_fullsized":"2024-04-26T12:42:42.121970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068216+0000","last_change":"2024-04-26T12:42:21.946016+0000","last_active":"2024-04-26T12:42:41.068216+0000","last_peered":"2024-04-26T12:42:41.068216+0000","last_clean":"2024-04-26T12:42:41.068216+0000","last_became_active":"2024-04-26T12:42:21.927785+0000","last_became_peered":"2024-04-26T12:42:21.927785+0000","last_unstale":"2024-04-26T12:42:41.068216+0000","last_undegraded":"2024-04-26T12:42:41.068216+0000","last_fullsized":"2024-04-26T12:42:41.068216+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'40","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:55.873609+0000","last_change":"2024-04-26T12:38:10.459269+0000","last_active":"2024-04-26T12:42:55.873609+0000","last_peered":"2024-04-26T12:42:55.873609+0000","last_clean":"2024-04-26T12:42:55.873609+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:42:55.873609+0000","last_undegraded":"2024-04-26T12:42:55.873609+0000","last_fullsized":"2024-04-26T12:42:55.873609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.587829+0000","last_change":"2024-04-26T12:43:02.587882+0000","last_active":"2024-04-26T12:43:02.587829+0000","last_peered":"2024-04-26T12:43:02.587829+0000","last_clean":"2024-04-26T12:43:02.587829+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:43:02.587829+0000","last_undegraded":"2024-04-26T12:43:02.587829+0000","last_fullsized":"2024-04-26T12:43:02.587829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:02.587599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:02.587599+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.587599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:22.846905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"139'26","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.803425+0000","last_change":"2024-04-26T12:43:09.803503+0000","last_active":"2024-04-26T12:43:09.803425+0000","last_peered":"2024-04-26T12:43:09.803425+0000","last_clean":"2024-04-26T12:43:09.803425+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:43:09.803425+0000","last_undegraded":"2024-04-26T12:43:09.803425+0000","last_fullsized":"2024-04-26T12:43:09.803425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:09.803242+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:09.803242+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.803242+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:38.691811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.213041+0000","last_change":"2024-04-26T12:43:03.213170+0000","last_active":"2024-04-26T12:43:03.213041+0000","last_peered":"2024-04-26T12:43:03.213041+0000","last_clean":"2024-04-26T12:43:03.213041+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:43:03.213041+0000","last_undegraded":"2024-04-26T12:43:03.213041+0000","last_fullsized":"2024-04-26T12:43:03.213041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.212745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.212745+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.212745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:14.957028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.609440+0000","last_change":"2024-04-26T12:42:59.609502+0000","last_active":"2024-04-26T12:42:59.609440+0000","last_peered":"2024-04-26T12:42:59.609440+0000","last_clean":"2024-04-26T12:42:59.609440+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:42:59.609440+0000","last_undegraded":"2024-04-26T12:42:59.609440+0000","last_fullsized":"2024-04-26T12:42:59.609440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:42:59.609236+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:42:59.609236+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.609236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:52.593677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"139'30","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.374573+0000","last_change":"2024-04-26T12:43:05.374641+0000","last_active":"2024-04-26T12:43:05.374573+0000","last_peered":"2024-04-26T12:43:05.374573+0000","last_clean":"2024-04-26T12:43:05.374573+0000","last_became_active":"2024-04-26T12:42:21.964241+0000","last_became_peered":"2024-04-26T12:42:21.964241+0000","last_unstale":"2024-04-26T12:43:05.374573+0000","last_undegraded":"2024-04-26T12:43:05.374573+0000","last_fullsized":"2024-04-26T12:43:05.374573+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'30","last_scrub_stamp":"2024-04-26T12:43:05.374357+0000","last_deep_scrub":"139'30","last_deep_scrub_stamp":"2024-04-26T12:43:05.374357+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.374357+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.842010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.249043+0000","last_change":"2024-04-26T12:43:05.249097+0000","last_active":"2024-04-26T12:43:05.249043+0000","last_peered":"2024-04-26T12:43:05.249043+0000","last_clean":"2024-04-26T12:43:05.249043+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:43:05.249043+0000","last_undegraded":"2024-04-26T12:43:05.249043+0000","last_fullsized":"2024-04-26T12:43:05.249043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:05.248837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:05.248837+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.248837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:12.372185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"139'37","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.911354+0000","last_change":"2024-04-26T12:43:02.911354+0000","last_active":"2024-04-26T12:43:02.911354+0000","last_peered":"2024-04-26T12:43:02.911354+0000","last_clean":"2024-04-26T12:43:02.911354+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:43:02.911354+0000","last_undegraded":"2024-04-26T12:43:02.911354+0000","last_fullsized":"2024-04-26T12:43:02.911354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'37","last_scrub_stamp":"2024-04-26T12:43:02.910944+0000","last_deep_scrub":"139'37","last_deep_scrub_stamp":"2024-04-26T12:43:02.910944+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.910944+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:02.364042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.270545+0000","last_change":"2024-04-26T12:42:21.947268+0000","last_active":"2024-04-26T12:42:58.270545+0000","last_peered":"2024-04-26T12:42:58.270545+0000","last_clean":"2024-04-26T12:42:58.270545+0000","last_became_active":"2024-04-26T12:42:21.946664+0000","last_became_peered":"2024-04-26T12:42:21.946664+0000","last_unstale":"2024-04-26T12:42:58.270545+0000","last_undegraded":"2024-04-26T12:42:58.270545+0000","last_fullsized":"2024-04-26T12:42:58.270545+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067956+0000","last_change":"2024-04-26T12:42:21.973393+0000","last_active":"2024-04-26T12:42:41.067956+0000","last_peered":"2024-04-26T12:42:41.067956+0000","last_clean":"2024-04-26T12:42:41.067956+0000","last_became_active":"2024-04-26T12:42:21.963727+0000","last_became_peered":"2024-04-26T12:42:21.963727+0000","last_unstale":"2024-04-26T12:42:41.067956+0000","last_undegraded":"2024-04-26T12:42:41.067956+0000","last_fullsized":"2024-04-26T12:42:41.067956+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":314,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.205535+0000","last_change":"2024-04-26T12:43:09.205602+0000","last_active":"2024-04-26T12:43:09.205535+0000","last_peered":"2024-04-26T12:43:09.205535+0000","last_clean":"2024-04-26T12:43:09.205535+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:43:09.205535+0000","last_undegraded":"2024-04-26T12:43:09.205535+0000","last_fullsized":"2024-04-26T12:43:09.205535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-04-26T12:43:09.205329+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-04-26T12:43:09.205329+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.205329+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:20.160206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"139'64","reported_seq":324,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.348059+0000","last_change":"2024-04-26T12:42:21.934786+0000","last_active":"2024-04-26T12:42:56.348059+0000","last_peered":"2024-04-26T12:42:56.348059+0000","last_clean":"2024-04-26T12:42:56.348059+0000","last_became_active":"2024-04-26T12:42:21.933941+0000","last_became_peered":"2024-04-26T12:42:21.933941+0000","last_unstale":"2024-04-26T12:42:56.348059+0000","last_undegraded":"2024-04-26T12:42:56.348059+0000","last_fullsized":"2024-04-26T12:42:56.348059+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.578199+0000","last_change":"2024-04-26T12:43:04.578253+0000","last_active":"2024-04-26T12:43:04.578199+0000","last_peered":"2024-04-26T12:43:04.578199+0000","last_clean":"2024-04-26T12:43:04.578199+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:43:04.578199+0000","last_undegraded":"2024-04-26T12:43:04.578199+0000","last_fullsized":"2024-04-26T12:43:04.578199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.577987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.577987+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.577987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:03.793769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"139'32","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.853150+0000","last_change":"2024-04-26T12:43:05.853150+0000","last_active":"2024-04-26T12:43:05.853150+0000","last_peered":"2024-04-26T12:43:05.853150+0000","last_clean":"2024-04-26T12:43:05.853150+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:43:05.853150+0000","last_undegraded":"2024-04-26T12:43:05.853150+0000","last_fullsized":"2024-04-26T12:43:05.853150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:05.852849+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:05.852849+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.852849+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:43.174011+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.948381+0000","last_change":"2024-04-26T12:43:06.948381+0000","last_active":"2024-04-26T12:43:06.948381+0000","last_peered":"2024-04-26T12:43:06.948381+0000","last_clean":"2024-04-26T12:43:06.948381+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:43:06.948381+0000","last_undegraded":"2024-04-26T12:43:06.948381+0000","last_fullsized":"2024-04-26T12:43:06.948381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:06.947999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:06.947999+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.947999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:02.613074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":236,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.726491+0000","last_change":"2024-04-26T12:38:20.523017+0000","last_active":"2024-04-26T12:42:58.726491+0000","last_peered":"2024-04-26T12:42:58.726491+0000","last_clean":"2024-04-26T12:42:58.726491+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:42:58.726491+0000","last_undegraded":"2024-04-26T12:42:58.726491+0000","last_fullsized":"2024-04-26T12:42:58.726491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.073038+0000","last_change":"2024-04-26T12:42:21.925516+0000","last_active":"2024-04-26T12:42:41.073038+0000","last_peered":"2024-04-26T12:42:41.073038+0000","last_clean":"2024-04-26T12:42:41.073038+0000","last_became_active":"2024-04-26T12:42:21.924628+0000","last_became_peered":"2024-04-26T12:42:21.924628+0000","last_unstale":"2024-04-26T12:42:41.073038+0000","last_undegraded":"2024-04-26T12:42:41.073038+0000","last_fullsized":"2024-04-26T12:42:41.073038+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"139'42","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.842130+0000","last_change":"2024-04-26T12:42:34.034805+0000","last_active":"2024-04-26T12:42:52.842130+0000","last_peered":"2024-04-26T12:42:52.842130+0000","last_clean":"2024-04-26T12:42:52.842130+0000","last_became_active":"2024-04-26T12:42:34.034029+0000","last_became_peered":"2024-04-26T12:42:34.034029+0000","last_unstale":"2024-04-26T12:42:52.842130+0000","last_undegraded":"2024-04-26T12:42:52.842130+0000","last_fullsized":"2024-04-26T12:42:52.842130+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":204,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068607+0000","last_change":"2024-04-26T12:42:34.032136+0000","last_active":"2024-04-26T12:42:41.068607+0000","last_peered":"2024-04-26T12:42:41.068607+0000","last_clean":"2024-04-26T12:42:41.068607+0000","last_became_active":"2024-04-26T12:42:34.031261+0000","last_became_peered":"2024-04-26T12:42:34.031261+0000","last_unstale":"2024-04-26T12:42:41.068607+0000","last_undegraded":"2024-04-26T12:42:41.068607+0000","last_fullsized":"2024-04-26T12:42:41.068607+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:13.416815+0000","last_clean_scrub_stamp":"2024-04-26T12:38:13.416815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"139'22","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.378068+0000","last_change":"2024-04-26T12:42:21.932892+0000","last_active":"2024-04-26T12:42:52.378068+0000","last_peered":"2024-04-26T12:42:52.378068+0000","last_clean":"2024-04-26T12:42:52.378068+0000","last_became_active":"2024-04-26T12:42:21.931947+0000","last_became_peered":"2024-04-26T12:42:21.931947+0000","last_unstale":"2024-04-26T12:42:52.378068+0000","last_undegraded":"2024-04-26T12:42:52.378068+0000","last_fullsized":"2024-04-26T12:42:52.378068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.409477+0000","last_change":"2024-04-26T12:42:21.935064+0000","last_active":"2024-04-26T12:42:41.409477+0000","last_peered":"2024-04-26T12:42:41.409477+0000","last_clean":"2024-04-26T12:42:41.409477+0000","last_became_active":"2024-04-26T12:42:21.933611+0000","last_became_peered":"2024-04-26T12:42:21.933611+0000","last_unstale":"2024-04-26T12:42:41.409477+0000","last_undegraded":"2024-04-26T12:42:41.409477+0000","last_fullsized":"2024-04-26T12:42:41.409477+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.257990+0000","last_change":"2024-04-26T12:43:03.258043+0000","last_active":"2024-04-26T12:43:03.257990+0000","last_peered":"2024-04-26T12:43:03.257990+0000","last_clean":"2024-04-26T12:43:03.257990+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:43:03.257990+0000","last_undegraded":"2024-04-26T12:43:03.257990+0000","last_fullsized":"2024-04-26T12:43:03.257990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.257787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.257787+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.257787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:57.561967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.564305+0000","last_change":"2024-04-26T12:43:03.564305+0000","last_active":"2024-04-26T12:43:03.564305+0000","last_peered":"2024-04-26T12:43:03.564305+0000","last_clean":"2024-04-26T12:43:03.564305+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:43:03.564305+0000","last_undegraded":"2024-04-26T12:43:03.564305+0000","last_fullsized":"2024-04-26T12:43:03.564305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.564054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.564054+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.564054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:15.568023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"139'44","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:55.873613+0000","last_change":"2024-04-26T12:38:10.461068+0000","last_active":"2024-04-26T12:42:55.873613+0000","last_peered":"2024-04-26T12:42:55.873613+0000","last_clean":"2024-04-26T12:42:55.873613+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:42:55.873613+0000","last_undegraded":"2024-04-26T12:42:55.873613+0000","last_fullsized":"2024-04-26T12:42:55.873613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.875580+0000","last_change":"2024-04-26T12:42:58.875580+0000","last_active":"2024-04-26T12:42:58.875580+0000","last_peered":"2024-04-26T12:42:58.875580+0000","last_clean":"2024-04-26T12:42:58.875580+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:42:58.875580+0000","last_undegraded":"2024-04-26T12:42:58.875580+0000","last_fullsized":"2024-04-26T12:42:58.875580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:58.875471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:58.875471+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.875471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:03.010290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"139'17","reported_seq":75,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.749737+0000","last_change":"2024-04-26T12:43:11.749825+0000","last_active":"2024-04-26T12:43:11.749737+0000","last_peered":"2024-04-26T12:43:11.749737+0000","last_clean":"2024-04-26T12:43:11.749737+0000","last_became_active":"2024-04-26T12:42:34.022362+0000","last_became_peered":"2024-04-26T12:42:34.022362+0000","last_unstale":"2024-04-26T12:43:11.749737+0000","last_undegraded":"2024-04-26T12:43:11.749737+0000","last_fullsized":"2024-04-26T12:43:11.749737+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'17","last_scrub_stamp":"2024-04-26T12:43:11.749536+0000","last_deep_scrub":"139'17","last_deep_scrub_stamp":"2024-04-26T12:43:11.749536+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.749536+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.974033+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"139'138","reported_seq":439,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.548368+0000","last_change":"2024-04-26T12:43:06.548430+0000","last_active":"2024-04-26T12:43:06.548368+0000","last_peered":"2024-04-26T12:43:06.548368+0000","last_clean":"2024-04-26T12:43:06.548368+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:43:06.548368+0000","last_undegraded":"2024-04-26T12:43:06.548368+0000","last_fullsized":"2024-04-26T12:43:06.548368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:06.548173+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:06.548173+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.548173+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:56.776441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"117'4","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.188749+0000","last_change":"2024-04-26T12:38:20.516435+0000","last_active":"2024-04-26T12:42:59.188749+0000","last_peered":"2024-04-26T12:42:59.188749+0000","last_clean":"2024-04-26T12:42:59.188749+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:42:59.188749+0000","last_undegraded":"2024-04-26T12:42:59.188749+0000","last_fullsized":"2024-04-26T12:42:59.188749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.066319+0000","last_change":"2024-04-26T12:42:34.029194+0000","last_active":"2024-04-26T12:42:41.066319+0000","last_peered":"2024-04-26T12:42:41.066319+0000","last_clean":"2024-04-26T12:42:41.066319+0000","last_became_active":"2024-04-26T12:42:34.028313+0000","last_became_peered":"2024-04-26T12:42:34.028313+0000","last_unstale":"2024-04-26T12:42:41.066319+0000","last_undegraded":"2024-04-26T12:42:41.066319+0000","last_fullsized":"2024-04-26T12:42:41.066319+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"139'52","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.269581+0000","last_change":"2024-04-26T12:38:10.450723+0000","last_active":"2024-04-26T12:42:58.269581+0000","last_peered":"2024-04-26T12:42:58.269581+0000","last_clean":"2024-04-26T12:42:58.269581+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:42:58.269581+0000","last_undegraded":"2024-04-26T12:42:58.269581+0000","last_fullsized":"2024-04-26T12:42:58.269581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.890081+0000","last_change":"2024-04-26T12:43:01.890081+0000","last_active":"2024-04-26T12:43:01.890081+0000","last_peered":"2024-04-26T12:43:01.890081+0000","last_clean":"2024-04-26T12:43:01.890081+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:43:01.890081+0000","last_undegraded":"2024-04-26T12:43:01.890081+0000","last_fullsized":"2024-04-26T12:43:01.890081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.889695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.889695+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.889695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:48.164433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"139'34","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.100676+0000","last_change":"2024-04-26T12:43:12.100772+0000","last_active":"2024-04-26T12:43:12.100676+0000","last_peered":"2024-04-26T12:43:12.100676+0000","last_clean":"2024-04-26T12:43:12.100676+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:43:12.100676+0000","last_undegraded":"2024-04-26T12:43:12.100676+0000","last_fullsized":"2024-04-26T12:43:12.100676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'34","last_scrub_stamp":"2024-04-26T12:43:12.100484+0000","last_deep_scrub":"139'34","last_deep_scrub_stamp":"2024-04-26T12:43:12.100484+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.100484+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:28.728460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":237,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:55.874347+0000","last_change":"2024-04-26T12:38:18.495352+0000","last_active":"2024-04-26T12:42:55.874347+0000","last_peered":"2024-04-26T12:42:55.874347+0000","last_clean":"2024-04-26T12:42:55.874347+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:42:55.874347+0000","last_undegraded":"2024-04-26T12:42:55.874347+0000","last_fullsized":"2024-04-26T12:42:55.874347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:17.440984+0000","last_clean_scrub_stamp":"2024-04-26T12:38:17.440984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":231,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.188879+0000","last_change":"2024-04-26T12:38:20.512127+0000","last_active":"2024-04-26T12:42:59.188879+0000","last_peered":"2024-04-26T12:42:59.188879+0000","last_clean":"2024-04-26T12:42:59.188879+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:42:59.188879+0000","last_undegraded":"2024-04-26T12:42:59.188879+0000","last_fullsized":"2024-04-26T12:42:59.188879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"117'14","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067874+0000","last_change":"2024-04-26T12:42:34.032654+0000","last_active":"2024-04-26T12:42:41.067874+0000","last_peered":"2024-04-26T12:42:41.067874+0000","last_clean":"2024-04-26T12:42:41.067874+0000","last_became_active":"2024-04-26T12:42:34.031426+0000","last_became_peered":"2024-04-26T12:42:34.031426+0000","last_unstale":"2024-04-26T12:42:41.067874+0000","last_undegraded":"2024-04-26T12:42:41.067874+0000","last_fullsized":"2024-04-26T12:42:41.067874+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"139'76","reported_seq":331,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.269614+0000","last_change":"2024-04-26T12:38:10.444366+0000","last_active":"2024-04-26T12:42:58.269614+0000","last_peered":"2024-04-26T12:42:58.269614+0000","last_clean":"2024-04-26T12:42:58.269614+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:42:58.269614+0000","last_undegraded":"2024-04-26T12:42:58.269614+0000","last_fullsized":"2024-04-26T12:42:58.269614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":76,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.169750+0000","last_change":"2024-04-26T12:43:08.169750+0000","last_active":"2024-04-26T12:43:08.169750+0000","last_peered":"2024-04-26T12:43:08.169750+0000","last_clean":"2024-04-26T12:43:08.169750+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:43:08.169750+0000","last_undegraded":"2024-04-26T12:43:08.169750+0000","last_fullsized":"2024-04-26T12:43:08.169750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:08.169495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:08.169495+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.169495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:37.150464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"139'25","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.335623+0000","last_change":"2024-04-26T12:43:12.335759+0000","last_active":"2024-04-26T12:43:12.335623+0000","last_peered":"2024-04-26T12:43:12.335623+0000","last_clean":"2024-04-26T12:43:12.335623+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:43:12.335623+0000","last_undegraded":"2024-04-26T12:43:12.335623+0000","last_fullsized":"2024-04-26T12:43:12.335623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'25","last_scrub_stamp":"2024-04-26T12:43:12.335290+0000","last_deep_scrub":"139'25","last_deep_scrub_stamp":"2024-04-26T12:43:12.335290+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.335290+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:43.038569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":254,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.561814+0000","last_change":"2024-04-26T12:43:16.561867+0000","last_active":"2024-04-26T12:43:16.561814+0000","last_peered":"2024-04-26T12:43:16.561814+0000","last_clean":"2024-04-26T12:43:16.561814+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:43:16.561814+0000","last_undegraded":"2024-04-26T12:43:16.561814+0000","last_fullsized":"2024-04-26T12:43:16.561814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:16.561568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:16.561568+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.561568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:12.226643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":192,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.302221+0000","last_change":"2024-04-26T12:43:13.302404+0000","last_active":"2024-04-26T12:43:13.302221+0000","last_peered":"2024-04-26T12:43:13.302221+0000","last_clean":"2024-04-26T12:43:13.302221+0000","last_became_active":"2024-04-26T12:42:21.951213+0000","last_became_peered":"2024-04-26T12:42:21.951213+0000","last_unstale":"2024-04-26T12:43:13.302221+0000","last_undegraded":"2024-04-26T12:43:13.302221+0000","last_fullsized":"2024-04-26T12:43:13.302221+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T12:43:13.301968+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T12:43:13.301968+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.301968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:56.191133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.069913+0000","last_change":"2024-04-26T12:42:21.963634+0000","last_active":"2024-04-26T12:42:41.069913+0000","last_peered":"2024-04-26T12:42:41.069913+0000","last_clean":"2024-04-26T12:42:41.069913+0000","last_became_active":"2024-04-26T12:42:21.952291+0000","last_became_peered":"2024-04-26T12:42:21.952291+0000","last_unstale":"2024-04-26T12:42:41.069913+0000","last_undegraded":"2024-04-26T12:42:41.069913+0000","last_fullsized":"2024-04-26T12:42:41.069913+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"139'54","reported_seq":304,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.802485+0000","last_change":"2024-04-26T12:42:21.929252+0000","last_active":"2024-04-26T12:42:52.802485+0000","last_peered":"2024-04-26T12:42:52.802485+0000","last_clean":"2024-04-26T12:42:52.802485+0000","last_became_active":"2024-04-26T12:42:21.928247+0000","last_became_peered":"2024-04-26T12:42:21.928247+0000","last_unstale":"2024-04-26T12:42:52.802485+0000","last_undegraded":"2024-04-26T12:42:52.802485+0000","last_fullsized":"2024-04-26T12:42:52.802485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":59,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.720995+0000","last_change":"2024-04-26T12:43:09.721066+0000","last_active":"2024-04-26T12:43:09.720995+0000","last_peered":"2024-04-26T12:43:09.720995+0000","last_clean":"2024-04-26T12:43:09.720995+0000","last_became_active":"2024-04-26T12:42:34.022065+0000","last_became_peered":"2024-04-26T12:42:34.022065+0000","last_unstale":"2024-04-26T12:43:09.720995+0000","last_undegraded":"2024-04-26T12:43:09.720995+0000","last_fullsized":"2024-04-26T12:43:09.720995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:09.720772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:09.720772+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.720772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:15.509639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"139'17","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.370819+0000","last_change":"2024-04-26T12:42:21.975843+0000","last_active":"2024-04-26T12:42:52.370819+0000","last_peered":"2024-04-26T12:42:52.370819+0000","last_clean":"2024-04-26T12:42:52.370819+0000","last_became_active":"2024-04-26T12:42:21.971062+0000","last_became_peered":"2024-04-26T12:42:21.971062+0000","last_unstale":"2024-04-26T12:42:52.370819+0000","last_undegraded":"2024-04-26T12:42:52.370819+0000","last_fullsized":"2024-04-26T12:42:52.370819+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":51,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.705346+0000","last_change":"2024-04-26T12:43:02.705400+0000","last_active":"2024-04-26T12:43:02.705346+0000","last_peered":"2024-04-26T12:43:02.705346+0000","last_clean":"2024-04-26T12:43:02.705346+0000","last_became_active":"2024-04-26T12:42:34.024706+0000","last_became_peered":"2024-04-26T12:42:34.024706+0000","last_unstale":"2024-04-26T12:43:02.705346+0000","last_undegraded":"2024-04-26T12:43:02.705346+0000","last_fullsized":"2024-04-26T12:43:02.705346+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:02.705146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:02.705146+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.705146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:30.502334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":235,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.188953+0000","last_change":"2024-04-26T12:38:20.514867+0000","last_active":"2024-04-26T12:42:59.188953+0000","last_peered":"2024-04-26T12:42:59.188953+0000","last_clean":"2024-04-26T12:42:59.188953+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:42:59.188953+0000","last_undegraded":"2024-04-26T12:42:59.188953+0000","last_fullsized":"2024-04-26T12:42:59.188953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.703385+0000","last_change":"2024-04-26T12:43:13.703442+0000","last_active":"2024-04-26T12:43:13.703385+0000","last_peered":"2024-04-26T12:43:13.703385+0000","last_clean":"2024-04-26T12:43:13.703385+0000","last_became_active":"2024-04-26T12:42:34.022553+0000","last_became_peered":"2024-04-26T12:42:34.022553+0000","last_unstale":"2024-04-26T12:43:13.703385+0000","last_undegraded":"2024-04-26T12:43:13.703385+0000","last_fullsized":"2024-04-26T12:43:13.703385+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'14","last_scrub_stamp":"2024-04-26T12:43:13.703180+0000","last_deep_scrub":"104'14","last_deep_scrub_stamp":"2024-04-26T12:43:13.703180+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.703180+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:43.045653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"139'50","reported_seq":304,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.830307+0000","last_change":"2024-04-26T12:38:10.460436+0000","last_active":"2024-04-26T12:42:52.830307+0000","last_peered":"2024-04-26T12:42:52.830307+0000","last_clean":"2024-04-26T12:42:52.830307+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:42:52.830307+0000","last_undegraded":"2024-04-26T12:42:52.830307+0000","last_fullsized":"2024-04-26T12:42:52.830307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"139'4","reported_seq":348,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.867769+0000","last_change":"2024-04-26T12:42:59.867769+0000","last_active":"2024-04-26T12:42:59.867769+0000","last_peered":"2024-04-26T12:42:59.867769+0000","last_clean":"2024-04-26T12:42:59.867769+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:42:59.867769+0000","last_undegraded":"2024-04-26T12:42:59.867769+0000","last_fullsized":"2024-04-26T12:42:59.867769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'4","last_scrub_stamp":"2024-04-26T12:42:59.867488+0000","last_deep_scrub":"139'4","last_deep_scrub_stamp":"2024-04-26T12:42:59.867488+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.867488+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:33.256882+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"139'23","reported_seq":81,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.702843+0000","last_change":"2024-04-26T12:43:07.702919+0000","last_active":"2024-04-26T12:43:07.702843+0000","last_peered":"2024-04-26T12:43:07.702843+0000","last_clean":"2024-04-26T12:43:07.702843+0000","last_became_active":"2024-04-26T12:42:34.017996+0000","last_became_peered":"2024-04-26T12:42:34.017996+0000","last_unstale":"2024-04-26T12:43:07.702843+0000","last_undegraded":"2024-04-26T12:43:07.702843+0000","last_fullsized":"2024-04-26T12:43:07.702843+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'23","last_scrub_stamp":"2024-04-26T12:43:07.702636+0000","last_deep_scrub":"139'23","last_deep_scrub_stamp":"2024-04-26T12:43:07.702636+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.702636+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:06.308608+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.228725+0000","last_change":"2024-04-26T12:43:01.228725+0000","last_active":"2024-04-26T12:43:01.228725+0000","last_peered":"2024-04-26T12:43:01.228725+0000","last_clean":"2024-04-26T12:43:01.228725+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:43:01.228725+0000","last_undegraded":"2024-04-26T12:43:01.228725+0000","last_fullsized":"2024-04-26T12:43:01.228725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.228301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.228301+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.228301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:16.914084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068781+0000","last_change":"2024-04-26T12:42:34.015473+0000","last_active":"2024-04-26T12:42:41.068781+0000","last_peered":"2024-04-26T12:42:41.068781+0000","last_clean":"2024-04-26T12:42:41.068781+0000","last_became_active":"2024-04-26T12:42:34.011472+0000","last_became_peered":"2024-04-26T12:42:34.011472+0000","last_unstale":"2024-04-26T12:42:41.068781+0000","last_undegraded":"2024-04-26T12:42:41.068781+0000","last_fullsized":"2024-04-26T12:42:41.068781+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"117'8","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.914258+0000","last_change":"2024-04-26T12:43:03.914320+0000","last_active":"2024-04-26T12:43:03.914258+0000","last_peered":"2024-04-26T12:43:03.914258+0000","last_clean":"2024-04-26T12:43:03.914258+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:43:03.914258+0000","last_undegraded":"2024-04-26T12:43:03.914258+0000","last_fullsized":"2024-04-26T12:43:03.914258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'8","last_scrub_stamp":"2024-04-26T12:43:03.914051+0000","last_deep_scrub":"117'8","last_deep_scrub_stamp":"2024-04-26T12:43:03.914051+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.914051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:16.025477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"139'36","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.492557+0000","last_change":"2024-04-26T12:43:11.492695+0000","last_active":"2024-04-26T12:43:11.492557+0000","last_peered":"2024-04-26T12:43:11.492557+0000","last_clean":"2024-04-26T12:43:11.492557+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:43:11.492557+0000","last_undegraded":"2024-04-26T12:43:11.492557+0000","last_fullsized":"2024-04-26T12:43:11.492557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:11.492274+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:11.492274+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.492274+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:23.983148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.055768+0000","last_change":"2024-04-26T12:43:17.055829+0000","last_active":"2024-04-26T12:43:17.055768+0000","last_peered":"2024-04-26T12:43:17.055768+0000","last_clean":"2024-04-26T12:43:17.055768+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:43:17.055768+0000","last_undegraded":"2024-04-26T12:43:17.055768+0000","last_fullsized":"2024-04-26T12:43:17.055768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'12","last_scrub_stamp":"2024-04-26T12:43:17.055523+0000","last_deep_scrub":"74'12","last_deep_scrub_stamp":"2024-04-26T12:43:17.055523+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.055523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:44.852711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"139'54","reported_seq":321,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.556358+0000","last_change":"2024-04-26T12:43:10.556427+0000","last_active":"2024-04-26T12:43:10.556358+0000","last_peered":"2024-04-26T12:43:10.556358+0000","last_clean":"2024-04-26T12:43:10.556358+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:43:10.556358+0000","last_undegraded":"2024-04-26T12:43:10.556358+0000","last_fullsized":"2024-04-26T12:43:10.556358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:10.556157+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:10.556157+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.556157+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:43.945550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.122109+0000","last_change":"2024-04-26T12:43:11.122256+0000","last_active":"2024-04-26T12:43:11.122109+0000","last_peered":"2024-04-26T12:43:11.122109+0000","last_clean":"2024-04-26T12:43:11.122109+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:43:11.122109+0000","last_undegraded":"2024-04-26T12:43:11.122109+0000","last_fullsized":"2024-04-26T12:43:11.122109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'4","last_scrub_stamp":"2024-04-26T12:43:11.121886+0000","last_deep_scrub":"104'4","last_deep_scrub_stamp":"2024-04-26T12:43:11.121886+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.121886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:22.580179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"139'50","reported_seq":320,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.250294+0000","last_change":"2024-04-26T12:43:02.250363+0000","last_active":"2024-04-26T12:43:02.250294+0000","last_peered":"2024-04-26T12:43:02.250294+0000","last_clean":"2024-04-26T12:43:02.250294+0000","last_became_active":"2024-04-26T12:42:21.925708+0000","last_became_peered":"2024-04-26T12:42:21.925708+0000","last_unstale":"2024-04-26T12:43:02.250294+0000","last_undegraded":"2024-04-26T12:43:02.250294+0000","last_fullsized":"2024-04-26T12:43:02.250294+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:02.250088+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:02.250088+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.250088+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:21.366905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"117'4","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.898995+0000","last_change":"2024-04-26T12:43:05.899059+0000","last_active":"2024-04-26T12:43:05.898995+0000","last_peered":"2024-04-26T12:43:05.898995+0000","last_clean":"2024-04-26T12:43:05.898995+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:43:05.898995+0000","last_undegraded":"2024-04-26T12:43:05.898995+0000","last_fullsized":"2024-04-26T12:43:05.898995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:05.898768+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:05.898768+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.898768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:10.366860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"139'56","reported_seq":316,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.847311+0000","last_change":"2024-04-26T12:42:21.959563+0000","last_active":"2024-04-26T12:42:52.847311+0000","last_peered":"2024-04-26T12:42:52.847311+0000","last_clean":"2024-04-26T12:42:52.847311+0000","last_became_active":"2024-04-26T12:42:21.957515+0000","last_became_peered":"2024-04-26T12:42:21.957515+0000","last_unstale":"2024-04-26T12:42:52.847311+0000","last_undegraded":"2024-04-26T12:42:52.847311+0000","last_fullsized":"2024-04-26T12:42:52.847311+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068765+0000","last_change":"2024-04-26T12:42:21.975117+0000","last_active":"2024-04-26T12:42:41.068765+0000","last_peered":"2024-04-26T12:42:41.068765+0000","last_clean":"2024-04-26T12:42:41.068765+0000","last_became_active":"2024-04-26T12:42:21.970669+0000","last_became_peered":"2024-04-26T12:42:21.970669+0000","last_unstale":"2024-04-26T12:42:41.068765+0000","last_undegraded":"2024-04-26T12:42:41.068765+0000","last_fullsized":"2024-04-26T12:42:41.068765+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"139'46","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.786728+0000","last_change":"2024-04-26T12:42:21.964762+0000","last_active":"2024-04-26T12:42:52.786728+0000","last_peered":"2024-04-26T12:42:52.786728+0000","last_clean":"2024-04-26T12:42:52.786728+0000","last_became_active":"2024-04-26T12:42:21.961965+0000","last_became_peered":"2024-04-26T12:42:21.961965+0000","last_unstale":"2024-04-26T12:42:52.786728+0000","last_undegraded":"2024-04-26T12:42:52.786728+0000","last_fullsized":"2024-04-26T12:42:52.786728+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":63,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.674574+0000","last_change":"2024-04-26T12:43:00.674626+0000","last_active":"2024-04-26T12:43:00.674574+0000","last_peered":"2024-04-26T12:43:00.674574+0000","last_clean":"2024-04-26T12:43:00.674574+0000","last_became_active":"2024-04-26T12:42:34.024880+0000","last_became_peered":"2024-04-26T12:42:34.024880+0000","last_unstale":"2024-04-26T12:43:00.674574+0000","last_undegraded":"2024-04-26T12:43:00.674574+0000","last_fullsized":"2024-04-26T12:43:00.674574+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.674389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.674389+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.674389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:29.421111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"139'38","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.778929+0000","last_change":"2024-04-26T12:38:57.843463+0000","last_active":"2024-04-26T12:42:52.778929+0000","last_peered":"2024-04-26T12:42:52.778929+0000","last_clean":"2024-04-26T12:42:52.778929+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:42:52.778929+0000","last_undegraded":"2024-04-26T12:42:52.778929+0000","last_fullsized":"2024-04-26T12:42:52.778929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":186,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.070184+0000","last_change":"2024-04-26T12:42:21.942927+0000","last_active":"2024-04-26T12:42:41.070184+0000","last_peered":"2024-04-26T12:42:41.070184+0000","last_clean":"2024-04-26T12:42:41.070184+0000","last_became_active":"2024-04-26T12:42:21.941594+0000","last_became_peered":"2024-04-26T12:42:21.941594+0000","last_unstale":"2024-04-26T12:42:41.070184+0000","last_undegraded":"2024-04-26T12:42:41.070184+0000","last_fullsized":"2024-04-26T12:42:41.070184+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"139'54","reported_seq":314,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.513113+0000","last_change":"2024-04-26T12:43:15.513189+0000","last_active":"2024-04-26T12:43:15.513113+0000","last_peered":"2024-04-26T12:43:15.513113+0000","last_clean":"2024-04-26T12:43:15.513113+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:43:15.513113+0000","last_undegraded":"2024-04-26T12:43:15.513113+0000","last_fullsized":"2024-04-26T12:43:15.513113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:15.512868+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:15.512868+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.512868+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:19.980960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"117'12","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.568047+0000","last_change":"2024-04-26T12:43:07.568228+0000","last_active":"2024-04-26T12:43:07.568047+0000","last_peered":"2024-04-26T12:43:07.568047+0000","last_clean":"2024-04-26T12:43:07.568047+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:43:07.568047+0000","last_undegraded":"2024-04-26T12:43:07.568047+0000","last_fullsized":"2024-04-26T12:43:07.568047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'12","last_scrub_stamp":"2024-04-26T12:43:07.567732+0000","last_deep_scrub":"117'12","last_deep_scrub_stamp":"2024-04-26T12:43:07.567732+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.567732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:36.516974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"139'64","reported_seq":322,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.335905+0000","last_change":"2024-04-26T12:43:12.336301+0000","last_active":"2024-04-26T12:43:12.335905+0000","last_peered":"2024-04-26T12:43:12.335905+0000","last_clean":"2024-04-26T12:43:12.335905+0000","last_became_active":"2024-04-26T12:42:21.948694+0000","last_became_peered":"2024-04-26T12:42:21.948694+0000","last_unstale":"2024-04-26T12:43:12.335905+0000","last_undegraded":"2024-04-26T12:43:12.335905+0000","last_fullsized":"2024-04-26T12:43:12.335905+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'64","last_scrub_stamp":"2024-04-26T12:43:12.335694+0000","last_deep_scrub":"139'64","last_deep_scrub_stamp":"2024-04-26T12:43:12.335694+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.335694+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:48.400013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":291,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.844411+0000","last_change":"2024-04-26T12:42:21.957965+0000","last_active":"2024-04-26T12:42:52.844411+0000","last_peered":"2024-04-26T12:42:52.844411+0000","last_clean":"2024-04-26T12:42:52.844411+0000","last_became_active":"2024-04-26T12:42:21.956925+0000","last_became_peered":"2024-04-26T12:42:21.956925+0000","last_unstale":"2024-04-26T12:42:52.844411+0000","last_undegraded":"2024-04-26T12:42:52.844411+0000","last_fullsized":"2024-04-26T12:42:52.844411+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"139'58","reported_seq":320,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.787498+0000","last_change":"2024-04-26T12:42:21.950280+0000","last_active":"2024-04-26T12:42:52.787498+0000","last_peered":"2024-04-26T12:42:52.787498+0000","last_clean":"2024-04-26T12:42:52.787498+0000","last_became_active":"2024-04-26T12:42:21.949469+0000","last_became_peered":"2024-04-26T12:42:21.949469+0000","last_unstale":"2024-04-26T12:42:52.787498+0000","last_undegraded":"2024-04-26T12:42:52.787498+0000","last_fullsized":"2024-04-26T12:42:52.787498+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":123,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.691945+0000","last_change":"2024-04-26T12:43:06.692004+0000","last_active":"2024-04-26T12:43:06.691945+0000","last_peered":"2024-04-26T12:43:06.691945+0000","last_clean":"2024-04-26T12:43:06.691945+0000","last_became_active":"2024-04-26T12:42:34.018659+0000","last_became_peered":"2024-04-26T12:42:34.018659+0000","last_unstale":"2024-04-26T12:43:06.691945+0000","last_undegraded":"2024-04-26T12:43:06.691945+0000","last_fullsized":"2024-04-26T12:43:06.691945+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:06.691742+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:06.691742+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.691742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:08.695966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"139'36","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.830918+0000","last_change":"2024-04-26T12:42:21.933174+0000","last_active":"2024-04-26T12:42:52.830918+0000","last_peered":"2024-04-26T12:42:52.830918+0000","last_clean":"2024-04-26T12:42:52.830918+0000","last_became_active":"2024-04-26T12:42:21.932263+0000","last_became_peered":"2024-04-26T12:42:21.932263+0000","last_unstale":"2024-04-26T12:42:52.830918+0000","last_undegraded":"2024-04-26T12:42:52.830918+0000","last_fullsized":"2024-04-26T12:42:52.830918+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"117'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.566523+0000","last_change":"2024-04-26T12:43:02.566604+0000","last_active":"2024-04-26T12:43:02.566523+0000","last_peered":"2024-04-26T12:43:02.566523+0000","last_clean":"2024-04-26T12:43:02.566523+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:43:02.566523+0000","last_undegraded":"2024-04-26T12:43:02.566523+0000","last_fullsized":"2024-04-26T12:43:02.566523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:02.566309+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:02.566309+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.566309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:34.116008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"139'32","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.686362+0000","last_change":"2024-04-26T12:38:10.465263+0000","last_active":"2024-04-26T12:42:52.686362+0000","last_peered":"2024-04-26T12:42:52.686362+0000","last_clean":"2024-04-26T12:42:52.686362+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:42:52.686362+0000","last_undegraded":"2024-04-26T12:42:52.686362+0000","last_fullsized":"2024-04-26T12:42:52.686362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"117'8","reported_seq":238,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068320+0000","last_change":"2024-04-26T12:42:34.024717+0000","last_active":"2024-04-26T12:42:41.068320+0000","last_peered":"2024-04-26T12:42:41.068320+0000","last_clean":"2024-04-26T12:42:41.068320+0000","last_became_active":"2024-04-26T12:42:34.023978+0000","last_became_peered":"2024-04-26T12:42:34.023978+0000","last_unstale":"2024-04-26T12:42:41.068320+0000","last_undegraded":"2024-04-26T12:42:41.068320+0000","last_fullsized":"2024-04-26T12:42:41.068320+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"139'46","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.847605+0000","last_change":"2024-04-26T12:38:10.474548+0000","last_active":"2024-04-26T12:42:52.847605+0000","last_peered":"2024-04-26T12:42:52.847605+0000","last_clean":"2024-04-26T12:42:52.847605+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:42:52.847605+0000","last_undegraded":"2024-04-26T12:42:52.847605+0000","last_fullsized":"2024-04-26T12:42:52.847605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.520064+0000","last_change":"2024-04-26T12:38:57.843705+0000","last_active":"2024-04-26T12:42:42.520064+0000","last_peered":"2024-04-26T12:42:42.520064+0000","last_clean":"2024-04-26T12:42:42.520064+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:42:42.520064+0000","last_undegraded":"2024-04-26T12:42:42.520064+0000","last_fullsized":"2024-04-26T12:42:42.520064+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"139'34","reported_seq":294,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.488505+0000","last_change":"2024-04-26T12:43:12.488578+0000","last_active":"2024-04-26T12:43:12.488505+0000","last_peered":"2024-04-26T12:43:12.488505+0000","last_clean":"2024-04-26T12:43:12.488505+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:43:12.488505+0000","last_undegraded":"2024-04-26T12:43:12.488505+0000","last_fullsized":"2024-04-26T12:43:12.488505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'34","last_scrub_stamp":"2024-04-26T12:43:12.488308+0000","last_deep_scrub":"139'34","last_deep_scrub_stamp":"2024-04-26T12:43:12.488308+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.488308+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:11.941406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.420636+0000","last_change":"2024-04-26T12:43:15.420698+0000","last_active":"2024-04-26T12:43:15.420636+0000","last_peered":"2024-04-26T12:43:15.420636+0000","last_clean":"2024-04-26T12:43:15.420636+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:43:15.420636+0000","last_undegraded":"2024-04-26T12:43:15.420636+0000","last_fullsized":"2024-04-26T12:43:15.420636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'6","last_scrub_stamp":"2024-04-26T12:43:15.420425+0000","last_deep_scrub":"104'6","last_deep_scrub_stamp":"2024-04-26T12:43:15.420425+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.420425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:12.527441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"139'48","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.809465+0000","last_change":"2024-04-26T12:43:12.809527+0000","last_active":"2024-04-26T12:43:12.809465+0000","last_peered":"2024-04-26T12:43:12.809465+0000","last_clean":"2024-04-26T12:43:12.809465+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:43:12.809465+0000","last_undegraded":"2024-04-26T12:43:12.809465+0000","last_fullsized":"2024-04-26T12:43:12.809465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:12.809240+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:12.809240+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.809240+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:00.875299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.320240+0000","last_change":"2024-04-26T12:43:08.320300+0000","last_active":"2024-04-26T12:43:08.320240+0000","last_peered":"2024-04-26T12:43:08.320240+0000","last_clean":"2024-04-26T12:43:08.320240+0000","last_became_active":"2024-04-26T12:42:21.965634+0000","last_became_peered":"2024-04-26T12:42:21.965634+0000","last_unstale":"2024-04-26T12:43:08.320240+0000","last_undegraded":"2024-04-26T12:43:08.320240+0000","last_fullsized":"2024-04-26T12:43:08.320240+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-04-26T12:43:08.320039+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-04-26T12:43:08.320039+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.320039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:38.031153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"139'32","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.549487+0000","last_change":"2024-04-26T12:43:00.549547+0000","last_active":"2024-04-26T12:43:00.549487+0000","last_peered":"2024-04-26T12:43:00.549487+0000","last_clean":"2024-04-26T12:43:00.549487+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:43:00.549487+0000","last_undegraded":"2024-04-26T12:43:00.549487+0000","last_fullsized":"2024-04-26T12:43:00.549487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:00.549294+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:00.549294+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.549294+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:53.533735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:42.516674+0000","last_change":"2024-04-26T12:42:21.967682+0000","last_active":"2024-04-26T12:42:42.516674+0000","last_peered":"2024-04-26T12:42:42.516674+0000","last_clean":"2024-04-26T12:42:42.516674+0000","last_became_active":"2024-04-26T12:42:21.967048+0000","last_became_peered":"2024-04-26T12:42:21.967048+0000","last_unstale":"2024-04-26T12:42:42.516674+0000","last_undegraded":"2024-04-26T12:42:42.516674+0000","last_fullsized":"2024-04-26T12:42:42.516674+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"139'30","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.856954+0000","last_change":"2024-04-26T12:38:10.470056+0000","last_active":"2024-04-26T12:42:52.856954+0000","last_peered":"2024-04-26T12:42:52.856954+0000","last_clean":"2024-04-26T12:42:52.856954+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:42:52.856954+0000","last_undegraded":"2024-04-26T12:42:52.856954+0000","last_fullsized":"2024-04-26T12:42:52.856954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"139'48","reported_seq":303,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.856869+0000","last_change":"2024-04-26T12:38:10.445037+0000","last_active":"2024-04-26T12:42:52.856869+0000","last_peered":"2024-04-26T12:42:52.856869+0000","last_clean":"2024-04-26T12:42:52.856869+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:42:52.856869+0000","last_undegraded":"2024-04-26T12:42:52.856869+0000","last_fullsized":"2024-04-26T12:42:52.856869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:55.874017+0000","last_change":"2024-04-26T12:42:21.937768+0000","last_active":"2024-04-26T12:42:55.874017+0000","last_peered":"2024-04-26T12:42:55.874017+0000","last_clean":"2024-04-26T12:42:55.874017+0000","last_became_active":"2024-04-26T12:42:21.936930+0000","last_became_peered":"2024-04-26T12:42:21.936930+0000","last_unstale":"2024-04-26T12:42:55.874017+0000","last_undegraded":"2024-04-26T12:42:55.874017+0000","last_fullsized":"2024-04-26T12:42:55.874017+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"139'50","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.983284+0000","last_change":"2024-04-26T12:43:12.983343+0000","last_active":"2024-04-26T12:43:12.983284+0000","last_peered":"2024-04-26T12:43:12.983284+0000","last_clean":"2024-04-26T12:43:12.983284+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:43:12.983284+0000","last_undegraded":"2024-04-26T12:43:12.983284+0000","last_fullsized":"2024-04-26T12:43:12.983284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:12.983082+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:12.983082+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.983082+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:16.724892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"117'2","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.269917+0000","last_change":"2024-04-26T12:38:12.449589+0000","last_active":"2024-04-26T12:42:58.269917+0000","last_peered":"2024-04-26T12:42:58.269917+0000","last_clean":"2024-04-26T12:42:58.269917+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:42:58.269917+0000","last_undegraded":"2024-04-26T12:42:58.269917+0000","last_fullsized":"2024-04-26T12:42:58.269917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":336,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1108,"ondisk_log_size":1108,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1061,"num_read_kb":1543,"num_write":541,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":973,"ondisk_log_size":973,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1275,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37596,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334244,"statfs":{"total":96636764160,"available":96598265856,"internally_reserved":0,"allocated":2314240,"data_stored":1600353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1695744,"data_stored":1009325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1748992,"data_stored":1011582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1687552,"data_stored":1008834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":122,"seq":523986010125,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42200,"kb_used_data":1680,"kb_used_omap":6,"kb_used_meta":40505,"kb_avail":94329640,"statfs":{"total":96636764160,"available":96593551360,"internally_reserved":0,"allocated":1720320,"data_stored":1010124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6715,"internal_metadata":41477573},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574915,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41144,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330696,"statfs":{"total":96636764160,"available":96594632704,"internally_reserved":0,"allocated":1687552,"data_stored":1009323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1720320,"data_stored":1010960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41736,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330104,"statfs":{"total":96636764160,"available":96594026496,"internally_reserved":0,"allocated":2293760,"data_stored":1599759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:43:19.983 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.983 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.983 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.983 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.983 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.983 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.984 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.984 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.984 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.984 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.984 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.984 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.985 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.985 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.985 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.985 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.985 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.985 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.985 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.986 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.986 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.986 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.986 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.986 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.986 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.987 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.987 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.987 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.987 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.987 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.987 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.987 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.988 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.988 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.988 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.988 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.988 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.988 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.988 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.988 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.989 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.989 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.989 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.989 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.989 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.989 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.989 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.990 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.990 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.990 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.990 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T12:38:03.355260+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.990 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.990 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.991 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.991 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.991 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.991 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.991 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.991 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.991 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.991 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.992 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.992 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.992 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.992 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.992 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.992 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.992 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.992 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.993 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.993 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.993 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.993 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.993 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.993 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.993 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T12:38:13.416815+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=13, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.994 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.994 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.994 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.994 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.994 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.994 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.994 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-26T12:38:17.440984+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=17, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.995 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.995 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.995 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.995 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.995 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.995 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.995 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.995 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.996 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.996 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.996 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.996 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.996 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.996 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.996 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.997 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.997 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.997 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.997 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.997 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.997 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.997 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.997 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.998 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.998 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.998 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:19.998 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:43:39.999 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:43:40.335 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:43:40.341 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:43:40.356 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-04-26T12:43:38.812349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623988,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4830,"num_read_kb":3732,"num_write":4425,"num_write_kb":6187917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5693,"ondisk_log_size":5693,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314872,"kb_used_data":14520,"kb_used_omap":17,"kb_used_meta":300270,"kb_avail":754659848,"statfs":{"total":773094113280,"available":772771684352,"internally_reserved":0,"allocated":14868480,"data_stored":9260260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17874,"internal_metadata":307477038},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006458"},"pg_stats":[{"pgid":"3.3f","version":"139'42","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.845729+0000","last_change":"2024-04-26T12:43:10.845789+0000","last_active":"2024-04-26T12:43:10.845729+0000","last_peered":"2024-04-26T12:43:10.845729+0000","last_clean":"2024-04-26T12:43:10.845729+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:43:10.845729+0000","last_undegraded":"2024-04-26T12:43:10.845729+0000","last_fullsized":"2024-04-26T12:43:10.845729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'42","last_scrub_stamp":"2024-04-26T12:43:10.845487+0000","last_deep_scrub":"139'42","last_deep_scrub_stamp":"2024-04-26T12:43:10.845487+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.845487+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:42.606975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"117'6","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.145242+0000","last_change":"2024-04-26T12:43:15.145305+0000","last_active":"2024-04-26T12:43:15.145242+0000","last_peered":"2024-04-26T12:43:15.145242+0000","last_clean":"2024-04-26T12:43:15.145242+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:43:15.145242+0000","last_undegraded":"2024-04-26T12:43:15.145242+0000","last_fullsized":"2024-04-26T12:43:15.145242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6","last_scrub_stamp":"2024-04-26T12:43:15.145028+0000","last_deep_scrub":"117'6","last_deep_scrub_stamp":"2024-04-26T12:43:15.145028+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.145028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:13.794591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"139'32","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.033857+0000","last_change":"2024-04-26T12:43:16.033919+0000","last_active":"2024-04-26T12:43:16.033857+0000","last_peered":"2024-04-26T12:43:16.033857+0000","last_clean":"2024-04-26T12:43:16.033857+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:43:16.033857+0000","last_undegraded":"2024-04-26T12:43:16.033857+0000","last_fullsized":"2024-04-26T12:43:16.033857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:16.033646+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:16.033646+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.033646+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:48.143330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.801901+0000","last_change":"2024-04-26T12:43:06.801901+0000","last_active":"2024-04-26T12:43:06.801901+0000","last_peered":"2024-04-26T12:43:06.801901+0000","last_clean":"2024-04-26T12:43:06.801901+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:43:06.801901+0000","last_undegraded":"2024-04-26T12:43:06.801901+0000","last_fullsized":"2024-04-26T12:43:06.801901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:06.801644+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:06.801644+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.801644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:11.269736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"139'36","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.405338+0000","last_change":"2024-04-26T12:43:21.405400+0000","last_active":"2024-04-26T12:43:21.405338+0000","last_peered":"2024-04-26T12:43:21.405338+0000","last_clean":"2024-04-26T12:43:21.405338+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:43:21.405338+0000","last_undegraded":"2024-04-26T12:43:21.405338+0000","last_fullsized":"2024-04-26T12:43:21.405338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:21.405110+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:21.405110+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.405110+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:21.866319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":63,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.698608+0000","last_change":"2024-04-26T12:43:10.698662+0000","last_active":"2024-04-26T12:43:10.698608+0000","last_peered":"2024-04-26T12:43:10.698608+0000","last_clean":"2024-04-26T12:43:10.698608+0000","last_became_active":"2024-04-26T12:42:34.016025+0000","last_became_peered":"2024-04-26T12:42:34.016025+0000","last_unstale":"2024-04-26T12:43:10.698608+0000","last_undegraded":"2024-04-26T12:43:10.698608+0000","last_fullsized":"2024-04-26T12:43:10.698608+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:10.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:10.698381+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:37.659849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"139'62","reported_seq":332,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.278976+0000","last_change":"2024-04-26T12:43:32.279041+0000","last_active":"2024-04-26T12:43:32.278976+0000","last_peered":"2024-04-26T12:43:32.278976+0000","last_clean":"2024-04-26T12:43:32.278976+0000","last_became_active":"2024-04-26T12:42:21.946477+0000","last_became_peered":"2024-04-26T12:42:21.946477+0000","last_unstale":"2024-04-26T12:43:32.278976+0000","last_undegraded":"2024-04-26T12:43:32.278976+0000","last_fullsized":"2024-04-26T12:43:32.278976+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'62","last_scrub_stamp":"2024-04-26T12:43:32.278756+0000","last_deep_scrub":"139'62","last_deep_scrub_stamp":"2024-04-26T12:43:32.278756+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.278756+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:17.507402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:34.367648+0000","last_change":"2024-04-26T12:43:34.367760+0000","last_active":"2024-04-26T12:43:34.367648+0000","last_peered":"2024-04-26T12:43:34.367648+0000","last_clean":"2024-04-26T12:43:34.367648+0000","last_became_active":"2024-04-26T12:42:21.956507+0000","last_became_peered":"2024-04-26T12:42:21.956507+0000","last_unstale":"2024-04-26T12:43:34.367648+0000","last_undegraded":"2024-04-26T12:43:34.367648+0000","last_fullsized":"2024-04-26T12:43:34.367648+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:34.367362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:34.367362+0000","last_clean_scrub_stamp":"2024-04-26T12:43:34.367362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:27.972814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"139'50","reported_seq":309,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.939594+0000","last_change":"2024-04-26T12:43:20.939731+0000","last_active":"2024-04-26T12:43:20.939594+0000","last_peered":"2024-04-26T12:43:20.939594+0000","last_clean":"2024-04-26T12:43:20.939594+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:43:20.939594+0000","last_undegraded":"2024-04-26T12:43:20.939594+0000","last_fullsized":"2024-04-26T12:43:20.939594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:20.939310+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:20.939310+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.939310+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:41.725910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.542893+0000","last_change":"2024-04-26T12:43:05.542954+0000","last_active":"2024-04-26T12:43:05.542893+0000","last_peered":"2024-04-26T12:43:05.542893+0000","last_clean":"2024-04-26T12:43:05.542893+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:43:05.542893+0000","last_undegraded":"2024-04-26T12:43:05.542893+0000","last_fullsized":"2024-04-26T12:43:05.542893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'4","last_scrub_stamp":"2024-04-26T12:43:05.542698+0000","last_deep_scrub":"104'4","last_deep_scrub_stamp":"2024-04-26T12:43:05.542698+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.542698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:07.307221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"139'50","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.525453+0000","last_change":"2024-04-26T12:43:11.525518+0000","last_active":"2024-04-26T12:43:11.525453+0000","last_peered":"2024-04-26T12:43:11.525453+0000","last_clean":"2024-04-26T12:43:11.525453+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:43:11.525453+0000","last_undegraded":"2024-04-26T12:43:11.525453+0000","last_fullsized":"2024-04-26T12:43:11.525453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:11.525255+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:11.525255+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.525255+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:57.799993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.640868+0000","last_change":"2024-04-26T12:43:23.640984+0000","last_active":"2024-04-26T12:43:23.640868+0000","last_peered":"2024-04-26T12:43:23.640868+0000","last_clean":"2024-04-26T12:43:23.640868+0000","last_became_active":"2024-04-26T12:42:34.006179+0000","last_became_peered":"2024-04-26T12:42:34.006179+0000","last_unstale":"2024-04-26T12:43:23.640868+0000","last_undegraded":"2024-04-26T12:43:23.640868+0000","last_fullsized":"2024-04-26T12:43:23.640868+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:23.640662+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:23.640662+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.640662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:04.683934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"139'44","reported_seq":303,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.966786+0000","last_change":"2024-04-26T12:43:22.966855+0000","last_active":"2024-04-26T12:43:22.966786+0000","last_peered":"2024-04-26T12:43:22.966786+0000","last_clean":"2024-04-26T12:43:22.966786+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:43:22.966786+0000","last_undegraded":"2024-04-26T12:43:22.966786+0000","last_fullsized":"2024-04-26T12:43:22.966786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'44","last_scrub_stamp":"2024-04-26T12:43:22.966581+0000","last_deep_scrub":"139'44","last_deep_scrub_stamp":"2024-04-26T12:43:22.966581+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.966581+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:24.970805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.107464+0000","last_change":"2024-04-26T12:43:13.107601+0000","last_active":"2024-04-26T12:43:13.107464+0000","last_peered":"2024-04-26T12:43:13.107464+0000","last_clean":"2024-04-26T12:43:13.107464+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:43:13.107464+0000","last_undegraded":"2024-04-26T12:43:13.107464+0000","last_fullsized":"2024-04-26T12:43:13.107464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:13.107156+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:13.107156+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.107156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:42.824560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"139'26","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.249898+0000","last_change":"2024-04-26T12:43:10.250029+0000","last_active":"2024-04-26T12:43:10.249898+0000","last_peered":"2024-04-26T12:43:10.249898+0000","last_clean":"2024-04-26T12:43:10.249898+0000","last_became_active":"2024-04-26T12:42:21.948971+0000","last_became_peered":"2024-04-26T12:42:21.948971+0000","last_unstale":"2024-04-26T12:43:10.249898+0000","last_undegraded":"2024-04-26T12:43:10.249898+0000","last_fullsized":"2024-04-26T12:43:10.249898+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:10.249582+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:10.249582+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.249582+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:31.064088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.547691+0000","last_change":"2024-04-26T12:43:15.547759+0000","last_active":"2024-04-26T12:43:15.547691+0000","last_peered":"2024-04-26T12:43:15.547691+0000","last_clean":"2024-04-26T12:43:15.547691+0000","last_became_active":"2024-04-26T12:42:21.964820+0000","last_became_peered":"2024-04-26T12:42:21.964820+0000","last_unstale":"2024-04-26T12:43:15.547691+0000","last_undegraded":"2024-04-26T12:43:15.547691+0000","last_fullsized":"2024-04-26T12:43:15.547691+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:15.547471+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:15.547471+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.547471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:52.868633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":177,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.702070+0000","last_change":"2024-04-26T12:43:19.702131+0000","last_active":"2024-04-26T12:43:19.702070+0000","last_peered":"2024-04-26T12:43:19.702070+0000","last_clean":"2024-04-26T12:43:19.702070+0000","last_became_active":"2024-04-26T12:42:34.003575+0000","last_became_peered":"2024-04-26T12:42:34.003575+0000","last_unstale":"2024-04-26T12:43:19.702070+0000","last_undegraded":"2024-04-26T12:43:19.702070+0000","last_fullsized":"2024-04-26T12:43:19.702070+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T12:43:19.701862+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T12:43:19.701862+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.701862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:10.706580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"139'50","reported_seq":309,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.834868+0000","last_change":"2024-04-26T12:43:16.834932+0000","last_active":"2024-04-26T12:43:16.834868+0000","last_peered":"2024-04-26T12:43:16.834868+0000","last_clean":"2024-04-26T12:43:16.834868+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:43:16.834868+0000","last_undegraded":"2024-04-26T12:43:16.834868+0000","last_fullsized":"2024-04-26T12:43:16.834868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:16.834665+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:16.834665+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.834665+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:45.581387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"117'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.754487+0000","last_change":"2024-04-26T12:43:08.754548+0000","last_active":"2024-04-26T12:43:08.754487+0000","last_peered":"2024-04-26T12:43:08.754487+0000","last_clean":"2024-04-26T12:43:08.754487+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:43:08.754487+0000","last_undegraded":"2024-04-26T12:43:08.754487+0000","last_fullsized":"2024-04-26T12:43:08.754487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:08.754281+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:08.754281+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.754281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:21.843729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"139'68","reported_seq":329,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.511231+0000","last_change":"2024-04-26T12:43:09.511361+0000","last_active":"2024-04-26T12:43:09.511231+0000","last_peered":"2024-04-26T12:43:09.511231+0000","last_clean":"2024-04-26T12:43:09.511231+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:43:09.511231+0000","last_undegraded":"2024-04-26T12:43:09.511231+0000","last_fullsized":"2024-04-26T12:43:09.511231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'68","last_scrub_stamp":"2024-04-26T12:43:09.510988+0000","last_deep_scrub":"139'68","last_deep_scrub_stamp":"2024-04-26T12:43:09.510988+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.510988+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:42.900382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":3,"num_write":78,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.179647+0000","last_change":"2024-04-26T12:43:17.179706+0000","last_active":"2024-04-26T12:43:17.179647+0000","last_peered":"2024-04-26T12:43:17.179647+0000","last_clean":"2024-04-26T12:43:17.179647+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:43:17.179647+0000","last_undegraded":"2024-04-26T12:43:17.179647+0000","last_fullsized":"2024-04-26T12:43:17.179647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:17.179433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:17.179433+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.179433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:22.968301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"139'54","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.530981+0000","last_change":"2024-04-26T12:43:13.531047+0000","last_active":"2024-04-26T12:43:13.530981+0000","last_peered":"2024-04-26T12:43:13.530981+0000","last_clean":"2024-04-26T12:43:13.530981+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:43:13.530981+0000","last_undegraded":"2024-04-26T12:43:13.530981+0000","last_fullsized":"2024-04-26T12:43:13.530981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:13.530753+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:13.530753+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.530753+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:25.642179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.510125+0000","last_change":"2024-04-26T12:43:13.510188+0000","last_active":"2024-04-26T12:43:13.510125+0000","last_peered":"2024-04-26T12:43:13.510125+0000","last_clean":"2024-04-26T12:43:13.510125+0000","last_became_active":"2024-04-26T12:42:21.956566+0000","last_became_peered":"2024-04-26T12:42:21.956566+0000","last_unstale":"2024-04-26T12:43:13.510125+0000","last_undegraded":"2024-04-26T12:43:13.510125+0000","last_fullsized":"2024-04-26T12:43:13.510125+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'8","last_scrub_stamp":"2024-04-26T12:43:13.509891+0000","last_deep_scrub":"104'8","last_deep_scrub_stamp":"2024-04-26T12:43:13.509891+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.509891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:12.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"139'38","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.745631+0000","last_change":"2024-04-26T12:43:17.745776+0000","last_active":"2024-04-26T12:43:17.745631+0000","last_peered":"2024-04-26T12:43:17.745631+0000","last_clean":"2024-04-26T12:43:17.745631+0000","last_became_active":"2024-04-26T12:42:34.022426+0000","last_became_peered":"2024-04-26T12:42:34.022426+0000","last_unstale":"2024-04-26T12:43:17.745631+0000","last_undegraded":"2024-04-26T12:43:17.745631+0000","last_fullsized":"2024-04-26T12:43:17.745631+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:17.745359+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:17.745359+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.745359+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:51.957445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.577896+0000","last_change":"2024-04-26T12:43:01.577896+0000","last_active":"2024-04-26T12:43:01.577896+0000","last_peered":"2024-04-26T12:43:01.577896+0000","last_clean":"2024-04-26T12:43:01.577896+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:43:01.577896+0000","last_undegraded":"2024-04-26T12:43:01.577896+0000","last_fullsized":"2024-04-26T12:43:01.577896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-04-26T12:43:01.577628+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-04-26T12:43:01.577628+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.577628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:42.423471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"139'42","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.258708+0000","last_change":"2024-04-26T12:43:16.258905+0000","last_active":"2024-04-26T12:43:16.258708+0000","last_peered":"2024-04-26T12:43:16.258708+0000","last_clean":"2024-04-26T12:43:16.258708+0000","last_became_active":"2024-04-26T12:42:21.932303+0000","last_became_peered":"2024-04-26T12:42:21.932303+0000","last_unstale":"2024-04-26T12:43:16.258708+0000","last_undegraded":"2024-04-26T12:43:16.258708+0000","last_fullsized":"2024-04-26T12:43:16.258708+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'42","last_scrub_stamp":"2024-04-26T12:43:16.258462+0000","last_deep_scrub":"139'42","last_deep_scrub_stamp":"2024-04-26T12:43:16.258462+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.258462+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:31.439585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":122,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.668127+0000","last_change":"2024-04-26T12:42:58.668192+0000","last_active":"2024-04-26T12:42:58.668127+0000","last_peered":"2024-04-26T12:42:58.668127+0000","last_clean":"2024-04-26T12:42:58.668127+0000","last_became_active":"2024-04-26T12:42:34.025281+0000","last_became_peered":"2024-04-26T12:42:34.025281+0000","last_unstale":"2024-04-26T12:42:58.668127+0000","last_undegraded":"2024-04-26T12:42:58.668127+0000","last_fullsized":"2024-04-26T12:42:58.668127+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:42:58.667924+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:42:58.667924+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.667924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:02.409734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"139'44","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.411672+0000","last_change":"2024-04-26T12:43:22.411733+0000","last_active":"2024-04-26T12:43:22.411672+0000","last_peered":"2024-04-26T12:43:22.411672+0000","last_clean":"2024-04-26T12:43:22.411672+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:43:22.411672+0000","last_undegraded":"2024-04-26T12:43:22.411672+0000","last_fullsized":"2024-04-26T12:43:22.411672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'44","last_scrub_stamp":"2024-04-26T12:43:22.411468+0000","last_deep_scrub":"139'44","last_deep_scrub_stamp":"2024-04-26T12:43:22.411468+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.411468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:40.595466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":127,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.677090+0000","last_change":"2024-04-26T12:43:26.677156+0000","last_active":"2024-04-26T12:43:26.677090+0000","last_peered":"2024-04-26T12:43:26.677090+0000","last_clean":"2024-04-26T12:43:26.677090+0000","last_became_active":"2024-04-26T12:42:34.013263+0000","last_became_peered":"2024-04-26T12:42:34.013263+0000","last_unstale":"2024-04-26T12:43:26.677090+0000","last_undegraded":"2024-04-26T12:43:26.677090+0000","last_fullsized":"2024-04-26T12:43:26.677090+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:43:26.676846+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:43:26.676846+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.676846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:25.359319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.312435+0000","last_change":"2024-04-26T12:43:02.312583+0000","last_active":"2024-04-26T12:43:02.312435+0000","last_peered":"2024-04-26T12:43:02.312435+0000","last_clean":"2024-04-26T12:43:02.312435+0000","last_became_active":"2024-04-26T12:42:21.961909+0000","last_became_peered":"2024-04-26T12:42:21.961909+0000","last_unstale":"2024-04-26T12:43:02.312435+0000","last_undegraded":"2024-04-26T12:43:02.312435+0000","last_fullsized":"2024-04-26T12:43:02.312435+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:02.312195+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:02.312195+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.312195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:15.538824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"139'36","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.924149+0000","last_change":"2024-04-26T12:43:21.924214+0000","last_active":"2024-04-26T12:43:21.924149+0000","last_peered":"2024-04-26T12:43:21.924149+0000","last_clean":"2024-04-26T12:43:21.924149+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:43:21.924149+0000","last_undegraded":"2024-04-26T12:43:21.924149+0000","last_fullsized":"2024-04-26T12:43:21.924149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:21.923934+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:21.923934+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.923934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.047282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.194144+0000","last_change":"2024-04-26T12:43:05.194144+0000","last_active":"2024-04-26T12:43:05.194144+0000","last_peered":"2024-04-26T12:43:05.194144+0000","last_clean":"2024-04-26T12:43:05.194144+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:43:05.194144+0000","last_undegraded":"2024-04-26T12:43:05.194144+0000","last_fullsized":"2024-04-26T12:43:05.194144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:05.193896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:05.193896+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.193896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:55.023402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"139'24","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.205866+0000","last_change":"2024-04-26T12:43:06.205866+0000","last_active":"2024-04-26T12:43:06.205866+0000","last_peered":"2024-04-26T12:43:06.205866+0000","last_clean":"2024-04-26T12:43:06.205866+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:43:06.205866+0000","last_undegraded":"2024-04-26T12:43:06.205866+0000","last_fullsized":"2024-04-26T12:43:06.205866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'24","last_scrub_stamp":"2024-04-26T12:43:06.205548+0000","last_deep_scrub":"139'24","last_deep_scrub_stamp":"2024-04-26T12:43:06.205548+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.205548+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:35.922951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.909934+0000","last_change":"2024-04-26T12:43:00.909934+0000","last_active":"2024-04-26T12:43:00.909934+0000","last_peered":"2024-04-26T12:43:00.909934+0000","last_clean":"2024-04-26T12:43:00.909934+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:43:00.909934+0000","last_undegraded":"2024-04-26T12:43:00.909934+0000","last_fullsized":"2024-04-26T12:43:00.909934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.909677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.909677+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.909677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:34.299071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"139'49","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.234487+0000","last_change":"2024-04-26T12:43:01.234487+0000","last_active":"2024-04-26T12:43:01.234487+0000","last_peered":"2024-04-26T12:43:01.234487+0000","last_clean":"2024-04-26T12:43:01.234487+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:43:01.234487+0000","last_undegraded":"2024-04-26T12:43:01.234487+0000","last_fullsized":"2024-04-26T12:43:01.234487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'49","last_scrub_stamp":"2024-04-26T12:43:01.234232+0000","last_deep_scrub":"139'49","last_deep_scrub_stamp":"2024-04-26T12:43:01.234232+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.234232+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:57.879592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.145410+0000","last_change":"2024-04-26T12:43:09.145461+0000","last_active":"2024-04-26T12:43:09.145410+0000","last_peered":"2024-04-26T12:43:09.145410+0000","last_clean":"2024-04-26T12:43:09.145410+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:43:09.145410+0000","last_undegraded":"2024-04-26T12:43:09.145410+0000","last_fullsized":"2024-04-26T12:43:09.145410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:09.145209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:09.145209+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.145209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:43.568311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"139'68","reported_seq":329,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.400534+0000","last_change":"2024-04-26T12:43:19.400598+0000","last_active":"2024-04-26T12:43:19.400534+0000","last_peered":"2024-04-26T12:43:19.400534+0000","last_clean":"2024-04-26T12:43:19.400534+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:43:19.400534+0000","last_undegraded":"2024-04-26T12:43:19.400534+0000","last_fullsized":"2024-04-26T12:43:19.400534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'68","last_scrub_stamp":"2024-04-26T12:43:19.400287+0000","last_deep_scrub":"139'68","last_deep_scrub_stamp":"2024-04-26T12:43:19.400287+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.400287+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:04.641084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.289308+0000","last_change":"2024-04-26T12:43:00.289382+0000","last_active":"2024-04-26T12:43:00.289308+0000","last_peered":"2024-04-26T12:43:00.289308+0000","last_clean":"2024-04-26T12:43:00.289308+0000","last_became_active":"2024-04-26T12:42:21.968825+0000","last_became_peered":"2024-04-26T12:42:21.968825+0000","last_unstale":"2024-04-26T12:43:00.289308+0000","last_undegraded":"2024-04-26T12:43:00.289308+0000","last_fullsized":"2024-04-26T12:43:00.289308+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.289104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.289104+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.289104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:56.967299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"139'9","reported_seq":67,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.683447+0000","last_change":"2024-04-26T12:43:05.683527+0000","last_active":"2024-04-26T12:43:05.683447+0000","last_peered":"2024-04-26T12:43:05.683447+0000","last_clean":"2024-04-26T12:43:05.683447+0000","last_became_active":"2024-04-26T12:42:34.018809+0000","last_became_peered":"2024-04-26T12:42:34.018809+0000","last_unstale":"2024-04-26T12:43:05.683447+0000","last_undegraded":"2024-04-26T12:43:05.683447+0000","last_fullsized":"2024-04-26T12:43:05.683447+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'9","last_scrub_stamp":"2024-04-26T12:43:05.683254+0000","last_deep_scrub":"139'9","last_deep_scrub_stamp":"2024-04-26T12:43:05.683254+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.683254+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:12.806602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":51,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.690434+0000","last_change":"2024-04-26T12:43:22.690495+0000","last_active":"2024-04-26T12:43:22.690434+0000","last_peered":"2024-04-26T12:43:22.690434+0000","last_clean":"2024-04-26T12:43:22.690434+0000","last_became_active":"2024-04-26T12:42:34.004534+0000","last_became_peered":"2024-04-26T12:42:34.004534+0000","last_unstale":"2024-04-26T12:43:22.690434+0000","last_undegraded":"2024-04-26T12:43:22.690434+0000","last_fullsized":"2024-04-26T12:43:22.690434+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:22.690242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:22.690242+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.690242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:36.772045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.177605+0000","last_change":"2024-04-26T12:42:57.177605+0000","last_active":"2024-04-26T12:42:57.177605+0000","last_peered":"2024-04-26T12:42:57.177605+0000","last_clean":"2024-04-26T12:42:57.177605+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:42:57.177605+0000","last_undegraded":"2024-04-26T12:42:57.177605+0000","last_fullsized":"2024-04-26T12:42:57.177605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:57.177175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:57.177175+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.177175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:47.735046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.236288+0000","last_change":"2024-04-26T12:43:02.236288+0000","last_active":"2024-04-26T12:43:02.236288+0000","last_peered":"2024-04-26T12:43:02.236288+0000","last_clean":"2024-04-26T12:43:02.236288+0000","last_became_active":"2024-04-26T12:42:21.936393+0000","last_became_peered":"2024-04-26T12:42:21.936393+0000","last_unstale":"2024-04-26T12:43:02.236288+0000","last_undegraded":"2024-04-26T12:43:02.236288+0000","last_fullsized":"2024-04-26T12:43:02.236288+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T12:43:02.236023+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T12:43:02.236023+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.236023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:36.659124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"139'42","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.007756+0000","last_change":"2024-04-26T12:43:25.007903+0000","last_active":"2024-04-26T12:43:25.007756+0000","last_peered":"2024-04-26T12:43:25.007756+0000","last_clean":"2024-04-26T12:43:25.007756+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:43:25.007756+0000","last_undegraded":"2024-04-26T12:43:25.007756+0000","last_fullsized":"2024-04-26T12:43:25.007756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'42","last_scrub_stamp":"2024-04-26T12:43:25.007446+0000","last_deep_scrub":"139'42","last_deep_scrub_stamp":"2024-04-26T12:43:25.007446+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.007446+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:35.962324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.290463+0000","last_change":"2024-04-26T12:43:11.290524+0000","last_active":"2024-04-26T12:43:11.290463+0000","last_peered":"2024-04-26T12:43:11.290463+0000","last_clean":"2024-04-26T12:43:11.290463+0000","last_became_active":"2024-04-26T12:42:21.957657+0000","last_became_peered":"2024-04-26T12:42:21.957657+0000","last_unstale":"2024-04-26T12:43:11.290463+0000","last_undegraded":"2024-04-26T12:43:11.290463+0000","last_fullsized":"2024-04-26T12:43:11.290463+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:11.290245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:11.290245+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.290245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:11.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"139'15","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.642454+0000","last_change":"2024-04-26T12:42:57.642454+0000","last_active":"2024-04-26T12:42:57.642454+0000","last_peered":"2024-04-26T12:42:57.642454+0000","last_clean":"2024-04-26T12:42:57.642454+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:42:57.642454+0000","last_undegraded":"2024-04-26T12:42:57.642454+0000","last_fullsized":"2024-04-26T12:42:57.642454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'15","last_scrub_stamp":"2024-04-26T12:42:57.642311+0000","last_deep_scrub":"139'15","last_deep_scrub_stamp":"2024-04-26T12:42:57.642311+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.642311+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:59.889605+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"139'139","reported_seq":514,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.984729+0000","last_change":"2024-04-26T12:43:26.984793+0000","last_active":"2024-04-26T12:43:26.984729+0000","last_peered":"2024-04-26T12:43:26.984729+0000","last_clean":"2024-04-26T12:43:26.984729+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:43:26.984729+0000","last_undegraded":"2024-04-26T12:43:26.984729+0000","last_fullsized":"2024-04-26T12:43:26.984729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'139","last_scrub_stamp":"2024-04-26T12:43:26.984533+0000","last_deep_scrub":"139'139","last_deep_scrub_stamp":"2024-04-26T12:43:26.984533+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.984533+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:53.946001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":124,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.717290+0000","last_change":"2024-04-26T12:43:14.717385+0000","last_active":"2024-04-26T12:43:14.717290+0000","last_peered":"2024-04-26T12:43:14.717290+0000","last_clean":"2024-04-26T12:43:14.717290+0000","last_became_active":"2024-04-26T12:42:34.015101+0000","last_became_peered":"2024-04-26T12:42:34.015101+0000","last_unstale":"2024-04-26T12:43:14.717290+0000","last_undegraded":"2024-04-26T12:43:14.717290+0000","last_fullsized":"2024-04-26T12:43:14.717290+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-04-26T12:43:14.717066+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-04-26T12:43:14.717066+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.717066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:11.824082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.303797+0000","last_change":"2024-04-26T12:42:59.303860+0000","last_active":"2024-04-26T12:42:59.303797+0000","last_peered":"2024-04-26T12:42:59.303797+0000","last_clean":"2024-04-26T12:42:59.303797+0000","last_became_active":"2024-04-26T12:42:21.970815+0000","last_became_peered":"2024-04-26T12:42:21.970815+0000","last_unstale":"2024-04-26T12:42:59.303797+0000","last_undegraded":"2024-04-26T12:42:59.303797+0000","last_fullsized":"2024-04-26T12:42:59.303797+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:42:59.303603+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:42:59.303603+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.303603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:40.944638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"139'54","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.524488+0000","last_change":"2024-04-26T12:43:10.524556+0000","last_active":"2024-04-26T12:43:10.524488+0000","last_peered":"2024-04-26T12:43:10.524488+0000","last_clean":"2024-04-26T12:43:10.524488+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:43:10.524488+0000","last_undegraded":"2024-04-26T12:43:10.524488+0000","last_fullsized":"2024-04-26T12:43:10.524488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:10.524282+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:10.524282+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.524282+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:56.799020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.274952+0000","last_change":"2024-04-26T12:43:29.275004+0000","last_active":"2024-04-26T12:43:29.274952+0000","last_peered":"2024-04-26T12:43:29.274952+0000","last_clean":"2024-04-26T12:43:29.274952+0000","last_became_active":"2024-04-26T12:42:21.926086+0000","last_became_peered":"2024-04-26T12:42:21.926086+0000","last_unstale":"2024-04-26T12:43:29.274952+0000","last_undegraded":"2024-04-26T12:43:29.274952+0000","last_fullsized":"2024-04-26T12:43:29.274952+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:29.274729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:29.274729+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.274729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:47.458727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"139'23","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.854610+0000","last_change":"2024-04-26T12:43:13.854683+0000","last_active":"2024-04-26T12:43:13.854610+0000","last_peered":"2024-04-26T12:43:13.854610+0000","last_clean":"2024-04-26T12:43:13.854610+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:43:13.854610+0000","last_undegraded":"2024-04-26T12:43:13.854610+0000","last_fullsized":"2024-04-26T12:43:13.854610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'23","last_scrub_stamp":"2024-04-26T12:43:13.854420+0000","last_deep_scrub":"139'23","last_deep_scrub_stamp":"2024-04-26T12:43:13.854420+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.854420+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:04.412292+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"139'140","reported_seq":426,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.369300+0000","last_change":"2024-04-26T12:43:07.369369+0000","last_active":"2024-04-26T12:43:07.369300+0000","last_peered":"2024-04-26T12:43:07.369300+0000","last_clean":"2024-04-26T12:43:07.369300+0000","last_became_active":"2024-04-26T12:42:21.972298+0000","last_became_peered":"2024-04-26T12:42:21.972298+0000","last_unstale":"2024-04-26T12:43:07.369300+0000","last_undegraded":"2024-04-26T12:43:07.369300+0000","last_fullsized":"2024-04-26T12:43:07.369300+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'140","last_scrub_stamp":"2024-04-26T12:43:07.369106+0000","last_deep_scrub":"139'140","last_deep_scrub_stamp":"2024-04-26T12:43:07.369106+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.369106+0000","objects_scrubbed":1,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:18.564273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.202926+0000","last_change":"2024-04-26T12:43:07.203044+0000","last_active":"2024-04-26T12:43:07.202926+0000","last_peered":"2024-04-26T12:43:07.202926+0000","last_clean":"2024-04-26T12:43:07.202926+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:43:07.202926+0000","last_undegraded":"2024-04-26T12:43:07.202926+0000","last_fullsized":"2024-04-26T12:43:07.202926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:07.202604+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:07.202604+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.202604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:23.435288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"139'48","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.578616+0000","last_change":"2024-04-26T12:43:09.578616+0000","last_active":"2024-04-26T12:43:09.578616+0000","last_peered":"2024-04-26T12:43:09.578616+0000","last_clean":"2024-04-26T12:43:09.578616+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:43:09.578616+0000","last_undegraded":"2024-04-26T12:43:09.578616+0000","last_fullsized":"2024-04-26T12:43:09.578616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:09.578188+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:09.578188+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.578188+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:05.831900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.835576+0000","last_change":"2024-04-26T12:43:03.835690+0000","last_active":"2024-04-26T12:43:03.835576+0000","last_peered":"2024-04-26T12:43:03.835576+0000","last_clean":"2024-04-26T12:43:03.835576+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:43:03.835576+0000","last_undegraded":"2024-04-26T12:43:03.835576+0000","last_fullsized":"2024-04-26T12:43:03.835576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.835273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.835273+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.835273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:03.288371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"139'38","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.147364+0000","last_change":"2024-04-26T12:43:14.147450+0000","last_active":"2024-04-26T12:43:14.147364+0000","last_peered":"2024-04-26T12:43:14.147364+0000","last_clean":"2024-04-26T12:43:14.147364+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:43:14.147364+0000","last_undegraded":"2024-04-26T12:43:14.147364+0000","last_fullsized":"2024-04-26T12:43:14.147364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:14.147135+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:14.147135+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.147135+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:24.485106+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.973887+0000","last_change":"2024-04-26T12:43:08.973943+0000","last_active":"2024-04-26T12:43:08.973887+0000","last_peered":"2024-04-26T12:43:08.973887+0000","last_clean":"2024-04-26T12:43:08.973887+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:43:08.973887+0000","last_undegraded":"2024-04-26T12:43:08.973887+0000","last_fullsized":"2024-04-26T12:43:08.973887+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:08.973679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:08.973679+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.973679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.619038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.199675+0000","last_change":"2024-04-26T12:43:00.199712+0000","last_active":"2024-04-26T12:43:00.199675+0000","last_peered":"2024-04-26T12:43:00.199675+0000","last_clean":"2024-04-26T12:43:00.199675+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:43:00.199675+0000","last_undegraded":"2024-04-26T12:43:00.199675+0000","last_fullsized":"2024-04-26T12:43:00.199675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.199539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.199539+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.199539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:59.508818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"117'8","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.648754+0000","last_change":"2024-04-26T12:43:29.648817+0000","last_active":"2024-04-26T12:43:29.648754+0000","last_peered":"2024-04-26T12:43:29.648754+0000","last_clean":"2024-04-26T12:43:29.648754+0000","last_became_active":"2024-04-26T12:42:34.027515+0000","last_became_peered":"2024-04-26T12:42:34.027515+0000","last_unstale":"2024-04-26T12:43:29.648754+0000","last_undegraded":"2024-04-26T12:43:29.648754+0000","last_fullsized":"2024-04-26T12:43:29.648754+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'8","last_scrub_stamp":"2024-04-26T12:43:29.648528+0000","last_deep_scrub":"117'8","last_deep_scrub_stamp":"2024-04-26T12:43:29.648528+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.648528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:03.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"139'40","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.972765+0000","last_change":"2024-04-26T12:43:23.972824+0000","last_active":"2024-04-26T12:43:23.972765+0000","last_peered":"2024-04-26T12:43:23.972765+0000","last_clean":"2024-04-26T12:43:23.972765+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:43:23.972765+0000","last_undegraded":"2024-04-26T12:43:23.972765+0000","last_fullsized":"2024-04-26T12:43:23.972765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:23.972572+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:23.972572+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.972572+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:22.578544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.577417+0000","last_change":"2024-04-26T12:43:04.577525+0000","last_active":"2024-04-26T12:43:04.577417+0000","last_peered":"2024-04-26T12:43:04.577417+0000","last_clean":"2024-04-26T12:43:04.577417+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:43:04.577417+0000","last_undegraded":"2024-04-26T12:43:04.577417+0000","last_fullsized":"2024-04-26T12:43:04.577417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.577199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.577199+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.577199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:12.782935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"139'23","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.705250+0000","last_change":"2024-04-26T12:42:21.974974+0000","last_active":"2024-04-26T12:42:52.705250+0000","last_peered":"2024-04-26T12:42:52.705250+0000","last_clean":"2024-04-26T12:42:52.705250+0000","last_became_active":"2024-04-26T12:42:21.968492+0000","last_became_peered":"2024-04-26T12:42:21.968492+0000","last_unstale":"2024-04-26T12:42:52.705250+0000","last_undegraded":"2024-04-26T12:42:52.705250+0000","last_fullsized":"2024-04-26T12:42:52.705250+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.261648+0000","last_change":"2024-04-26T12:43:18.261703+0000","last_active":"2024-04-26T12:43:18.261648+0000","last_peered":"2024-04-26T12:43:18.261648+0000","last_clean":"2024-04-26T12:43:18.261648+0000","last_became_active":"2024-04-26T12:42:21.942925+0000","last_became_peered":"2024-04-26T12:42:21.942925+0000","last_unstale":"2024-04-26T12:43:18.261648+0000","last_undegraded":"2024-04-26T12:43:18.261648+0000","last_fullsized":"2024-04-26T12:43:18.261648+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:18.261435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:18.261435+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.261435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:14.820450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.600088+0000","last_change":"2024-04-26T12:43:22.600148+0000","last_active":"2024-04-26T12:43:22.600088+0000","last_peered":"2024-04-26T12:43:22.600088+0000","last_clean":"2024-04-26T12:43:22.600088+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:43:22.600088+0000","last_undegraded":"2024-04-26T12:43:22.600088+0000","last_fullsized":"2024-04-26T12:43:22.600088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'9","last_scrub_stamp":"2024-04-26T12:43:22.599879+0000","last_deep_scrub":"104'9","last_deep_scrub_stamp":"2024-04-26T12:43:22.599879+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.599879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:13.157750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.597598+0000","last_change":"2024-04-26T12:43:03.597659+0000","last_active":"2024-04-26T12:43:03.597598+0000","last_peered":"2024-04-26T12:43:03.597598+0000","last_clean":"2024-04-26T12:43:03.597598+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:43:03.597598+0000","last_undegraded":"2024-04-26T12:43:03.597598+0000","last_fullsized":"2024-04-26T12:43:03.597598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-04-26T12:43:03.597397+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-04-26T12:43:03.597397+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.597397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:49.371415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"139'38","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.850437+0000","last_change":"2024-04-26T12:43:14.850502+0000","last_active":"2024-04-26T12:43:14.850437+0000","last_peered":"2024-04-26T12:43:14.850437+0000","last_clean":"2024-04-26T12:43:14.850437+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:43:14.850437+0000","last_undegraded":"2024-04-26T12:43:14.850437+0000","last_fullsized":"2024-04-26T12:43:14.850437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:14.850229+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:14.850229+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.850229+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:18.592039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.624596+0000","last_change":"2024-04-26T12:43:07.624649+0000","last_active":"2024-04-26T12:43:07.624596+0000","last_peered":"2024-04-26T12:43:07.624596+0000","last_clean":"2024-04-26T12:43:07.624596+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:43:07.624596+0000","last_undegraded":"2024-04-26T12:43:07.624596+0000","last_fullsized":"2024-04-26T12:43:07.624596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:07.624397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:07.624397+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.624397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:57.852666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"139'33","reported_seq":294,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.793798+0000","last_change":"2024-04-26T12:43:07.793894+0000","last_active":"2024-04-26T12:43:07.793798+0000","last_peered":"2024-04-26T12:43:07.793798+0000","last_clean":"2024-04-26T12:43:07.793798+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:43:07.793798+0000","last_undegraded":"2024-04-26T12:43:07.793798+0000","last_fullsized":"2024-04-26T12:43:07.793798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'33","last_scrub_stamp":"2024-04-26T12:43:07.793623+0000","last_deep_scrub":"139'33","last_deep_scrub_stamp":"2024-04-26T12:43:07.793623+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.793623+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:03.458697+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"139'139","reported_seq":468,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.422683+0000","last_change":"2024-04-26T12:43:28.422748+0000","last_active":"2024-04-26T12:43:28.422683+0000","last_peered":"2024-04-26T12:43:28.422683+0000","last_clean":"2024-04-26T12:43:28.422683+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:43:28.422683+0000","last_undegraded":"2024-04-26T12:43:28.422683+0000","last_fullsized":"2024-04-26T12:43:28.422683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'139","last_scrub_stamp":"2024-04-26T12:43:28.422471+0000","last_deep_scrub":"139'139","last_deep_scrub_stamp":"2024-04-26T12:43:28.422471+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.422471+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:43.355095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.132746+0000","last_change":"2024-04-26T12:42:56.132770+0000","last_active":"2024-04-26T12:42:56.132746+0000","last_peered":"2024-04-26T12:42:56.132746+0000","last_clean":"2024-04-26T12:42:56.132746+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:42:56.132746+0000","last_undegraded":"2024-04-26T12:42:56.132746+0000","last_fullsized":"2024-04-26T12:42:56.132746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:42:56.132663+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:42:56.132663+0000","last_clean_scrub_stamp":"2024-04-26T12:42:56.132663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:50.436843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.440872+0000","last_change":"2024-04-26T12:43:17.440934+0000","last_active":"2024-04-26T12:43:17.440872+0000","last_peered":"2024-04-26T12:43:17.440872+0000","last_clean":"2024-04-26T12:43:17.440872+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:43:17.440872+0000","last_undegraded":"2024-04-26T12:43:17.440872+0000","last_fullsized":"2024-04-26T12:43:17.440872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:17.440639+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:17.440639+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.440639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:32.950498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"139'36","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:35.269468+0000","last_change":"2024-04-26T12:43:35.269533+0000","last_active":"2024-04-26T12:43:35.269468+0000","last_peered":"2024-04-26T12:43:35.269468+0000","last_clean":"2024-04-26T12:43:35.269468+0000","last_became_active":"2024-04-26T12:42:21.959122+0000","last_became_peered":"2024-04-26T12:42:21.959122+0000","last_unstale":"2024-04-26T12:43:35.269468+0000","last_undegraded":"2024-04-26T12:43:35.269468+0000","last_fullsized":"2024-04-26T12:43:35.269468+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:35.269260+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:35.269260+0000","last_clean_scrub_stamp":"2024-04-26T12:43:35.269260+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:36.573418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.579314+0000","last_change":"2024-04-26T12:42:59.579343+0000","last_active":"2024-04-26T12:42:59.579314+0000","last_peered":"2024-04-26T12:42:59.579314+0000","last_clean":"2024-04-26T12:42:59.579314+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:42:59.579314+0000","last_undegraded":"2024-04-26T12:42:59.579314+0000","last_fullsized":"2024-04-26T12:42:59.579314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:59.579187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:59.579187+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.579187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:52.115646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"139'39","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.253479+0000","last_change":"2024-04-26T12:43:08.253556+0000","last_active":"2024-04-26T12:43:08.253479+0000","last_peered":"2024-04-26T12:43:08.253479+0000","last_clean":"2024-04-26T12:43:08.253479+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:43:08.253479+0000","last_undegraded":"2024-04-26T12:43:08.253479+0000","last_fullsized":"2024-04-26T12:43:08.253479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'39","last_scrub_stamp":"2024-04-26T12:43:08.253296+0000","last_deep_scrub":"139'39","last_deep_scrub_stamp":"2024-04-26T12:43:08.253296+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.253296+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:50.352734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.623885+0000","last_change":"2024-04-26T12:42:58.623924+0000","last_active":"2024-04-26T12:42:58.623885+0000","last_peered":"2024-04-26T12:42:58.623885+0000","last_clean":"2024-04-26T12:42:58.623885+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:42:58.623885+0000","last_undegraded":"2024-04-26T12:42:58.623885+0000","last_fullsized":"2024-04-26T12:42:58.623885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:58.623773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:58.623773+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.623773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:57.930708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"139'8","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.117115+0000","last_change":"2024-04-26T12:43:25.117179+0000","last_active":"2024-04-26T12:43:25.117115+0000","last_peered":"2024-04-26T12:43:25.117115+0000","last_clean":"2024-04-26T12:43:25.117115+0000","last_became_active":"2024-04-26T12:42:21.934686+0000","last_became_peered":"2024-04-26T12:42:21.934686+0000","last_unstale":"2024-04-26T12:43:25.117115+0000","last_undegraded":"2024-04-26T12:43:25.117115+0000","last_fullsized":"2024-04-26T12:43:25.117115+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'8","last_scrub_stamp":"2024-04-26T12:43:25.116917+0000","last_deep_scrub":"139'8","last_deep_scrub_stamp":"2024-04-26T12:43:25.116917+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.116917+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:52.511928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"117'4","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.709382+0000","last_change":"2024-04-26T12:43:32.709482+0000","last_active":"2024-04-26T12:43:32.709382+0000","last_peered":"2024-04-26T12:43:32.709382+0000","last_clean":"2024-04-26T12:43:32.709382+0000","last_became_active":"2024-04-26T12:42:34.031776+0000","last_became_peered":"2024-04-26T12:42:34.031776+0000","last_unstale":"2024-04-26T12:43:32.709382+0000","last_undegraded":"2024-04-26T12:43:32.709382+0000","last_fullsized":"2024-04-26T12:43:32.709382+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:32.709169+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:32.709169+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.709169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:26.314620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"139'52","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.831772+0000","last_change":"2024-04-26T12:42:21.974477+0000","last_active":"2024-04-26T12:42:52.831772+0000","last_peered":"2024-04-26T12:42:52.831772+0000","last_clean":"2024-04-26T12:42:52.831772+0000","last_became_active":"2024-04-26T12:42:21.967072+0000","last_became_peered":"2024-04-26T12:42:21.967072+0000","last_unstale":"2024-04-26T12:42:52.831772+0000","last_undegraded":"2024-04-26T12:42:52.831772+0000","last_fullsized":"2024-04-26T12:42:52.831772+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:09.397765+0000","last_clean_scrub_stamp":"2024-04-26T12:38:09.397765+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.671500+0000","last_change":"2024-04-26T12:43:06.671553+0000","last_active":"2024-04-26T12:43:06.671500+0000","last_peered":"2024-04-26T12:43:06.671500+0000","last_clean":"2024-04-26T12:43:06.671500+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:43:06.671500+0000","last_undegraded":"2024-04-26T12:43:06.671500+0000","last_fullsized":"2024-04-26T12:43:06.671500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:06.671308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:06.671308+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.671308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:08.435831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"139'26","reported_seq":85,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.723100+0000","last_change":"2024-04-26T12:43:01.723178+0000","last_active":"2024-04-26T12:43:01.723100+0000","last_peered":"2024-04-26T12:43:01.723100+0000","last_clean":"2024-04-26T12:43:01.723100+0000","last_became_active":"2024-04-26T12:42:34.027524+0000","last_became_peered":"2024-04-26T12:42:34.027524+0000","last_unstale":"2024-04-26T12:43:01.723100+0000","last_undegraded":"2024-04-26T12:43:01.723100+0000","last_fullsized":"2024-04-26T12:43:01.723100+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:01.722913+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:01.722913+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.722913+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:33.832597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.420270+0000","last_change":"2024-04-26T12:43:30.420395+0000","last_active":"2024-04-26T12:43:30.420270+0000","last_peered":"2024-04-26T12:43:30.420270+0000","last_clean":"2024-04-26T12:43:30.420270+0000","last_became_active":"2024-04-26T12:42:21.937057+0000","last_became_peered":"2024-04-26T12:42:21.937057+0000","last_unstale":"2024-04-26T12:43:30.420270+0000","last_undegraded":"2024-04-26T12:43:30.420270+0000","last_fullsized":"2024-04-26T12:43:30.420270+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:30.420027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:30.420027+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.420027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:04.055624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":227,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.277903+0000","last_change":"2024-04-26T12:43:09.278044+0000","last_active":"2024-04-26T12:43:09.277903+0000","last_peered":"2024-04-26T12:43:09.277903+0000","last_clean":"2024-04-26T12:43:09.277903+0000","last_became_active":"2024-04-26T12:42:21.948878+0000","last_became_peered":"2024-04-26T12:42:21.948878+0000","last_unstale":"2024-04-26T12:43:09.277903+0000","last_undegraded":"2024-04-26T12:43:09.277903+0000","last_fullsized":"2024-04-26T12:43:09.277903+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:09.277669+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:09.277669+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.277669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:05.039552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":140,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.726264+0000","last_change":"2024-04-26T12:43:08.726414+0000","last_active":"2024-04-26T12:43:08.726264+0000","last_peered":"2024-04-26T12:43:08.726264+0000","last_clean":"2024-04-26T12:43:08.726264+0000","last_became_active":"2024-04-26T12:42:34.018540+0000","last_became_peered":"2024-04-26T12:42:34.018540+0000","last_unstale":"2024-04-26T12:43:08.726264+0000","last_undegraded":"2024-04-26T12:43:08.726264+0000","last_fullsized":"2024-04-26T12:43:08.726264+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-04-26T12:43:08.726036+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-04-26T12:43:08.726036+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.726036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:26.448825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"139'40","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.495420+0000","last_change":"2024-04-26T12:43:14.495545+0000","last_active":"2024-04-26T12:43:14.495420+0000","last_peered":"2024-04-26T12:43:14.495420+0000","last_clean":"2024-04-26T12:43:14.495420+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:43:14.495420+0000","last_undegraded":"2024-04-26T12:43:14.495420+0000","last_fullsized":"2024-04-26T12:43:14.495420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:14.495095+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:14.495095+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.495095+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:51.816257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.900868+0000","last_change":"2024-04-26T12:42:56.900889+0000","last_active":"2024-04-26T12:42:56.900868+0000","last_peered":"2024-04-26T12:42:56.900868+0000","last_clean":"2024-04-26T12:42:56.900868+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:42:56.900868+0000","last_undegraded":"2024-04-26T12:42:56.900868+0000","last_fullsized":"2024-04-26T12:42:56.900868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:56.900773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:56.900773+0000","last_clean_scrub_stamp":"2024-04-26T12:42:56.900773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:47.129042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"139'32","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.531746+0000","last_change":"2024-04-26T12:43:14.531831+0000","last_active":"2024-04-26T12:43:14.531746+0000","last_peered":"2024-04-26T12:43:14.531746+0000","last_clean":"2024-04-26T12:43:14.531746+0000","last_became_active":"2024-04-26T12:42:21.958977+0000","last_became_peered":"2024-04-26T12:42:21.958977+0000","last_unstale":"2024-04-26T12:43:14.531746+0000","last_undegraded":"2024-04-26T12:43:14.531746+0000","last_fullsized":"2024-04-26T12:43:14.531746+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:14.531555+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:14.531555+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.531555+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:26.642981+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"139'138","reported_seq":452,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.622736+0000","last_change":"2024-04-26T12:43:08.622800+0000","last_active":"2024-04-26T12:43:08.622736+0000","last_peered":"2024-04-26T12:43:08.622736+0000","last_clean":"2024-04-26T12:43:08.622736+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:43:08.622736+0000","last_undegraded":"2024-04-26T12:43:08.622736+0000","last_fullsized":"2024-04-26T12:43:08.622736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:08.622527+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:08.622527+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.622527+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:37.571768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.120795+0000","last_change":"2024-04-26T12:43:19.120857+0000","last_active":"2024-04-26T12:43:19.120795+0000","last_peered":"2024-04-26T12:43:19.120795+0000","last_clean":"2024-04-26T12:43:19.120795+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:43:19.120795+0000","last_undegraded":"2024-04-26T12:43:19.120795+0000","last_fullsized":"2024-04-26T12:43:19.120795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:43:19.120559+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:43:19.120559+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.120559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:39.907160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":189,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.705327+0000","last_change":"2024-04-26T12:42:59.705388+0000","last_active":"2024-04-26T12:42:59.705327+0000","last_peered":"2024-04-26T12:42:59.705327+0000","last_clean":"2024-04-26T12:42:59.705327+0000","last_became_active":"2024-04-26T12:42:34.025094+0000","last_became_peered":"2024-04-26T12:42:34.025094+0000","last_unstale":"2024-04-26T12:42:59.705327+0000","last_undegraded":"2024-04-26T12:42:59.705327+0000","last_fullsized":"2024-04-26T12:42:59.705327+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-04-26T12:42:59.705118+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-04-26T12:42:59.705118+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.705118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:42.842126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"139'70","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.692554+0000","last_change":"2024-04-26T12:43:03.692616+0000","last_active":"2024-04-26T12:43:03.692554+0000","last_peered":"2024-04-26T12:43:03.692554+0000","last_clean":"2024-04-26T12:43:03.692554+0000","last_became_active":"2024-04-26T12:42:34.019821+0000","last_became_peered":"2024-04-26T12:42:34.019821+0000","last_unstale":"2024-04-26T12:43:03.692554+0000","last_undegraded":"2024-04-26T12:43:03.692554+0000","last_fullsized":"2024-04-26T12:43:03.692554+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'70","last_scrub_stamp":"2024-04-26T12:43:03.692350+0000","last_deep_scrub":"139'70","last_deep_scrub_stamp":"2024-04-26T12:43:03.692350+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.692350+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:15.436633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"139'4","reported_seq":441,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.217077+0000","last_change":"2024-04-26T12:43:06.217156+0000","last_active":"2024-04-26T12:43:06.217077+0000","last_peered":"2024-04-26T12:43:06.217077+0000","last_clean":"2024-04-26T12:43:06.217077+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:43:06.217077+0000","last_undegraded":"2024-04-26T12:43:06.217077+0000","last_fullsized":"2024-04-26T12:43:06.217077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'4","last_scrub_stamp":"2024-04-26T12:43:06.216848+0000","last_deep_scrub":"139'4","last_deep_scrub_stamp":"2024-04-26T12:43:06.216848+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.216848+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.585068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"139'15","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.218749+0000","last_change":"2024-04-26T12:43:17.218821+0000","last_active":"2024-04-26T12:43:17.218749+0000","last_peered":"2024-04-26T12:43:17.218749+0000","last_clean":"2024-04-26T12:43:17.218749+0000","last_became_active":"2024-04-26T12:42:21.952480+0000","last_became_peered":"2024-04-26T12:42:21.952480+0000","last_unstale":"2024-04-26T12:43:17.218749+0000","last_undegraded":"2024-04-26T12:43:17.218749+0000","last_fullsized":"2024-04-26T12:43:17.218749+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'15","last_scrub_stamp":"2024-04-26T12:43:17.218550+0000","last_deep_scrub":"139'15","last_deep_scrub_stamp":"2024-04-26T12:43:17.218550+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.218550+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:53.496680+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"139'138","reported_seq":484,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.646105+0000","last_change":"2024-04-26T12:43:18.646170+0000","last_active":"2024-04-26T12:43:18.646105+0000","last_peered":"2024-04-26T12:43:18.646105+0000","last_clean":"2024-04-26T12:43:18.646105+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:43:18.646105+0000","last_undegraded":"2024-04-26T12:43:18.646105+0000","last_fullsized":"2024-04-26T12:43:18.646105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:18.645905+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:18.645905+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.645905+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:47.534473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.696476+0000","last_change":"2024-04-26T12:43:04.696540+0000","last_active":"2024-04-26T12:43:04.696476+0000","last_peered":"2024-04-26T12:43:04.696476+0000","last_clean":"2024-04-26T12:43:04.696476+0000","last_became_active":"2024-04-26T12:42:34.015095+0000","last_became_peered":"2024-04-26T12:42:34.015095+0000","last_unstale":"2024-04-26T12:43:04.696476+0000","last_undegraded":"2024-04-26T12:43:04.696476+0000","last_fullsized":"2024-04-26T12:43:04.696476+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:04.696255+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:04.696255+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.696255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:25.482856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.136384+0000","last_change":"2024-04-26T12:43:26.136441+0000","last_active":"2024-04-26T12:43:26.136384+0000","last_peered":"2024-04-26T12:43:26.136384+0000","last_clean":"2024-04-26T12:43:26.136384+0000","last_became_active":"2024-04-26T12:42:21.953253+0000","last_became_peered":"2024-04-26T12:42:21.953253+0000","last_unstale":"2024-04-26T12:43:26.136384+0000","last_undegraded":"2024-04-26T12:43:26.136384+0000","last_fullsized":"2024-04-26T12:43:26.136384+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:26.136200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:26.136200+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.136200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:04.018570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"139'40","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.337604+0000","last_change":"2024-04-26T12:43:14.337667+0000","last_active":"2024-04-26T12:43:14.337604+0000","last_peered":"2024-04-26T12:43:14.337604+0000","last_clean":"2024-04-26T12:43:14.337604+0000","last_became_active":"2024-04-26T12:42:21.940512+0000","last_became_peered":"2024-04-26T12:42:21.940512+0000","last_unstale":"2024-04-26T12:43:14.337604+0000","last_undegraded":"2024-04-26T12:43:14.337604+0000","last_fullsized":"2024-04-26T12:43:14.337604+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:14.337382+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:14.337382+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.337382+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:29.589516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":59,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.704574+0000","last_change":"2024-04-26T12:43:21.704627+0000","last_active":"2024-04-26T12:43:21.704574+0000","last_peered":"2024-04-26T12:43:21.704574+0000","last_clean":"2024-04-26T12:43:21.704574+0000","last_became_active":"2024-04-26T12:42:34.005897+0000","last_became_peered":"2024-04-26T12:42:34.005897+0000","last_unstale":"2024-04-26T12:43:21.704574+0000","last_undegraded":"2024-04-26T12:43:21.704574+0000","last_fullsized":"2024-04-26T12:43:21.704574+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:21.704375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:21.704375+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.704375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:39.888373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"139'36","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.106269+0000","last_change":"2024-04-26T12:43:10.106352+0000","last_active":"2024-04-26T12:43:10.106269+0000","last_peered":"2024-04-26T12:43:10.106269+0000","last_clean":"2024-04-26T12:43:10.106269+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:43:10.106269+0000","last_undegraded":"2024-04-26T12:43:10.106269+0000","last_fullsized":"2024-04-26T12:43:10.106269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:10.106078+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:10.106078+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.106078+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:26.424587+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.570860+0000","last_change":"2024-04-26T12:43:23.571003+0000","last_active":"2024-04-26T12:43:23.570860+0000","last_peered":"2024-04-26T12:43:23.570860+0000","last_clean":"2024-04-26T12:43:23.570860+0000","last_became_active":"2024-04-26T12:42:21.946663+0000","last_became_peered":"2024-04-26T12:42:21.946663+0000","last_unstale":"2024-04-26T12:43:23.570860+0000","last_undegraded":"2024-04-26T12:43:23.570860+0000","last_fullsized":"2024-04-26T12:43:23.570860+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:23.570615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:23.570615+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.570615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:27.312425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.082820+0000","last_change":"2024-04-26T12:43:20.082900+0000","last_active":"2024-04-26T12:43:20.082820+0000","last_peered":"2024-04-26T12:43:20.082820+0000","last_clean":"2024-04-26T12:43:20.082820+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:43:20.082820+0000","last_undegraded":"2024-04-26T12:43:20.082820+0000","last_fullsized":"2024-04-26T12:43:20.082820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:20.082606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:20.082606+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.082606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:31.111296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.612572+0000","last_change":"2024-04-26T12:43:01.612636+0000","last_active":"2024-04-26T12:43:01.612572+0000","last_peered":"2024-04-26T12:43:01.612572+0000","last_clean":"2024-04-26T12:43:01.612572+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:43:01.612572+0000","last_undegraded":"2024-04-26T12:43:01.612572+0000","last_fullsized":"2024-04-26T12:43:01.612572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-04-26T12:43:01.612356+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-04-26T12:43:01.612356+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.612356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:33.491385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"139'119","reported_seq":417,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.917410+0000","last_change":"2024-04-26T12:43:19.917497+0000","last_active":"2024-04-26T12:43:19.917410+0000","last_peered":"2024-04-26T12:43:19.917410+0000","last_clean":"2024-04-26T12:43:19.917410+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:43:19.917410+0000","last_undegraded":"2024-04-26T12:43:19.917410+0000","last_fullsized":"2024-04-26T12:43:19.917410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'119","last_scrub_stamp":"2024-04-26T12:43:19.917235+0000","last_deep_scrub":"139'119","last_deep_scrub_stamp":"2024-04-26T12:43:19.917235+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.917235+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.661518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.223894+0000","last_change":"2024-04-26T12:43:21.223950+0000","last_active":"2024-04-26T12:43:21.223894+0000","last_peered":"2024-04-26T12:43:21.223894+0000","last_clean":"2024-04-26T12:43:21.223894+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:43:21.223894+0000","last_undegraded":"2024-04-26T12:43:21.223894+0000","last_fullsized":"2024-04-26T12:43:21.223894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:21.223692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:21.223692+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.223692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:50.566165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"139'66","reported_seq":324,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.154484+0000","last_change":"2024-04-26T12:43:28.154549+0000","last_active":"2024-04-26T12:43:28.154484+0000","last_peered":"2024-04-26T12:43:28.154484+0000","last_clean":"2024-04-26T12:43:28.154484+0000","last_became_active":"2024-04-26T12:42:21.929093+0000","last_became_peered":"2024-04-26T12:42:21.929093+0000","last_unstale":"2024-04-26T12:43:28.154484+0000","last_undegraded":"2024-04-26T12:43:28.154484+0000","last_fullsized":"2024-04-26T12:43:28.154484+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'66","last_scrub_stamp":"2024-04-26T12:43:28.154276+0000","last_deep_scrub":"139'66","last_deep_scrub_stamp":"2024-04-26T12:43:28.154276+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.154276+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:34.684450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.856821+0000","last_change":"2024-04-26T12:43:02.856875+0000","last_active":"2024-04-26T12:43:02.856821+0000","last_peered":"2024-04-26T12:43:02.856821+0000","last_clean":"2024-04-26T12:43:02.856821+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:43:02.856821+0000","last_undegraded":"2024-04-26T12:43:02.856821+0000","last_fullsized":"2024-04-26T12:43:02.856821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:02.856629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:02.856629+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.856629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:13.235151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"139'55","reported_seq":339,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.242391+0000","last_change":"2024-04-26T12:43:30.242468+0000","last_active":"2024-04-26T12:43:30.242391+0000","last_peered":"2024-04-26T12:43:30.242391+0000","last_clean":"2024-04-26T12:43:30.242391+0000","last_became_active":"2024-04-26T12:42:21.931114+0000","last_became_peered":"2024-04-26T12:42:21.931114+0000","last_unstale":"2024-04-26T12:43:30.242391+0000","last_undegraded":"2024-04-26T12:43:30.242391+0000","last_fullsized":"2024-04-26T12:43:30.242391+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'55","last_scrub_stamp":"2024-04-26T12:43:30.242160+0000","last_deep_scrub":"139'55","last_deep_scrub_stamp":"2024-04-26T12:43:30.242160+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.242160+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:44.323963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":397,"num_write":30,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.391393+0000","last_change":"2024-04-26T12:43:14.391532+0000","last_active":"2024-04-26T12:43:14.391393+0000","last_peered":"2024-04-26T12:43:14.391393+0000","last_clean":"2024-04-26T12:43:14.391393+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:43:14.391393+0000","last_undegraded":"2024-04-26T12:43:14.391393+0000","last_fullsized":"2024-04-26T12:43:14.391393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:14.391148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:14.391148+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.391148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:43.733621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.639398+0000","last_change":"2024-04-26T12:43:20.639454+0000","last_active":"2024-04-26T12:43:20.639398+0000","last_peered":"2024-04-26T12:43:20.639398+0000","last_clean":"2024-04-26T12:43:20.639398+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:43:20.639398+0000","last_undegraded":"2024-04-26T12:43:20.639398+0000","last_fullsized":"2024-04-26T12:43:20.639398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:20.639204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:20.639204+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.639204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:32.944499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.286255+0000","last_change":"2024-04-26T12:43:11.286324+0000","last_active":"2024-04-26T12:43:11.286255+0000","last_peered":"2024-04-26T12:43:11.286255+0000","last_clean":"2024-04-26T12:43:11.286255+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:43:11.286255+0000","last_undegraded":"2024-04-26T12:43:11.286255+0000","last_fullsized":"2024-04-26T12:43:11.286255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:11.286038+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:11.286038+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.286038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:49.168408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.862484+0000","last_change":"2024-04-26T12:43:17.862535+0000","last_active":"2024-04-26T12:43:17.862484+0000","last_peered":"2024-04-26T12:43:17.862484+0000","last_clean":"2024-04-26T12:43:17.862484+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:43:17.862484+0000","last_undegraded":"2024-04-26T12:43:17.862484+0000","last_fullsized":"2024-04-26T12:43:17.862484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:17.862271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:17.862271+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.862271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:49.971956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'36","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.412874+0000","last_change":"2024-04-26T12:43:25.412936+0000","last_active":"2024-04-26T12:43:25.412874+0000","last_peered":"2024-04-26T12:43:25.412874+0000","last_clean":"2024-04-26T12:43:25.412874+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:43:25.412874+0000","last_undegraded":"2024-04-26T12:43:25.412874+0000","last_fullsized":"2024-04-26T12:43:25.412874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:25.412658+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:25.412658+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.412658+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:27.267873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.233009+0000","last_change":"2024-04-26T12:43:04.233068+0000","last_active":"2024-04-26T12:43:04.233009+0000","last_peered":"2024-04-26T12:43:04.233009+0000","last_clean":"2024-04-26T12:43:04.233009+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:43:04.233009+0000","last_undegraded":"2024-04-26T12:43:04.233009+0000","last_fullsized":"2024-04-26T12:43:04.233009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.232754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.232754+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.232754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:54.790626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"139'155","reported_seq":533,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.901929+0000","last_change":"2024-04-26T12:43:00.902011+0000","last_active":"2024-04-26T12:43:00.901929+0000","last_peered":"2024-04-26T12:43:00.901929+0000","last_clean":"2024-04-26T12:43:00.901929+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:43:00.901929+0000","last_undegraded":"2024-04-26T12:43:00.901929+0000","last_fullsized":"2024-04-26T12:43:00.901929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'155","last_scrub_stamp":"2024-04-26T12:43:00.901702+0000","last_deep_scrub":"139'155","last_deep_scrub_stamp":"2024-04-26T12:43:00.901702+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.901702+0000","objects_scrubbed":10,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:47.176440+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":191,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.022289+0000","last_change":"2024-04-26T12:43:26.022349+0000","last_active":"2024-04-26T12:43:26.022289+0000","last_peered":"2024-04-26T12:43:26.022289+0000","last_clean":"2024-04-26T12:43:26.022289+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:43:26.022289+0000","last_undegraded":"2024-04-26T12:43:26.022289+0000","last_fullsized":"2024-04-26T12:43:26.022289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:26.022096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:26.022096+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.022096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:31.810963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"117'2","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.099947+0000","last_change":"2024-04-26T12:43:21.100074+0000","last_active":"2024-04-26T12:43:21.099947+0000","last_peered":"2024-04-26T12:43:21.099947+0000","last_clean":"2024-04-26T12:43:21.099947+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:43:21.099947+0000","last_undegraded":"2024-04-26T12:43:21.099947+0000","last_fullsized":"2024-04-26T12:43:21.099947+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'2","last_scrub_stamp":"2024-04-26T12:43:21.099705+0000","last_deep_scrub":"117'2","last_deep_scrub_stamp":"2024-04-26T12:43:21.099705+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.099705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:23.103929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.945417+0000","last_change":"2024-04-26T12:43:07.945480+0000","last_active":"2024-04-26T12:43:07.945417+0000","last_peered":"2024-04-26T12:43:07.945417+0000","last_clean":"2024-04-26T12:43:07.945417+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:43:07.945417+0000","last_undegraded":"2024-04-26T12:43:07.945417+0000","last_fullsized":"2024-04-26T12:43:07.945417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'10","last_scrub_stamp":"2024-04-26T12:43:07.945203+0000","last_deep_scrub":"104'10","last_deep_scrub_stamp":"2024-04-26T12:43:07.945203+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.945203+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:02.826059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.490419+0000","last_change":"2024-04-26T12:43:12.490476+0000","last_active":"2024-04-26T12:43:12.490419+0000","last_peered":"2024-04-26T12:43:12.490419+0000","last_clean":"2024-04-26T12:43:12.490419+0000","last_became_active":"2024-04-26T12:42:21.938117+0000","last_became_peered":"2024-04-26T12:42:21.938117+0000","last_unstale":"2024-04-26T12:43:12.490419+0000","last_undegraded":"2024-04-26T12:43:12.490419+0000","last_fullsized":"2024-04-26T12:43:12.490419+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:12.490218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:12.490218+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.490218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:24.981091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"139'66","reported_seq":328,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.024378+0000","last_change":"2024-04-26T12:43:15.024525+0000","last_active":"2024-04-26T12:43:15.024378+0000","last_peered":"2024-04-26T12:43:15.024378+0000","last_clean":"2024-04-26T12:43:15.024378+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:43:15.024378+0000","last_undegraded":"2024-04-26T12:43:15.024378+0000","last_fullsized":"2024-04-26T12:43:15.024378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'66","last_scrub_stamp":"2024-04-26T12:43:15.024133+0000","last_deep_scrub":"139'66","last_deep_scrub_stamp":"2024-04-26T12:43:15.024133+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.024133+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:43.770855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":76,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"139'4","reported_seq":348,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.632383+0000","last_change":"2024-04-26T12:43:05.632454+0000","last_active":"2024-04-26T12:43:05.632383+0000","last_peered":"2024-04-26T12:43:05.632383+0000","last_clean":"2024-04-26T12:43:05.632383+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:43:05.632383+0000","last_undegraded":"2024-04-26T12:43:05.632383+0000","last_fullsized":"2024-04-26T12:43:05.632383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'4","last_scrub_stamp":"2024-04-26T12:43:05.632196+0000","last_deep_scrub":"139'4","last_deep_scrub_stamp":"2024-04-26T12:43:05.632196+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.632196+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:14.699365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"139'26","reported_seq":333,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.882265+0000","last_change":"2024-04-26T12:43:15.882347+0000","last_active":"2024-04-26T12:43:15.882265+0000","last_peered":"2024-04-26T12:43:15.882265+0000","last_clean":"2024-04-26T12:43:15.882265+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:43:15.882265+0000","last_undegraded":"2024-04-26T12:43:15.882265+0000","last_fullsized":"2024-04-26T12:43:15.882265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:15.882042+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:15.882042+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.882042+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:59.019050+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.442092+0000","last_change":"2024-04-26T12:43:16.442222+0000","last_active":"2024-04-26T12:43:16.442092+0000","last_peered":"2024-04-26T12:43:16.442092+0000","last_clean":"2024-04-26T12:43:16.442092+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:43:16.442092+0000","last_undegraded":"2024-04-26T12:43:16.442092+0000","last_fullsized":"2024-04-26T12:43:16.442092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:16.441866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:16.441866+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.441866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:46.860759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"139'2","reported_seq":222,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.188557+0000","last_change":"2024-04-26T12:43:32.188633+0000","last_active":"2024-04-26T12:43:32.188557+0000","last_peered":"2024-04-26T12:43:32.188557+0000","last_clean":"2024-04-26T12:43:32.188557+0000","last_became_active":"2024-04-26T12:42:21.928602+0000","last_became_peered":"2024-04-26T12:42:21.928602+0000","last_unstale":"2024-04-26T12:43:32.188557+0000","last_undegraded":"2024-04-26T12:43:32.188557+0000","last_fullsized":"2024-04-26T12:43:32.188557+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'2","last_scrub_stamp":"2024-04-26T12:43:32.188350+0000","last_deep_scrub":"139'2","last_deep_scrub_stamp":"2024-04-26T12:43:32.188350+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.188350+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:08.051364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.094528+0000","last_change":"2024-04-26T12:43:18.094672+0000","last_active":"2024-04-26T12:43:18.094528+0000","last_peered":"2024-04-26T12:43:18.094528+0000","last_clean":"2024-04-26T12:43:18.094528+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:43:18.094528+0000","last_undegraded":"2024-04-26T12:43:18.094528+0000","last_fullsized":"2024-04-26T12:43:18.094528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'8","last_scrub_stamp":"2024-04-26T12:43:18.094171+0000","last_deep_scrub":"74'8","last_deep_scrub_stamp":"2024-04-26T12:43:18.094171+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.094171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:29.838455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.207704+0000","last_change":"2024-04-26T12:43:20.207833+0000","last_active":"2024-04-26T12:43:20.207704+0000","last_peered":"2024-04-26T12:43:20.207704+0000","last_clean":"2024-04-26T12:43:20.207704+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:43:20.207704+0000","last_undegraded":"2024-04-26T12:43:20.207704+0000","last_fullsized":"2024-04-26T12:43:20.207704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:20.207457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:20.207457+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.207457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:07.143400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"139'36","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.659419+0000","last_change":"2024-04-26T12:43:20.659481+0000","last_active":"2024-04-26T12:43:20.659419+0000","last_peered":"2024-04-26T12:43:20.659419+0000","last_clean":"2024-04-26T12:43:20.659419+0000","last_became_active":"2024-04-26T12:42:34.004041+0000","last_became_peered":"2024-04-26T12:42:34.004041+0000","last_unstale":"2024-04-26T12:43:20.659419+0000","last_undegraded":"2024-04-26T12:43:20.659419+0000","last_fullsized":"2024-04-26T12:43:20.659419+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:20.659230+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:20.659230+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.659230+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:10.313531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.229773+0000","last_change":"2024-04-26T12:43:07.229827+0000","last_active":"2024-04-26T12:43:07.229773+0000","last_peered":"2024-04-26T12:43:07.229773+0000","last_clean":"2024-04-26T12:43:07.229773+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:43:07.229773+0000","last_undegraded":"2024-04-26T12:43:07.229773+0000","last_fullsized":"2024-04-26T12:43:07.229773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:07.229566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:07.229566+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.229566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:05.835538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"139'19","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.214936+0000","last_change":"2024-04-26T12:43:20.215012+0000","last_active":"2024-04-26T12:43:20.214936+0000","last_peered":"2024-04-26T12:43:20.214936+0000","last_clean":"2024-04-26T12:43:20.214936+0000","last_became_active":"2024-04-26T12:42:21.942937+0000","last_became_peered":"2024-04-26T12:42:21.942937+0000","last_unstale":"2024-04-26T12:43:20.214936+0000","last_undegraded":"2024-04-26T12:43:20.214936+0000","last_fullsized":"2024-04-26T12:43:20.214936+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'19","last_scrub_stamp":"2024-04-26T12:43:20.214734+0000","last_deep_scrub":"139'19","last_deep_scrub_stamp":"2024-04-26T12:43:20.214734+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.214734+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:50.148019+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.678142+0000","last_change":"2024-04-26T12:43:19.678195+0000","last_active":"2024-04-26T12:43:19.678142+0000","last_peered":"2024-04-26T12:43:19.678142+0000","last_clean":"2024-04-26T12:43:19.678142+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:43:19.678142+0000","last_undegraded":"2024-04-26T12:43:19.678142+0000","last_fullsized":"2024-04-26T12:43:19.678142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:19.677940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:19.677940+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.677940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:51.439428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.257733+0000","last_change":"2024-04-26T12:43:31.257796+0000","last_active":"2024-04-26T12:43:31.257733+0000","last_peered":"2024-04-26T12:43:31.257733+0000","last_clean":"2024-04-26T12:43:31.257733+0000","last_became_active":"2024-04-26T12:42:21.941954+0000","last_became_peered":"2024-04-26T12:42:21.941954+0000","last_unstale":"2024-04-26T12:43:31.257733+0000","last_undegraded":"2024-04-26T12:43:31.257733+0000","last_fullsized":"2024-04-26T12:43:31.257733+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-04-26T12:43:31.257520+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-04-26T12:43:31.257520+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.257520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:12.300791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.935762+0000","last_change":"2024-04-26T12:43:09.935829+0000","last_active":"2024-04-26T12:43:09.935762+0000","last_peered":"2024-04-26T12:43:09.935762+0000","last_clean":"2024-04-26T12:43:09.935762+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:43:09.935762+0000","last_undegraded":"2024-04-26T12:43:09.935762+0000","last_fullsized":"2024-04-26T12:43:09.935762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:43:09.935517+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:43:09.935517+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.935517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:29.052334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'52","reported_seq":322,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.228505+0000","last_change":"2024-04-26T12:42:59.228566+0000","last_active":"2024-04-26T12:42:59.228505+0000","last_peered":"2024-04-26T12:42:59.228505+0000","last_clean":"2024-04-26T12:42:59.228505+0000","last_became_active":"2024-04-26T12:42:21.923345+0000","last_became_peered":"2024-04-26T12:42:21.923345+0000","last_unstale":"2024-04-26T12:42:59.228505+0000","last_undegraded":"2024-04-26T12:42:59.228505+0000","last_fullsized":"2024-04-26T12:42:59.228505+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'52","last_scrub_stamp":"2024-04-26T12:42:59.228284+0000","last_deep_scrub":"139'52","last_deep_scrub_stamp":"2024-04-26T12:42:59.228284+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.228284+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:49.470394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.939391+0000","last_change":"2024-04-26T12:43:11.939446+0000","last_active":"2024-04-26T12:43:11.939391+0000","last_peered":"2024-04-26T12:43:11.939391+0000","last_clean":"2024-04-26T12:43:11.939391+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:43:11.939391+0000","last_undegraded":"2024-04-26T12:43:11.939391+0000","last_fullsized":"2024-04-26T12:43:11.939391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:11.939178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:11.939178+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.939178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:02.497049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.212612+0000","last_change":"2024-04-26T12:43:04.212666+0000","last_active":"2024-04-26T12:43:04.212612+0000","last_peered":"2024-04-26T12:43:04.212612+0000","last_clean":"2024-04-26T12:43:04.212612+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:43:04.212612+0000","last_undegraded":"2024-04-26T12:43:04.212612+0000","last_fullsized":"2024-04-26T12:43:04.212612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.212416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.212416+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.212416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:24.999017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"139'48","reported_seq":326,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.450009+0000","last_change":"2024-04-26T12:43:32.450106+0000","last_active":"2024-04-26T12:43:32.450009+0000","last_peered":"2024-04-26T12:43:32.450009+0000","last_clean":"2024-04-26T12:43:32.450009+0000","last_became_active":"2024-04-26T12:42:21.956451+0000","last_became_peered":"2024-04-26T12:42:21.956451+0000","last_unstale":"2024-04-26T12:43:32.450009+0000","last_undegraded":"2024-04-26T12:43:32.450009+0000","last_fullsized":"2024-04-26T12:43:32.450009+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:32.449818+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:32.449818+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.449818+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:38.795688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":213,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.697649+0000","last_change":"2024-04-26T12:43:16.697707+0000","last_active":"2024-04-26T12:43:16.697649+0000","last_peered":"2024-04-26T12:43:16.697649+0000","last_clean":"2024-04-26T12:43:16.697649+0000","last_became_active":"2024-04-26T12:42:34.014949+0000","last_became_peered":"2024-04-26T12:42:34.014949+0000","last_unstale":"2024-04-26T12:43:16.697649+0000","last_undegraded":"2024-04-26T12:43:16.697649+0000","last_fullsized":"2024-04-26T12:43:16.697649+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:16.697451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:16.697451+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.697451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:32.207309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.161144+0000","last_change":"2024-04-26T12:42:58.161182+0000","last_active":"2024-04-26T12:42:58.161144+0000","last_peered":"2024-04-26T12:42:58.161144+0000","last_clean":"2024-04-26T12:42:58.161144+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:42:58.161144+0000","last_undegraded":"2024-04-26T12:42:58.161144+0000","last_fullsized":"2024-04-26T12:42:58.161144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:58.160999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:58.160999+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.160999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:47.990505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.352611+0000","last_change":"2024-04-26T12:43:13.352776+0000","last_active":"2024-04-26T12:43:13.352611+0000","last_peered":"2024-04-26T12:43:13.352611+0000","last_clean":"2024-04-26T12:43:13.352611+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:43:13.352611+0000","last_undegraded":"2024-04-26T12:43:13.352611+0000","last_fullsized":"2024-04-26T12:43:13.352611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:13.352310+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:13.352310+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.352310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:13.713815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"139'62","reported_seq":323,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.028784+0000","last_change":"2024-04-26T12:43:14.028907+0000","last_active":"2024-04-26T12:43:14.028784+0000","last_peered":"2024-04-26T12:43:14.028784+0000","last_clean":"2024-04-26T12:43:14.028784+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:43:14.028784+0000","last_undegraded":"2024-04-26T12:43:14.028784+0000","last_fullsized":"2024-04-26T12:43:14.028784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'62","last_scrub_stamp":"2024-04-26T12:43:14.028520+0000","last_deep_scrub":"139'62","last_deep_scrub_stamp":"2024-04-26T12:43:14.028520+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.028520+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:57.165528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.868181+0000","last_change":"2024-04-26T12:43:18.868233+0000","last_active":"2024-04-26T12:43:18.868181+0000","last_peered":"2024-04-26T12:43:18.868181+0000","last_clean":"2024-04-26T12:43:18.868181+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:43:18.868181+0000","last_undegraded":"2024-04-26T12:43:18.868181+0000","last_fullsized":"2024-04-26T12:43:18.868181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:18.867983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:18.867983+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.867983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:46.665171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.573429+0000","last_change":"2024-04-26T12:43:00.573485+0000","last_active":"2024-04-26T12:43:00.573429+0000","last_peered":"2024-04-26T12:43:00.573429+0000","last_clean":"2024-04-26T12:43:00.573429+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:43:00.573429+0000","last_undegraded":"2024-04-26T12:43:00.573429+0000","last_fullsized":"2024-04-26T12:43:00.573429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.573216+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:13.231544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"139'21","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.883931+0000","last_change":"2024-04-26T12:43:04.884109+0000","last_active":"2024-04-26T12:43:04.883931+0000","last_peered":"2024-04-26T12:43:04.883931+0000","last_clean":"2024-04-26T12:43:04.883931+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:43:04.883931+0000","last_undegraded":"2024-04-26T12:43:04.883931+0000","last_fullsized":"2024-04-26T12:43:04.883931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'21","last_scrub_stamp":"2024-04-26T12:43:04.883646+0000","last_deep_scrub":"139'21","last_deep_scrub_stamp":"2024-04-26T12:43:04.883646+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.883646+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:42.204808+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"139'138","reported_seq":439,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.159003+0000","last_change":"2024-04-26T12:43:16.159078+0000","last_active":"2024-04-26T12:43:16.159003+0000","last_peered":"2024-04-26T12:43:16.159003+0000","last_clean":"2024-04-26T12:43:16.159003+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:43:16.159003+0000","last_undegraded":"2024-04-26T12:43:16.159003+0000","last_fullsized":"2024-04-26T12:43:16.159003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:16.158784+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:16.158784+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.158784+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:27.113662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":228,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.301903+0000","last_change":"2024-04-26T12:43:15.301974+0000","last_active":"2024-04-26T12:43:15.301903+0000","last_peered":"2024-04-26T12:43:15.301903+0000","last_clean":"2024-04-26T12:43:15.301903+0000","last_became_active":"2024-04-26T12:42:21.960618+0000","last_became_peered":"2024-04-26T12:42:21.960618+0000","last_unstale":"2024-04-26T12:43:15.301903+0000","last_undegraded":"2024-04-26T12:43:15.301903+0000","last_fullsized":"2024-04-26T12:43:15.301903+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'3","last_scrub_stamp":"2024-04-26T12:43:15.301706+0000","last_deep_scrub":"68'3","last_deep_scrub_stamp":"2024-04-26T12:43:15.301706+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.301706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:43.780448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:33.219807+0000","last_change":"2024-04-26T12:43:33.219870+0000","last_active":"2024-04-26T12:43:33.219807+0000","last_peered":"2024-04-26T12:43:33.219807+0000","last_clean":"2024-04-26T12:43:33.219807+0000","last_became_active":"2024-04-26T12:42:21.960998+0000","last_became_peered":"2024-04-26T12:42:21.960998+0000","last_unstale":"2024-04-26T12:43:33.219807+0000","last_undegraded":"2024-04-26T12:43:33.219807+0000","last_fullsized":"2024-04-26T12:43:33.219807+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:33.219588+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:33.219588+0000","last_clean_scrub_stamp":"2024-04-26T12:43:33.219588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:34.137353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"139'54","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.266517+0000","last_change":"2024-04-26T12:42:58.266580+0000","last_active":"2024-04-26T12:42:58.266517+0000","last_peered":"2024-04-26T12:42:58.266517+0000","last_clean":"2024-04-26T12:42:58.266517+0000","last_became_active":"2024-04-26T12:42:21.968901+0000","last_became_peered":"2024-04-26T12:42:21.968901+0000","last_unstale":"2024-04-26T12:42:58.266517+0000","last_undegraded":"2024-04-26T12:42:58.266517+0000","last_fullsized":"2024-04-26T12:42:58.266517+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:42:58.266315+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:42:58.266315+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.266315+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:20.120407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.909328+0000","last_change":"2024-04-26T12:43:10.909424+0000","last_active":"2024-04-26T12:43:10.909328+0000","last_peered":"2024-04-26T12:43:10.909328+0000","last_clean":"2024-04-26T12:43:10.909328+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:43:10.909328+0000","last_undegraded":"2024-04-26T12:43:10.909328+0000","last_fullsized":"2024-04-26T12:43:10.909328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:10.909043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:10.909043+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.909043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:58.975101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.736160+0000","last_change":"2024-04-26T12:43:12.736215+0000","last_active":"2024-04-26T12:43:12.736160+0000","last_peered":"2024-04-26T12:43:12.736160+0000","last_clean":"2024-04-26T12:43:12.736160+0000","last_became_active":"2024-04-26T12:42:34.015774+0000","last_became_peered":"2024-04-26T12:42:34.015774+0000","last_unstale":"2024-04-26T12:43:12.736160+0000","last_undegraded":"2024-04-26T12:43:12.736160+0000","last_fullsized":"2024-04-26T12:43:12.736160+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:12.735961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:12.735961+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.735961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:59.671904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"139'15","reported_seq":85,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.703854+0000","last_change":"2024-04-26T12:43:30.703930+0000","last_active":"2024-04-26T12:43:30.703854+0000","last_peered":"2024-04-26T12:43:30.703854+0000","last_clean":"2024-04-26T12:43:30.703854+0000","last_became_active":"2024-04-26T12:42:34.029037+0000","last_became_peered":"2024-04-26T12:42:34.029037+0000","last_unstale":"2024-04-26T12:43:30.703854+0000","last_undegraded":"2024-04-26T12:43:30.703854+0000","last_fullsized":"2024-04-26T12:43:30.703854+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'15","last_scrub_stamp":"2024-04-26T12:43:30.703675+0000","last_deep_scrub":"139'15","last_deep_scrub_stamp":"2024-04-26T12:43:30.703675+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.703675+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.551338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"139'140","reported_seq":426,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.362564+0000","last_change":"2024-04-26T12:43:03.362634+0000","last_active":"2024-04-26T12:43:03.362564+0000","last_peered":"2024-04-26T12:43:03.362564+0000","last_clean":"2024-04-26T12:43:03.362564+0000","last_became_active":"2024-04-26T12:42:21.962332+0000","last_became_peered":"2024-04-26T12:42:21.962332+0000","last_unstale":"2024-04-26T12:43:03.362564+0000","last_undegraded":"2024-04-26T12:43:03.362564+0000","last_fullsized":"2024-04-26T12:43:03.362564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'140","last_scrub_stamp":"2024-04-26T12:43:03.362373+0000","last_deep_scrub":"139'140","last_deep_scrub_stamp":"2024-04-26T12:43:03.362373+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.362373+0000","objects_scrubbed":1,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:17.592743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.409296+0000","last_change":"2024-04-26T12:43:31.409381+0000","last_active":"2024-04-26T12:43:31.409296+0000","last_peered":"2024-04-26T12:43:31.409296+0000","last_clean":"2024-04-26T12:43:31.409296+0000","last_became_active":"2024-04-26T12:42:21.956715+0000","last_became_peered":"2024-04-26T12:42:21.956715+0000","last_unstale":"2024-04-26T12:43:31.409296+0000","last_undegraded":"2024-04-26T12:43:31.409296+0000","last_fullsized":"2024-04-26T12:43:31.409296+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:31.409064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:31.409064+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.409064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:45.009262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":124,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.594461+0000","last_change":"2024-04-26T12:43:24.594527+0000","last_active":"2024-04-26T12:43:24.594461+0000","last_peered":"2024-04-26T12:43:24.594461+0000","last_clean":"2024-04-26T12:43:24.594461+0000","last_became_active":"2024-04-26T12:42:34.010800+0000","last_became_peered":"2024-04-26T12:42:34.010800+0000","last_unstale":"2024-04-26T12:43:24.594461+0000","last_undegraded":"2024-04-26T12:43:24.594461+0000","last_fullsized":"2024-04-26T12:43:24.594461+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:24.594262+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:24.594262+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.594262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:09.822908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"139'46","reported_seq":308,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.380642+0000","last_change":"2024-04-26T12:43:20.380725+0000","last_active":"2024-04-26T12:43:20.380642+0000","last_peered":"2024-04-26T12:43:20.380642+0000","last_clean":"2024-04-26T12:43:20.380642+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:43:20.380642+0000","last_undegraded":"2024-04-26T12:43:20.380642+0000","last_fullsized":"2024-04-26T12:43:20.380642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'46","last_scrub_stamp":"2024-04-26T12:43:20.380437+0000","last_deep_scrub":"139'46","last_deep_scrub_stamp":"2024-04-26T12:43:20.380437+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.380437+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:11.385155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.546974+0000","last_change":"2024-04-26T12:43:08.547033+0000","last_active":"2024-04-26T12:43:08.546974+0000","last_peered":"2024-04-26T12:43:08.546974+0000","last_clean":"2024-04-26T12:43:08.546974+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:43:08.546974+0000","last_undegraded":"2024-04-26T12:43:08.546974+0000","last_fullsized":"2024-04-26T12:43:08.546974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:08.546762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:08.546762+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.546762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:04.800474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.190774+0000","last_change":"2024-04-26T12:43:31.190828+0000","last_active":"2024-04-26T12:43:31.190774+0000","last_peered":"2024-04-26T12:43:31.190774+0000","last_clean":"2024-04-26T12:43:31.190774+0000","last_became_active":"2024-04-26T12:42:21.926472+0000","last_became_peered":"2024-04-26T12:42:21.926472+0000","last_unstale":"2024-04-26T12:43:31.190774+0000","last_undegraded":"2024-04-26T12:43:31.190774+0000","last_fullsized":"2024-04-26T12:43:31.190774+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:31.190570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:31.190570+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.190570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:12.398445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"139'57","reported_seq":333,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.815299+0000","last_change":"2024-04-26T12:43:11.815386+0000","last_active":"2024-04-26T12:43:11.815299+0000","last_peered":"2024-04-26T12:43:11.815299+0000","last_clean":"2024-04-26T12:43:11.815299+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:43:11.815299+0000","last_undegraded":"2024-04-26T12:43:11.815299+0000","last_fullsized":"2024-04-26T12:43:11.815299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'57","last_scrub_stamp":"2024-04-26T12:43:11.815105+0000","last_deep_scrub":"139'57","last_deep_scrub_stamp":"2024-04-26T12:43:11.815105+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.815105+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:24.120399+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.127903+0000","last_change":"2024-04-26T12:43:25.128019+0000","last_active":"2024-04-26T12:43:25.127903+0000","last_peered":"2024-04-26T12:43:25.127903+0000","last_clean":"2024-04-26T12:43:25.127903+0000","last_became_active":"2024-04-26T12:42:21.918031+0000","last_became_peered":"2024-04-26T12:42:21.918031+0000","last_unstale":"2024-04-26T12:43:25.127903+0000","last_undegraded":"2024-04-26T12:43:25.127903+0000","last_fullsized":"2024-04-26T12:43:25.127903+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:25.127670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:25.127670+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.127670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:50.102254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.293486+0000","last_change":"2024-04-26T12:43:28.293547+0000","last_active":"2024-04-26T12:43:28.293486+0000","last_peered":"2024-04-26T12:43:28.293486+0000","last_clean":"2024-04-26T12:43:28.293486+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:43:28.293486+0000","last_undegraded":"2024-04-26T12:43:28.293486+0000","last_fullsized":"2024-04-26T12:43:28.293486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:28.293291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:28.293291+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.293291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:17.947592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.204130+0000","last_change":"2024-04-26T12:42:59.204187+0000","last_active":"2024-04-26T12:42:59.204130+0000","last_peered":"2024-04-26T12:42:59.204130+0000","last_clean":"2024-04-26T12:42:59.204130+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:42:59.204130+0000","last_undegraded":"2024-04-26T12:42:59.204130+0000","last_fullsized":"2024-04-26T12:42:59.204130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'7","last_scrub_stamp":"2024-04-26T12:42:59.203938+0000","last_deep_scrub":"91'7","last_deep_scrub_stamp":"2024-04-26T12:42:59.203938+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.203938+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:17.572158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":195,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.697773+0000","last_change":"2024-04-26T12:43:15.697902+0000","last_active":"2024-04-26T12:43:15.697773+0000","last_peered":"2024-04-26T12:43:15.697773+0000","last_clean":"2024-04-26T12:43:15.697773+0000","last_became_active":"2024-04-26T12:42:34.022792+0000","last_became_peered":"2024-04-26T12:42:34.022792+0000","last_unstale":"2024-04-26T12:43:15.697773+0000","last_undegraded":"2024-04-26T12:43:15.697773+0000","last_fullsized":"2024-04-26T12:43:15.697773+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'2","last_scrub_stamp":"2024-04-26T12:43:15.697480+0000","last_deep_scrub":"104'2","last_deep_scrub_stamp":"2024-04-26T12:43:15.697480+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.697480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:46.116374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"139'40","reported_seq":250,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.628536+0000","last_change":"2024-04-26T12:43:25.628601+0000","last_active":"2024-04-26T12:43:25.628536+0000","last_peered":"2024-04-26T12:43:25.628536+0000","last_clean":"2024-04-26T12:43:25.628536+0000","last_became_active":"2024-04-26T12:42:34.008295+0000","last_became_peered":"2024-04-26T12:42:34.008295+0000","last_unstale":"2024-04-26T12:43:25.628536+0000","last_undegraded":"2024-04-26T12:43:25.628536+0000","last_fullsized":"2024-04-26T12:43:25.628536+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:25.628341+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:25.628341+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.628341+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:23.734125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.925045+0000","last_change":"2024-04-26T12:42:57.925077+0000","last_active":"2024-04-26T12:42:57.925045+0000","last_peered":"2024-04-26T12:42:57.925045+0000","last_clean":"2024-04-26T12:42:57.925045+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:42:57.925045+0000","last_undegraded":"2024-04-26T12:42:57.925045+0000","last_fullsized":"2024-04-26T12:42:57.925045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:57.924946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:57.924946+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.924946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:20.467638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"139'26","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.331838+0000","last_change":"2024-04-26T12:43:06.331924+0000","last_active":"2024-04-26T12:43:06.331838+0000","last_peered":"2024-04-26T12:43:06.331838+0000","last_clean":"2024-04-26T12:43:06.331838+0000","last_became_active":"2024-04-26T12:42:21.964467+0000","last_became_peered":"2024-04-26T12:42:21.964467+0000","last_unstale":"2024-04-26T12:43:06.331838+0000","last_undegraded":"2024-04-26T12:43:06.331838+0000","last_fullsized":"2024-04-26T12:43:06.331838+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:06.331620+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:06.331620+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.331620+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:10.579086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.197069+0000","last_change":"2024-04-26T12:43:21.197127+0000","last_active":"2024-04-26T12:43:21.197069+0000","last_peered":"2024-04-26T12:43:21.197069+0000","last_clean":"2024-04-26T12:43:21.197069+0000","last_became_active":"2024-04-26T12:42:21.959360+0000","last_became_peered":"2024-04-26T12:42:21.959360+0000","last_unstale":"2024-04-26T12:43:21.197069+0000","last_undegraded":"2024-04-26T12:43:21.197069+0000","last_fullsized":"2024-04-26T12:43:21.197069+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:21.196835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:21.196835+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.196835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:46.891982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.309941+0000","last_change":"2024-04-26T12:43:01.310002+0000","last_active":"2024-04-26T12:43:01.309941+0000","last_peered":"2024-04-26T12:43:01.309941+0000","last_clean":"2024-04-26T12:43:01.309941+0000","last_became_active":"2024-04-26T12:42:21.968658+0000","last_became_peered":"2024-04-26T12:42:21.968658+0000","last_unstale":"2024-04-26T12:43:01.309941+0000","last_undegraded":"2024-04-26T12:43:01.309941+0000","last_fullsized":"2024-04-26T12:43:01.309941+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.309721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.309721+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.309721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:16.498477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.889190+0000","last_change":"2024-04-26T12:43:01.889248+0000","last_active":"2024-04-26T12:43:01.889190+0000","last_peered":"2024-04-26T12:43:01.889190+0000","last_clean":"2024-04-26T12:43:01.889190+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:43:01.889190+0000","last_undegraded":"2024-04-26T12:43:01.889190+0000","last_fullsized":"2024-04-26T12:43:01.889190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.888989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.888989+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.888989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:12.267511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"139'46","reported_seq":312,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.941948+0000","last_change":"2024-04-26T12:43:31.942018+0000","last_active":"2024-04-26T12:43:31.941948+0000","last_peered":"2024-04-26T12:43:31.941948+0000","last_clean":"2024-04-26T12:43:31.941948+0000","last_became_active":"2024-04-26T12:42:21.955428+0000","last_became_peered":"2024-04-26T12:42:21.955428+0000","last_unstale":"2024-04-26T12:43:31.941948+0000","last_undegraded":"2024-04-26T12:43:31.941948+0000","last_fullsized":"2024-04-26T12:43:31.941948+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'46","last_scrub_stamp":"2024-04-26T12:43:31.941744+0000","last_deep_scrub":"139'46","last_deep_scrub_stamp":"2024-04-26T12:43:31.941744+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.941744+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:02.360638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:34.216081+0000","last_change":"2024-04-26T12:43:34.216146+0000","last_active":"2024-04-26T12:43:34.216081+0000","last_peered":"2024-04-26T12:43:34.216081+0000","last_clean":"2024-04-26T12:43:34.216081+0000","last_became_active":"2024-04-26T12:42:21.964554+0000","last_became_peered":"2024-04-26T12:42:21.964554+0000","last_unstale":"2024-04-26T12:43:34.216081+0000","last_undegraded":"2024-04-26T12:43:34.216081+0000","last_fullsized":"2024-04-26T12:43:34.216081+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:34.215845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:34.215845+0000","last_clean_scrub_stamp":"2024-04-26T12:43:34.215845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:15.463239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"139'12","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.249419+0000","last_change":"2024-04-26T12:43:10.249501+0000","last_active":"2024-04-26T12:43:10.249419+0000","last_peered":"2024-04-26T12:43:10.249419+0000","last_clean":"2024-04-26T12:43:10.249419+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:43:10.249419+0000","last_undegraded":"2024-04-26T12:43:10.249419+0000","last_fullsized":"2024-04-26T12:43:10.249419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'12","last_scrub_stamp":"2024-04-26T12:43:10.249209+0000","last_deep_scrub":"139'12","last_deep_scrub_stamp":"2024-04-26T12:43:10.249209+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.249209+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:37.644219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.904953+0000","last_change":"2024-04-26T12:42:59.905038+0000","last_active":"2024-04-26T12:42:59.904953+0000","last_peered":"2024-04-26T12:42:59.904953+0000","last_clean":"2024-04-26T12:42:59.904953+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:42:59.904953+0000","last_undegraded":"2024-04-26T12:42:59.904953+0000","last_fullsized":"2024-04-26T12:42:59.904953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:59.904710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:59.904710+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.904710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:56.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.245163+0000","last_change":"2024-04-26T12:43:00.245163+0000","last_active":"2024-04-26T12:43:00.245163+0000","last_peered":"2024-04-26T12:43:00.245163+0000","last_clean":"2024-04-26T12:43:00.245163+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:43:00.245163+0000","last_undegraded":"2024-04-26T12:43:00.245163+0000","last_fullsized":"2024-04-26T12:43:00.245163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:00.244880+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:00.244880+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.244880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.477564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.350436+0000","last_change":"2024-04-26T12:43:04.350508+0000","last_active":"2024-04-26T12:43:04.350436+0000","last_peered":"2024-04-26T12:43:04.350436+0000","last_clean":"2024-04-26T12:43:04.350436+0000","last_became_active":"2024-04-26T12:42:21.965760+0000","last_became_peered":"2024-04-26T12:42:21.965760+0000","last_unstale":"2024-04-26T12:43:04.350436+0000","last_undegraded":"2024-04-26T12:43:04.350436+0000","last_fullsized":"2024-04-26T12:43:04.350436+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'10","last_scrub_stamp":"2024-04-26T12:43:04.350211+0000","last_deep_scrub":"74'10","last_deep_scrub_stamp":"2024-04-26T12:43:04.350211+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.350211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.688741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"139'54","reported_seq":317,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.209612+0000","last_change":"2024-04-26T12:43:22.209672+0000","last_active":"2024-04-26T12:43:22.209612+0000","last_peered":"2024-04-26T12:43:22.209612+0000","last_clean":"2024-04-26T12:43:22.209612+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:43:22.209612+0000","last_undegraded":"2024-04-26T12:43:22.209612+0000","last_fullsized":"2024-04-26T12:43:22.209612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:22.209397+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:22.209397+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.209397+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:19.316413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.815707+0000","last_change":"2024-04-26T12:43:04.815767+0000","last_active":"2024-04-26T12:43:04.815707+0000","last_peered":"2024-04-26T12:43:04.815707+0000","last_clean":"2024-04-26T12:43:04.815707+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:43:04.815707+0000","last_undegraded":"2024-04-26T12:43:04.815707+0000","last_fullsized":"2024-04-26T12:43:04.815707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.815514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.815514+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.815514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:16.926940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"139'22","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.875637+0000","last_change":"2024-04-26T12:42:21.974557+0000","last_active":"2024-04-26T12:42:52.875637+0000","last_peered":"2024-04-26T12:42:52.875637+0000","last_clean":"2024-04-26T12:42:52.875637+0000","last_became_active":"2024-04-26T12:42:21.967735+0000","last_became_peered":"2024-04-26T12:42:21.967735+0000","last_unstale":"2024-04-26T12:42:52.875637+0000","last_undegraded":"2024-04-26T12:42:52.875637+0000","last_fullsized":"2024-04-26T12:42:52.875637+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.609437+0000","last_change":"2024-04-26T12:43:17.609493+0000","last_active":"2024-04-26T12:43:17.609437+0000","last_peered":"2024-04-26T12:43:17.609437+0000","last_clean":"2024-04-26T12:43:17.609437+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:43:17.609437+0000","last_undegraded":"2024-04-26T12:43:17.609437+0000","last_fullsized":"2024-04-26T12:43:17.609437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:17.609242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:17.609242+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.609242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:30.698690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.215345+0000","last_change":"2024-04-26T12:43:18.215345+0000","last_active":"2024-04-26T12:43:18.215345+0000","last_peered":"2024-04-26T12:43:18.215345+0000","last_clean":"2024-04-26T12:43:18.215345+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:43:18.215345+0000","last_undegraded":"2024-04-26T12:43:18.215345+0000","last_fullsized":"2024-04-26T12:43:18.215345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:18.215089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:18.215089+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.215089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:45.176558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.170420+0000","last_change":"2024-04-26T12:43:22.170546+0000","last_active":"2024-04-26T12:43:22.170420+0000","last_peered":"2024-04-26T12:43:22.170420+0000","last_clean":"2024-04-26T12:43:22.170420+0000","last_became_active":"2024-04-26T12:42:21.927785+0000","last_became_peered":"2024-04-26T12:42:21.927785+0000","last_unstale":"2024-04-26T12:43:22.170420+0000","last_undegraded":"2024-04-26T12:43:22.170420+0000","last_fullsized":"2024-04-26T12:43:22.170420+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:22.170154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:22.170154+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.170154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:02.056224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'40","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.381760+0000","last_change":"2024-04-26T12:43:23.381946+0000","last_active":"2024-04-26T12:43:23.381760+0000","last_peered":"2024-04-26T12:43:23.381760+0000","last_clean":"2024-04-26T12:43:23.381760+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:43:23.381760+0000","last_undegraded":"2024-04-26T12:43:23.381760+0000","last_fullsized":"2024-04-26T12:43:23.381760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:23.381511+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:23.381511+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.381511+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:37.463314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.587829+0000","last_change":"2024-04-26T12:43:02.587882+0000","last_active":"2024-04-26T12:43:02.587829+0000","last_peered":"2024-04-26T12:43:02.587829+0000","last_clean":"2024-04-26T12:43:02.587829+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:43:02.587829+0000","last_undegraded":"2024-04-26T12:43:02.587829+0000","last_fullsized":"2024-04-26T12:43:02.587829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:02.587599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:02.587599+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.587599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:22.846905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"139'26","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.803425+0000","last_change":"2024-04-26T12:43:09.803503+0000","last_active":"2024-04-26T12:43:09.803425+0000","last_peered":"2024-04-26T12:43:09.803425+0000","last_clean":"2024-04-26T12:43:09.803425+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:43:09.803425+0000","last_undegraded":"2024-04-26T12:43:09.803425+0000","last_fullsized":"2024-04-26T12:43:09.803425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:09.803242+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:09.803242+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.803242+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:38.691811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.213041+0000","last_change":"2024-04-26T12:43:03.213170+0000","last_active":"2024-04-26T12:43:03.213041+0000","last_peered":"2024-04-26T12:43:03.213041+0000","last_clean":"2024-04-26T12:43:03.213041+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:43:03.213041+0000","last_undegraded":"2024-04-26T12:43:03.213041+0000","last_fullsized":"2024-04-26T12:43:03.213041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.212745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.212745+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.212745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:14.957028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.609440+0000","last_change":"2024-04-26T12:42:59.609502+0000","last_active":"2024-04-26T12:42:59.609440+0000","last_peered":"2024-04-26T12:42:59.609440+0000","last_clean":"2024-04-26T12:42:59.609440+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:42:59.609440+0000","last_undegraded":"2024-04-26T12:42:59.609440+0000","last_fullsized":"2024-04-26T12:42:59.609440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:42:59.609236+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:42:59.609236+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.609236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:52.593677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"139'30","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.374573+0000","last_change":"2024-04-26T12:43:05.374641+0000","last_active":"2024-04-26T12:43:05.374573+0000","last_peered":"2024-04-26T12:43:05.374573+0000","last_clean":"2024-04-26T12:43:05.374573+0000","last_became_active":"2024-04-26T12:42:21.964241+0000","last_became_peered":"2024-04-26T12:42:21.964241+0000","last_unstale":"2024-04-26T12:43:05.374573+0000","last_undegraded":"2024-04-26T12:43:05.374573+0000","last_fullsized":"2024-04-26T12:43:05.374573+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'30","last_scrub_stamp":"2024-04-26T12:43:05.374357+0000","last_deep_scrub":"139'30","last_deep_scrub_stamp":"2024-04-26T12:43:05.374357+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.374357+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.842010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.249043+0000","last_change":"2024-04-26T12:43:05.249097+0000","last_active":"2024-04-26T12:43:05.249043+0000","last_peered":"2024-04-26T12:43:05.249043+0000","last_clean":"2024-04-26T12:43:05.249043+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:43:05.249043+0000","last_undegraded":"2024-04-26T12:43:05.249043+0000","last_fullsized":"2024-04-26T12:43:05.249043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:05.248837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:05.248837+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.248837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:12.372185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"139'37","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.911354+0000","last_change":"2024-04-26T12:43:02.911354+0000","last_active":"2024-04-26T12:43:02.911354+0000","last_peered":"2024-04-26T12:43:02.911354+0000","last_clean":"2024-04-26T12:43:02.911354+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:43:02.911354+0000","last_undegraded":"2024-04-26T12:43:02.911354+0000","last_fullsized":"2024-04-26T12:43:02.911354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'37","last_scrub_stamp":"2024-04-26T12:43:02.910944+0000","last_deep_scrub":"139'37","last_deep_scrub_stamp":"2024-04-26T12:43:02.910944+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.910944+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:02.364042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:33.266163+0000","last_change":"2024-04-26T12:43:33.266225+0000","last_active":"2024-04-26T12:43:33.266163+0000","last_peered":"2024-04-26T12:43:33.266163+0000","last_clean":"2024-04-26T12:43:33.266163+0000","last_became_active":"2024-04-26T12:42:21.946664+0000","last_became_peered":"2024-04-26T12:42:21.946664+0000","last_unstale":"2024-04-26T12:43:33.266163+0000","last_undegraded":"2024-04-26T12:43:33.266163+0000","last_fullsized":"2024-04-26T12:43:33.266163+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:33.265967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:33.265967+0000","last_clean_scrub_stamp":"2024-04-26T12:43:33.265967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:31.371752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":218,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.067956+0000","last_change":"2024-04-26T12:42:21.973393+0000","last_active":"2024-04-26T12:42:41.067956+0000","last_peered":"2024-04-26T12:42:41.067956+0000","last_clean":"2024-04-26T12:42:41.067956+0000","last_became_active":"2024-04-26T12:42:21.963727+0000","last_became_peered":"2024-04-26T12:42:21.963727+0000","last_unstale":"2024-04-26T12:42:41.067956+0000","last_undegraded":"2024-04-26T12:42:41.067956+0000","last_fullsized":"2024-04-26T12:42:41.067956+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:19.471910+0000","last_clean_scrub_stamp":"2024-04-26T12:38:19.471910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":314,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.205535+0000","last_change":"2024-04-26T12:43:09.205602+0000","last_active":"2024-04-26T12:43:09.205535+0000","last_peered":"2024-04-26T12:43:09.205535+0000","last_clean":"2024-04-26T12:43:09.205535+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:43:09.205535+0000","last_undegraded":"2024-04-26T12:43:09.205535+0000","last_fullsized":"2024-04-26T12:43:09.205535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-04-26T12:43:09.205329+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-04-26T12:43:09.205329+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.205329+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:20.160206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"139'64","reported_seq":332,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.129900+0000","last_change":"2024-04-26T12:43:23.130059+0000","last_active":"2024-04-26T12:43:23.129900+0000","last_peered":"2024-04-26T12:43:23.129900+0000","last_clean":"2024-04-26T12:43:23.129900+0000","last_became_active":"2024-04-26T12:42:21.933941+0000","last_became_peered":"2024-04-26T12:42:21.933941+0000","last_unstale":"2024-04-26T12:43:23.129900+0000","last_undegraded":"2024-04-26T12:43:23.129900+0000","last_fullsized":"2024-04-26T12:43:23.129900+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'64","last_scrub_stamp":"2024-04-26T12:43:23.129589+0000","last_deep_scrub":"139'64","last_deep_scrub_stamp":"2024-04-26T12:43:23.129589+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.129589+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:05.229027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.578199+0000","last_change":"2024-04-26T12:43:04.578253+0000","last_active":"2024-04-26T12:43:04.578199+0000","last_peered":"2024-04-26T12:43:04.578199+0000","last_clean":"2024-04-26T12:43:04.578199+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:43:04.578199+0000","last_undegraded":"2024-04-26T12:43:04.578199+0000","last_fullsized":"2024-04-26T12:43:04.578199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.577987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.577987+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.577987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:03.793769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"139'32","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.853150+0000","last_change":"2024-04-26T12:43:05.853150+0000","last_active":"2024-04-26T12:43:05.853150+0000","last_peered":"2024-04-26T12:43:05.853150+0000","last_clean":"2024-04-26T12:43:05.853150+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:43:05.853150+0000","last_undegraded":"2024-04-26T12:43:05.853150+0000","last_fullsized":"2024-04-26T12:43:05.853150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:05.852849+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:05.852849+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.852849+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:43.174011+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.948381+0000","last_change":"2024-04-26T12:43:06.948381+0000","last_active":"2024-04-26T12:43:06.948381+0000","last_peered":"2024-04-26T12:43:06.948381+0000","last_clean":"2024-04-26T12:43:06.948381+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:43:06.948381+0000","last_undegraded":"2024-04-26T12:43:06.948381+0000","last_fullsized":"2024-04-26T12:43:06.948381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:06.947999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:06.947999+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.947999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:02.613074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.621173+0000","last_change":"2024-04-26T12:43:21.621235+0000","last_active":"2024-04-26T12:43:21.621173+0000","last_peered":"2024-04-26T12:43:21.621173+0000","last_clean":"2024-04-26T12:43:21.621173+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:43:21.621173+0000","last_undegraded":"2024-04-26T12:43:21.621173+0000","last_fullsized":"2024-04-26T12:43:21.621173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'3","last_scrub_stamp":"2024-04-26T12:43:21.620920+0000","last_deep_scrub":"68'3","last_deep_scrub_stamp":"2024-04-26T12:43:21.620920+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.620920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:09.686978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.134825+0000","last_change":"2024-04-26T12:43:26.134944+0000","last_active":"2024-04-26T12:43:26.134825+0000","last_peered":"2024-04-26T12:43:26.134825+0000","last_clean":"2024-04-26T12:43:26.134825+0000","last_became_active":"2024-04-26T12:42:21.924628+0000","last_became_peered":"2024-04-26T12:42:21.924628+0000","last_unstale":"2024-04-26T12:43:26.134825+0000","last_undegraded":"2024-04-26T12:43:26.134825+0000","last_fullsized":"2024-04-26T12:43:26.134825+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:26.134543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:26.134543+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.134543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:19.960554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"139'42","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:34.680108+0000","last_change":"2024-04-26T12:43:34.680174+0000","last_active":"2024-04-26T12:43:34.680108+0000","last_peered":"2024-04-26T12:43:34.680108+0000","last_clean":"2024-04-26T12:43:34.680108+0000","last_became_active":"2024-04-26T12:42:34.034029+0000","last_became_peered":"2024-04-26T12:42:34.034029+0000","last_unstale":"2024-04-26T12:43:34.680108+0000","last_undegraded":"2024-04-26T12:43:34.680108+0000","last_fullsized":"2024-04-26T12:43:34.680108+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'42","last_scrub_stamp":"2024-04-26T12:43:34.679891+0000","last_deep_scrub":"139'42","last_deep_scrub_stamp":"2024-04-26T12:43:34.679891+0000","last_clean_scrub_stamp":"2024-04-26T12:43:34.679891+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:01.025304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.702999+0000","last_change":"2024-04-26T12:43:31.703118+0000","last_active":"2024-04-26T12:43:31.702999+0000","last_peered":"2024-04-26T12:43:31.702999+0000","last_clean":"2024-04-26T12:43:31.702999+0000","last_became_active":"2024-04-26T12:42:34.031261+0000","last_became_peered":"2024-04-26T12:42:34.031261+0000","last_unstale":"2024-04-26T12:43:31.702999+0000","last_undegraded":"2024-04-26T12:43:31.702999+0000","last_fullsized":"2024-04-26T12:43:31.702999+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:31.702748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:31.702748+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.702748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:34.303461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"139'27","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.149959+0000","last_change":"2024-04-26T12:43:29.150036+0000","last_active":"2024-04-26T12:43:29.149959+0000","last_peered":"2024-04-26T12:43:29.149959+0000","last_clean":"2024-04-26T12:43:29.149959+0000","last_became_active":"2024-04-26T12:42:21.931947+0000","last_became_peered":"2024-04-26T12:42:21.931947+0000","last_unstale":"2024-04-26T12:43:29.149959+0000","last_undegraded":"2024-04-26T12:43:29.149959+0000","last_fullsized":"2024-04-26T12:43:29.149959+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'27","last_scrub_stamp":"2024-04-26T12:43:29.149771+0000","last_deep_scrub":"139'27","last_deep_scrub_stamp":"2024-04-26T12:43:29.149771+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.149771+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:50.619544+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.115856+0000","last_change":"2024-04-26T12:43:24.115908+0000","last_active":"2024-04-26T12:43:24.115856+0000","last_peered":"2024-04-26T12:43:24.115856+0000","last_clean":"2024-04-26T12:43:24.115856+0000","last_became_active":"2024-04-26T12:42:21.933611+0000","last_became_peered":"2024-04-26T12:42:21.933611+0000","last_unstale":"2024-04-26T12:43:24.115856+0000","last_undegraded":"2024-04-26T12:43:24.115856+0000","last_fullsized":"2024-04-26T12:43:24.115856+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:24.115659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:24.115659+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.115659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:35.070536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.257990+0000","last_change":"2024-04-26T12:43:03.258043+0000","last_active":"2024-04-26T12:43:03.257990+0000","last_peered":"2024-04-26T12:43:03.257990+0000","last_clean":"2024-04-26T12:43:03.257990+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:43:03.257990+0000","last_undegraded":"2024-04-26T12:43:03.257990+0000","last_fullsized":"2024-04-26T12:43:03.257990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.257787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.257787+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.257787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:57.561967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.564305+0000","last_change":"2024-04-26T12:43:03.564305+0000","last_active":"2024-04-26T12:43:03.564305+0000","last_peered":"2024-04-26T12:43:03.564305+0000","last_clean":"2024-04-26T12:43:03.564305+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:43:03.564305+0000","last_undegraded":"2024-04-26T12:43:03.564305+0000","last_fullsized":"2024-04-26T12:43:03.564305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.564054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.564054+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.564054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:15.568023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"139'44","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.413235+0000","last_change":"2024-04-26T12:43:26.413292+0000","last_active":"2024-04-26T12:43:26.413235+0000","last_peered":"2024-04-26T12:43:26.413235+0000","last_clean":"2024-04-26T12:43:26.413235+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:43:26.413235+0000","last_undegraded":"2024-04-26T12:43:26.413235+0000","last_fullsized":"2024-04-26T12:43:26.413235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'44","last_scrub_stamp":"2024-04-26T12:43:26.413041+0000","last_deep_scrub":"139'44","last_deep_scrub_stamp":"2024-04-26T12:43:26.413041+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.413041+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:38.159572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.875580+0000","last_change":"2024-04-26T12:42:58.875580+0000","last_active":"2024-04-26T12:42:58.875580+0000","last_peered":"2024-04-26T12:42:58.875580+0000","last_clean":"2024-04-26T12:42:58.875580+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:42:58.875580+0000","last_undegraded":"2024-04-26T12:42:58.875580+0000","last_fullsized":"2024-04-26T12:42:58.875580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:58.875471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:58.875471+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.875471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:03.010290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"139'17","reported_seq":75,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.749737+0000","last_change":"2024-04-26T12:43:11.749825+0000","last_active":"2024-04-26T12:43:11.749737+0000","last_peered":"2024-04-26T12:43:11.749737+0000","last_clean":"2024-04-26T12:43:11.749737+0000","last_became_active":"2024-04-26T12:42:34.022362+0000","last_became_peered":"2024-04-26T12:42:34.022362+0000","last_unstale":"2024-04-26T12:43:11.749737+0000","last_undegraded":"2024-04-26T12:43:11.749737+0000","last_fullsized":"2024-04-26T12:43:11.749737+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'17","last_scrub_stamp":"2024-04-26T12:43:11.749536+0000","last_deep_scrub":"139'17","last_deep_scrub_stamp":"2024-04-26T12:43:11.749536+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.749536+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.974033+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"139'138","reported_seq":439,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.548368+0000","last_change":"2024-04-26T12:43:06.548430+0000","last_active":"2024-04-26T12:43:06.548368+0000","last_peered":"2024-04-26T12:43:06.548368+0000","last_clean":"2024-04-26T12:43:06.548368+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:43:06.548368+0000","last_undegraded":"2024-04-26T12:43:06.548368+0000","last_fullsized":"2024-04-26T12:43:06.548368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:06.548173+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:06.548173+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.548173+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:56.776441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"117'4","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.018849+0000","last_change":"2024-04-26T12:43:30.018913+0000","last_active":"2024-04-26T12:43:30.018849+0000","last_peered":"2024-04-26T12:43:30.018849+0000","last_clean":"2024-04-26T12:43:30.018849+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:43:30.018849+0000","last_undegraded":"2024-04-26T12:43:30.018849+0000","last_fullsized":"2024-04-26T12:43:30.018849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:30.018561+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:30.018561+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.018561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:59.361034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.698464+0000","last_change":"2024-04-26T12:43:28.698532+0000","last_active":"2024-04-26T12:43:28.698464+0000","last_peered":"2024-04-26T12:43:28.698464+0000","last_clean":"2024-04-26T12:43:28.698464+0000","last_became_active":"2024-04-26T12:42:34.028313+0000","last_became_peered":"2024-04-26T12:42:34.028313+0000","last_unstale":"2024-04-26T12:43:28.698464+0000","last_undegraded":"2024-04-26T12:43:28.698464+0000","last_fullsized":"2024-04-26T12:43:28.698464+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'10","last_scrub_stamp":"2024-04-26T12:43:28.698049+0000","last_deep_scrub":"104'10","last_deep_scrub_stamp":"2024-04-26T12:43:28.698049+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.698049+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:00.421101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"139'52","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.288878+0000","last_change":"2024-04-26T12:43:25.288958+0000","last_active":"2024-04-26T12:43:25.288878+0000","last_peered":"2024-04-26T12:43:25.288878+0000","last_clean":"2024-04-26T12:43:25.288878+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:43:25.288878+0000","last_undegraded":"2024-04-26T12:43:25.288878+0000","last_fullsized":"2024-04-26T12:43:25.288878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'52","last_scrub_stamp":"2024-04-26T12:43:25.288674+0000","last_deep_scrub":"139'52","last_deep_scrub_stamp":"2024-04-26T12:43:25.288674+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.288674+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:59.500760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.890081+0000","last_change":"2024-04-26T12:43:01.890081+0000","last_active":"2024-04-26T12:43:01.890081+0000","last_peered":"2024-04-26T12:43:01.890081+0000","last_clean":"2024-04-26T12:43:01.890081+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:43:01.890081+0000","last_undegraded":"2024-04-26T12:43:01.890081+0000","last_fullsized":"2024-04-26T12:43:01.890081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.889695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.889695+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.889695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:48.164433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"139'34","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.100676+0000","last_change":"2024-04-26T12:43:12.100772+0000","last_active":"2024-04-26T12:43:12.100676+0000","last_peered":"2024-04-26T12:43:12.100676+0000","last_clean":"2024-04-26T12:43:12.100676+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:43:12.100676+0000","last_undegraded":"2024-04-26T12:43:12.100676+0000","last_fullsized":"2024-04-26T12:43:12.100676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'34","last_scrub_stamp":"2024-04-26T12:43:12.100484+0000","last_deep_scrub":"139'34","last_deep_scrub_stamp":"2024-04-26T12:43:12.100484+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.100484+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:28.728460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.403016+0000","last_change":"2024-04-26T12:43:18.403077+0000","last_active":"2024-04-26T12:43:18.403016+0000","last_peered":"2024-04-26T12:43:18.403016+0000","last_clean":"2024-04-26T12:43:18.403016+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:43:18.403016+0000","last_undegraded":"2024-04-26T12:43:18.403016+0000","last_fullsized":"2024-04-26T12:43:18.403016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:18.402792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:18.402792+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.402792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:50.540626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.007972+0000","last_change":"2024-04-26T12:43:28.008032+0000","last_active":"2024-04-26T12:43:28.007972+0000","last_peered":"2024-04-26T12:43:28.007972+0000","last_clean":"2024-04-26T12:43:28.007972+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:43:28.007972+0000","last_undegraded":"2024-04-26T12:43:28.007972+0000","last_fullsized":"2024-04-26T12:43:28.007972+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:28.007747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:28.007747+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.007747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:45.232244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"117'14","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:33.696707+0000","last_change":"2024-04-26T12:43:33.696857+0000","last_active":"2024-04-26T12:43:33.696707+0000","last_peered":"2024-04-26T12:43:33.696707+0000","last_clean":"2024-04-26T12:43:33.696707+0000","last_became_active":"2024-04-26T12:42:34.031426+0000","last_became_peered":"2024-04-26T12:42:34.031426+0000","last_unstale":"2024-04-26T12:43:33.696707+0000","last_undegraded":"2024-04-26T12:43:33.696707+0000","last_fullsized":"2024-04-26T12:43:33.696707+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'14","last_scrub_stamp":"2024-04-26T12:43:33.696465+0000","last_deep_scrub":"117'14","last_deep_scrub_stamp":"2024-04-26T12:43:33.696465+0000","last_clean_scrub_stamp":"2024-04-26T12:43:33.696465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:42.358782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"139'76","reported_seq":339,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.238066+0000","last_change":"2024-04-26T12:43:23.238133+0000","last_active":"2024-04-26T12:43:23.238066+0000","last_peered":"2024-04-26T12:43:23.238066+0000","last_clean":"2024-04-26T12:43:23.238066+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:43:23.238066+0000","last_undegraded":"2024-04-26T12:43:23.238066+0000","last_fullsized":"2024-04-26T12:43:23.238066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'76","last_scrub_stamp":"2024-04-26T12:43:23.237837+0000","last_deep_scrub":"139'76","last_deep_scrub_stamp":"2024-04-26T12:43:23.237837+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.237837+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:53.656730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":76,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.169750+0000","last_change":"2024-04-26T12:43:08.169750+0000","last_active":"2024-04-26T12:43:08.169750+0000","last_peered":"2024-04-26T12:43:08.169750+0000","last_clean":"2024-04-26T12:43:08.169750+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:43:08.169750+0000","last_undegraded":"2024-04-26T12:43:08.169750+0000","last_fullsized":"2024-04-26T12:43:08.169750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:08.169495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:08.169495+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.169495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:37.150464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"139'25","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.335623+0000","last_change":"2024-04-26T12:43:12.335759+0000","last_active":"2024-04-26T12:43:12.335623+0000","last_peered":"2024-04-26T12:43:12.335623+0000","last_clean":"2024-04-26T12:43:12.335623+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:43:12.335623+0000","last_undegraded":"2024-04-26T12:43:12.335623+0000","last_fullsized":"2024-04-26T12:43:12.335623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'25","last_scrub_stamp":"2024-04-26T12:43:12.335290+0000","last_deep_scrub":"139'25","last_deep_scrub_stamp":"2024-04-26T12:43:12.335290+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.335290+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:43.038569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":254,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.561814+0000","last_change":"2024-04-26T12:43:16.561867+0000","last_active":"2024-04-26T12:43:16.561814+0000","last_peered":"2024-04-26T12:43:16.561814+0000","last_clean":"2024-04-26T12:43:16.561814+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:43:16.561814+0000","last_undegraded":"2024-04-26T12:43:16.561814+0000","last_fullsized":"2024-04-26T12:43:16.561814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:16.561568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:16.561568+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.561568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:12.226643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":192,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.302221+0000","last_change":"2024-04-26T12:43:13.302404+0000","last_active":"2024-04-26T12:43:13.302221+0000","last_peered":"2024-04-26T12:43:13.302221+0000","last_clean":"2024-04-26T12:43:13.302221+0000","last_became_active":"2024-04-26T12:42:21.951213+0000","last_became_peered":"2024-04-26T12:42:21.951213+0000","last_unstale":"2024-04-26T12:43:13.302221+0000","last_undegraded":"2024-04-26T12:43:13.302221+0000","last_fullsized":"2024-04-26T12:43:13.302221+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T12:43:13.301968+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T12:43:13.301968+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.301968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:56.191133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.235702+0000","last_change":"2024-04-26T12:43:19.235770+0000","last_active":"2024-04-26T12:43:19.235702+0000","last_peered":"2024-04-26T12:43:19.235702+0000","last_clean":"2024-04-26T12:43:19.235702+0000","last_became_active":"2024-04-26T12:42:21.952291+0000","last_became_peered":"2024-04-26T12:42:21.952291+0000","last_unstale":"2024-04-26T12:43:19.235702+0000","last_undegraded":"2024-04-26T12:43:19.235702+0000","last_fullsized":"2024-04-26T12:43:19.235702+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'4","last_scrub_stamp":"2024-04-26T12:43:19.235435+0000","last_deep_scrub":"104'4","last_deep_scrub_stamp":"2024-04-26T12:43:19.235435+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.235435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:21.866442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"139'54","reported_seq":312,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:27.151934+0000","last_change":"2024-04-26T12:43:27.152108+0000","last_active":"2024-04-26T12:43:27.151934+0000","last_peered":"2024-04-26T12:43:27.151934+0000","last_clean":"2024-04-26T12:43:27.151934+0000","last_became_active":"2024-04-26T12:42:21.928247+0000","last_became_peered":"2024-04-26T12:42:21.928247+0000","last_unstale":"2024-04-26T12:43:27.151934+0000","last_undegraded":"2024-04-26T12:43:27.151934+0000","last_fullsized":"2024-04-26T12:43:27.151934+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:27.151690+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:27.151690+0000","last_clean_scrub_stamp":"2024-04-26T12:43:27.151690+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:14.119920+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":59,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.720995+0000","last_change":"2024-04-26T12:43:09.721066+0000","last_active":"2024-04-26T12:43:09.720995+0000","last_peered":"2024-04-26T12:43:09.720995+0000","last_clean":"2024-04-26T12:43:09.720995+0000","last_became_active":"2024-04-26T12:42:34.022065+0000","last_became_peered":"2024-04-26T12:42:34.022065+0000","last_unstale":"2024-04-26T12:43:09.720995+0000","last_undegraded":"2024-04-26T12:43:09.720995+0000","last_fullsized":"2024-04-26T12:43:09.720995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:09.720772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:09.720772+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.720772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:15.509639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"139'17","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:52.370819+0000","last_change":"2024-04-26T12:42:21.975843+0000","last_active":"2024-04-26T12:42:52.370819+0000","last_peered":"2024-04-26T12:42:52.370819+0000","last_clean":"2024-04-26T12:42:52.370819+0000","last_became_active":"2024-04-26T12:42:21.971062+0000","last_became_peered":"2024-04-26T12:42:21.971062+0000","last_unstale":"2024-04-26T12:42:52.370819+0000","last_undegraded":"2024-04-26T12:42:52.370819+0000","last_fullsized":"2024-04-26T12:42:52.370819+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:15.423612+0000","last_clean_scrub_stamp":"2024-04-26T12:38:15.423612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":51,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.705346+0000","last_change":"2024-04-26T12:43:02.705400+0000","last_active":"2024-04-26T12:43:02.705346+0000","last_peered":"2024-04-26T12:43:02.705346+0000","last_clean":"2024-04-26T12:43:02.705346+0000","last_became_active":"2024-04-26T12:42:34.024706+0000","last_became_peered":"2024-04-26T12:42:34.024706+0000","last_unstale":"2024-04-26T12:43:02.705346+0000","last_undegraded":"2024-04-26T12:43:02.705346+0000","last_fullsized":"2024-04-26T12:43:02.705346+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:02.705146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:02.705146+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.705146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:30.502334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.036332+0000","last_change":"2024-04-26T12:43:29.036395+0000","last_active":"2024-04-26T12:43:29.036332+0000","last_peered":"2024-04-26T12:43:29.036332+0000","last_clean":"2024-04-26T12:43:29.036332+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:43:29.036332+0000","last_undegraded":"2024-04-26T12:43:29.036332+0000","last_fullsized":"2024-04-26T12:43:29.036332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'2","last_scrub_stamp":"2024-04-26T12:43:29.036126+0000","last_deep_scrub":"74'2","last_deep_scrub_stamp":"2024-04-26T12:43:29.036126+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.036126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:15.972069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.703385+0000","last_change":"2024-04-26T12:43:13.703442+0000","last_active":"2024-04-26T12:43:13.703385+0000","last_peered":"2024-04-26T12:43:13.703385+0000","last_clean":"2024-04-26T12:43:13.703385+0000","last_became_active":"2024-04-26T12:42:34.022553+0000","last_became_peered":"2024-04-26T12:42:34.022553+0000","last_unstale":"2024-04-26T12:43:13.703385+0000","last_undegraded":"2024-04-26T12:43:13.703385+0000","last_fullsized":"2024-04-26T12:43:13.703385+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'14","last_scrub_stamp":"2024-04-26T12:43:13.703180+0000","last_deep_scrub":"104'14","last_deep_scrub_stamp":"2024-04-26T12:43:13.703180+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.703180+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:43.045653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"139'50","reported_seq":312,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.406966+0000","last_change":"2024-04-26T12:43:24.407024+0000","last_active":"2024-04-26T12:43:24.406966+0000","last_peered":"2024-04-26T12:43:24.406966+0000","last_clean":"2024-04-26T12:43:24.406966+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:43:24.406966+0000","last_undegraded":"2024-04-26T12:43:24.406966+0000","last_fullsized":"2024-04-26T12:43:24.406966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:24.406737+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:24.406737+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.406737+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:52.410906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"139'4","reported_seq":348,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.867769+0000","last_change":"2024-04-26T12:42:59.867769+0000","last_active":"2024-04-26T12:42:59.867769+0000","last_peered":"2024-04-26T12:42:59.867769+0000","last_clean":"2024-04-26T12:42:59.867769+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:42:59.867769+0000","last_undegraded":"2024-04-26T12:42:59.867769+0000","last_fullsized":"2024-04-26T12:42:59.867769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'4","last_scrub_stamp":"2024-04-26T12:42:59.867488+0000","last_deep_scrub":"139'4","last_deep_scrub_stamp":"2024-04-26T12:42:59.867488+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.867488+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:33.256882+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"139'23","reported_seq":81,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.702843+0000","last_change":"2024-04-26T12:43:07.702919+0000","last_active":"2024-04-26T12:43:07.702843+0000","last_peered":"2024-04-26T12:43:07.702843+0000","last_clean":"2024-04-26T12:43:07.702843+0000","last_became_active":"2024-04-26T12:42:34.017996+0000","last_became_peered":"2024-04-26T12:42:34.017996+0000","last_unstale":"2024-04-26T12:43:07.702843+0000","last_undegraded":"2024-04-26T12:43:07.702843+0000","last_fullsized":"2024-04-26T12:43:07.702843+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'23","last_scrub_stamp":"2024-04-26T12:43:07.702636+0000","last_deep_scrub":"139'23","last_deep_scrub_stamp":"2024-04-26T12:43:07.702636+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.702636+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:06.308608+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.228725+0000","last_change":"2024-04-26T12:43:01.228725+0000","last_active":"2024-04-26T12:43:01.228725+0000","last_peered":"2024-04-26T12:43:01.228725+0000","last_clean":"2024-04-26T12:43:01.228725+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:43:01.228725+0000","last_undegraded":"2024-04-26T12:43:01.228725+0000","last_fullsized":"2024-04-26T12:43:01.228725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.228301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.228301+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.228301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:16.914084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.715013+0000","last_change":"2024-04-26T12:43:18.715078+0000","last_active":"2024-04-26T12:43:18.715013+0000","last_peered":"2024-04-26T12:43:18.715013+0000","last_clean":"2024-04-26T12:43:18.715013+0000","last_became_active":"2024-04-26T12:42:34.011472+0000","last_became_peered":"2024-04-26T12:42:34.011472+0000","last_unstale":"2024-04-26T12:43:18.715013+0000","last_undegraded":"2024-04-26T12:43:18.715013+0000","last_fullsized":"2024-04-26T12:43:18.715013+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:18.714800+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:18.714800+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.714800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:03.955597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"117'8","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.914258+0000","last_change":"2024-04-26T12:43:03.914320+0000","last_active":"2024-04-26T12:43:03.914258+0000","last_peered":"2024-04-26T12:43:03.914258+0000","last_clean":"2024-04-26T12:43:03.914258+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:43:03.914258+0000","last_undegraded":"2024-04-26T12:43:03.914258+0000","last_fullsized":"2024-04-26T12:43:03.914258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'8","last_scrub_stamp":"2024-04-26T12:43:03.914051+0000","last_deep_scrub":"117'8","last_deep_scrub_stamp":"2024-04-26T12:43:03.914051+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.914051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:16.025477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"139'36","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.492557+0000","last_change":"2024-04-26T12:43:11.492695+0000","last_active":"2024-04-26T12:43:11.492557+0000","last_peered":"2024-04-26T12:43:11.492557+0000","last_clean":"2024-04-26T12:43:11.492557+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:43:11.492557+0000","last_undegraded":"2024-04-26T12:43:11.492557+0000","last_fullsized":"2024-04-26T12:43:11.492557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:11.492274+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:11.492274+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.492274+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:23.983148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.055768+0000","last_change":"2024-04-26T12:43:17.055829+0000","last_active":"2024-04-26T12:43:17.055768+0000","last_peered":"2024-04-26T12:43:17.055768+0000","last_clean":"2024-04-26T12:43:17.055768+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:43:17.055768+0000","last_undegraded":"2024-04-26T12:43:17.055768+0000","last_fullsized":"2024-04-26T12:43:17.055768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'12","last_scrub_stamp":"2024-04-26T12:43:17.055523+0000","last_deep_scrub":"74'12","last_deep_scrub_stamp":"2024-04-26T12:43:17.055523+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.055523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:44.852711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"139'54","reported_seq":321,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.556358+0000","last_change":"2024-04-26T12:43:10.556427+0000","last_active":"2024-04-26T12:43:10.556358+0000","last_peered":"2024-04-26T12:43:10.556358+0000","last_clean":"2024-04-26T12:43:10.556358+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:43:10.556358+0000","last_undegraded":"2024-04-26T12:43:10.556358+0000","last_fullsized":"2024-04-26T12:43:10.556358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:10.556157+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:10.556157+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.556157+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:43.945550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.122109+0000","last_change":"2024-04-26T12:43:11.122256+0000","last_active":"2024-04-26T12:43:11.122109+0000","last_peered":"2024-04-26T12:43:11.122109+0000","last_clean":"2024-04-26T12:43:11.122109+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:43:11.122109+0000","last_undegraded":"2024-04-26T12:43:11.122109+0000","last_fullsized":"2024-04-26T12:43:11.122109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'4","last_scrub_stamp":"2024-04-26T12:43:11.121886+0000","last_deep_scrub":"104'4","last_deep_scrub_stamp":"2024-04-26T12:43:11.121886+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.121886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:22.580179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"139'50","reported_seq":320,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.250294+0000","last_change":"2024-04-26T12:43:02.250363+0000","last_active":"2024-04-26T12:43:02.250294+0000","last_peered":"2024-04-26T12:43:02.250294+0000","last_clean":"2024-04-26T12:43:02.250294+0000","last_became_active":"2024-04-26T12:42:21.925708+0000","last_became_peered":"2024-04-26T12:42:21.925708+0000","last_unstale":"2024-04-26T12:43:02.250294+0000","last_undegraded":"2024-04-26T12:43:02.250294+0000","last_fullsized":"2024-04-26T12:43:02.250294+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:02.250088+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:02.250088+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.250088+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:21.366905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"117'4","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.898995+0000","last_change":"2024-04-26T12:43:05.899059+0000","last_active":"2024-04-26T12:43:05.898995+0000","last_peered":"2024-04-26T12:43:05.898995+0000","last_clean":"2024-04-26T12:43:05.898995+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:43:05.898995+0000","last_undegraded":"2024-04-26T12:43:05.898995+0000","last_fullsized":"2024-04-26T12:43:05.898995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:05.898768+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:05.898768+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.898768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:10.366860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"139'56","reported_seq":324,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:35.325652+0000","last_change":"2024-04-26T12:43:35.325719+0000","last_active":"2024-04-26T12:43:35.325652+0000","last_peered":"2024-04-26T12:43:35.325652+0000","last_clean":"2024-04-26T12:43:35.325652+0000","last_became_active":"2024-04-26T12:42:21.957515+0000","last_became_peered":"2024-04-26T12:42:21.957515+0000","last_unstale":"2024-04-26T12:43:35.325652+0000","last_undegraded":"2024-04-26T12:43:35.325652+0000","last_fullsized":"2024-04-26T12:43:35.325652+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'56","last_scrub_stamp":"2024-04-26T12:43:35.325454+0000","last_deep_scrub":"139'56","last_deep_scrub_stamp":"2024-04-26T12:43:35.325454+0000","last_clean_scrub_stamp":"2024-04-26T12:43:35.325454+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:01.670867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:41.068765+0000","last_change":"2024-04-26T12:42:21.975117+0000","last_active":"2024-04-26T12:42:41.068765+0000","last_peered":"2024-04-26T12:42:41.068765+0000","last_clean":"2024-04-26T12:42:41.068765+0000","last_became_active":"2024-04-26T12:42:21.970669+0000","last_became_peered":"2024-04-26T12:42:21.970669+0000","last_unstale":"2024-04-26T12:42:41.068765+0000","last_undegraded":"2024-04-26T12:42:41.068765+0000","last_fullsized":"2024-04-26T12:42:41.068765+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:38:11.409266+0000","last_clean_scrub_stamp":"2024-04-26T12:38:11.409266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"139'46","reported_seq":303,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.158895+0000","last_change":"2024-04-26T12:43:23.158956+0000","last_active":"2024-04-26T12:43:23.158895+0000","last_peered":"2024-04-26T12:43:23.158895+0000","last_clean":"2024-04-26T12:43:23.158895+0000","last_became_active":"2024-04-26T12:42:21.961965+0000","last_became_peered":"2024-04-26T12:42:21.961965+0000","last_unstale":"2024-04-26T12:43:23.158895+0000","last_undegraded":"2024-04-26T12:43:23.158895+0000","last_fullsized":"2024-04-26T12:43:23.158895+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'46","last_scrub_stamp":"2024-04-26T12:43:23.158679+0000","last_deep_scrub":"139'46","last_deep_scrub_stamp":"2024-04-26T12:43:23.158679+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.158679+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.144602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":63,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.674574+0000","last_change":"2024-04-26T12:43:00.674626+0000","last_active":"2024-04-26T12:43:00.674574+0000","last_peered":"2024-04-26T12:43:00.674574+0000","last_clean":"2024-04-26T12:43:00.674574+0000","last_became_active":"2024-04-26T12:42:34.024880+0000","last_became_peered":"2024-04-26T12:42:34.024880+0000","last_unstale":"2024-04-26T12:43:00.674574+0000","last_undegraded":"2024-04-26T12:43:00.674574+0000","last_fullsized":"2024-04-26T12:43:00.674574+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.674389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.674389+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.674389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:29.421111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"139'38","reported_seq":304,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.137818+0000","last_change":"2024-04-26T12:43:22.137883+0000","last_active":"2024-04-26T12:43:22.137818+0000","last_peered":"2024-04-26T12:43:22.137818+0000","last_clean":"2024-04-26T12:43:22.137818+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:43:22.137818+0000","last_undegraded":"2024-04-26T12:43:22.137818+0000","last_fullsized":"2024-04-26T12:43:22.137818+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:22.137607+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:22.137607+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.137607+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:20.743579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":194,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.107869+0000","last_change":"2024-04-26T12:43:24.107926+0000","last_active":"2024-04-26T12:43:24.107869+0000","last_peered":"2024-04-26T12:43:24.107869+0000","last_clean":"2024-04-26T12:43:24.107869+0000","last_became_active":"2024-04-26T12:42:21.941594+0000","last_became_peered":"2024-04-26T12:42:21.941594+0000","last_unstale":"2024-04-26T12:43:24.107869+0000","last_undegraded":"2024-04-26T12:43:24.107869+0000","last_fullsized":"2024-04-26T12:43:24.107869+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:24.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:24.107660+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:10.400981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"139'54","reported_seq":314,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.513113+0000","last_change":"2024-04-26T12:43:15.513189+0000","last_active":"2024-04-26T12:43:15.513113+0000","last_peered":"2024-04-26T12:43:15.513113+0000","last_clean":"2024-04-26T12:43:15.513113+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:43:15.513113+0000","last_undegraded":"2024-04-26T12:43:15.513113+0000","last_fullsized":"2024-04-26T12:43:15.513113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:15.512868+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:15.512868+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.512868+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:19.980960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"117'12","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.568047+0000","last_change":"2024-04-26T12:43:07.568228+0000","last_active":"2024-04-26T12:43:07.568047+0000","last_peered":"2024-04-26T12:43:07.568047+0000","last_clean":"2024-04-26T12:43:07.568047+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:43:07.568047+0000","last_undegraded":"2024-04-26T12:43:07.568047+0000","last_fullsized":"2024-04-26T12:43:07.568047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'12","last_scrub_stamp":"2024-04-26T12:43:07.567732+0000","last_deep_scrub":"117'12","last_deep_scrub_stamp":"2024-04-26T12:43:07.567732+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.567732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:36.516974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"139'64","reported_seq":322,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.335905+0000","last_change":"2024-04-26T12:43:12.336301+0000","last_active":"2024-04-26T12:43:12.335905+0000","last_peered":"2024-04-26T12:43:12.335905+0000","last_clean":"2024-04-26T12:43:12.335905+0000","last_became_active":"2024-04-26T12:42:21.948694+0000","last_became_peered":"2024-04-26T12:42:21.948694+0000","last_unstale":"2024-04-26T12:43:12.335905+0000","last_undegraded":"2024-04-26T12:43:12.335905+0000","last_fullsized":"2024-04-26T12:43:12.335905+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'64","last_scrub_stamp":"2024-04-26T12:43:12.335694+0000","last_deep_scrub":"139'64","last_deep_scrub_stamp":"2024-04-26T12:43:12.335694+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.335694+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:48.400013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:33.399797+0000","last_change":"2024-04-26T12:43:33.399863+0000","last_active":"2024-04-26T12:43:33.399797+0000","last_peered":"2024-04-26T12:43:33.399797+0000","last_clean":"2024-04-26T12:43:33.399797+0000","last_became_active":"2024-04-26T12:42:21.956925+0000","last_became_peered":"2024-04-26T12:42:21.956925+0000","last_unstale":"2024-04-26T12:43:33.399797+0000","last_undegraded":"2024-04-26T12:43:33.399797+0000","last_fullsized":"2024-04-26T12:43:33.399797+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-04-26T12:43:33.399592+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-04-26T12:43:33.399592+0000","last_clean_scrub_stamp":"2024-04-26T12:43:33.399592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.488053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"139'58","reported_seq":328,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:34.242847+0000","last_change":"2024-04-26T12:43:34.242967+0000","last_active":"2024-04-26T12:43:34.242847+0000","last_peered":"2024-04-26T12:43:34.242847+0000","last_clean":"2024-04-26T12:43:34.242847+0000","last_became_active":"2024-04-26T12:42:21.949469+0000","last_became_peered":"2024-04-26T12:42:21.949469+0000","last_unstale":"2024-04-26T12:43:34.242847+0000","last_undegraded":"2024-04-26T12:43:34.242847+0000","last_fullsized":"2024-04-26T12:43:34.242847+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'58","last_scrub_stamp":"2024-04-26T12:43:34.242615+0000","last_deep_scrub":"139'58","last_deep_scrub_stamp":"2024-04-26T12:43:34.242615+0000","last_clean_scrub_stamp":"2024-04-26T12:43:34.242615+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:32.925089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":123,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.691945+0000","last_change":"2024-04-26T12:43:06.692004+0000","last_active":"2024-04-26T12:43:06.691945+0000","last_peered":"2024-04-26T12:43:06.691945+0000","last_clean":"2024-04-26T12:43:06.691945+0000","last_became_active":"2024-04-26T12:42:34.018659+0000","last_became_peered":"2024-04-26T12:42:34.018659+0000","last_unstale":"2024-04-26T12:43:06.691945+0000","last_undegraded":"2024-04-26T12:43:06.691945+0000","last_fullsized":"2024-04-26T12:43:06.691945+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:06.691742+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:06.691742+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.691742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:08.695966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"139'36","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.175150+0000","last_change":"2024-04-26T12:43:30.175234+0000","last_active":"2024-04-26T12:43:30.175150+0000","last_peered":"2024-04-26T12:43:30.175150+0000","last_clean":"2024-04-26T12:43:30.175150+0000","last_became_active":"2024-04-26T12:42:21.932263+0000","last_became_peered":"2024-04-26T12:42:21.932263+0000","last_unstale":"2024-04-26T12:43:30.175150+0000","last_undegraded":"2024-04-26T12:43:30.175150+0000","last_fullsized":"2024-04-26T12:43:30.175150+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:30.174919+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:30.174919+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.174919+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:36.174705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"117'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.566523+0000","last_change":"2024-04-26T12:43:02.566604+0000","last_active":"2024-04-26T12:43:02.566523+0000","last_peered":"2024-04-26T12:43:02.566523+0000","last_clean":"2024-04-26T12:43:02.566523+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:43:02.566523+0000","last_undegraded":"2024-04-26T12:43:02.566523+0000","last_fullsized":"2024-04-26T12:43:02.566523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:02.566309+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:02.566309+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.566309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:34.116008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"139'32","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.327061+0000","last_change":"2024-04-26T12:43:26.327118+0000","last_active":"2024-04-26T12:43:26.327061+0000","last_peered":"2024-04-26T12:43:26.327061+0000","last_clean":"2024-04-26T12:43:26.327061+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:43:26.327061+0000","last_undegraded":"2024-04-26T12:43:26.327061+0000","last_fullsized":"2024-04-26T12:43:26.327061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:26.326863+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:26.326863+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.326863+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:11.567660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"117'8","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:27.694402+0000","last_change":"2024-04-26T12:43:27.694465+0000","last_active":"2024-04-26T12:43:27.694402+0000","last_peered":"2024-04-26T12:43:27.694402+0000","last_clean":"2024-04-26T12:43:27.694402+0000","last_became_active":"2024-04-26T12:42:34.023978+0000","last_became_peered":"2024-04-26T12:42:34.023978+0000","last_unstale":"2024-04-26T12:43:27.694402+0000","last_undegraded":"2024-04-26T12:43:27.694402+0000","last_fullsized":"2024-04-26T12:43:27.694402+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'8","last_scrub_stamp":"2024-04-26T12:43:27.694206+0000","last_deep_scrub":"117'8","last_deep_scrub_stamp":"2024-04-26T12:43:27.694206+0000","last_clean_scrub_stamp":"2024-04-26T12:43:27.694206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:28.998364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"139'46","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:27.394123+0000","last_change":"2024-04-26T12:43:27.394184+0000","last_active":"2024-04-26T12:43:27.394123+0000","last_peered":"2024-04-26T12:43:27.394123+0000","last_clean":"2024-04-26T12:43:27.394123+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:43:27.394123+0000","last_undegraded":"2024-04-26T12:43:27.394123+0000","last_fullsized":"2024-04-26T12:43:27.394123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'46","last_scrub_stamp":"2024-04-26T12:43:27.393919+0000","last_deep_scrub":"139'46","last_deep_scrub_stamp":"2024-04-26T12:43:27.393919+0000","last_clean_scrub_stamp":"2024-04-26T12:43:27.393919+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.984089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.974101+0000","last_change":"2024-04-26T12:43:30.974186+0000","last_active":"2024-04-26T12:43:30.974101+0000","last_peered":"2024-04-26T12:43:30.974101+0000","last_clean":"2024-04-26T12:43:30.974101+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:43:30.974101+0000","last_undegraded":"2024-04-26T12:43:30.974101+0000","last_fullsized":"2024-04-26T12:43:30.974101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:30.973894+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:30.973894+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.973894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:28.080910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"139'34","reported_seq":294,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.488505+0000","last_change":"2024-04-26T12:43:12.488578+0000","last_active":"2024-04-26T12:43:12.488505+0000","last_peered":"2024-04-26T12:43:12.488505+0000","last_clean":"2024-04-26T12:43:12.488505+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:43:12.488505+0000","last_undegraded":"2024-04-26T12:43:12.488505+0000","last_fullsized":"2024-04-26T12:43:12.488505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'34","last_scrub_stamp":"2024-04-26T12:43:12.488308+0000","last_deep_scrub":"139'34","last_deep_scrub_stamp":"2024-04-26T12:43:12.488308+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.488308+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:11.941406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.420636+0000","last_change":"2024-04-26T12:43:15.420698+0000","last_active":"2024-04-26T12:43:15.420636+0000","last_peered":"2024-04-26T12:43:15.420636+0000","last_clean":"2024-04-26T12:43:15.420636+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:43:15.420636+0000","last_undegraded":"2024-04-26T12:43:15.420636+0000","last_fullsized":"2024-04-26T12:43:15.420636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'6","last_scrub_stamp":"2024-04-26T12:43:15.420425+0000","last_deep_scrub":"104'6","last_deep_scrub_stamp":"2024-04-26T12:43:15.420425+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.420425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:12.527441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"139'48","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.809465+0000","last_change":"2024-04-26T12:43:12.809527+0000","last_active":"2024-04-26T12:43:12.809465+0000","last_peered":"2024-04-26T12:43:12.809465+0000","last_clean":"2024-04-26T12:43:12.809465+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:43:12.809465+0000","last_undegraded":"2024-04-26T12:43:12.809465+0000","last_fullsized":"2024-04-26T12:43:12.809465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:12.809240+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:12.809240+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.809240+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:00.875299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.320240+0000","last_change":"2024-04-26T12:43:08.320300+0000","last_active":"2024-04-26T12:43:08.320240+0000","last_peered":"2024-04-26T12:43:08.320240+0000","last_clean":"2024-04-26T12:43:08.320240+0000","last_became_active":"2024-04-26T12:42:21.965634+0000","last_became_peered":"2024-04-26T12:42:21.965634+0000","last_unstale":"2024-04-26T12:43:08.320240+0000","last_undegraded":"2024-04-26T12:43:08.320240+0000","last_fullsized":"2024-04-26T12:43:08.320240+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-04-26T12:43:08.320039+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-04-26T12:43:08.320039+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.320039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:38.031153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"139'32","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.549487+0000","last_change":"2024-04-26T12:43:00.549547+0000","last_active":"2024-04-26T12:43:00.549487+0000","last_peered":"2024-04-26T12:43:00.549487+0000","last_clean":"2024-04-26T12:43:00.549487+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:43:00.549487+0000","last_undegraded":"2024-04-26T12:43:00.549487+0000","last_fullsized":"2024-04-26T12:43:00.549487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:00.549294+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:00.549294+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.549294+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:53.533735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.984102+0000","last_change":"2024-04-26T12:43:32.984161+0000","last_active":"2024-04-26T12:43:32.984102+0000","last_peered":"2024-04-26T12:43:32.984102+0000","last_clean":"2024-04-26T12:43:32.984102+0000","last_became_active":"2024-04-26T12:42:21.967048+0000","last_became_peered":"2024-04-26T12:42:21.967048+0000","last_unstale":"2024-04-26T12:43:32.984102+0000","last_undegraded":"2024-04-26T12:43:32.984102+0000","last_fullsized":"2024-04-26T12:43:32.984102+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T12:43:32.983884+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T12:43:32.983884+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.983884+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:48.493742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"139'30","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:27.342494+0000","last_change":"2024-04-26T12:43:27.342558+0000","last_active":"2024-04-26T12:43:27.342494+0000","last_peered":"2024-04-26T12:43:27.342494+0000","last_clean":"2024-04-26T12:43:27.342494+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:43:27.342494+0000","last_undegraded":"2024-04-26T12:43:27.342494+0000","last_fullsized":"2024-04-26T12:43:27.342494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'30","last_scrub_stamp":"2024-04-26T12:43:27.342298+0000","last_deep_scrub":"139'30","last_deep_scrub_stamp":"2024-04-26T12:43:27.342298+0000","last_clean_scrub_stamp":"2024-04-26T12:43:27.342298+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:18.347016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"139'48","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.264253+0000","last_change":"2024-04-26T12:43:24.264313+0000","last_active":"2024-04-26T12:43:24.264253+0000","last_peered":"2024-04-26T12:43:24.264253+0000","last_clean":"2024-04-26T12:43:24.264253+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:43:24.264253+0000","last_undegraded":"2024-04-26T12:43:24.264253+0000","last_fullsized":"2024-04-26T12:43:24.264253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:24.264057+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:24.264057+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.264057+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:39.773915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.439833+0000","last_change":"2024-04-26T12:43:29.439890+0000","last_active":"2024-04-26T12:43:29.439833+0000","last_peered":"2024-04-26T12:43:29.439833+0000","last_clean":"2024-04-26T12:43:29.439833+0000","last_became_active":"2024-04-26T12:42:21.936930+0000","last_became_peered":"2024-04-26T12:42:21.936930+0000","last_unstale":"2024-04-26T12:43:29.439833+0000","last_undegraded":"2024-04-26T12:43:29.439833+0000","last_fullsized":"2024-04-26T12:43:29.439833+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T12:43:29.439631+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T12:43:29.439631+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.439631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:49.649723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"139'50","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.983284+0000","last_change":"2024-04-26T12:43:12.983343+0000","last_active":"2024-04-26T12:43:12.983284+0000","last_peered":"2024-04-26T12:43:12.983284+0000","last_clean":"2024-04-26T12:43:12.983284+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:43:12.983284+0000","last_undegraded":"2024-04-26T12:43:12.983284+0000","last_fullsized":"2024-04-26T12:43:12.983284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:12.983082+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:12.983082+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.983082+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:16.724892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"117'2","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.193719+0000","last_change":"2024-04-26T12:43:19.193776+0000","last_active":"2024-04-26T12:43:19.193719+0000","last_peered":"2024-04-26T12:43:19.193719+0000","last_clean":"2024-04-26T12:43:19.193719+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:43:19.193719+0000","last_undegraded":"2024-04-26T12:43:19.193719+0000","last_fullsized":"2024-04-26T12:43:19.193719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'2","last_scrub_stamp":"2024-04-26T12:43:19.193519+0000","last_deep_scrub":"117'2","last_deep_scrub_stamp":"2024-04-26T12:43:19.193519+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.193519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:36.418015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":336,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1110,"ondisk_log_size":1110,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1061,"num_read_kb":1543,"num_write":541,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1007,"ondisk_log_size":1007,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1275,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37596,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334244,"statfs":{"total":96636764160,"available":96598265856,"internally_reserved":0,"allocated":2314240,"data_stored":1600353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36992,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334848,"statfs":{"total":96636764160,"available":96598884352,"internally_reserved":0,"allocated":1695744,"data_stored":1009325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1748992,"data_stored":1011582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1687552,"data_stored":1008834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":122,"seq":523986010129,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42200,"kb_used_data":1680,"kb_used_omap":6,"kb_used_meta":40505,"kb_avail":94329640,"statfs":{"total":96636764160,"available":96593551360,"internally_reserved":0,"allocated":1720320,"data_stored":1010124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6715,"internal_metadata":41477573},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41144,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330696,"statfs":{"total":96636764160,"available":96594632704,"internally_reserved":0,"allocated":1687552,"data_stored":1009323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1720320,"data_stored":1010960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41736,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330104,"statfs":{"total":96636764160,"available":96594026496,"internally_reserved":0,"allocated":2293760,"data_stored":1599759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:43:40.369 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:40.369 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T12:38:09.397765+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=9, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:40.371 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:40.371 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-26T12:38:19.471910+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:40.371 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-26T12:38:15.423612+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=15, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:40.372 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T12:38:11.409266+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=38, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=12, tm_min=42, tm_sec=54, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T12:43:40.372 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T12:44:00.373 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T12:44:00.731 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-26T12:44:00.738 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-26T12:44:00.758 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-04-26T12:43:58.823321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623988,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4830,"num_read_kb":3732,"num_write":4425,"num_write_kb":6187917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5704,"ondisk_log_size":5704,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314872,"kb_used_data":14520,"kb_used_omap":17,"kb_used_meta":300270,"kb_avail":754659848,"statfs":{"total":773094113280,"available":772771684352,"internally_reserved":0,"allocated":14868480,"data_stored":9260260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17874,"internal_metadata":307477038},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006384"},"pg_stats":[{"pgid":"3.3f","version":"139'42","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.845729+0000","last_change":"2024-04-26T12:43:10.845789+0000","last_active":"2024-04-26T12:43:10.845729+0000","last_peered":"2024-04-26T12:43:10.845729+0000","last_clean":"2024-04-26T12:43:10.845729+0000","last_became_active":"2024-04-26T12:38:10.475623+0000","last_became_peered":"2024-04-26T12:38:10.475623+0000","last_unstale":"2024-04-26T12:43:10.845729+0000","last_undegraded":"2024-04-26T12:43:10.845729+0000","last_fullsized":"2024-04-26T12:43:10.845729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'42","last_scrub_stamp":"2024-04-26T12:43:10.845487+0000","last_deep_scrub":"139'42","last_deep_scrub_stamp":"2024-04-26T12:43:10.845487+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.845487+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:42.606975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"117'6","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.145242+0000","last_change":"2024-04-26T12:43:15.145305+0000","last_active":"2024-04-26T12:43:15.145242+0000","last_peered":"2024-04-26T12:43:15.145242+0000","last_clean":"2024-04-26T12:43:15.145242+0000","last_became_active":"2024-04-26T12:38:12.454935+0000","last_became_peered":"2024-04-26T12:38:12.454935+0000","last_unstale":"2024-04-26T12:43:15.145242+0000","last_undegraded":"2024-04-26T12:43:15.145242+0000","last_fullsized":"2024-04-26T12:43:15.145242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6","last_scrub_stamp":"2024-04-26T12:43:15.145028+0000","last_deep_scrub":"117'6","last_deep_scrub_stamp":"2024-04-26T12:43:15.145028+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.145028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:13.794591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"139'32","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.033857+0000","last_change":"2024-04-26T12:43:16.033919+0000","last_active":"2024-04-26T12:43:16.033857+0000","last_peered":"2024-04-26T12:43:16.033857+0000","last_clean":"2024-04-26T12:43:16.033857+0000","last_became_active":"2024-04-26T12:38:10.435596+0000","last_became_peered":"2024-04-26T12:38:10.435596+0000","last_unstale":"2024-04-26T12:43:16.033857+0000","last_undegraded":"2024-04-26T12:43:16.033857+0000","last_fullsized":"2024-04-26T12:43:16.033857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:16.033646+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:16.033646+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.033646+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:48.143330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"68'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.801901+0000","last_change":"2024-04-26T12:43:06.801901+0000","last_active":"2024-04-26T12:43:06.801901+0000","last_peered":"2024-04-26T12:43:06.801901+0000","last_clean":"2024-04-26T12:43:06.801901+0000","last_became_active":"2024-04-26T12:38:12.466870+0000","last_became_peered":"2024-04-26T12:38:12.466870+0000","last_unstale":"2024-04-26T12:43:06.801901+0000","last_undegraded":"2024-04-26T12:43:06.801901+0000","last_fullsized":"2024-04-26T12:43:06.801901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:06.801644+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:06.801644+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.801644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:11.269736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"139'36","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.405338+0000","last_change":"2024-04-26T12:43:21.405400+0000","last_active":"2024-04-26T12:43:21.405338+0000","last_peered":"2024-04-26T12:43:21.405338+0000","last_clean":"2024-04-26T12:43:21.405338+0000","last_became_active":"2024-04-26T12:38:10.442791+0000","last_became_peered":"2024-04-26T12:38:10.442791+0000","last_unstale":"2024-04-26T12:43:21.405338+0000","last_undegraded":"2024-04-26T12:43:21.405338+0000","last_fullsized":"2024-04-26T12:43:21.405338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:21.405110+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:21.405110+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.405110+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:21.866319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":63,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.698608+0000","last_change":"2024-04-26T12:43:10.698662+0000","last_active":"2024-04-26T12:43:10.698608+0000","last_peered":"2024-04-26T12:43:10.698608+0000","last_clean":"2024-04-26T12:43:10.698608+0000","last_became_active":"2024-04-26T12:42:34.016025+0000","last_became_peered":"2024-04-26T12:42:34.016025+0000","last_unstale":"2024-04-26T12:43:10.698608+0000","last_undegraded":"2024-04-26T12:43:10.698608+0000","last_fullsized":"2024-04-26T12:43:10.698608+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:10.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:10.698381+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:37.659849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"139'62","reported_seq":332,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.278976+0000","last_change":"2024-04-26T12:43:32.279041+0000","last_active":"2024-04-26T12:43:32.278976+0000","last_peered":"2024-04-26T12:43:32.278976+0000","last_clean":"2024-04-26T12:43:32.278976+0000","last_became_active":"2024-04-26T12:42:21.946477+0000","last_became_peered":"2024-04-26T12:42:21.946477+0000","last_unstale":"2024-04-26T12:43:32.278976+0000","last_undegraded":"2024-04-26T12:43:32.278976+0000","last_fullsized":"2024-04-26T12:43:32.278976+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'62","last_scrub_stamp":"2024-04-26T12:43:32.278756+0000","last_deep_scrub":"139'62","last_deep_scrub_stamp":"2024-04-26T12:43:32.278756+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.278756+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:17.507402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:34.367648+0000","last_change":"2024-04-26T12:43:34.367760+0000","last_active":"2024-04-26T12:43:34.367648+0000","last_peered":"2024-04-26T12:43:34.367648+0000","last_clean":"2024-04-26T12:43:34.367648+0000","last_became_active":"2024-04-26T12:42:21.956507+0000","last_became_peered":"2024-04-26T12:42:21.956507+0000","last_unstale":"2024-04-26T12:43:34.367648+0000","last_undegraded":"2024-04-26T12:43:34.367648+0000","last_fullsized":"2024-04-26T12:43:34.367648+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:34.367362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:34.367362+0000","last_clean_scrub_stamp":"2024-04-26T12:43:34.367362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:27.972814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"139'50","reported_seq":309,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.939594+0000","last_change":"2024-04-26T12:43:20.939731+0000","last_active":"2024-04-26T12:43:20.939594+0000","last_peered":"2024-04-26T12:43:20.939594+0000","last_clean":"2024-04-26T12:43:20.939594+0000","last_became_active":"2024-04-26T12:38:10.467038+0000","last_became_peered":"2024-04-26T12:38:10.467038+0000","last_unstale":"2024-04-26T12:43:20.939594+0000","last_undegraded":"2024-04-26T12:43:20.939594+0000","last_fullsized":"2024-04-26T12:43:20.939594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:20.939310+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:20.939310+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.939310+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:41.725910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"104'4","reported_seq":272,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.542893+0000","last_change":"2024-04-26T12:43:05.542954+0000","last_active":"2024-04-26T12:43:05.542893+0000","last_peered":"2024-04-26T12:43:05.542893+0000","last_clean":"2024-04-26T12:43:05.542893+0000","last_became_active":"2024-04-26T12:38:12.448345+0000","last_became_peered":"2024-04-26T12:38:12.448345+0000","last_unstale":"2024-04-26T12:43:05.542893+0000","last_undegraded":"2024-04-26T12:43:05.542893+0000","last_fullsized":"2024-04-26T12:43:05.542893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'4","last_scrub_stamp":"2024-04-26T12:43:05.542698+0000","last_deep_scrub":"104'4","last_deep_scrub_stamp":"2024-04-26T12:43:05.542698+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.542698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:07.307221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"139'50","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.525518+0000","last_change":"2024-04-26T12:43:11.525518+0000","last_active":"2024-04-26T12:43:11.525518+0000","last_peered":"2024-04-26T12:43:11.525518+0000","last_clean":"2024-04-26T12:43:11.525518+0000","last_became_active":"2024-04-26T12:38:58.159617+0000","last_became_peered":"2024-04-26T12:38:58.159617+0000","last_unstale":"2024-04-26T12:43:11.525518+0000","last_undegraded":"2024-04-26T12:43:11.525518+0000","last_fullsized":"2024-04-26T12:43:11.525518+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:11.525255+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:11.525255+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.525255+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:57.799993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"68'4","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.640868+0000","last_change":"2024-04-26T12:43:23.640984+0000","last_active":"2024-04-26T12:43:23.640868+0000","last_peered":"2024-04-26T12:43:23.640868+0000","last_clean":"2024-04-26T12:43:23.640868+0000","last_became_active":"2024-04-26T12:42:34.006179+0000","last_became_peered":"2024-04-26T12:42:34.006179+0000","last_unstale":"2024-04-26T12:43:23.640868+0000","last_undegraded":"2024-04-26T12:43:23.640868+0000","last_fullsized":"2024-04-26T12:43:23.640868+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:23.640662+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:23.640662+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.640662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:04.683934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"139'44","reported_seq":303,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.966786+0000","last_change":"2024-04-26T12:43:22.966855+0000","last_active":"2024-04-26T12:43:22.966786+0000","last_peered":"2024-04-26T12:43:22.966786+0000","last_clean":"2024-04-26T12:43:22.966786+0000","last_became_active":"2024-04-26T12:38:10.467404+0000","last_became_peered":"2024-04-26T12:38:10.467404+0000","last_unstale":"2024-04-26T12:43:22.966786+0000","last_undegraded":"2024-04-26T12:43:22.966786+0000","last_fullsized":"2024-04-26T12:43:22.966786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'44","last_scrub_stamp":"2024-04-26T12:43:22.966581+0000","last_deep_scrub":"139'44","last_deep_scrub_stamp":"2024-04-26T12:43:22.966581+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.966581+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:24.970805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'4","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.107464+0000","last_change":"2024-04-26T12:43:13.107601+0000","last_active":"2024-04-26T12:43:13.107464+0000","last_peered":"2024-04-26T12:43:13.107464+0000","last_clean":"2024-04-26T12:43:13.107464+0000","last_became_active":"2024-04-26T12:38:12.457898+0000","last_became_peered":"2024-04-26T12:38:12.457898+0000","last_unstale":"2024-04-26T12:43:13.107464+0000","last_undegraded":"2024-04-26T12:43:13.107464+0000","last_fullsized":"2024-04-26T12:43:13.107464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:13.107156+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:13.107156+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.107156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:42.824560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"139'26","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.249898+0000","last_change":"2024-04-26T12:43:10.250029+0000","last_active":"2024-04-26T12:43:10.249898+0000","last_peered":"2024-04-26T12:43:10.249898+0000","last_clean":"2024-04-26T12:43:10.249898+0000","last_became_active":"2024-04-26T12:42:21.948971+0000","last_became_peered":"2024-04-26T12:42:21.948971+0000","last_unstale":"2024-04-26T12:43:10.249898+0000","last_undegraded":"2024-04-26T12:43:10.249898+0000","last_fullsized":"2024-04-26T12:43:10.249898+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:10.249582+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:10.249582+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.249582+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:40:31.064088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'4","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.547691+0000","last_change":"2024-04-26T12:43:15.547759+0000","last_active":"2024-04-26T12:43:15.547691+0000","last_peered":"2024-04-26T12:43:15.547691+0000","last_clean":"2024-04-26T12:43:15.547691+0000","last_became_active":"2024-04-26T12:42:21.964820+0000","last_became_peered":"2024-04-26T12:42:21.964820+0000","last_unstale":"2024-04-26T12:43:15.547691+0000","last_undegraded":"2024-04-26T12:43:15.547691+0000","last_fullsized":"2024-04-26T12:43:15.547691+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:15.547471+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:15.547471+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.547471+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:52.868633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"91'4","reported_seq":177,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.702070+0000","last_change":"2024-04-26T12:43:19.702131+0000","last_active":"2024-04-26T12:43:19.702070+0000","last_peered":"2024-04-26T12:43:19.702070+0000","last_clean":"2024-04-26T12:43:19.702070+0000","last_became_active":"2024-04-26T12:42:34.003575+0000","last_became_peered":"2024-04-26T12:42:34.003575+0000","last_unstale":"2024-04-26T12:43:19.702070+0000","last_undegraded":"2024-04-26T12:43:19.702070+0000","last_fullsized":"2024-04-26T12:43:19.702070+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T12:43:19.701862+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T12:43:19.701862+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.701862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:10.706580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"139'50","reported_seq":309,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.834868+0000","last_change":"2024-04-26T12:43:16.834932+0000","last_active":"2024-04-26T12:43:16.834868+0000","last_peered":"2024-04-26T12:43:16.834868+0000","last_clean":"2024-04-26T12:43:16.834868+0000","last_became_active":"2024-04-26T12:38:10.472074+0000","last_became_peered":"2024-04-26T12:38:10.472074+0000","last_unstale":"2024-04-26T12:43:16.834868+0000","last_undegraded":"2024-04-26T12:43:16.834868+0000","last_fullsized":"2024-04-26T12:43:16.834868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:16.834665+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:16.834665+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.834665+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:45.581387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"117'4","reported_seq":271,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.754487+0000","last_change":"2024-04-26T12:43:08.754548+0000","last_active":"2024-04-26T12:43:08.754487+0000","last_peered":"2024-04-26T12:43:08.754487+0000","last_clean":"2024-04-26T12:43:08.754487+0000","last_became_active":"2024-04-26T12:38:12.465624+0000","last_became_peered":"2024-04-26T12:38:12.465624+0000","last_unstale":"2024-04-26T12:43:08.754487+0000","last_undegraded":"2024-04-26T12:43:08.754487+0000","last_fullsized":"2024-04-26T12:43:08.754487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:08.754281+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:08.754281+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.754281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:21.843729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"139'68","reported_seq":329,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.511231+0000","last_change":"2024-04-26T12:43:09.511361+0000","last_active":"2024-04-26T12:43:09.511231+0000","last_peered":"2024-04-26T12:43:09.511231+0000","last_clean":"2024-04-26T12:43:09.511231+0000","last_became_active":"2024-04-26T12:38:10.449426+0000","last_became_peered":"2024-04-26T12:38:10.449426+0000","last_unstale":"2024-04-26T12:43:09.511231+0000","last_undegraded":"2024-04-26T12:43:09.511231+0000","last_fullsized":"2024-04-26T12:43:09.511231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'68","last_scrub_stamp":"2024-04-26T12:43:09.510988+0000","last_deep_scrub":"139'68","last_deep_scrub_stamp":"2024-04-26T12:43:09.510988+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.510988+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:42.900382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":3,"num_write":78,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.179647+0000","last_change":"2024-04-26T12:43:17.179706+0000","last_active":"2024-04-26T12:43:17.179647+0000","last_peered":"2024-04-26T12:43:17.179647+0000","last_clean":"2024-04-26T12:43:17.179647+0000","last_became_active":"2024-04-26T12:38:12.454707+0000","last_became_peered":"2024-04-26T12:38:12.454707+0000","last_unstale":"2024-04-26T12:43:17.179647+0000","last_undegraded":"2024-04-26T12:43:17.179647+0000","last_fullsized":"2024-04-26T12:43:17.179647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:17.179433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:17.179433+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.179433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:22.968301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"139'54","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.530981+0000","last_change":"2024-04-26T12:43:13.531047+0000","last_active":"2024-04-26T12:43:13.530981+0000","last_peered":"2024-04-26T12:43:13.530981+0000","last_clean":"2024-04-26T12:43:13.530981+0000","last_became_active":"2024-04-26T12:38:10.452855+0000","last_became_peered":"2024-04-26T12:38:10.452855+0000","last_unstale":"2024-04-26T12:43:13.530981+0000","last_undegraded":"2024-04-26T12:43:13.530981+0000","last_fullsized":"2024-04-26T12:43:13.530981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:13.530753+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:13.530753+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.530753+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:25.642179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"104'8","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.510125+0000","last_change":"2024-04-26T12:43:13.510188+0000","last_active":"2024-04-26T12:43:13.510125+0000","last_peered":"2024-04-26T12:43:13.510125+0000","last_clean":"2024-04-26T12:43:13.510125+0000","last_became_active":"2024-04-26T12:42:21.956566+0000","last_became_peered":"2024-04-26T12:42:21.956566+0000","last_unstale":"2024-04-26T12:43:13.510125+0000","last_undegraded":"2024-04-26T12:43:13.510125+0000","last_fullsized":"2024-04-26T12:43:13.510125+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'8","last_scrub_stamp":"2024-04-26T12:43:13.509891+0000","last_deep_scrub":"104'8","last_deep_scrub_stamp":"2024-04-26T12:43:13.509891+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.509891+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:12.962990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"139'38","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.745631+0000","last_change":"2024-04-26T12:43:17.745776+0000","last_active":"2024-04-26T12:43:17.745631+0000","last_peered":"2024-04-26T12:43:17.745631+0000","last_clean":"2024-04-26T12:43:17.745631+0000","last_became_active":"2024-04-26T12:42:34.022426+0000","last_became_peered":"2024-04-26T12:42:34.022426+0000","last_unstale":"2024-04-26T12:43:17.745631+0000","last_undegraded":"2024-04-26T12:43:17.745631+0000","last_fullsized":"2024-04-26T12:43:17.745631+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:17.745359+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:17.745359+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.745359+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:51.957445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"91'8","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.577896+0000","last_change":"2024-04-26T12:43:01.577896+0000","last_active":"2024-04-26T12:43:01.577896+0000","last_peered":"2024-04-26T12:43:01.577896+0000","last_clean":"2024-04-26T12:43:01.577896+0000","last_became_active":"2024-04-26T12:38:12.449694+0000","last_became_peered":"2024-04-26T12:38:12.449694+0000","last_unstale":"2024-04-26T12:43:01.577896+0000","last_undegraded":"2024-04-26T12:43:01.577896+0000","last_fullsized":"2024-04-26T12:43:01.577896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-04-26T12:43:01.577628+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-04-26T12:43:01.577628+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.577628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:42.423471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"139'42","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.258708+0000","last_change":"2024-04-26T12:43:16.258905+0000","last_active":"2024-04-26T12:43:16.258708+0000","last_peered":"2024-04-26T12:43:16.258708+0000","last_clean":"2024-04-26T12:43:16.258708+0000","last_became_active":"2024-04-26T12:42:21.932303+0000","last_became_peered":"2024-04-26T12:42:21.932303+0000","last_unstale":"2024-04-26T12:43:16.258708+0000","last_undegraded":"2024-04-26T12:43:16.258708+0000","last_fullsized":"2024-04-26T12:43:16.258708+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'42","last_scrub_stamp":"2024-04-26T12:43:16.258462+0000","last_deep_scrub":"139'42","last_deep_scrub_stamp":"2024-04-26T12:43:16.258462+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.258462+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:31.439585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":83968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"67'2","reported_seq":122,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.668127+0000","last_change":"2024-04-26T12:42:58.668192+0000","last_active":"2024-04-26T12:42:58.668127+0000","last_peered":"2024-04-26T12:42:58.668127+0000","last_clean":"2024-04-26T12:42:58.668127+0000","last_became_active":"2024-04-26T12:42:34.025281+0000","last_became_peered":"2024-04-26T12:42:34.025281+0000","last_unstale":"2024-04-26T12:42:58.668127+0000","last_undegraded":"2024-04-26T12:42:58.668127+0000","last_fullsized":"2024-04-26T12:42:58.668127+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:42:58.667924+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:42:58.667924+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.667924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:02.409734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"139'44","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.411672+0000","last_change":"2024-04-26T12:43:22.411733+0000","last_active":"2024-04-26T12:43:22.411672+0000","last_peered":"2024-04-26T12:43:22.411672+0000","last_clean":"2024-04-26T12:43:22.411672+0000","last_became_active":"2024-04-26T12:38:10.454390+0000","last_became_peered":"2024-04-26T12:38:10.454390+0000","last_unstale":"2024-04-26T12:43:22.411672+0000","last_undegraded":"2024-04-26T12:43:22.411672+0000","last_fullsized":"2024-04-26T12:43:22.411672+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'44","last_scrub_stamp":"2024-04-26T12:43:22.411468+0000","last_deep_scrub":"139'44","last_deep_scrub_stamp":"2024-04-26T12:43:22.411468+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.411468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:40.595466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'2","reported_seq":127,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.677090+0000","last_change":"2024-04-26T12:43:26.677156+0000","last_active":"2024-04-26T12:43:26.677090+0000","last_peered":"2024-04-26T12:43:26.677090+0000","last_clean":"2024-04-26T12:43:26.677090+0000","last_became_active":"2024-04-26T12:42:34.013263+0000","last_became_peered":"2024-04-26T12:42:34.013263+0000","last_unstale":"2024-04-26T12:43:26.677090+0000","last_undegraded":"2024-04-26T12:43:26.677090+0000","last_fullsized":"2024-04-26T12:43:26.677090+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:43:26.676846+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:43:26.676846+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.676846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:25.359319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"68'4","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.312435+0000","last_change":"2024-04-26T12:43:02.312583+0000","last_active":"2024-04-26T12:43:02.312435+0000","last_peered":"2024-04-26T12:43:02.312435+0000","last_clean":"2024-04-26T12:43:02.312435+0000","last_became_active":"2024-04-26T12:42:21.961909+0000","last_became_peered":"2024-04-26T12:42:21.961909+0000","last_unstale":"2024-04-26T12:43:02.312435+0000","last_undegraded":"2024-04-26T12:43:02.312435+0000","last_fullsized":"2024-04-26T12:43:02.312435+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:02.312195+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:02.312195+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.312195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:15.538824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"139'36","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.924149+0000","last_change":"2024-04-26T12:43:21.924214+0000","last_active":"2024-04-26T12:43:21.924149+0000","last_peered":"2024-04-26T12:43:21.924149+0000","last_clean":"2024-04-26T12:43:21.924149+0000","last_became_active":"2024-04-26T12:38:10.467337+0000","last_became_peered":"2024-04-26T12:38:10.467337+0000","last_unstale":"2024-04-26T12:43:21.924149+0000","last_undegraded":"2024-04-26T12:43:21.924149+0000","last_fullsized":"2024-04-26T12:43:21.924149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:21.923934+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:21.923934+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.923934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.047282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.194144+0000","last_change":"2024-04-26T12:43:05.194144+0000","last_active":"2024-04-26T12:43:05.194144+0000","last_peered":"2024-04-26T12:43:05.194144+0000","last_clean":"2024-04-26T12:43:05.194144+0000","last_became_active":"2024-04-26T12:38:14.443376+0000","last_became_peered":"2024-04-26T12:38:14.443376+0000","last_unstale":"2024-04-26T12:43:05.194144+0000","last_undegraded":"2024-04-26T12:43:05.194144+0000","last_fullsized":"2024-04-26T12:43:05.194144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:05.193896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:05.193896+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.193896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:55.023402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"139'24","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.205866+0000","last_change":"2024-04-26T12:43:06.205866+0000","last_active":"2024-04-26T12:43:06.205866+0000","last_peered":"2024-04-26T12:43:06.205866+0000","last_clean":"2024-04-26T12:43:06.205866+0000","last_became_active":"2024-04-26T12:38:16.468795+0000","last_became_peered":"2024-04-26T12:38:16.468795+0000","last_unstale":"2024-04-26T12:43:06.205866+0000","last_undegraded":"2024-04-26T12:43:06.205866+0000","last_fullsized":"2024-04-26T12:43:06.205866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'24","last_scrub_stamp":"2024-04-26T12:43:06.205548+0000","last_deep_scrub":"139'24","last_deep_scrub_stamp":"2024-04-26T12:43:06.205548+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.205548+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:35.922951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.909934+0000","last_change":"2024-04-26T12:43:00.909934+0000","last_active":"2024-04-26T12:43:00.909934+0000","last_peered":"2024-04-26T12:43:00.909934+0000","last_clean":"2024-04-26T12:43:00.909934+0000","last_became_active":"2024-04-26T12:38:18.489642+0000","last_became_peered":"2024-04-26T12:38:18.489642+0000","last_unstale":"2024-04-26T12:43:00.909934+0000","last_undegraded":"2024-04-26T12:43:00.909934+0000","last_fullsized":"2024-04-26T12:43:00.909934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.909677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.909677+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.909677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:34.299071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"139'49","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.234487+0000","last_change":"2024-04-26T12:43:01.234487+0000","last_active":"2024-04-26T12:43:01.234487+0000","last_peered":"2024-04-26T12:43:01.234487+0000","last_clean":"2024-04-26T12:43:01.234487+0000","last_became_active":"2024-04-26T12:38:20.523145+0000","last_became_peered":"2024-04-26T12:38:20.523145+0000","last_unstale":"2024-04-26T12:43:01.234487+0000","last_undegraded":"2024-04-26T12:43:01.234487+0000","last_fullsized":"2024-04-26T12:43:01.234487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'49","last_scrub_stamp":"2024-04-26T12:43:01.234232+0000","last_deep_scrub":"139'49","last_deep_scrub_stamp":"2024-04-26T12:43:01.234232+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.234232+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:57.879592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":259,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.145410+0000","last_change":"2024-04-26T12:43:09.145461+0000","last_active":"2024-04-26T12:43:09.145410+0000","last_peered":"2024-04-26T12:43:09.145410+0000","last_clean":"2024-04-26T12:43:09.145410+0000","last_became_active":"2024-04-26T12:38:12.463726+0000","last_became_peered":"2024-04-26T12:38:12.463726+0000","last_unstale":"2024-04-26T12:43:09.145410+0000","last_undegraded":"2024-04-26T12:43:09.145410+0000","last_fullsized":"2024-04-26T12:43:09.145410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:09.145209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:09.145209+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.145209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:43.568311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"139'68","reported_seq":329,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.400534+0000","last_change":"2024-04-26T12:43:19.400598+0000","last_active":"2024-04-26T12:43:19.400534+0000","last_peered":"2024-04-26T12:43:19.400534+0000","last_clean":"2024-04-26T12:43:19.400534+0000","last_became_active":"2024-04-26T12:38:10.474190+0000","last_became_peered":"2024-04-26T12:38:10.474190+0000","last_unstale":"2024-04-26T12:43:19.400534+0000","last_undegraded":"2024-04-26T12:43:19.400534+0000","last_fullsized":"2024-04-26T12:43:19.400534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'68","last_scrub_stamp":"2024-04-26T12:43:19.400287+0000","last_deep_scrub":"139'68","last_deep_scrub_stamp":"2024-04-26T12:43:19.400287+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.400287+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:04.641084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.289308+0000","last_change":"2024-04-26T12:43:00.289382+0000","last_active":"2024-04-26T12:43:00.289308+0000","last_peered":"2024-04-26T12:43:00.289308+0000","last_clean":"2024-04-26T12:43:00.289308+0000","last_became_active":"2024-04-26T12:42:21.968825+0000","last_became_peered":"2024-04-26T12:42:21.968825+0000","last_unstale":"2024-04-26T12:43:00.289308+0000","last_undegraded":"2024-04-26T12:43:00.289308+0000","last_fullsized":"2024-04-26T12:43:00.289308+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.289104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.289104+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.289104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:56.967299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"139'9","reported_seq":67,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.683447+0000","last_change":"2024-04-26T12:43:05.683527+0000","last_active":"2024-04-26T12:43:05.683447+0000","last_peered":"2024-04-26T12:43:05.683447+0000","last_clean":"2024-04-26T12:43:05.683447+0000","last_became_active":"2024-04-26T12:42:34.018809+0000","last_became_peered":"2024-04-26T12:42:34.018809+0000","last_unstale":"2024-04-26T12:43:05.683447+0000","last_undegraded":"2024-04-26T12:43:05.683447+0000","last_fullsized":"2024-04-26T12:43:05.683447+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'9","last_scrub_stamp":"2024-04-26T12:43:05.683254+0000","last_deep_scrub":"139'9","last_deep_scrub_stamp":"2024-04-26T12:43:05.683254+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.683254+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:12.806602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":51,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.690434+0000","last_change":"2024-04-26T12:43:22.690495+0000","last_active":"2024-04-26T12:43:22.690434+0000","last_peered":"2024-04-26T12:43:22.690434+0000","last_clean":"2024-04-26T12:43:22.690434+0000","last_became_active":"2024-04-26T12:42:34.004534+0000","last_became_peered":"2024-04-26T12:42:34.004534+0000","last_unstale":"2024-04-26T12:43:22.690434+0000","last_undegraded":"2024-04-26T12:43:22.690434+0000","last_fullsized":"2024-04-26T12:43:22.690434+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:22.690242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:22.690242+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.690242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:36.772045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.177605+0000","last_change":"2024-04-26T12:42:57.177605+0000","last_active":"2024-04-26T12:42:57.177605+0000","last_peered":"2024-04-26T12:42:57.177605+0000","last_clean":"2024-04-26T12:42:57.177605+0000","last_became_active":"2024-04-26T12:38:20.514710+0000","last_became_peered":"2024-04-26T12:38:20.514710+0000","last_unstale":"2024-04-26T12:42:57.177605+0000","last_undegraded":"2024-04-26T12:42:57.177605+0000","last_fullsized":"2024-04-26T12:42:57.177605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:57.177175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:57.177175+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.177175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:47.735046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"91'4","reported_seq":282,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.236288+0000","last_change":"2024-04-26T12:43:02.236288+0000","last_active":"2024-04-26T12:43:02.236288+0000","last_peered":"2024-04-26T12:43:02.236288+0000","last_clean":"2024-04-26T12:43:02.236288+0000","last_became_active":"2024-04-26T12:42:21.936393+0000","last_became_peered":"2024-04-26T12:42:21.936393+0000","last_unstale":"2024-04-26T12:43:02.236288+0000","last_undegraded":"2024-04-26T12:43:02.236288+0000","last_fullsized":"2024-04-26T12:43:02.236288+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T12:43:02.236023+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T12:43:02.236023+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.236023+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:27:36.659124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"139'42","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.007756+0000","last_change":"2024-04-26T12:43:25.007903+0000","last_active":"2024-04-26T12:43:25.007756+0000","last_peered":"2024-04-26T12:43:25.007756+0000","last_clean":"2024-04-26T12:43:25.007756+0000","last_became_active":"2024-04-26T12:38:10.472623+0000","last_became_peered":"2024-04-26T12:38:10.472623+0000","last_unstale":"2024-04-26T12:43:25.007756+0000","last_undegraded":"2024-04-26T12:43:25.007756+0000","last_fullsized":"2024-04-26T12:43:25.007756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'42","last_scrub_stamp":"2024-04-26T12:43:25.007446+0000","last_deep_scrub":"139'42","last_deep_scrub_stamp":"2024-04-26T12:43:25.007446+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.007446+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:35.962324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.290463+0000","last_change":"2024-04-26T12:43:11.290524+0000","last_active":"2024-04-26T12:43:11.290463+0000","last_peered":"2024-04-26T12:43:11.290463+0000","last_clean":"2024-04-26T12:43:11.290463+0000","last_became_active":"2024-04-26T12:42:21.957657+0000","last_became_peered":"2024-04-26T12:42:21.957657+0000","last_unstale":"2024-04-26T12:43:11.290463+0000","last_undegraded":"2024-04-26T12:43:11.290463+0000","last_fullsized":"2024-04-26T12:43:11.290463+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:11.290245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:11.290245+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.290245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:11.073934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"139'15","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.642454+0000","last_change":"2024-04-26T12:42:57.642454+0000","last_active":"2024-04-26T12:42:57.642454+0000","last_peered":"2024-04-26T12:42:57.642454+0000","last_clean":"2024-04-26T12:42:57.642454+0000","last_became_active":"2024-04-26T12:38:16.453273+0000","last_became_peered":"2024-04-26T12:38:16.453273+0000","last_unstale":"2024-04-26T12:42:57.642454+0000","last_undegraded":"2024-04-26T12:42:57.642454+0000","last_fullsized":"2024-04-26T12:42:57.642454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'15","last_scrub_stamp":"2024-04-26T12:42:57.642311+0000","last_deep_scrub":"139'15","last_deep_scrub_stamp":"2024-04-26T12:42:57.642311+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.642311+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:33:59.889605+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"139'139","reported_seq":514,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.984729+0000","last_change":"2024-04-26T12:43:26.984793+0000","last_active":"2024-04-26T12:43:26.984729+0000","last_peered":"2024-04-26T12:43:26.984729+0000","last_clean":"2024-04-26T12:43:26.984729+0000","last_became_active":"2024-04-26T12:38:18.496680+0000","last_became_peered":"2024-04-26T12:38:18.496680+0000","last_unstale":"2024-04-26T12:43:26.984729+0000","last_undegraded":"2024-04-26T12:43:26.984729+0000","last_fullsized":"2024-04-26T12:43:26.984729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'139","last_scrub_stamp":"2024-04-26T12:43:26.984533+0000","last_deep_scrub":"139'139","last_deep_scrub_stamp":"2024-04-26T12:43:26.984533+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.984533+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:53.946001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"68'6","reported_seq":124,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.717290+0000","last_change":"2024-04-26T12:43:14.717385+0000","last_active":"2024-04-26T12:43:14.717290+0000","last_peered":"2024-04-26T12:43:14.717290+0000","last_clean":"2024-04-26T12:43:14.717290+0000","last_became_active":"2024-04-26T12:42:34.015101+0000","last_became_peered":"2024-04-26T12:42:34.015101+0000","last_unstale":"2024-04-26T12:43:14.717290+0000","last_undegraded":"2024-04-26T12:43:14.717290+0000","last_fullsized":"2024-04-26T12:43:14.717290+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-04-26T12:43:14.717066+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-04-26T12:43:14.717066+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.717066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:11.824082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"68'2","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.303797+0000","last_change":"2024-04-26T12:42:59.303860+0000","last_active":"2024-04-26T12:42:59.303797+0000","last_peered":"2024-04-26T12:42:59.303797+0000","last_clean":"2024-04-26T12:42:59.303797+0000","last_became_active":"2024-04-26T12:42:21.970815+0000","last_became_peered":"2024-04-26T12:42:21.970815+0000","last_unstale":"2024-04-26T12:42:59.303797+0000","last_undegraded":"2024-04-26T12:42:59.303797+0000","last_fullsized":"2024-04-26T12:42:59.303797+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:42:59.303603+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:42:59.303603+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.303603+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:40.944638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"139'54","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.524488+0000","last_change":"2024-04-26T12:43:10.524556+0000","last_active":"2024-04-26T12:43:10.524488+0000","last_peered":"2024-04-26T12:43:10.524488+0000","last_clean":"2024-04-26T12:43:10.524488+0000","last_became_active":"2024-04-26T12:38:10.449439+0000","last_became_peered":"2024-04-26T12:38:10.449439+0000","last_unstale":"2024-04-26T12:43:10.524488+0000","last_undegraded":"2024-04-26T12:43:10.524488+0000","last_fullsized":"2024-04-26T12:43:10.524488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:10.524282+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:10.524282+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.524282+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:56.799020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":262,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.274952+0000","last_change":"2024-04-26T12:43:29.275004+0000","last_active":"2024-04-26T12:43:29.274952+0000","last_peered":"2024-04-26T12:43:29.274952+0000","last_clean":"2024-04-26T12:43:29.274952+0000","last_became_active":"2024-04-26T12:42:21.926086+0000","last_became_peered":"2024-04-26T12:42:21.926086+0000","last_unstale":"2024-04-26T12:43:29.274952+0000","last_undegraded":"2024-04-26T12:43:29.274952+0000","last_fullsized":"2024-04-26T12:43:29.274952+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:29.274729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:29.274729+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.274729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:47.458727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"139'23","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.854610+0000","last_change":"2024-04-26T12:43:13.854683+0000","last_active":"2024-04-26T12:43:13.854610+0000","last_peered":"2024-04-26T12:43:13.854610+0000","last_clean":"2024-04-26T12:43:13.854610+0000","last_became_active":"2024-04-26T12:38:16.529329+0000","last_became_peered":"2024-04-26T12:38:16.529329+0000","last_unstale":"2024-04-26T12:43:13.854610+0000","last_undegraded":"2024-04-26T12:43:13.854610+0000","last_fullsized":"2024-04-26T12:43:13.854610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'23","last_scrub_stamp":"2024-04-26T12:43:13.854420+0000","last_deep_scrub":"139'23","last_deep_scrub_stamp":"2024-04-26T12:43:13.854420+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.854420+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:04.412292+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"139'140","reported_seq":426,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.369300+0000","last_change":"2024-04-26T12:43:07.369369+0000","last_active":"2024-04-26T12:43:07.369300+0000","last_peered":"2024-04-26T12:43:07.369300+0000","last_clean":"2024-04-26T12:43:07.369300+0000","last_became_active":"2024-04-26T12:42:21.972298+0000","last_became_peered":"2024-04-26T12:42:21.972298+0000","last_unstale":"2024-04-26T12:43:07.369300+0000","last_undegraded":"2024-04-26T12:43:07.369300+0000","last_fullsized":"2024-04-26T12:43:07.369300+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'140","last_scrub_stamp":"2024-04-26T12:43:07.369106+0000","last_deep_scrub":"139'140","last_deep_scrub_stamp":"2024-04-26T12:43:07.369106+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.369106+0000","objects_scrubbed":1,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:18.564273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"68'2","reported_seq":268,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.202926+0000","last_change":"2024-04-26T12:43:07.203044+0000","last_active":"2024-04-26T12:43:07.202926+0000","last_peered":"2024-04-26T12:43:07.202926+0000","last_clean":"2024-04-26T12:43:07.202926+0000","last_became_active":"2024-04-26T12:38:12.464120+0000","last_became_peered":"2024-04-26T12:38:12.464120+0000","last_unstale":"2024-04-26T12:43:07.202926+0000","last_undegraded":"2024-04-26T12:43:07.202926+0000","last_fullsized":"2024-04-26T12:43:07.202926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:07.202604+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:07.202604+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.202604+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:23.435288+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"139'48","reported_seq":261,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.578616+0000","last_change":"2024-04-26T12:43:09.578616+0000","last_active":"2024-04-26T12:43:09.578616+0000","last_peered":"2024-04-26T12:43:09.578616+0000","last_clean":"2024-04-26T12:43:09.578616+0000","last_became_active":"2024-04-26T12:38:57.838206+0000","last_became_peered":"2024-04-26T12:38:57.838206+0000","last_unstale":"2024-04-26T12:43:09.578616+0000","last_undegraded":"2024-04-26T12:43:09.578616+0000","last_fullsized":"2024-04-26T12:43:09.578616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:09.578188+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:09.578188+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.578188+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:05.831900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.835576+0000","last_change":"2024-04-26T12:43:03.835690+0000","last_active":"2024-04-26T12:43:03.835576+0000","last_peered":"2024-04-26T12:43:03.835576+0000","last_clean":"2024-04-26T12:43:03.835576+0000","last_became_active":"2024-04-26T12:38:14.464750+0000","last_became_peered":"2024-04-26T12:38:14.464750+0000","last_unstale":"2024-04-26T12:43:03.835576+0000","last_undegraded":"2024-04-26T12:43:03.835576+0000","last_fullsized":"2024-04-26T12:43:03.835576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.835273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.835273+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.835273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:03.288371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"139'38","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.147364+0000","last_change":"2024-04-26T12:43:14.147450+0000","last_active":"2024-04-26T12:43:14.147364+0000","last_peered":"2024-04-26T12:43:14.147364+0000","last_clean":"2024-04-26T12:43:14.147364+0000","last_became_active":"2024-04-26T12:38:16.528944+0000","last_became_peered":"2024-04-26T12:38:16.528944+0000","last_unstale":"2024-04-26T12:43:14.147364+0000","last_undegraded":"2024-04-26T12:43:14.147364+0000","last_fullsized":"2024-04-26T12:43:14.147364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:14.147135+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:14.147135+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.147135+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:24.485106+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.973887+0000","last_change":"2024-04-26T12:43:08.973943+0000","last_active":"2024-04-26T12:43:08.973887+0000","last_peered":"2024-04-26T12:43:08.973887+0000","last_clean":"2024-04-26T12:43:08.973887+0000","last_became_active":"2024-04-26T12:38:18.502449+0000","last_became_peered":"2024-04-26T12:38:18.502449+0000","last_unstale":"2024-04-26T12:43:08.973887+0000","last_undegraded":"2024-04-26T12:43:08.973887+0000","last_fullsized":"2024-04-26T12:43:08.973887+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:08.973679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:08.973679+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.973679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:05.619038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.199675+0000","last_change":"2024-04-26T12:43:00.199712+0000","last_active":"2024-04-26T12:43:00.199675+0000","last_peered":"2024-04-26T12:43:00.199675+0000","last_clean":"2024-04-26T12:43:00.199675+0000","last_became_active":"2024-04-26T12:38:20.522436+0000","last_became_peered":"2024-04-26T12:38:20.522436+0000","last_unstale":"2024-04-26T12:43:00.199675+0000","last_undegraded":"2024-04-26T12:43:00.199675+0000","last_fullsized":"2024-04-26T12:43:00.199675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.199539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.199539+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.199539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:59.508818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"117'8","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.648754+0000","last_change":"2024-04-26T12:43:29.648817+0000","last_active":"2024-04-26T12:43:29.648754+0000","last_peered":"2024-04-26T12:43:29.648754+0000","last_clean":"2024-04-26T12:43:29.648754+0000","last_became_active":"2024-04-26T12:42:34.027515+0000","last_became_peered":"2024-04-26T12:42:34.027515+0000","last_unstale":"2024-04-26T12:43:29.648754+0000","last_undegraded":"2024-04-26T12:43:29.648754+0000","last_fullsized":"2024-04-26T12:43:29.648754+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'8","last_scrub_stamp":"2024-04-26T12:43:29.648528+0000","last_deep_scrub":"117'8","last_deep_scrub_stamp":"2024-04-26T12:43:29.648528+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.648528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:03.856585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"139'40","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.972765+0000","last_change":"2024-04-26T12:43:23.972824+0000","last_active":"2024-04-26T12:43:23.972765+0000","last_peered":"2024-04-26T12:43:23.972765+0000","last_clean":"2024-04-26T12:43:23.972765+0000","last_became_active":"2024-04-26T12:38:10.467186+0000","last_became_peered":"2024-04-26T12:38:10.467186+0000","last_unstale":"2024-04-26T12:43:23.972765+0000","last_undegraded":"2024-04-26T12:43:23.972765+0000","last_fullsized":"2024-04-26T12:43:23.972765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:23.972572+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:23.972572+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.972572+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:22.578544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.577417+0000","last_change":"2024-04-26T12:43:04.577525+0000","last_active":"2024-04-26T12:43:04.577417+0000","last_peered":"2024-04-26T12:43:04.577417+0000","last_clean":"2024-04-26T12:43:04.577417+0000","last_became_active":"2024-04-26T12:38:14.444808+0000","last_became_peered":"2024-04-26T12:38:14.444808+0000","last_unstale":"2024-04-26T12:43:04.577417+0000","last_undegraded":"2024-04-26T12:43:04.577417+0000","last_fullsized":"2024-04-26T12:43:04.577417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.577199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.577199+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.577199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:27:12.782935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"139'27","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:38.348279+0000","last_change":"2024-04-26T12:43:38.348360+0000","last_active":"2024-04-26T12:43:38.348279+0000","last_peered":"2024-04-26T12:43:38.348279+0000","last_clean":"2024-04-26T12:43:38.348279+0000","last_became_active":"2024-04-26T12:42:21.968492+0000","last_became_peered":"2024-04-26T12:42:21.968492+0000","last_unstale":"2024-04-26T12:43:38.348279+0000","last_undegraded":"2024-04-26T12:43:38.348279+0000","last_fullsized":"2024-04-26T12:43:38.348279+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'27","last_scrub_stamp":"2024-04-26T12:43:38.348080+0000","last_deep_scrub":"139'27","last_deep_scrub_stamp":"2024-04-26T12:43:38.348080+0000","last_clean_scrub_stamp":"2024-04-26T12:43:38.348080+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:20.116474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.261648+0000","last_change":"2024-04-26T12:43:18.261703+0000","last_active":"2024-04-26T12:43:18.261648+0000","last_peered":"2024-04-26T12:43:18.261648+0000","last_clean":"2024-04-26T12:43:18.261648+0000","last_became_active":"2024-04-26T12:42:21.942925+0000","last_became_peered":"2024-04-26T12:42:21.942925+0000","last_unstale":"2024-04-26T12:43:18.261648+0000","last_undegraded":"2024-04-26T12:43:18.261648+0000","last_fullsized":"2024-04-26T12:43:18.261648+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:18.261435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:18.261435+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.261435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:14.820450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"104'9","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.600088+0000","last_change":"2024-04-26T12:43:22.600148+0000","last_active":"2024-04-26T12:43:22.600088+0000","last_peered":"2024-04-26T12:43:22.600088+0000","last_clean":"2024-04-26T12:43:22.600088+0000","last_became_active":"2024-04-26T12:38:20.521950+0000","last_became_peered":"2024-04-26T12:38:20.521950+0000","last_unstale":"2024-04-26T12:43:22.600088+0000","last_undegraded":"2024-04-26T12:43:22.600088+0000","last_fullsized":"2024-04-26T12:43:22.600088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'9","last_scrub_stamp":"2024-04-26T12:43:22.599879+0000","last_deep_scrub":"104'9","last_deep_scrub_stamp":"2024-04-26T12:43:22.599879+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.599879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:13.157750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"74'4","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.597598+0000","last_change":"2024-04-26T12:43:03.597659+0000","last_active":"2024-04-26T12:43:03.597598+0000","last_peered":"2024-04-26T12:43:03.597598+0000","last_clean":"2024-04-26T12:43:03.597598+0000","last_became_active":"2024-04-26T12:38:12.448615+0000","last_became_peered":"2024-04-26T12:38:12.448615+0000","last_unstale":"2024-04-26T12:43:03.597598+0000","last_undegraded":"2024-04-26T12:43:03.597598+0000","last_fullsized":"2024-04-26T12:43:03.597598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-04-26T12:43:03.597397+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-04-26T12:43:03.597397+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.597397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:49.371415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"139'38","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.850437+0000","last_change":"2024-04-26T12:43:14.850502+0000","last_active":"2024-04-26T12:43:14.850437+0000","last_peered":"2024-04-26T12:43:14.850437+0000","last_clean":"2024-04-26T12:43:14.850437+0000","last_became_active":"2024-04-26T12:38:10.474265+0000","last_became_peered":"2024-04-26T12:38:10.474265+0000","last_unstale":"2024-04-26T12:43:14.850437+0000","last_undegraded":"2024-04-26T12:43:14.850437+0000","last_fullsized":"2024-04-26T12:43:14.850437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:14.850229+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:14.850229+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.850229+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:18.592039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.624596+0000","last_change":"2024-04-26T12:43:07.624649+0000","last_active":"2024-04-26T12:43:07.624596+0000","last_peered":"2024-04-26T12:43:07.624596+0000","last_clean":"2024-04-26T12:43:07.624596+0000","last_became_active":"2024-04-26T12:38:14.455979+0000","last_became_peered":"2024-04-26T12:38:14.455979+0000","last_unstale":"2024-04-26T12:43:07.624596+0000","last_undegraded":"2024-04-26T12:43:07.624596+0000","last_fullsized":"2024-04-26T12:43:07.624596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:07.624397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:07.624397+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.624397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:57.852666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"139'33","reported_seq":294,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.793798+0000","last_change":"2024-04-26T12:43:07.793894+0000","last_active":"2024-04-26T12:43:07.793798+0000","last_peered":"2024-04-26T12:43:07.793798+0000","last_clean":"2024-04-26T12:43:07.793798+0000","last_became_active":"2024-04-26T12:38:16.464386+0000","last_became_peered":"2024-04-26T12:38:16.464386+0000","last_unstale":"2024-04-26T12:43:07.793798+0000","last_undegraded":"2024-04-26T12:43:07.793798+0000","last_fullsized":"2024-04-26T12:43:07.793798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'33","last_scrub_stamp":"2024-04-26T12:43:07.793623+0000","last_deep_scrub":"139'33","last_deep_scrub_stamp":"2024-04-26T12:43:07.793623+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.793623+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:03.458697+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"139'139","reported_seq":468,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.422683+0000","last_change":"2024-04-26T12:43:28.422748+0000","last_active":"2024-04-26T12:43:28.422683+0000","last_peered":"2024-04-26T12:43:28.422683+0000","last_clean":"2024-04-26T12:43:28.422683+0000","last_became_active":"2024-04-26T12:38:18.494734+0000","last_became_peered":"2024-04-26T12:38:18.494734+0000","last_unstale":"2024-04-26T12:43:28.422683+0000","last_undegraded":"2024-04-26T12:43:28.422683+0000","last_fullsized":"2024-04-26T12:43:28.422683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'139","last_scrub_stamp":"2024-04-26T12:43:28.422471+0000","last_deep_scrub":"139'139","last_deep_scrub_stamp":"2024-04-26T12:43:28.422471+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.422471+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:43.355095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"68'4","reported_seq":247,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.132746+0000","last_change":"2024-04-26T12:42:56.132770+0000","last_active":"2024-04-26T12:42:56.132746+0000","last_peered":"2024-04-26T12:42:56.132746+0000","last_clean":"2024-04-26T12:42:56.132746+0000","last_became_active":"2024-04-26T12:38:20.514568+0000","last_became_peered":"2024-04-26T12:38:20.514568+0000","last_unstale":"2024-04-26T12:42:56.132746+0000","last_undegraded":"2024-04-26T12:42:56.132746+0000","last_fullsized":"2024-04-26T12:42:56.132746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:42:56.132663+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:42:56.132663+0000","last_clean_scrub_stamp":"2024-04-26T12:42:56.132663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:50.436843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"68'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.440872+0000","last_change":"2024-04-26T12:43:17.440934+0000","last_active":"2024-04-26T12:43:17.440872+0000","last_peered":"2024-04-26T12:43:17.440872+0000","last_clean":"2024-04-26T12:43:17.440872+0000","last_became_active":"2024-04-26T12:38:12.456874+0000","last_became_peered":"2024-04-26T12:38:12.456874+0000","last_unstale":"2024-04-26T12:43:17.440872+0000","last_undegraded":"2024-04-26T12:43:17.440872+0000","last_fullsized":"2024-04-26T12:43:17.440872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:17.440639+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:17.440639+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.440639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:32.950498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"139'36","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:35.269468+0000","last_change":"2024-04-26T12:43:35.269533+0000","last_active":"2024-04-26T12:43:35.269468+0000","last_peered":"2024-04-26T12:43:35.269468+0000","last_clean":"2024-04-26T12:43:35.269468+0000","last_became_active":"2024-04-26T12:42:21.959122+0000","last_became_peered":"2024-04-26T12:42:21.959122+0000","last_unstale":"2024-04-26T12:43:35.269468+0000","last_undegraded":"2024-04-26T12:43:35.269468+0000","last_fullsized":"2024-04-26T12:43:35.269468+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:35.269260+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:35.269260+0000","last_clean_scrub_stamp":"2024-04-26T12:43:35.269260+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:36.573418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.579314+0000","last_change":"2024-04-26T12:42:59.579343+0000","last_active":"2024-04-26T12:42:59.579314+0000","last_peered":"2024-04-26T12:42:59.579314+0000","last_clean":"2024-04-26T12:42:59.579314+0000","last_became_active":"2024-04-26T12:38:14.463443+0000","last_became_peered":"2024-04-26T12:38:14.463443+0000","last_unstale":"2024-04-26T12:42:59.579314+0000","last_undegraded":"2024-04-26T12:42:59.579314+0000","last_fullsized":"2024-04-26T12:42:59.579314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:59.579187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:59.579187+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.579187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:52.115646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"139'39","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.253479+0000","last_change":"2024-04-26T12:43:08.253556+0000","last_active":"2024-04-26T12:43:08.253479+0000","last_peered":"2024-04-26T12:43:08.253479+0000","last_clean":"2024-04-26T12:43:08.253479+0000","last_became_active":"2024-04-26T12:38:16.470081+0000","last_became_peered":"2024-04-26T12:38:16.470081+0000","last_unstale":"2024-04-26T12:43:08.253479+0000","last_undegraded":"2024-04-26T12:43:08.253479+0000","last_fullsized":"2024-04-26T12:43:08.253479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'39","last_scrub_stamp":"2024-04-26T12:43:08.253296+0000","last_deep_scrub":"139'39","last_deep_scrub_stamp":"2024-04-26T12:43:08.253296+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.253296+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:50.352734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.623885+0000","last_change":"2024-04-26T12:42:58.623924+0000","last_active":"2024-04-26T12:42:58.623885+0000","last_peered":"2024-04-26T12:42:58.623885+0000","last_clean":"2024-04-26T12:42:58.623885+0000","last_became_active":"2024-04-26T12:38:18.472069+0000","last_became_peered":"2024-04-26T12:38:18.472069+0000","last_unstale":"2024-04-26T12:42:58.623885+0000","last_undegraded":"2024-04-26T12:42:58.623885+0000","last_fullsized":"2024-04-26T12:42:58.623885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:58.623773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:58.623773+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.623773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:57.930708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"139'8","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.117115+0000","last_change":"2024-04-26T12:43:25.117179+0000","last_active":"2024-04-26T12:43:25.117115+0000","last_peered":"2024-04-26T12:43:25.117115+0000","last_clean":"2024-04-26T12:43:25.117115+0000","last_became_active":"2024-04-26T12:42:21.934686+0000","last_became_peered":"2024-04-26T12:42:21.934686+0000","last_unstale":"2024-04-26T12:43:25.117115+0000","last_undegraded":"2024-04-26T12:43:25.117115+0000","last_fullsized":"2024-04-26T12:43:25.117115+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'8","last_scrub_stamp":"2024-04-26T12:43:25.116917+0000","last_deep_scrub":"139'8","last_deep_scrub_stamp":"2024-04-26T12:43:25.116917+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.116917+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:52.511928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"117'4","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.709482+0000","last_change":"2024-04-26T12:43:32.709482+0000","last_active":"2024-04-26T12:43:32.709482+0000","last_peered":"2024-04-26T12:43:32.709482+0000","last_clean":"2024-04-26T12:43:32.709482+0000","last_became_active":"2024-04-26T12:42:34.031776+0000","last_became_peered":"2024-04-26T12:42:34.031776+0000","last_unstale":"2024-04-26T12:43:32.709482+0000","last_undegraded":"2024-04-26T12:43:32.709482+0000","last_fullsized":"2024-04-26T12:43:32.709482+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:32.709169+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:32.709169+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.709169+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:26.314620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"139'52","reported_seq":309,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:36.296889+0000","last_change":"2024-04-26T12:43:36.297017+0000","last_active":"2024-04-26T12:43:36.296889+0000","last_peered":"2024-04-26T12:43:36.296889+0000","last_clean":"2024-04-26T12:43:36.296889+0000","last_became_active":"2024-04-26T12:42:21.967072+0000","last_became_peered":"2024-04-26T12:42:21.967072+0000","last_unstale":"2024-04-26T12:43:36.296889+0000","last_undegraded":"2024-04-26T12:43:36.296889+0000","last_fullsized":"2024-04-26T12:43:36.296889+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'52","last_scrub_stamp":"2024-04-26T12:43:36.296595+0000","last_deep_scrub":"139'52","last_deep_scrub_stamp":"2024-04-26T12:43:36.296595+0000","last_clean_scrub_stamp":"2024-04-26T12:43:36.296595+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:37.157088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.671500+0000","last_change":"2024-04-26T12:43:06.671553+0000","last_active":"2024-04-26T12:43:06.671500+0000","last_peered":"2024-04-26T12:43:06.671500+0000","last_clean":"2024-04-26T12:43:06.671500+0000","last_became_active":"2024-04-26T12:38:14.451254+0000","last_became_peered":"2024-04-26T12:38:14.451254+0000","last_unstale":"2024-04-26T12:43:06.671500+0000","last_undegraded":"2024-04-26T12:43:06.671500+0000","last_fullsized":"2024-04-26T12:43:06.671500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:06.671308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:06.671308+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.671308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:08.435831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"139'26","reported_seq":85,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.723100+0000","last_change":"2024-04-26T12:43:01.723178+0000","last_active":"2024-04-26T12:43:01.723100+0000","last_peered":"2024-04-26T12:43:01.723100+0000","last_clean":"2024-04-26T12:43:01.723100+0000","last_became_active":"2024-04-26T12:42:34.027524+0000","last_became_peered":"2024-04-26T12:42:34.027524+0000","last_unstale":"2024-04-26T12:43:01.723100+0000","last_undegraded":"2024-04-26T12:43:01.723100+0000","last_fullsized":"2024-04-26T12:43:01.723100+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:01.722913+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:01.722913+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.722913+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:33.832597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.420270+0000","last_change":"2024-04-26T12:43:30.420395+0000","last_active":"2024-04-26T12:43:30.420270+0000","last_peered":"2024-04-26T12:43:30.420270+0000","last_clean":"2024-04-26T12:43:30.420270+0000","last_became_active":"2024-04-26T12:42:21.937057+0000","last_became_peered":"2024-04-26T12:42:21.937057+0000","last_unstale":"2024-04-26T12:43:30.420270+0000","last_undegraded":"2024-04-26T12:43:30.420270+0000","last_fullsized":"2024-04-26T12:43:30.420270+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:30.420027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:30.420027+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.420027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:04.055624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"67'4","reported_seq":227,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.277903+0000","last_change":"2024-04-26T12:43:09.278044+0000","last_active":"2024-04-26T12:43:09.277903+0000","last_peered":"2024-04-26T12:43:09.277903+0000","last_clean":"2024-04-26T12:43:09.277903+0000","last_became_active":"2024-04-26T12:42:21.948878+0000","last_became_peered":"2024-04-26T12:42:21.948878+0000","last_unstale":"2024-04-26T12:43:09.277903+0000","last_undegraded":"2024-04-26T12:43:09.277903+0000","last_fullsized":"2024-04-26T12:43:09.277903+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:09.277669+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:09.277669+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.277669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:05.039552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'6","reported_seq":140,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.726264+0000","last_change":"2024-04-26T12:43:08.726414+0000","last_active":"2024-04-26T12:43:08.726264+0000","last_peered":"2024-04-26T12:43:08.726264+0000","last_clean":"2024-04-26T12:43:08.726264+0000","last_became_active":"2024-04-26T12:42:34.018540+0000","last_became_peered":"2024-04-26T12:42:34.018540+0000","last_unstale":"2024-04-26T12:43:08.726264+0000","last_undegraded":"2024-04-26T12:43:08.726264+0000","last_fullsized":"2024-04-26T12:43:08.726264+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-04-26T12:43:08.726036+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-04-26T12:43:08.726036+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.726036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:26.448825+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"139'40","reported_seq":300,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.495420+0000","last_change":"2024-04-26T12:43:14.495545+0000","last_active":"2024-04-26T12:43:14.495420+0000","last_peered":"2024-04-26T12:43:14.495420+0000","last_clean":"2024-04-26T12:43:14.495420+0000","last_became_active":"2024-04-26T12:38:10.451606+0000","last_became_peered":"2024-04-26T12:38:10.451606+0000","last_unstale":"2024-04-26T12:43:14.495420+0000","last_undegraded":"2024-04-26T12:43:14.495420+0000","last_fullsized":"2024-04-26T12:43:14.495420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:14.495095+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:14.495095+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.495095+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:51.816257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:56.900868+0000","last_change":"2024-04-26T12:42:56.900889+0000","last_active":"2024-04-26T12:42:56.900868+0000","last_peered":"2024-04-26T12:42:56.900868+0000","last_clean":"2024-04-26T12:42:56.900868+0000","last_became_active":"2024-04-26T12:38:14.457924+0000","last_became_peered":"2024-04-26T12:38:14.457924+0000","last_unstale":"2024-04-26T12:42:56.900868+0000","last_undegraded":"2024-04-26T12:42:56.900868+0000","last_fullsized":"2024-04-26T12:42:56.900868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:56.900773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:56.900773+0000","last_clean_scrub_stamp":"2024-04-26T12:42:56.900773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:47.129042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"139'32","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.531746+0000","last_change":"2024-04-26T12:43:14.531831+0000","last_active":"2024-04-26T12:43:14.531746+0000","last_peered":"2024-04-26T12:43:14.531746+0000","last_clean":"2024-04-26T12:43:14.531746+0000","last_became_active":"2024-04-26T12:42:21.958977+0000","last_became_peered":"2024-04-26T12:42:21.958977+0000","last_unstale":"2024-04-26T12:43:14.531746+0000","last_undegraded":"2024-04-26T12:43:14.531746+0000","last_fullsized":"2024-04-26T12:43:14.531746+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:14.531555+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:14.531555+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.531555+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:26.642981+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"139'138","reported_seq":452,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.622736+0000","last_change":"2024-04-26T12:43:08.622800+0000","last_active":"2024-04-26T12:43:08.622736+0000","last_peered":"2024-04-26T12:43:08.622736+0000","last_clean":"2024-04-26T12:43:08.622736+0000","last_became_active":"2024-04-26T12:38:18.489177+0000","last_became_peered":"2024-04-26T12:38:18.489177+0000","last_unstale":"2024-04-26T12:43:08.622736+0000","last_undegraded":"2024-04-26T12:43:08.622736+0000","last_fullsized":"2024-04-26T12:43:08.622736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:08.622527+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:08.622527+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.622527+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:37.571768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"67'2","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.120795+0000","last_change":"2024-04-26T12:43:19.120857+0000","last_active":"2024-04-26T12:43:19.120795+0000","last_peered":"2024-04-26T12:43:19.120795+0000","last_clean":"2024-04-26T12:43:19.120795+0000","last_became_active":"2024-04-26T12:38:20.501611+0000","last_became_peered":"2024-04-26T12:38:20.501611+0000","last_unstale":"2024-04-26T12:43:19.120795+0000","last_undegraded":"2024-04-26T12:43:19.120795+0000","last_fullsized":"2024-04-26T12:43:19.120795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:43:19.120559+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:43:19.120559+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.120559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:39.907160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"91'6","reported_seq":189,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.705327+0000","last_change":"2024-04-26T12:42:59.705388+0000","last_active":"2024-04-26T12:42:59.705327+0000","last_peered":"2024-04-26T12:42:59.705327+0000","last_clean":"2024-04-26T12:42:59.705327+0000","last_became_active":"2024-04-26T12:42:34.025094+0000","last_became_peered":"2024-04-26T12:42:34.025094+0000","last_unstale":"2024-04-26T12:42:59.705327+0000","last_undegraded":"2024-04-26T12:42:59.705327+0000","last_fullsized":"2024-04-26T12:42:59.705327+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-04-26T12:42:59.705118+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-04-26T12:42:59.705118+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.705118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:42.842126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"139'70","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.692554+0000","last_change":"2024-04-26T12:43:03.692616+0000","last_active":"2024-04-26T12:43:03.692554+0000","last_peered":"2024-04-26T12:43:03.692554+0000","last_clean":"2024-04-26T12:43:03.692554+0000","last_became_active":"2024-04-26T12:42:34.019821+0000","last_became_peered":"2024-04-26T12:42:34.019821+0000","last_unstale":"2024-04-26T12:43:03.692554+0000","last_undegraded":"2024-04-26T12:43:03.692554+0000","last_fullsized":"2024-04-26T12:43:03.692554+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'70","last_scrub_stamp":"2024-04-26T12:43:03.692350+0000","last_deep_scrub":"139'70","last_deep_scrub_stamp":"2024-04-26T12:43:03.692350+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.692350+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:15.436633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"139'4","reported_seq":441,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.217077+0000","last_change":"2024-04-26T12:43:06.217156+0000","last_active":"2024-04-26T12:43:06.217077+0000","last_peered":"2024-04-26T12:43:06.217077+0000","last_clean":"2024-04-26T12:43:06.217077+0000","last_became_active":"2024-04-26T12:38:14.458243+0000","last_became_peered":"2024-04-26T12:38:14.458243+0000","last_unstale":"2024-04-26T12:43:06.217077+0000","last_undegraded":"2024-04-26T12:43:06.217077+0000","last_fullsized":"2024-04-26T12:43:06.217077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'4","last_scrub_stamp":"2024-04-26T12:43:06.216848+0000","last_deep_scrub":"139'4","last_deep_scrub_stamp":"2024-04-26T12:43:06.216848+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.216848+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.585068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"139'15","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.218749+0000","last_change":"2024-04-26T12:43:17.218821+0000","last_active":"2024-04-26T12:43:17.218749+0000","last_peered":"2024-04-26T12:43:17.218749+0000","last_clean":"2024-04-26T12:43:17.218749+0000","last_became_active":"2024-04-26T12:42:21.952480+0000","last_became_peered":"2024-04-26T12:42:21.952480+0000","last_unstale":"2024-04-26T12:43:17.218749+0000","last_undegraded":"2024-04-26T12:43:17.218749+0000","last_fullsized":"2024-04-26T12:43:17.218749+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'15","last_scrub_stamp":"2024-04-26T12:43:17.218550+0000","last_deep_scrub":"139'15","last_deep_scrub_stamp":"2024-04-26T12:43:17.218550+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.218550+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:06:53.496680+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"139'138","reported_seq":484,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.646105+0000","last_change":"2024-04-26T12:43:18.646170+0000","last_active":"2024-04-26T12:43:18.646105+0000","last_peered":"2024-04-26T12:43:18.646105+0000","last_clean":"2024-04-26T12:43:18.646105+0000","last_became_active":"2024-04-26T12:38:18.496147+0000","last_became_peered":"2024-04-26T12:38:18.496147+0000","last_unstale":"2024-04-26T12:43:18.646105+0000","last_undegraded":"2024-04-26T12:43:18.646105+0000","last_fullsized":"2024-04-26T12:43:18.646105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:18.645905+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:18.645905+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.645905+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:47.534473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'4","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.696476+0000","last_change":"2024-04-26T12:43:04.696540+0000","last_active":"2024-04-26T12:43:04.696476+0000","last_peered":"2024-04-26T12:43:04.696476+0000","last_clean":"2024-04-26T12:43:04.696476+0000","last_became_active":"2024-04-26T12:42:34.015095+0000","last_became_peered":"2024-04-26T12:42:34.015095+0000","last_unstale":"2024-04-26T12:43:04.696476+0000","last_undegraded":"2024-04-26T12:43:04.696476+0000","last_fullsized":"2024-04-26T12:43:04.696476+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:04.696255+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:04.696255+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.696255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:25.482856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.136384+0000","last_change":"2024-04-26T12:43:26.136441+0000","last_active":"2024-04-26T12:43:26.136384+0000","last_peered":"2024-04-26T12:43:26.136384+0000","last_clean":"2024-04-26T12:43:26.136384+0000","last_became_active":"2024-04-26T12:42:21.953253+0000","last_became_peered":"2024-04-26T12:42:21.953253+0000","last_unstale":"2024-04-26T12:43:26.136384+0000","last_undegraded":"2024-04-26T12:43:26.136384+0000","last_fullsized":"2024-04-26T12:43:26.136384+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:26.136200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:26.136200+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.136200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:04.018570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"139'40","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.337604+0000","last_change":"2024-04-26T12:43:14.337667+0000","last_active":"2024-04-26T12:43:14.337604+0000","last_peered":"2024-04-26T12:43:14.337604+0000","last_clean":"2024-04-26T12:43:14.337604+0000","last_became_active":"2024-04-26T12:42:21.940512+0000","last_became_peered":"2024-04-26T12:42:21.940512+0000","last_unstale":"2024-04-26T12:43:14.337604+0000","last_undegraded":"2024-04-26T12:43:14.337604+0000","last_fullsized":"2024-04-26T12:43:14.337604+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:14.337382+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:14.337382+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.337382+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:29.589516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":59,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.704574+0000","last_change":"2024-04-26T12:43:21.704627+0000","last_active":"2024-04-26T12:43:21.704574+0000","last_peered":"2024-04-26T12:43:21.704574+0000","last_clean":"2024-04-26T12:43:21.704574+0000","last_became_active":"2024-04-26T12:42:34.005897+0000","last_became_peered":"2024-04-26T12:42:34.005897+0000","last_unstale":"2024-04-26T12:43:21.704574+0000","last_undegraded":"2024-04-26T12:43:21.704574+0000","last_fullsized":"2024-04-26T12:43:21.704574+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:21.704375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:21.704375+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.704375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:39.888373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"139'36","reported_seq":302,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.106269+0000","last_change":"2024-04-26T12:43:10.106352+0000","last_active":"2024-04-26T12:43:10.106269+0000","last_peered":"2024-04-26T12:43:10.106269+0000","last_clean":"2024-04-26T12:43:10.106269+0000","last_became_active":"2024-04-26T12:38:16.474072+0000","last_became_peered":"2024-04-26T12:38:16.474072+0000","last_unstale":"2024-04-26T12:43:10.106269+0000","last_undegraded":"2024-04-26T12:43:10.106269+0000","last_fullsized":"2024-04-26T12:43:10.106269+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:10.106078+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:10.106078+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.106078+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:26.424587+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.570860+0000","last_change":"2024-04-26T12:43:23.571003+0000","last_active":"2024-04-26T12:43:23.570860+0000","last_peered":"2024-04-26T12:43:23.570860+0000","last_clean":"2024-04-26T12:43:23.570860+0000","last_became_active":"2024-04-26T12:42:21.946663+0000","last_became_peered":"2024-04-26T12:42:21.946663+0000","last_unstale":"2024-04-26T12:43:23.570860+0000","last_undegraded":"2024-04-26T12:43:23.570860+0000","last_fullsized":"2024-04-26T12:43:23.570860+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:23.570615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:23.570615+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.570615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:27.312425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.082820+0000","last_change":"2024-04-26T12:43:20.082900+0000","last_active":"2024-04-26T12:43:20.082820+0000","last_peered":"2024-04-26T12:43:20.082820+0000","last_clean":"2024-04-26T12:43:20.082820+0000","last_became_active":"2024-04-26T12:38:20.516655+0000","last_became_peered":"2024-04-26T12:38:20.516655+0000","last_unstale":"2024-04-26T12:43:20.082820+0000","last_undegraded":"2024-04-26T12:43:20.082820+0000","last_fullsized":"2024-04-26T12:43:20.082820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:20.082606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:20.082606+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.082606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:32:31.111296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"67'8","reported_seq":292,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.612572+0000","last_change":"2024-04-26T12:43:01.612636+0000","last_active":"2024-04-26T12:43:01.612572+0000","last_peered":"2024-04-26T12:43:01.612572+0000","last_clean":"2024-04-26T12:43:01.612572+0000","last_became_active":"2024-04-26T12:38:12.451309+0000","last_became_peered":"2024-04-26T12:38:12.451309+0000","last_unstale":"2024-04-26T12:43:01.612572+0000","last_undegraded":"2024-04-26T12:43:01.612572+0000","last_fullsized":"2024-04-26T12:43:01.612572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-04-26T12:43:01.612356+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-04-26T12:43:01.612356+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.612356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:33.491385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"139'119","reported_seq":417,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.917410+0000","last_change":"2024-04-26T12:43:19.917497+0000","last_active":"2024-04-26T12:43:19.917410+0000","last_peered":"2024-04-26T12:43:19.917410+0000","last_clean":"2024-04-26T12:43:19.917410+0000","last_became_active":"2024-04-26T12:38:04.411482+0000","last_became_peered":"2024-04-26T12:38:04.411482+0000","last_unstale":"2024-04-26T12:43:19.917410+0000","last_undegraded":"2024-04-26T12:43:19.917410+0000","last_fullsized":"2024-04-26T12:43:19.917410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'119","last_scrub_stamp":"2024-04-26T12:43:19.917235+0000","last_deep_scrub":"139'119","last_deep_scrub_stamp":"2024-04-26T12:43:19.917235+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.917235+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.661518+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.223894+0000","last_change":"2024-04-26T12:43:21.223950+0000","last_active":"2024-04-26T12:43:21.223894+0000","last_peered":"2024-04-26T12:43:21.223894+0000","last_clean":"2024-04-26T12:43:21.223894+0000","last_became_active":"2024-04-26T12:38:04.384708+0000","last_became_peered":"2024-04-26T12:38:04.384708+0000","last_unstale":"2024-04-26T12:43:21.223894+0000","last_undegraded":"2024-04-26T12:43:21.223894+0000","last_fullsized":"2024-04-26T12:43:21.223894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:21.223692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:21.223692+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.223692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:50.566165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"139'66","reported_seq":324,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.154484+0000","last_change":"2024-04-26T12:43:28.154549+0000","last_active":"2024-04-26T12:43:28.154484+0000","last_peered":"2024-04-26T12:43:28.154484+0000","last_clean":"2024-04-26T12:43:28.154484+0000","last_became_active":"2024-04-26T12:42:21.929093+0000","last_became_peered":"2024-04-26T12:42:21.929093+0000","last_unstale":"2024-04-26T12:43:28.154484+0000","last_undegraded":"2024-04-26T12:43:28.154484+0000","last_fullsized":"2024-04-26T12:43:28.154484+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'66","last_scrub_stamp":"2024-04-26T12:43:28.154276+0000","last_deep_scrub":"139'66","last_deep_scrub_stamp":"2024-04-26T12:43:28.154276+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.154276+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:34.684450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.856821+0000","last_change":"2024-04-26T12:43:02.856875+0000","last_active":"2024-04-26T12:43:02.856821+0000","last_peered":"2024-04-26T12:43:02.856821+0000","last_clean":"2024-04-26T12:43:02.856821+0000","last_became_active":"2024-04-26T12:38:14.452179+0000","last_became_peered":"2024-04-26T12:38:14.452179+0000","last_unstale":"2024-04-26T12:43:02.856821+0000","last_undegraded":"2024-04-26T12:43:02.856821+0000","last_fullsized":"2024-04-26T12:43:02.856821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:02.856629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:02.856629+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.856629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:13.235151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"139'55","reported_seq":339,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.242391+0000","last_change":"2024-04-26T12:43:30.242468+0000","last_active":"2024-04-26T12:43:30.242391+0000","last_peered":"2024-04-26T12:43:30.242391+0000","last_clean":"2024-04-26T12:43:30.242391+0000","last_became_active":"2024-04-26T12:42:21.931114+0000","last_became_peered":"2024-04-26T12:42:21.931114+0000","last_unstale":"2024-04-26T12:43:30.242391+0000","last_undegraded":"2024-04-26T12:43:30.242391+0000","last_fullsized":"2024-04-26T12:43:30.242391+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'55","last_scrub_stamp":"2024-04-26T12:43:30.242160+0000","last_deep_scrub":"139'55","last_deep_scrub_stamp":"2024-04-26T12:43:30.242160+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.242160+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:44.323963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":397,"num_write":30,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.391393+0000","last_change":"2024-04-26T12:43:14.391532+0000","last_active":"2024-04-26T12:43:14.391393+0000","last_peered":"2024-04-26T12:43:14.391393+0000","last_clean":"2024-04-26T12:43:14.391393+0000","last_became_active":"2024-04-26T12:38:18.487982+0000","last_became_peered":"2024-04-26T12:38:18.487982+0000","last_unstale":"2024-04-26T12:43:14.391393+0000","last_undegraded":"2024-04-26T12:43:14.391393+0000","last_fullsized":"2024-04-26T12:43:14.391393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:14.391148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:14.391148+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.391148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:43.733621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":240,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.639398+0000","last_change":"2024-04-26T12:43:20.639454+0000","last_active":"2024-04-26T12:43:20.639398+0000","last_peered":"2024-04-26T12:43:20.639398+0000","last_clean":"2024-04-26T12:43:20.639398+0000","last_became_active":"2024-04-26T12:38:20.520781+0000","last_became_peered":"2024-04-26T12:38:20.520781+0000","last_unstale":"2024-04-26T12:43:20.639398+0000","last_undegraded":"2024-04-26T12:43:20.639398+0000","last_fullsized":"2024-04-26T12:43:20.639398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:20.639204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:20.639204+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.639204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:32.944499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"67'4","reported_seq":275,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.286255+0000","last_change":"2024-04-26T12:43:11.286324+0000","last_active":"2024-04-26T12:43:11.286255+0000","last_peered":"2024-04-26T12:43:11.286255+0000","last_clean":"2024-04-26T12:43:11.286255+0000","last_became_active":"2024-04-26T12:38:12.461596+0000","last_became_peered":"2024-04-26T12:38:12.461596+0000","last_unstale":"2024-04-26T12:43:11.286255+0000","last_undegraded":"2024-04-26T12:43:11.286255+0000","last_fullsized":"2024-04-26T12:43:11.286255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:11.286038+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:11.286038+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.286038+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:49.168408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.862484+0000","last_change":"2024-04-26T12:43:17.862535+0000","last_active":"2024-04-26T12:43:17.862484+0000","last_peered":"2024-04-26T12:43:17.862484+0000","last_clean":"2024-04-26T12:43:17.862484+0000","last_became_active":"2024-04-26T12:38:04.384312+0000","last_became_peered":"2024-04-26T12:38:04.384312+0000","last_unstale":"2024-04-26T12:43:17.862484+0000","last_undegraded":"2024-04-26T12:43:17.862484+0000","last_fullsized":"2024-04-26T12:43:17.862484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:17.862271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:17.862271+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.862271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:49.971956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"139'36","reported_seq":297,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.412874+0000","last_change":"2024-04-26T12:43:25.412936+0000","last_active":"2024-04-26T12:43:25.412874+0000","last_peered":"2024-04-26T12:43:25.412874+0000","last_clean":"2024-04-26T12:43:25.412874+0000","last_became_active":"2024-04-26T12:38:10.459612+0000","last_became_peered":"2024-04-26T12:38:10.459612+0000","last_unstale":"2024-04-26T12:43:25.412874+0000","last_undegraded":"2024-04-26T12:43:25.412874+0000","last_fullsized":"2024-04-26T12:43:25.412874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:25.412658+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:25.412658+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.412658+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:27.267873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.233009+0000","last_change":"2024-04-26T12:43:04.233068+0000","last_active":"2024-04-26T12:43:04.233009+0000","last_peered":"2024-04-26T12:43:04.233009+0000","last_clean":"2024-04-26T12:43:04.233009+0000","last_became_active":"2024-04-26T12:38:14.455626+0000","last_became_peered":"2024-04-26T12:38:14.455626+0000","last_unstale":"2024-04-26T12:43:04.233009+0000","last_undegraded":"2024-04-26T12:43:04.233009+0000","last_fullsized":"2024-04-26T12:43:04.233009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.232754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.232754+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.232754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:54.790626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"139'155","reported_seq":533,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.901929+0000","last_change":"2024-04-26T12:43:00.902011+0000","last_active":"2024-04-26T12:43:00.901929+0000","last_peered":"2024-04-26T12:43:00.901929+0000","last_clean":"2024-04-26T12:43:00.901929+0000","last_became_active":"2024-04-26T12:38:16.471895+0000","last_became_peered":"2024-04-26T12:38:16.471895+0000","last_unstale":"2024-04-26T12:43:00.901929+0000","last_undegraded":"2024-04-26T12:43:00.901929+0000","last_fullsized":"2024-04-26T12:43:00.901929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'155","last_scrub_stamp":"2024-04-26T12:43:00.901702+0000","last_deep_scrub":"139'155","last_deep_scrub_stamp":"2024-04-26T12:43:00.901702+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.901702+0000","objects_scrubbed":10,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:47.176440+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":191,"num_write":36,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.022289+0000","last_change":"2024-04-26T12:43:26.022349+0000","last_active":"2024-04-26T12:43:26.022289+0000","last_peered":"2024-04-26T12:43:26.022289+0000","last_clean":"2024-04-26T12:43:26.022289+0000","last_became_active":"2024-04-26T12:38:18.479873+0000","last_became_peered":"2024-04-26T12:38:18.479873+0000","last_unstale":"2024-04-26T12:43:26.022289+0000","last_undegraded":"2024-04-26T12:43:26.022289+0000","last_fullsized":"2024-04-26T12:43:26.022289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:26.022096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:26.022096+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.022096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:31.810963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"117'2","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.099947+0000","last_change":"2024-04-26T12:43:21.100074+0000","last_active":"2024-04-26T12:43:21.099947+0000","last_peered":"2024-04-26T12:43:21.099947+0000","last_clean":"2024-04-26T12:43:21.099947+0000","last_became_active":"2024-04-26T12:38:20.715048+0000","last_became_peered":"2024-04-26T12:38:20.715048+0000","last_unstale":"2024-04-26T12:43:21.099947+0000","last_undegraded":"2024-04-26T12:43:21.099947+0000","last_fullsized":"2024-04-26T12:43:21.099947+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'2","last_scrub_stamp":"2024-04-26T12:43:21.099705+0000","last_deep_scrub":"117'2","last_deep_scrub_stamp":"2024-04-26T12:43:21.099705+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.099705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:23.103929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"104'10","reported_seq":286,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.945417+0000","last_change":"2024-04-26T12:43:07.945480+0000","last_active":"2024-04-26T12:43:07.945417+0000","last_peered":"2024-04-26T12:43:07.945417+0000","last_clean":"2024-04-26T12:43:07.945417+0000","last_became_active":"2024-04-26T12:38:12.461397+0000","last_became_peered":"2024-04-26T12:38:12.461397+0000","last_unstale":"2024-04-26T12:43:07.945417+0000","last_undegraded":"2024-04-26T12:43:07.945417+0000","last_fullsized":"2024-04-26T12:43:07.945417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'10","last_scrub_stamp":"2024-04-26T12:43:07.945203+0000","last_deep_scrub":"104'10","last_deep_scrub_stamp":"2024-04-26T12:43:07.945203+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.945203+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:02.826059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.490419+0000","last_change":"2024-04-26T12:43:12.490476+0000","last_active":"2024-04-26T12:43:12.490419+0000","last_peered":"2024-04-26T12:43:12.490419+0000","last_clean":"2024-04-26T12:43:12.490419+0000","last_became_active":"2024-04-26T12:42:21.938117+0000","last_became_peered":"2024-04-26T12:42:21.938117+0000","last_unstale":"2024-04-26T12:43:12.490419+0000","last_undegraded":"2024-04-26T12:43:12.490419+0000","last_fullsized":"2024-04-26T12:43:12.490419+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:12.490218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:12.490218+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.490218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:24.981091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"139'66","reported_seq":328,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.024378+0000","last_change":"2024-04-26T12:43:15.024525+0000","last_active":"2024-04-26T12:43:15.024378+0000","last_peered":"2024-04-26T12:43:15.024378+0000","last_clean":"2024-04-26T12:43:15.024378+0000","last_became_active":"2024-04-26T12:38:10.428494+0000","last_became_peered":"2024-04-26T12:38:10.428494+0000","last_unstale":"2024-04-26T12:43:15.024378+0000","last_undegraded":"2024-04-26T12:43:15.024378+0000","last_fullsized":"2024-04-26T12:43:15.024378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'66","last_scrub_stamp":"2024-04-26T12:43:15.024133+0000","last_deep_scrub":"139'66","last_deep_scrub_stamp":"2024-04-26T12:43:15.024133+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.024133+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:43.770855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":76,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"139'4","reported_seq":348,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.632383+0000","last_change":"2024-04-26T12:43:05.632454+0000","last_active":"2024-04-26T12:43:05.632383+0000","last_peered":"2024-04-26T12:43:05.632383+0000","last_clean":"2024-04-26T12:43:05.632383+0000","last_became_active":"2024-04-26T12:38:14.448049+0000","last_became_peered":"2024-04-26T12:38:14.448049+0000","last_unstale":"2024-04-26T12:43:05.632383+0000","last_undegraded":"2024-04-26T12:43:05.632383+0000","last_fullsized":"2024-04-26T12:43:05.632383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'4","last_scrub_stamp":"2024-04-26T12:43:05.632196+0000","last_deep_scrub":"139'4","last_deep_scrub_stamp":"2024-04-26T12:43:05.632196+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.632196+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:14.699365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"139'26","reported_seq":333,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.882265+0000","last_change":"2024-04-26T12:43:15.882347+0000","last_active":"2024-04-26T12:43:15.882265+0000","last_peered":"2024-04-26T12:43:15.882265+0000","last_clean":"2024-04-26T12:43:15.882265+0000","last_became_active":"2024-04-26T12:38:16.529583+0000","last_became_peered":"2024-04-26T12:38:16.529583+0000","last_unstale":"2024-04-26T12:43:15.882265+0000","last_undegraded":"2024-04-26T12:43:15.882265+0000","last_fullsized":"2024-04-26T12:43:15.882265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:15.882042+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:15.882042+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.882042+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:59.019050+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.442092+0000","last_change":"2024-04-26T12:43:16.442222+0000","last_active":"2024-04-26T12:43:16.442092+0000","last_peered":"2024-04-26T12:43:16.442092+0000","last_clean":"2024-04-26T12:43:16.442092+0000","last_became_active":"2024-04-26T12:38:18.488166+0000","last_became_peered":"2024-04-26T12:38:18.488166+0000","last_unstale":"2024-04-26T12:43:16.442092+0000","last_undegraded":"2024-04-26T12:43:16.442092+0000","last_fullsized":"2024-04-26T12:43:16.442092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:16.441866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:16.441866+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.441866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:46.860759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"139'2","reported_seq":222,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.188557+0000","last_change":"2024-04-26T12:43:32.188633+0000","last_active":"2024-04-26T12:43:32.188557+0000","last_peered":"2024-04-26T12:43:32.188557+0000","last_clean":"2024-04-26T12:43:32.188557+0000","last_became_active":"2024-04-26T12:42:21.928602+0000","last_became_peered":"2024-04-26T12:42:21.928602+0000","last_unstale":"2024-04-26T12:43:32.188557+0000","last_undegraded":"2024-04-26T12:43:32.188557+0000","last_fullsized":"2024-04-26T12:43:32.188557+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'2","last_scrub_stamp":"2024-04-26T12:43:32.188350+0000","last_deep_scrub":"139'2","last_deep_scrub_stamp":"2024-04-26T12:43:32.188350+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.188350+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:08.051364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"74'8","reported_seq":279,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.094528+0000","last_change":"2024-04-26T12:43:18.094672+0000","last_active":"2024-04-26T12:43:18.094528+0000","last_peered":"2024-04-26T12:43:18.094528+0000","last_clean":"2024-04-26T12:43:18.094528+0000","last_became_active":"2024-04-26T12:38:12.455328+0000","last_became_peered":"2024-04-26T12:38:12.455328+0000","last_unstale":"2024-04-26T12:43:18.094528+0000","last_undegraded":"2024-04-26T12:43:18.094528+0000","last_fullsized":"2024-04-26T12:43:18.094528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'8","last_scrub_stamp":"2024-04-26T12:43:18.094171+0000","last_deep_scrub":"74'8","last_deep_scrub_stamp":"2024-04-26T12:43:18.094171+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.094171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:29.838455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":269,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.207704+0000","last_change":"2024-04-26T12:43:20.207833+0000","last_active":"2024-04-26T12:43:20.207704+0000","last_peered":"2024-04-26T12:43:20.207704+0000","last_clean":"2024-04-26T12:43:20.207704+0000","last_became_active":"2024-04-26T12:38:04.382298+0000","last_became_peered":"2024-04-26T12:38:04.382298+0000","last_unstale":"2024-04-26T12:43:20.207704+0000","last_undegraded":"2024-04-26T12:43:20.207704+0000","last_fullsized":"2024-04-26T12:43:20.207704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:20.207457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:20.207457+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.207457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:07.143400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"139'36","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.659419+0000","last_change":"2024-04-26T12:43:20.659481+0000","last_active":"2024-04-26T12:43:20.659419+0000","last_peered":"2024-04-26T12:43:20.659419+0000","last_clean":"2024-04-26T12:43:20.659419+0000","last_became_active":"2024-04-26T12:42:34.004041+0000","last_became_peered":"2024-04-26T12:42:34.004041+0000","last_unstale":"2024-04-26T12:43:20.659419+0000","last_undegraded":"2024-04-26T12:43:20.659419+0000","last_fullsized":"2024-04-26T12:43:20.659419+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:20.659230+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:20.659230+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.659230+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:10.313531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.229773+0000","last_change":"2024-04-26T12:43:07.229827+0000","last_active":"2024-04-26T12:43:07.229773+0000","last_peered":"2024-04-26T12:43:07.229773+0000","last_clean":"2024-04-26T12:43:07.229773+0000","last_became_active":"2024-04-26T12:38:14.446336+0000","last_became_peered":"2024-04-26T12:38:14.446336+0000","last_unstale":"2024-04-26T12:43:07.229773+0000","last_undegraded":"2024-04-26T12:43:07.229773+0000","last_fullsized":"2024-04-26T12:43:07.229773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:07.229566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:07.229566+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.229566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:05.835538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"139'19","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.214936+0000","last_change":"2024-04-26T12:43:20.215012+0000","last_active":"2024-04-26T12:43:20.214936+0000","last_peered":"2024-04-26T12:43:20.214936+0000","last_clean":"2024-04-26T12:43:20.214936+0000","last_became_active":"2024-04-26T12:42:21.942937+0000","last_became_peered":"2024-04-26T12:42:21.942937+0000","last_unstale":"2024-04-26T12:43:20.214936+0000","last_undegraded":"2024-04-26T12:43:20.214936+0000","last_fullsized":"2024-04-26T12:43:20.214936+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'19","last_scrub_stamp":"2024-04-26T12:43:20.214734+0000","last_deep_scrub":"139'19","last_deep_scrub_stamp":"2024-04-26T12:43:20.214734+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.214734+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:50.148019+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.678142+0000","last_change":"2024-04-26T12:43:19.678195+0000","last_active":"2024-04-26T12:43:19.678142+0000","last_peered":"2024-04-26T12:43:19.678142+0000","last_clean":"2024-04-26T12:43:19.678142+0000","last_became_active":"2024-04-26T12:38:18.500448+0000","last_became_peered":"2024-04-26T12:38:18.500448+0000","last_unstale":"2024-04-26T12:43:19.678142+0000","last_undegraded":"2024-04-26T12:43:19.678142+0000","last_fullsized":"2024-04-26T12:43:19.678142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:19.677940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:19.677940+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.677940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:55:51.439428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"74'4","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.257733+0000","last_change":"2024-04-26T12:43:31.257796+0000","last_active":"2024-04-26T12:43:31.257733+0000","last_peered":"2024-04-26T12:43:31.257733+0000","last_clean":"2024-04-26T12:43:31.257733+0000","last_became_active":"2024-04-26T12:42:21.941954+0000","last_became_peered":"2024-04-26T12:42:21.941954+0000","last_unstale":"2024-04-26T12:43:31.257733+0000","last_undegraded":"2024-04-26T12:43:31.257733+0000","last_fullsized":"2024-04-26T12:43:31.257733+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-04-26T12:43:31.257520+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-04-26T12:43:31.257520+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.257520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:12.300791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'2","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.935762+0000","last_change":"2024-04-26T12:43:09.935829+0000","last_active":"2024-04-26T12:43:09.935762+0000","last_peered":"2024-04-26T12:43:09.935762+0000","last_clean":"2024-04-26T12:43:09.935762+0000","last_became_active":"2024-04-26T12:38:12.456357+0000","last_became_peered":"2024-04-26T12:38:12.456357+0000","last_unstale":"2024-04-26T12:43:09.935762+0000","last_undegraded":"2024-04-26T12:43:09.935762+0000","last_fullsized":"2024-04-26T12:43:09.935762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-04-26T12:43:09.935517+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-04-26T12:43:09.935517+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.935517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:29.052334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"139'52","reported_seq":322,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.228505+0000","last_change":"2024-04-26T12:42:59.228566+0000","last_active":"2024-04-26T12:42:59.228505+0000","last_peered":"2024-04-26T12:42:59.228505+0000","last_clean":"2024-04-26T12:42:59.228505+0000","last_became_active":"2024-04-26T12:42:21.923345+0000","last_became_peered":"2024-04-26T12:42:21.923345+0000","last_unstale":"2024-04-26T12:42:59.228505+0000","last_undegraded":"2024-04-26T12:42:59.228505+0000","last_fullsized":"2024-04-26T12:42:59.228505+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'52","last_scrub_stamp":"2024-04-26T12:42:59.228284+0000","last_deep_scrub":"139'52","last_deep_scrub_stamp":"2024-04-26T12:42:59.228284+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.228284+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:49.470394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.939391+0000","last_change":"2024-04-26T12:43:11.939446+0000","last_active":"2024-04-26T12:43:11.939391+0000","last_peered":"2024-04-26T12:43:11.939391+0000","last_clean":"2024-04-26T12:43:11.939391+0000","last_became_active":"2024-04-26T12:38:04.410297+0000","last_became_peered":"2024-04-26T12:38:04.410297+0000","last_unstale":"2024-04-26T12:43:11.939391+0000","last_undegraded":"2024-04-26T12:43:11.939391+0000","last_fullsized":"2024-04-26T12:43:11.939391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:11.939178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:11.939178+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.939178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:02.497049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.212612+0000","last_change":"2024-04-26T12:43:04.212666+0000","last_active":"2024-04-26T12:43:04.212612+0000","last_peered":"2024-04-26T12:43:04.212612+0000","last_clean":"2024-04-26T12:43:04.212612+0000","last_became_active":"2024-04-26T12:38:14.462360+0000","last_became_peered":"2024-04-26T12:38:14.462360+0000","last_unstale":"2024-04-26T12:43:04.212612+0000","last_undegraded":"2024-04-26T12:43:04.212612+0000","last_fullsized":"2024-04-26T12:43:04.212612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.212416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.212416+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.212416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:24.999017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"139'48","reported_seq":326,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.450009+0000","last_change":"2024-04-26T12:43:32.450106+0000","last_active":"2024-04-26T12:43:32.450009+0000","last_peered":"2024-04-26T12:43:32.450009+0000","last_clean":"2024-04-26T12:43:32.450009+0000","last_became_active":"2024-04-26T12:42:21.956451+0000","last_became_peered":"2024-04-26T12:42:21.956451+0000","last_unstale":"2024-04-26T12:43:32.450009+0000","last_undegraded":"2024-04-26T12:43:32.450009+0000","last_fullsized":"2024-04-26T12:43:32.450009+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:32.449818+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:32.449818+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.449818+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:38.795688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":214,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.697707+0000","last_change":"2024-04-26T12:43:16.697707+0000","last_active":"2024-04-26T12:43:16.697707+0000","last_peered":"2024-04-26T12:43:16.697707+0000","last_clean":"2024-04-26T12:43:16.697707+0000","last_became_active":"2024-04-26T12:42:34.014949+0000","last_became_peered":"2024-04-26T12:42:34.014949+0000","last_unstale":"2024-04-26T12:43:16.697707+0000","last_undegraded":"2024-04-26T12:43:16.697707+0000","last_fullsized":"2024-04-26T12:43:16.697707+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:16.697451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:16.697451+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.697451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:32.207309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":241,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.161144+0000","last_change":"2024-04-26T12:42:58.161182+0000","last_active":"2024-04-26T12:42:58.161144+0000","last_peered":"2024-04-26T12:42:58.161144+0000","last_clean":"2024-04-26T12:42:58.161144+0000","last_became_active":"2024-04-26T12:38:20.712931+0000","last_became_peered":"2024-04-26T12:38:20.712931+0000","last_unstale":"2024-04-26T12:42:58.161144+0000","last_undegraded":"2024-04-26T12:42:58.161144+0000","last_fullsized":"2024-04-26T12:42:58.161144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:58.160999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:58.160999+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.160999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:47.990505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"68'2","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.352611+0000","last_change":"2024-04-26T12:43:13.352776+0000","last_active":"2024-04-26T12:43:13.352611+0000","last_peered":"2024-04-26T12:43:13.352611+0000","last_clean":"2024-04-26T12:43:13.352611+0000","last_became_active":"2024-04-26T12:38:12.455514+0000","last_became_peered":"2024-04-26T12:38:12.455514+0000","last_unstale":"2024-04-26T12:43:13.352611+0000","last_undegraded":"2024-04-26T12:43:13.352611+0000","last_fullsized":"2024-04-26T12:43:13.352611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:13.352310+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:13.352310+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.352310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:13.713815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"139'62","reported_seq":323,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:14.028784+0000","last_change":"2024-04-26T12:43:14.028907+0000","last_active":"2024-04-26T12:43:14.028784+0000","last_peered":"2024-04-26T12:43:14.028784+0000","last_clean":"2024-04-26T12:43:14.028784+0000","last_became_active":"2024-04-26T12:38:10.428227+0000","last_became_peered":"2024-04-26T12:38:10.428227+0000","last_unstale":"2024-04-26T12:43:14.028784+0000","last_undegraded":"2024-04-26T12:43:14.028784+0000","last_fullsized":"2024-04-26T12:43:14.028784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'62","last_scrub_stamp":"2024-04-26T12:43:14.028520+0000","last_deep_scrub":"139'62","last_deep_scrub_stamp":"2024-04-26T12:43:14.028520+0000","last_clean_scrub_stamp":"2024-04-26T12:43:14.028520+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:57.165528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":265,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.868181+0000","last_change":"2024-04-26T12:43:18.868233+0000","last_active":"2024-04-26T12:43:18.868181+0000","last_peered":"2024-04-26T12:43:18.868181+0000","last_clean":"2024-04-26T12:43:18.868181+0000","last_became_active":"2024-04-26T12:38:04.411515+0000","last_became_peered":"2024-04-26T12:38:04.411515+0000","last_unstale":"2024-04-26T12:43:18.868181+0000","last_undegraded":"2024-04-26T12:43:18.868181+0000","last_fullsized":"2024-04-26T12:43:18.868181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:18.867983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:18.867983+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.867983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:46.665171+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.573429+0000","last_change":"2024-04-26T12:43:00.573485+0000","last_active":"2024-04-26T12:43:00.573429+0000","last_peered":"2024-04-26T12:43:00.573429+0000","last_clean":"2024-04-26T12:43:00.573429+0000","last_became_active":"2024-04-26T12:38:14.452354+0000","last_became_peered":"2024-04-26T12:38:14.452354+0000","last_unstale":"2024-04-26T12:43:00.573429+0000","last_undegraded":"2024-04-26T12:43:00.573429+0000","last_fullsized":"2024-04-26T12:43:00.573429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.573216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.573216+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.573216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:13.231544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"139'21","reported_seq":277,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.883931+0000","last_change":"2024-04-26T12:43:04.884109+0000","last_active":"2024-04-26T12:43:04.883931+0000","last_peered":"2024-04-26T12:43:04.883931+0000","last_clean":"2024-04-26T12:43:04.883931+0000","last_became_active":"2024-04-26T12:38:16.526745+0000","last_became_peered":"2024-04-26T12:38:16.526745+0000","last_unstale":"2024-04-26T12:43:04.883931+0000","last_undegraded":"2024-04-26T12:43:04.883931+0000","last_fullsized":"2024-04-26T12:43:04.883931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'21","last_scrub_stamp":"2024-04-26T12:43:04.883646+0000","last_deep_scrub":"139'21","last_deep_scrub_stamp":"2024-04-26T12:43:04.883646+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.883646+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:42.204808+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"139'138","reported_seq":439,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.159003+0000","last_change":"2024-04-26T12:43:16.159078+0000","last_active":"2024-04-26T12:43:16.159003+0000","last_peered":"2024-04-26T12:43:16.159003+0000","last_clean":"2024-04-26T12:43:16.159003+0000","last_became_active":"2024-04-26T12:38:18.495992+0000","last_became_peered":"2024-04-26T12:38:18.495992+0000","last_unstale":"2024-04-26T12:43:16.159003+0000","last_undegraded":"2024-04-26T12:43:16.159003+0000","last_fullsized":"2024-04-26T12:43:16.159003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:16.158784+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:16.158784+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.158784+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:27.113662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"68'3","reported_seq":228,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.301903+0000","last_change":"2024-04-26T12:43:15.301974+0000","last_active":"2024-04-26T12:43:15.301903+0000","last_peered":"2024-04-26T12:43:15.301903+0000","last_clean":"2024-04-26T12:43:15.301903+0000","last_became_active":"2024-04-26T12:42:21.960618+0000","last_became_peered":"2024-04-26T12:42:21.960618+0000","last_unstale":"2024-04-26T12:43:15.301903+0000","last_undegraded":"2024-04-26T12:43:15.301903+0000","last_fullsized":"2024-04-26T12:43:15.301903+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'3","last_scrub_stamp":"2024-04-26T12:43:15.301706+0000","last_deep_scrub":"68'3","last_deep_scrub_stamp":"2024-04-26T12:43:15.301706+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.301706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:43.780448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"67'4","reported_seq":256,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:33.219807+0000","last_change":"2024-04-26T12:43:33.219870+0000","last_active":"2024-04-26T12:43:33.219807+0000","last_peered":"2024-04-26T12:43:33.219807+0000","last_clean":"2024-04-26T12:43:33.219807+0000","last_became_active":"2024-04-26T12:42:21.960998+0000","last_became_peered":"2024-04-26T12:42:21.960998+0000","last_unstale":"2024-04-26T12:43:33.219807+0000","last_undegraded":"2024-04-26T12:43:33.219807+0000","last_fullsized":"2024-04-26T12:43:33.219807+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:33.219588+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:33.219588+0000","last_clean_scrub_stamp":"2024-04-26T12:43:33.219588+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:34.137353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"139'54","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.266517+0000","last_change":"2024-04-26T12:42:58.266580+0000","last_active":"2024-04-26T12:42:58.266517+0000","last_peered":"2024-04-26T12:42:58.266517+0000","last_clean":"2024-04-26T12:42:58.266517+0000","last_became_active":"2024-04-26T12:42:21.968901+0000","last_became_peered":"2024-04-26T12:42:21.968901+0000","last_unstale":"2024-04-26T12:42:58.266517+0000","last_undegraded":"2024-04-26T12:42:58.266517+0000","last_fullsized":"2024-04-26T12:42:58.266517+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:42:58.266315+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:42:58.266315+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.266315+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:20.120407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.909328+0000","last_change":"2024-04-26T12:43:10.909424+0000","last_active":"2024-04-26T12:43:10.909328+0000","last_peered":"2024-04-26T12:43:10.909328+0000","last_clean":"2024-04-26T12:43:10.909328+0000","last_became_active":"2024-04-26T12:38:04.381496+0000","last_became_peered":"2024-04-26T12:38:04.381496+0000","last_unstale":"2024-04-26T12:43:10.909328+0000","last_undegraded":"2024-04-26T12:43:10.909328+0000","last_fullsized":"2024-04-26T12:43:10.909328+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:10.909043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:10.909043+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.909043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:58.975101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":213,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.736215+0000","last_change":"2024-04-26T12:43:12.736215+0000","last_active":"2024-04-26T12:43:12.736215+0000","last_peered":"2024-04-26T12:43:12.736215+0000","last_clean":"2024-04-26T12:43:12.736215+0000","last_became_active":"2024-04-26T12:42:34.015774+0000","last_became_peered":"2024-04-26T12:42:34.015774+0000","last_unstale":"2024-04-26T12:43:12.736215+0000","last_undegraded":"2024-04-26T12:43:12.736215+0000","last_fullsized":"2024-04-26T12:43:12.736215+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:12.735961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:12.735961+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.735961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:59.671904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"139'15","reported_seq":86,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.703930+0000","last_change":"2024-04-26T12:43:30.703930+0000","last_active":"2024-04-26T12:43:30.703930+0000","last_peered":"2024-04-26T12:43:30.703930+0000","last_clean":"2024-04-26T12:43:30.703930+0000","last_became_active":"2024-04-26T12:42:34.029037+0000","last_became_peered":"2024-04-26T12:42:34.029037+0000","last_unstale":"2024-04-26T12:43:30.703930+0000","last_undegraded":"2024-04-26T12:43:30.703930+0000","last_fullsized":"2024-04-26T12:43:30.703930+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'15","last_scrub_stamp":"2024-04-26T12:43:30.703675+0000","last_deep_scrub":"139'15","last_deep_scrub_stamp":"2024-04-26T12:43:30.703675+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.703675+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:38.551338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"139'140","reported_seq":426,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.362564+0000","last_change":"2024-04-26T12:43:03.362634+0000","last_active":"2024-04-26T12:43:03.362564+0000","last_peered":"2024-04-26T12:43:03.362564+0000","last_clean":"2024-04-26T12:43:03.362564+0000","last_became_active":"2024-04-26T12:42:21.962332+0000","last_became_peered":"2024-04-26T12:42:21.962332+0000","last_unstale":"2024-04-26T12:43:03.362564+0000","last_undegraded":"2024-04-26T12:43:03.362564+0000","last_fullsized":"2024-04-26T12:43:03.362564+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'140","last_scrub_stamp":"2024-04-26T12:43:03.362373+0000","last_deep_scrub":"139'140","last_deep_scrub_stamp":"2024-04-26T12:43:03.362373+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.362373+0000","objects_scrubbed":1,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:17.592743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":248,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.409296+0000","last_change":"2024-04-26T12:43:31.409381+0000","last_active":"2024-04-26T12:43:31.409296+0000","last_peered":"2024-04-26T12:43:31.409296+0000","last_clean":"2024-04-26T12:43:31.409296+0000","last_became_active":"2024-04-26T12:42:21.956715+0000","last_became_peered":"2024-04-26T12:42:21.956715+0000","last_unstale":"2024-04-26T12:43:31.409296+0000","last_undegraded":"2024-04-26T12:43:31.409296+0000","last_fullsized":"2024-04-26T12:43:31.409296+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:31.409064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:31.409064+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.409064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:45.009262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'2","reported_seq":124,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.594461+0000","last_change":"2024-04-26T12:43:24.594527+0000","last_active":"2024-04-26T12:43:24.594461+0000","last_peered":"2024-04-26T12:43:24.594461+0000","last_clean":"2024-04-26T12:43:24.594461+0000","last_became_active":"2024-04-26T12:42:34.010800+0000","last_became_peered":"2024-04-26T12:42:34.010800+0000","last_unstale":"2024-04-26T12:43:24.594461+0000","last_undegraded":"2024-04-26T12:43:24.594461+0000","last_fullsized":"2024-04-26T12:43:24.594461+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:24.594262+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:24.594262+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.594262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:09.822908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"139'46","reported_seq":308,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:20.380642+0000","last_change":"2024-04-26T12:43:20.380725+0000","last_active":"2024-04-26T12:43:20.380642+0000","last_peered":"2024-04-26T12:43:20.380642+0000","last_clean":"2024-04-26T12:43:20.380642+0000","last_became_active":"2024-04-26T12:38:10.441223+0000","last_became_peered":"2024-04-26T12:38:10.441223+0000","last_unstale":"2024-04-26T12:43:20.380642+0000","last_undegraded":"2024-04-26T12:43:20.380642+0000","last_fullsized":"2024-04-26T12:43:20.380642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'46","last_scrub_stamp":"2024-04-26T12:43:20.380437+0000","last_deep_scrub":"139'46","last_deep_scrub_stamp":"2024-04-26T12:43:20.380437+0000","last_clean_scrub_stamp":"2024-04-26T12:43:20.380437+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:11.385155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":56,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":266,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.546974+0000","last_change":"2024-04-26T12:43:08.547033+0000","last_active":"2024-04-26T12:43:08.546974+0000","last_peered":"2024-04-26T12:43:08.546974+0000","last_clean":"2024-04-26T12:43:08.546974+0000","last_became_active":"2024-04-26T12:38:04.385489+0000","last_became_peered":"2024-04-26T12:38:04.385489+0000","last_unstale":"2024-04-26T12:43:08.546974+0000","last_undegraded":"2024-04-26T12:43:08.546974+0000","last_fullsized":"2024-04-26T12:43:08.546974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:08.546762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:08.546762+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.546762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:04.800474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.190774+0000","last_change":"2024-04-26T12:43:31.190828+0000","last_active":"2024-04-26T12:43:31.190774+0000","last_peered":"2024-04-26T12:43:31.190774+0000","last_clean":"2024-04-26T12:43:31.190774+0000","last_became_active":"2024-04-26T12:42:21.926472+0000","last_became_peered":"2024-04-26T12:42:21.926472+0000","last_unstale":"2024-04-26T12:43:31.190774+0000","last_undegraded":"2024-04-26T12:43:31.190774+0000","last_fullsized":"2024-04-26T12:43:31.190774+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:31.190570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:31.190570+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.190570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:12.398445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"139'57","reported_seq":333,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.815299+0000","last_change":"2024-04-26T12:43:11.815386+0000","last_active":"2024-04-26T12:43:11.815299+0000","last_peered":"2024-04-26T12:43:11.815299+0000","last_clean":"2024-04-26T12:43:11.815299+0000","last_became_active":"2024-04-26T12:38:16.527930+0000","last_became_peered":"2024-04-26T12:38:16.527930+0000","last_unstale":"2024-04-26T12:43:11.815299+0000","last_undegraded":"2024-04-26T12:43:11.815299+0000","last_fullsized":"2024-04-26T12:43:11.815299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'57","last_scrub_stamp":"2024-04-26T12:43:11.815105+0000","last_deep_scrub":"139'57","last_deep_scrub_stamp":"2024-04-26T12:43:11.815105+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.815105+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:24.120399+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.127903+0000","last_change":"2024-04-26T12:43:25.128019+0000","last_active":"2024-04-26T12:43:25.127903+0000","last_peered":"2024-04-26T12:43:25.127903+0000","last_clean":"2024-04-26T12:43:25.127903+0000","last_became_active":"2024-04-26T12:42:21.918031+0000","last_became_peered":"2024-04-26T12:42:21.918031+0000","last_unstale":"2024-04-26T12:43:25.127903+0000","last_undegraded":"2024-04-26T12:43:25.127903+0000","last_fullsized":"2024-04-26T12:43:25.127903+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:25.127670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:25.127670+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.127670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:50.102254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.293486+0000","last_change":"2024-04-26T12:43:28.293547+0000","last_active":"2024-04-26T12:43:28.293486+0000","last_peered":"2024-04-26T12:43:28.293486+0000","last_clean":"2024-04-26T12:43:28.293486+0000","last_became_active":"2024-04-26T12:38:20.517429+0000","last_became_peered":"2024-04-26T12:38:20.517429+0000","last_unstale":"2024-04-26T12:43:28.293486+0000","last_undegraded":"2024-04-26T12:43:28.293486+0000","last_fullsized":"2024-04-26T12:43:28.293486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:28.293291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:28.293291+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.293291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:17.947592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"91'7","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.204130+0000","last_change":"2024-04-26T12:42:59.204187+0000","last_active":"2024-04-26T12:42:59.204130+0000","last_peered":"2024-04-26T12:42:59.204130+0000","last_clean":"2024-04-26T12:42:59.204130+0000","last_became_active":"2024-04-26T12:38:20.514476+0000","last_became_peered":"2024-04-26T12:38:20.514476+0000","last_unstale":"2024-04-26T12:42:59.204130+0000","last_undegraded":"2024-04-26T12:42:59.204130+0000","last_fullsized":"2024-04-26T12:42:59.204130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'7","last_scrub_stamp":"2024-04-26T12:42:59.203938+0000","last_deep_scrub":"91'7","last_deep_scrub_stamp":"2024-04-26T12:42:59.203938+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.203938+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:17.572158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"104'2","reported_seq":195,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.697773+0000","last_change":"2024-04-26T12:43:15.697902+0000","last_active":"2024-04-26T12:43:15.697773+0000","last_peered":"2024-04-26T12:43:15.697773+0000","last_clean":"2024-04-26T12:43:15.697773+0000","last_became_active":"2024-04-26T12:42:34.022792+0000","last_became_peered":"2024-04-26T12:42:34.022792+0000","last_unstale":"2024-04-26T12:43:15.697773+0000","last_undegraded":"2024-04-26T12:43:15.697773+0000","last_fullsized":"2024-04-26T12:43:15.697773+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'2","last_scrub_stamp":"2024-04-26T12:43:15.697480+0000","last_deep_scrub":"104'2","last_deep_scrub_stamp":"2024-04-26T12:43:15.697480+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.697480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:46.116374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"139'40","reported_seq":250,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.628536+0000","last_change":"2024-04-26T12:43:25.628601+0000","last_active":"2024-04-26T12:43:25.628536+0000","last_peered":"2024-04-26T12:43:25.628536+0000","last_clean":"2024-04-26T12:43:25.628536+0000","last_became_active":"2024-04-26T12:42:34.008295+0000","last_became_peered":"2024-04-26T12:42:34.008295+0000","last_unstale":"2024-04-26T12:43:25.628536+0000","last_undegraded":"2024-04-26T12:43:25.628536+0000","last_fullsized":"2024-04-26T12:43:25.628536+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:25.628341+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:25.628341+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.628341+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:23.734125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:57.925045+0000","last_change":"2024-04-26T12:42:57.925077+0000","last_active":"2024-04-26T12:42:57.925045+0000","last_peered":"2024-04-26T12:42:57.925045+0000","last_clean":"2024-04-26T12:42:57.925045+0000","last_became_active":"2024-04-26T12:38:14.454603+0000","last_became_peered":"2024-04-26T12:38:14.454603+0000","last_unstale":"2024-04-26T12:42:57.925045+0000","last_undegraded":"2024-04-26T12:42:57.925045+0000","last_fullsized":"2024-04-26T12:42:57.925045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:57.924946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:57.924946+0000","last_clean_scrub_stamp":"2024-04-26T12:42:57.924946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:20.467638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"139'26","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.331838+0000","last_change":"2024-04-26T12:43:06.331924+0000","last_active":"2024-04-26T12:43:06.331838+0000","last_peered":"2024-04-26T12:43:06.331838+0000","last_clean":"2024-04-26T12:43:06.331838+0000","last_became_active":"2024-04-26T12:42:21.964467+0000","last_became_peered":"2024-04-26T12:42:21.964467+0000","last_unstale":"2024-04-26T12:43:06.331838+0000","last_undegraded":"2024-04-26T12:43:06.331838+0000","last_fullsized":"2024-04-26T12:43:06.331838+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:06.331620+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:06.331620+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.331620+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:10.579086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.197069+0000","last_change":"2024-04-26T12:43:21.197127+0000","last_active":"2024-04-26T12:43:21.197069+0000","last_peered":"2024-04-26T12:43:21.197069+0000","last_clean":"2024-04-26T12:43:21.197069+0000","last_became_active":"2024-04-26T12:42:21.959360+0000","last_became_peered":"2024-04-26T12:42:21.959360+0000","last_unstale":"2024-04-26T12:43:21.197069+0000","last_undegraded":"2024-04-26T12:43:21.197069+0000","last_fullsized":"2024-04-26T12:43:21.197069+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:21.196835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:21.196835+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.196835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:46.891982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.309941+0000","last_change":"2024-04-26T12:43:01.310002+0000","last_active":"2024-04-26T12:43:01.309941+0000","last_peered":"2024-04-26T12:43:01.309941+0000","last_clean":"2024-04-26T12:43:01.309941+0000","last_became_active":"2024-04-26T12:42:21.968658+0000","last_became_peered":"2024-04-26T12:42:21.968658+0000","last_unstale":"2024-04-26T12:43:01.309941+0000","last_undegraded":"2024-04-26T12:43:01.309941+0000","last_fullsized":"2024-04-26T12:43:01.309941+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.309721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.309721+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.309721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:16.498477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.889190+0000","last_change":"2024-04-26T12:43:01.889248+0000","last_active":"2024-04-26T12:43:01.889190+0000","last_peered":"2024-04-26T12:43:01.889190+0000","last_clean":"2024-04-26T12:43:01.889190+0000","last_became_active":"2024-04-26T12:38:12.466166+0000","last_became_peered":"2024-04-26T12:38:12.466166+0000","last_unstale":"2024-04-26T12:43:01.889190+0000","last_undegraded":"2024-04-26T12:43:01.889190+0000","last_fullsized":"2024-04-26T12:43:01.889190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.888989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.888989+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.888989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:12.267511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"139'46","reported_seq":312,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.941948+0000","last_change":"2024-04-26T12:43:31.942018+0000","last_active":"2024-04-26T12:43:31.941948+0000","last_peered":"2024-04-26T12:43:31.941948+0000","last_clean":"2024-04-26T12:43:31.941948+0000","last_became_active":"2024-04-26T12:42:21.955428+0000","last_became_peered":"2024-04-26T12:42:21.955428+0000","last_unstale":"2024-04-26T12:43:31.941948+0000","last_undegraded":"2024-04-26T12:43:31.941948+0000","last_fullsized":"2024-04-26T12:43:31.941948+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'46","last_scrub_stamp":"2024-04-26T12:43:31.941744+0000","last_deep_scrub":"139'46","last_deep_scrub_stamp":"2024-04-26T12:43:31.941744+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.941744+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:02.360638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:34.216081+0000","last_change":"2024-04-26T12:43:34.216146+0000","last_active":"2024-04-26T12:43:34.216081+0000","last_peered":"2024-04-26T12:43:34.216081+0000","last_clean":"2024-04-26T12:43:34.216081+0000","last_became_active":"2024-04-26T12:42:21.964554+0000","last_became_peered":"2024-04-26T12:42:21.964554+0000","last_unstale":"2024-04-26T12:43:34.216081+0000","last_undegraded":"2024-04-26T12:43:34.216081+0000","last_fullsized":"2024-04-26T12:43:34.216081+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:34.215845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:34.215845+0000","last_clean_scrub_stamp":"2024-04-26T12:43:34.215845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:15.463239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"139'12","reported_seq":263,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.249419+0000","last_change":"2024-04-26T12:43:10.249501+0000","last_active":"2024-04-26T12:43:10.249419+0000","last_peered":"2024-04-26T12:43:10.249419+0000","last_clean":"2024-04-26T12:43:10.249419+0000","last_became_active":"2024-04-26T12:38:16.474742+0000","last_became_peered":"2024-04-26T12:38:16.474742+0000","last_unstale":"2024-04-26T12:43:10.249419+0000","last_undegraded":"2024-04-26T12:43:10.249419+0000","last_fullsized":"2024-04-26T12:43:10.249419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'12","last_scrub_stamp":"2024-04-26T12:43:10.249209+0000","last_deep_scrub":"139'12","last_deep_scrub_stamp":"2024-04-26T12:43:10.249209+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.249209+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:37.644219+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":34,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.904953+0000","last_change":"2024-04-26T12:42:59.905038+0000","last_active":"2024-04-26T12:42:59.904953+0000","last_peered":"2024-04-26T12:42:59.904953+0000","last_clean":"2024-04-26T12:42:59.904953+0000","last_became_active":"2024-04-26T12:38:18.490203+0000","last_became_peered":"2024-04-26T12:38:18.490203+0000","last_unstale":"2024-04-26T12:42:59.904953+0000","last_undegraded":"2024-04-26T12:42:59.904953+0000","last_fullsized":"2024-04-26T12:42:59.904953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:59.904710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:59.904710+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.904710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:51:56.158422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'4","reported_seq":249,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.245163+0000","last_change":"2024-04-26T12:43:00.245163+0000","last_active":"2024-04-26T12:43:00.245163+0000","last_peered":"2024-04-26T12:43:00.245163+0000","last_clean":"2024-04-26T12:43:00.245163+0000","last_became_active":"2024-04-26T12:38:20.501047+0000","last_became_peered":"2024-04-26T12:38:20.501047+0000","last_unstale":"2024-04-26T12:43:00.245163+0000","last_undegraded":"2024-04-26T12:43:00.245163+0000","last_fullsized":"2024-04-26T12:43:00.245163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'4","last_scrub_stamp":"2024-04-26T12:43:00.244880+0000","last_deep_scrub":"68'4","last_deep_scrub_stamp":"2024-04-26T12:43:00.244880+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.244880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.477564+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"74'10","reported_seq":283,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.350436+0000","last_change":"2024-04-26T12:43:04.350508+0000","last_active":"2024-04-26T12:43:04.350436+0000","last_peered":"2024-04-26T12:43:04.350436+0000","last_clean":"2024-04-26T12:43:04.350436+0000","last_became_active":"2024-04-26T12:42:21.965760+0000","last_became_peered":"2024-04-26T12:42:21.965760+0000","last_unstale":"2024-04-26T12:43:04.350436+0000","last_undegraded":"2024-04-26T12:43:04.350436+0000","last_fullsized":"2024-04-26T12:43:04.350436+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'10","last_scrub_stamp":"2024-04-26T12:43:04.350211+0000","last_deep_scrub":"74'10","last_deep_scrub_stamp":"2024-04-26T12:43:04.350211+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.350211+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:25.688741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"139'54","reported_seq":317,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.209612+0000","last_change":"2024-04-26T12:43:22.209672+0000","last_active":"2024-04-26T12:43:22.209612+0000","last_peered":"2024-04-26T12:43:22.209612+0000","last_clean":"2024-04-26T12:43:22.209612+0000","last_became_active":"2024-04-26T12:38:10.439771+0000","last_became_peered":"2024-04-26T12:38:10.439771+0000","last_unstale":"2024-04-26T12:43:22.209612+0000","last_undegraded":"2024-04-26T12:43:22.209612+0000","last_fullsized":"2024-04-26T12:43:22.209612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:22.209397+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:22.209397+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.209397+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:19.316413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.815707+0000","last_change":"2024-04-26T12:43:04.815767+0000","last_active":"2024-04-26T12:43:04.815707+0000","last_peered":"2024-04-26T12:43:04.815707+0000","last_clean":"2024-04-26T12:43:04.815707+0000","last_became_active":"2024-04-26T12:38:14.451056+0000","last_became_peered":"2024-04-26T12:38:14.451056+0000","last_unstale":"2024-04-26T12:43:04.815707+0000","last_undegraded":"2024-04-26T12:43:04.815707+0000","last_fullsized":"2024-04-26T12:43:04.815707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.815514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.815514+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.815514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:16.926940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"139'27","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:37.305448+0000","last_change":"2024-04-26T12:43:37.305530+0000","last_active":"2024-04-26T12:43:37.305448+0000","last_peered":"2024-04-26T12:43:37.305448+0000","last_clean":"2024-04-26T12:43:37.305448+0000","last_became_active":"2024-04-26T12:42:21.967735+0000","last_became_peered":"2024-04-26T12:42:21.967735+0000","last_unstale":"2024-04-26T12:43:37.305448+0000","last_undegraded":"2024-04-26T12:43:37.305448+0000","last_fullsized":"2024-04-26T12:43:37.305448+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'27","last_scrub_stamp":"2024-04-26T12:43:37.305239+0000","last_deep_scrub":"139'27","last_deep_scrub_stamp":"2024-04-26T12:43:37.305239+0000","last_clean_scrub_stamp":"2024-04-26T12:43:37.305239+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:56:45.034824+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.609437+0000","last_change":"2024-04-26T12:43:17.609493+0000","last_active":"2024-04-26T12:43:17.609437+0000","last_peered":"2024-04-26T12:43:17.609437+0000","last_clean":"2024-04-26T12:43:17.609437+0000","last_became_active":"2024-04-26T12:38:18.490549+0000","last_became_peered":"2024-04-26T12:38:18.490549+0000","last_unstale":"2024-04-26T12:43:17.609437+0000","last_undegraded":"2024-04-26T12:43:17.609437+0000","last_fullsized":"2024-04-26T12:43:17.609437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:17.609242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:17.609242+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.609242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:30.698690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.215345+0000","last_change":"2024-04-26T12:43:18.215345+0000","last_active":"2024-04-26T12:43:18.215345+0000","last_peered":"2024-04-26T12:43:18.215345+0000","last_clean":"2024-04-26T12:43:18.215345+0000","last_became_active":"2024-04-26T12:38:20.514981+0000","last_became_peered":"2024-04-26T12:38:20.514981+0000","last_unstale":"2024-04-26T12:43:18.215345+0000","last_undegraded":"2024-04-26T12:43:18.215345+0000","last_fullsized":"2024-04-26T12:43:18.215345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:18.215089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:18.215089+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.215089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:45.176558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.170420+0000","last_change":"2024-04-26T12:43:22.170546+0000","last_active":"2024-04-26T12:43:22.170420+0000","last_peered":"2024-04-26T12:43:22.170420+0000","last_clean":"2024-04-26T12:43:22.170420+0000","last_became_active":"2024-04-26T12:42:21.927785+0000","last_became_peered":"2024-04-26T12:42:21.927785+0000","last_unstale":"2024-04-26T12:43:22.170420+0000","last_undegraded":"2024-04-26T12:43:22.170420+0000","last_fullsized":"2024-04-26T12:43:22.170420+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:22.170154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:22.170154+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.170154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:02.056224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"139'40","reported_seq":301,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.381760+0000","last_change":"2024-04-26T12:43:23.381946+0000","last_active":"2024-04-26T12:43:23.381760+0000","last_peered":"2024-04-26T12:43:23.381760+0000","last_clean":"2024-04-26T12:43:23.381760+0000","last_became_active":"2024-04-26T12:38:10.455315+0000","last_became_peered":"2024-04-26T12:38:10.455315+0000","last_unstale":"2024-04-26T12:43:23.381760+0000","last_undegraded":"2024-04-26T12:43:23.381760+0000","last_fullsized":"2024-04-26T12:43:23.381760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'40","last_scrub_stamp":"2024-04-26T12:43:23.381511+0000","last_deep_scrub":"139'40","last_deep_scrub_stamp":"2024-04-26T12:43:23.381511+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.381511+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:37.463314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.587829+0000","last_change":"2024-04-26T12:43:02.587882+0000","last_active":"2024-04-26T12:43:02.587829+0000","last_peered":"2024-04-26T12:43:02.587829+0000","last_clean":"2024-04-26T12:43:02.587829+0000","last_became_active":"2024-04-26T12:38:14.462962+0000","last_became_peered":"2024-04-26T12:38:14.462962+0000","last_unstale":"2024-04-26T12:43:02.587829+0000","last_undegraded":"2024-04-26T12:43:02.587829+0000","last_fullsized":"2024-04-26T12:43:02.587829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:02.587599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:02.587599+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.587599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:22.846905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"139'26","reported_seq":284,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.803425+0000","last_change":"2024-04-26T12:43:09.803503+0000","last_active":"2024-04-26T12:43:09.803425+0000","last_peered":"2024-04-26T12:43:09.803425+0000","last_clean":"2024-04-26T12:43:09.803425+0000","last_became_active":"2024-04-26T12:38:16.472667+0000","last_became_peered":"2024-04-26T12:38:16.472667+0000","last_unstale":"2024-04-26T12:43:09.803425+0000","last_undegraded":"2024-04-26T12:43:09.803425+0000","last_fullsized":"2024-04-26T12:43:09.803425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'26","last_scrub_stamp":"2024-04-26T12:43:09.803242+0000","last_deep_scrub":"139'26","last_deep_scrub_stamp":"2024-04-26T12:43:09.803242+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.803242+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:38.691811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.213041+0000","last_change":"2024-04-26T12:43:03.213170+0000","last_active":"2024-04-26T12:43:03.213041+0000","last_peered":"2024-04-26T12:43:03.213041+0000","last_clean":"2024-04-26T12:43:03.213041+0000","last_became_active":"2024-04-26T12:38:18.489397+0000","last_became_peered":"2024-04-26T12:38:18.489397+0000","last_unstale":"2024-04-26T12:43:03.213041+0000","last_undegraded":"2024-04-26T12:43:03.213041+0000","last_fullsized":"2024-04-26T12:43:03.213041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.212745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.212745+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.212745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:14.957028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"68'2","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.609440+0000","last_change":"2024-04-26T12:42:59.609502+0000","last_active":"2024-04-26T12:42:59.609440+0000","last_peered":"2024-04-26T12:42:59.609440+0000","last_clean":"2024-04-26T12:42:59.609440+0000","last_became_active":"2024-04-26T12:38:12.457248+0000","last_became_peered":"2024-04-26T12:38:12.457248+0000","last_unstale":"2024-04-26T12:42:59.609440+0000","last_undegraded":"2024-04-26T12:42:59.609440+0000","last_fullsized":"2024-04-26T12:42:59.609440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:42:59.609236+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:42:59.609236+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.609236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:52.593677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"139'30","reported_seq":287,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.374573+0000","last_change":"2024-04-26T12:43:05.374641+0000","last_active":"2024-04-26T12:43:05.374573+0000","last_peered":"2024-04-26T12:43:05.374573+0000","last_clean":"2024-04-26T12:43:05.374573+0000","last_became_active":"2024-04-26T12:42:21.964241+0000","last_became_peered":"2024-04-26T12:42:21.964241+0000","last_unstale":"2024-04-26T12:43:05.374573+0000","last_undegraded":"2024-04-26T12:43:05.374573+0000","last_fullsized":"2024-04-26T12:43:05.374573+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'30","last_scrub_stamp":"2024-04-26T12:43:05.374357+0000","last_deep_scrub":"139'30","last_deep_scrub_stamp":"2024-04-26T12:43:05.374357+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.374357+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:04.842010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.249043+0000","last_change":"2024-04-26T12:43:05.249097+0000","last_active":"2024-04-26T12:43:05.249043+0000","last_peered":"2024-04-26T12:43:05.249043+0000","last_clean":"2024-04-26T12:43:05.249043+0000","last_became_active":"2024-04-26T12:38:14.457730+0000","last_became_peered":"2024-04-26T12:38:14.457730+0000","last_unstale":"2024-04-26T12:43:05.249043+0000","last_undegraded":"2024-04-26T12:43:05.249043+0000","last_fullsized":"2024-04-26T12:43:05.249043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:05.248837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:05.248837+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.248837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:12.372185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"139'37","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.911354+0000","last_change":"2024-04-26T12:43:02.911354+0000","last_active":"2024-04-26T12:43:02.911354+0000","last_peered":"2024-04-26T12:43:02.911354+0000","last_clean":"2024-04-26T12:43:02.911354+0000","last_became_active":"2024-04-26T12:38:16.476668+0000","last_became_peered":"2024-04-26T12:38:16.476668+0000","last_unstale":"2024-04-26T12:43:02.911354+0000","last_undegraded":"2024-04-26T12:43:02.911354+0000","last_fullsized":"2024-04-26T12:43:02.911354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'37","last_scrub_stamp":"2024-04-26T12:43:02.910944+0000","last_deep_scrub":"139'37","last_deep_scrub_stamp":"2024-04-26T12:43:02.910944+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.910944+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:02.364042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":254,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:33.266163+0000","last_change":"2024-04-26T12:43:33.266225+0000","last_active":"2024-04-26T12:43:33.266163+0000","last_peered":"2024-04-26T12:43:33.266163+0000","last_clean":"2024-04-26T12:43:33.266163+0000","last_became_active":"2024-04-26T12:42:21.946664+0000","last_became_peered":"2024-04-26T12:42:21.946664+0000","last_unstale":"2024-04-26T12:43:33.266163+0000","last_undegraded":"2024-04-26T12:43:33.266163+0000","last_fullsized":"2024-04-26T12:43:33.266163+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:33.265967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:33.265967+0000","last_clean_scrub_stamp":"2024-04-26T12:43:33.265967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:57:31.371752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:35.266008+0000","last_change":"2024-04-26T12:43:35.266070+0000","last_active":"2024-04-26T12:43:35.266008+0000","last_peered":"2024-04-26T12:43:35.266008+0000","last_clean":"2024-04-26T12:43:35.266008+0000","last_became_active":"2024-04-26T12:42:21.963727+0000","last_became_peered":"2024-04-26T12:42:21.963727+0000","last_unstale":"2024-04-26T12:43:35.266008+0000","last_undegraded":"2024-04-26T12:43:35.266008+0000","last_fullsized":"2024-04-26T12:43:35.266008+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:35.265798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:35.265798+0000","last_clean_scrub_stamp":"2024-04-26T12:43:35.265798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:03.022826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"91'16","reported_seq":314,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.205535+0000","last_change":"2024-04-26T12:43:09.205602+0000","last_active":"2024-04-26T12:43:09.205535+0000","last_peered":"2024-04-26T12:43:09.205535+0000","last_clean":"2024-04-26T12:43:09.205535+0000","last_became_active":"2024-04-26T12:38:12.462413+0000","last_became_peered":"2024-04-26T12:38:12.462413+0000","last_unstale":"2024-04-26T12:43:09.205535+0000","last_undegraded":"2024-04-26T12:43:09.205535+0000","last_fullsized":"2024-04-26T12:43:09.205535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'16","last_scrub_stamp":"2024-04-26T12:43:09.205329+0000","last_deep_scrub":"91'16","last_deep_scrub_stamp":"2024-04-26T12:43:09.205329+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.205329+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:20.160206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":75,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"139'64","reported_seq":332,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.129900+0000","last_change":"2024-04-26T12:43:23.130059+0000","last_active":"2024-04-26T12:43:23.129900+0000","last_peered":"2024-04-26T12:43:23.129900+0000","last_clean":"2024-04-26T12:43:23.129900+0000","last_became_active":"2024-04-26T12:42:21.933941+0000","last_became_peered":"2024-04-26T12:42:21.933941+0000","last_unstale":"2024-04-26T12:43:23.129900+0000","last_undegraded":"2024-04-26T12:43:23.129900+0000","last_fullsized":"2024-04-26T12:43:23.129900+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'64","last_scrub_stamp":"2024-04-26T12:43:23.129589+0000","last_deep_scrub":"139'64","last_deep_scrub_stamp":"2024-04-26T12:43:23.129589+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.129589+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:05.229027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:04.578199+0000","last_change":"2024-04-26T12:43:04.578253+0000","last_active":"2024-04-26T12:43:04.578199+0000","last_peered":"2024-04-26T12:43:04.578199+0000","last_clean":"2024-04-26T12:43:04.578199+0000","last_became_active":"2024-04-26T12:38:14.464587+0000","last_became_peered":"2024-04-26T12:38:14.464587+0000","last_unstale":"2024-04-26T12:43:04.578199+0000","last_undegraded":"2024-04-26T12:43:04.578199+0000","last_fullsized":"2024-04-26T12:43:04.578199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:04.577987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:04.577987+0000","last_clean_scrub_stamp":"2024-04-26T12:43:04.577987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:03.793769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"139'32","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.853150+0000","last_change":"2024-04-26T12:43:05.853150+0000","last_active":"2024-04-26T12:43:05.853150+0000","last_peered":"2024-04-26T12:43:05.853150+0000","last_clean":"2024-04-26T12:43:05.853150+0000","last_became_active":"2024-04-26T12:38:16.464348+0000","last_became_peered":"2024-04-26T12:38:16.464348+0000","last_unstale":"2024-04-26T12:43:05.853150+0000","last_undegraded":"2024-04-26T12:43:05.853150+0000","last_fullsized":"2024-04-26T12:43:05.853150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:05.852849+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:05.852849+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.852849+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:43.174011+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.948381+0000","last_change":"2024-04-26T12:43:06.948381+0000","last_active":"2024-04-26T12:43:06.948381+0000","last_peered":"2024-04-26T12:43:06.948381+0000","last_clean":"2024-04-26T12:43:06.948381+0000","last_became_active":"2024-04-26T12:38:18.490936+0000","last_became_peered":"2024-04-26T12:38:18.490936+0000","last_unstale":"2024-04-26T12:43:06.948381+0000","last_undegraded":"2024-04-26T12:43:06.948381+0000","last_fullsized":"2024-04-26T12:43:06.948381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:06.947999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:06.947999+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.947999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:02.613074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'3","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:21.621173+0000","last_change":"2024-04-26T12:43:21.621235+0000","last_active":"2024-04-26T12:43:21.621173+0000","last_peered":"2024-04-26T12:43:21.621173+0000","last_clean":"2024-04-26T12:43:21.621173+0000","last_became_active":"2024-04-26T12:38:20.520553+0000","last_became_peered":"2024-04-26T12:38:20.520553+0000","last_unstale":"2024-04-26T12:43:21.621173+0000","last_undegraded":"2024-04-26T12:43:21.621173+0000","last_fullsized":"2024-04-26T12:43:21.621173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'3","last_scrub_stamp":"2024-04-26T12:43:21.620920+0000","last_deep_scrub":"68'3","last_deep_scrub_stamp":"2024-04-26T12:43:21.620920+0000","last_clean_scrub_stamp":"2024-04-26T12:43:21.620920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:09.686978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.134825+0000","last_change":"2024-04-26T12:43:26.134944+0000","last_active":"2024-04-26T12:43:26.134825+0000","last_peered":"2024-04-26T12:43:26.134825+0000","last_clean":"2024-04-26T12:43:26.134825+0000","last_became_active":"2024-04-26T12:42:21.924628+0000","last_became_peered":"2024-04-26T12:42:21.924628+0000","last_unstale":"2024-04-26T12:43:26.134825+0000","last_undegraded":"2024-04-26T12:43:26.134825+0000","last_fullsized":"2024-04-26T12:43:26.134825+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:26.134543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:26.134543+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.134543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:19.960554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"139'42","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:34.680108+0000","last_change":"2024-04-26T12:43:34.680174+0000","last_active":"2024-04-26T12:43:34.680108+0000","last_peered":"2024-04-26T12:43:34.680108+0000","last_clean":"2024-04-26T12:43:34.680108+0000","last_became_active":"2024-04-26T12:42:34.034029+0000","last_became_peered":"2024-04-26T12:42:34.034029+0000","last_unstale":"2024-04-26T12:43:34.680108+0000","last_undegraded":"2024-04-26T12:43:34.680108+0000","last_fullsized":"2024-04-26T12:43:34.680108+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'42","last_scrub_stamp":"2024-04-26T12:43:34.679891+0000","last_deep_scrub":"139'42","last_deep_scrub_stamp":"2024-04-26T12:43:34.679891+0000","last_clean_scrub_stamp":"2024-04-26T12:43:34.679891+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:01.025304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":212,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:31.702999+0000","last_change":"2024-04-26T12:43:31.703118+0000","last_active":"2024-04-26T12:43:31.702999+0000","last_peered":"2024-04-26T12:43:31.702999+0000","last_clean":"2024-04-26T12:43:31.702999+0000","last_became_active":"2024-04-26T12:42:34.031261+0000","last_became_peered":"2024-04-26T12:42:34.031261+0000","last_unstale":"2024-04-26T12:43:31.702999+0000","last_undegraded":"2024-04-26T12:43:31.702999+0000","last_fullsized":"2024-04-26T12:43:31.702999+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:31.702748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:31.702748+0000","last_clean_scrub_stamp":"2024-04-26T12:43:31.702748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:34.303461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"139'27","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.149959+0000","last_change":"2024-04-26T12:43:29.150036+0000","last_active":"2024-04-26T12:43:29.149959+0000","last_peered":"2024-04-26T12:43:29.149959+0000","last_clean":"2024-04-26T12:43:29.149959+0000","last_became_active":"2024-04-26T12:42:21.931947+0000","last_became_peered":"2024-04-26T12:42:21.931947+0000","last_unstale":"2024-04-26T12:43:29.149959+0000","last_undegraded":"2024-04-26T12:43:29.149959+0000","last_fullsized":"2024-04-26T12:43:29.149959+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'27","last_scrub_stamp":"2024-04-26T12:43:29.149771+0000","last_deep_scrub":"139'27","last_deep_scrub_stamp":"2024-04-26T12:43:29.149771+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.149771+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:50.619544+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":18,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":252,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.115856+0000","last_change":"2024-04-26T12:43:24.115908+0000","last_active":"2024-04-26T12:43:24.115856+0000","last_peered":"2024-04-26T12:43:24.115856+0000","last_clean":"2024-04-26T12:43:24.115856+0000","last_became_active":"2024-04-26T12:42:21.933611+0000","last_became_peered":"2024-04-26T12:42:21.933611+0000","last_unstale":"2024-04-26T12:43:24.115856+0000","last_undegraded":"2024-04-26T12:43:24.115856+0000","last_fullsized":"2024-04-26T12:43:24.115856+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:24.115659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:24.115659+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.115659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:35.070536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.257990+0000","last_change":"2024-04-26T12:43:03.258043+0000","last_active":"2024-04-26T12:43:03.257990+0000","last_peered":"2024-04-26T12:43:03.257990+0000","last_clean":"2024-04-26T12:43:03.257990+0000","last_became_active":"2024-04-26T12:38:20.516517+0000","last_became_peered":"2024-04-26T12:38:20.516517+0000","last_unstale":"2024-04-26T12:43:03.257990+0000","last_undegraded":"2024-04-26T12:43:03.257990+0000","last_fullsized":"2024-04-26T12:43:03.257990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.257787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.257787+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.257787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:57.561967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":257,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.564305+0000","last_change":"2024-04-26T12:43:03.564305+0000","last_active":"2024-04-26T12:43:03.564305+0000","last_peered":"2024-04-26T12:43:03.564305+0000","last_clean":"2024-04-26T12:43:03.564305+0000","last_became_active":"2024-04-26T12:38:12.459836+0000","last_became_peered":"2024-04-26T12:38:12.459836+0000","last_unstale":"2024-04-26T12:43:03.564305+0000","last_undegraded":"2024-04-26T12:43:03.564305+0000","last_fullsized":"2024-04-26T12:43:03.564305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:03.564054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:03.564054+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.564054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:15.568023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"139'44","reported_seq":305,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.413235+0000","last_change":"2024-04-26T12:43:26.413292+0000","last_active":"2024-04-26T12:43:26.413235+0000","last_peered":"2024-04-26T12:43:26.413235+0000","last_clean":"2024-04-26T12:43:26.413235+0000","last_became_active":"2024-04-26T12:38:10.454959+0000","last_became_peered":"2024-04-26T12:38:10.454959+0000","last_unstale":"2024-04-26T12:43:26.413235+0000","last_undegraded":"2024-04-26T12:43:26.413235+0000","last_fullsized":"2024-04-26T12:43:26.413235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'44","last_scrub_stamp":"2024-04-26T12:43:26.413041+0000","last_deep_scrub":"139'44","last_deep_scrub_stamp":"2024-04-26T12:43:26.413041+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.413041+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:38.159572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:58.875580+0000","last_change":"2024-04-26T12:42:58.875580+0000","last_active":"2024-04-26T12:42:58.875580+0000","last_peered":"2024-04-26T12:42:58.875580+0000","last_clean":"2024-04-26T12:42:58.875580+0000","last_became_active":"2024-04-26T12:38:14.461265+0000","last_became_peered":"2024-04-26T12:38:14.461265+0000","last_unstale":"2024-04-26T12:42:58.875580+0000","last_undegraded":"2024-04-26T12:42:58.875580+0000","last_fullsized":"2024-04-26T12:42:58.875580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:42:58.875471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:42:58.875471+0000","last_clean_scrub_stamp":"2024-04-26T12:42:58.875471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:03.010290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"139'17","reported_seq":75,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.749737+0000","last_change":"2024-04-26T12:43:11.749825+0000","last_active":"2024-04-26T12:43:11.749737+0000","last_peered":"2024-04-26T12:43:11.749737+0000","last_clean":"2024-04-26T12:43:11.749737+0000","last_became_active":"2024-04-26T12:42:34.022362+0000","last_became_peered":"2024-04-26T12:42:34.022362+0000","last_unstale":"2024-04-26T12:43:11.749737+0000","last_undegraded":"2024-04-26T12:43:11.749737+0000","last_fullsized":"2024-04-26T12:43:11.749737+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'17","last_scrub_stamp":"2024-04-26T12:43:11.749536+0000","last_deep_scrub":"139'17","last_deep_scrub_stamp":"2024-04-26T12:43:11.749536+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.749536+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.974033+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"139'138","reported_seq":439,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.548368+0000","last_change":"2024-04-26T12:43:06.548430+0000","last_active":"2024-04-26T12:43:06.548368+0000","last_peered":"2024-04-26T12:43:06.548368+0000","last_clean":"2024-04-26T12:43:06.548368+0000","last_became_active":"2024-04-26T12:38:18.481045+0000","last_became_peered":"2024-04-26T12:38:18.481045+0000","last_unstale":"2024-04-26T12:43:06.548368+0000","last_undegraded":"2024-04-26T12:43:06.548368+0000","last_fullsized":"2024-04-26T12:43:06.548368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'138","last_scrub_stamp":"2024-04-26T12:43:06.548173+0000","last_deep_scrub":"139'138","last_deep_scrub_stamp":"2024-04-26T12:43:06.548173+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.548173+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:56.776441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"117'4","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.018849+0000","last_change":"2024-04-26T12:43:30.018913+0000","last_active":"2024-04-26T12:43:30.018849+0000","last_peered":"2024-04-26T12:43:30.018849+0000","last_clean":"2024-04-26T12:43:30.018849+0000","last_became_active":"2024-04-26T12:38:20.515938+0000","last_became_peered":"2024-04-26T12:38:20.515938+0000","last_unstale":"2024-04-26T12:43:30.018849+0000","last_undegraded":"2024-04-26T12:43:30.018849+0000","last_fullsized":"2024-04-26T12:43:30.018849+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:30.018561+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:30.018561+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.018561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:59.361034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"104'10","reported_seq":226,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.698464+0000","last_change":"2024-04-26T12:43:28.698532+0000","last_active":"2024-04-26T12:43:28.698464+0000","last_peered":"2024-04-26T12:43:28.698464+0000","last_clean":"2024-04-26T12:43:28.698464+0000","last_became_active":"2024-04-26T12:42:34.028313+0000","last_became_peered":"2024-04-26T12:42:34.028313+0000","last_unstale":"2024-04-26T12:43:28.698464+0000","last_undegraded":"2024-04-26T12:43:28.698464+0000","last_fullsized":"2024-04-26T12:43:28.698464+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'10","last_scrub_stamp":"2024-04-26T12:43:28.698049+0000","last_deep_scrub":"104'10","last_deep_scrub_stamp":"2024-04-26T12:43:28.698049+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.698049+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:39:00.421101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"139'52","reported_seq":315,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:25.288878+0000","last_change":"2024-04-26T12:43:25.288958+0000","last_active":"2024-04-26T12:43:25.288878+0000","last_peered":"2024-04-26T12:43:25.288878+0000","last_clean":"2024-04-26T12:43:25.288878+0000","last_became_active":"2024-04-26T12:38:10.449907+0000","last_became_peered":"2024-04-26T12:38:10.449907+0000","last_unstale":"2024-04-26T12:43:25.288878+0000","last_undegraded":"2024-04-26T12:43:25.288878+0000","last_fullsized":"2024-04-26T12:43:25.288878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'52","last_scrub_stamp":"2024-04-26T12:43:25.288674+0000","last_deep_scrub":"139'52","last_deep_scrub_stamp":"2024-04-26T12:43:25.288674+0000","last_clean_scrub_stamp":"2024-04-26T12:43:25.288674+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:59.500760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":251,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.890081+0000","last_change":"2024-04-26T12:43:01.890081+0000","last_active":"2024-04-26T12:43:01.890081+0000","last_peered":"2024-04-26T12:43:01.890081+0000","last_clean":"2024-04-26T12:43:01.890081+0000","last_became_active":"2024-04-26T12:38:14.452650+0000","last_became_peered":"2024-04-26T12:38:14.452650+0000","last_unstale":"2024-04-26T12:43:01.890081+0000","last_undegraded":"2024-04-26T12:43:01.890081+0000","last_fullsized":"2024-04-26T12:43:01.890081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.889695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.889695+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.889695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:05:48.164433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"139'34","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.100676+0000","last_change":"2024-04-26T12:43:12.100772+0000","last_active":"2024-04-26T12:43:12.100676+0000","last_peered":"2024-04-26T12:43:12.100676+0000","last_clean":"2024-04-26T12:43:12.100676+0000","last_became_active":"2024-04-26T12:38:16.474247+0000","last_became_peered":"2024-04-26T12:38:16.474247+0000","last_unstale":"2024-04-26T12:43:12.100676+0000","last_undegraded":"2024-04-26T12:43:12.100676+0000","last_fullsized":"2024-04-26T12:43:12.100676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'34","last_scrub_stamp":"2024-04-26T12:43:12.100484+0000","last_deep_scrub":"139'34","last_deep_scrub_stamp":"2024-04-26T12:43:12.100484+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.100484+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:28.728460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.403016+0000","last_change":"2024-04-26T12:43:18.403077+0000","last_active":"2024-04-26T12:43:18.403016+0000","last_peered":"2024-04-26T12:43:18.403016+0000","last_clean":"2024-04-26T12:43:18.403016+0000","last_became_active":"2024-04-26T12:38:18.494544+0000","last_became_peered":"2024-04-26T12:38:18.494544+0000","last_unstale":"2024-04-26T12:43:18.403016+0000","last_undegraded":"2024-04-26T12:43:18.403016+0000","last_fullsized":"2024-04-26T12:43:18.403016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:18.402792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:18.402792+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.402792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:04:50.540626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":239,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:28.007972+0000","last_change":"2024-04-26T12:43:28.008032+0000","last_active":"2024-04-26T12:43:28.007972+0000","last_peered":"2024-04-26T12:43:28.007972+0000","last_clean":"2024-04-26T12:43:28.007972+0000","last_became_active":"2024-04-26T12:38:20.511370+0000","last_became_peered":"2024-04-26T12:38:20.511370+0000","last_unstale":"2024-04-26T12:43:28.007972+0000","last_undegraded":"2024-04-26T12:43:28.007972+0000","last_fullsized":"2024-04-26T12:43:28.007972+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:28.007747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:28.007747+0000","last_clean_scrub_stamp":"2024-04-26T12:43:28.007747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:45.232244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"117'14","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:33.696707+0000","last_change":"2024-04-26T12:43:33.696857+0000","last_active":"2024-04-26T12:43:33.696707+0000","last_peered":"2024-04-26T12:43:33.696707+0000","last_clean":"2024-04-26T12:43:33.696707+0000","last_became_active":"2024-04-26T12:42:34.031426+0000","last_became_peered":"2024-04-26T12:42:34.031426+0000","last_unstale":"2024-04-26T12:43:33.696707+0000","last_undegraded":"2024-04-26T12:43:33.696707+0000","last_fullsized":"2024-04-26T12:43:33.696707+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'14","last_scrub_stamp":"2024-04-26T12:43:33.696465+0000","last_deep_scrub":"117'14","last_deep_scrub_stamp":"2024-04-26T12:43:33.696465+0000","last_clean_scrub_stamp":"2024-04-26T12:43:33.696465+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:42.358782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"139'76","reported_seq":339,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.238066+0000","last_change":"2024-04-26T12:43:23.238133+0000","last_active":"2024-04-26T12:43:23.238066+0000","last_peered":"2024-04-26T12:43:23.238066+0000","last_clean":"2024-04-26T12:43:23.238066+0000","last_became_active":"2024-04-26T12:38:10.443611+0000","last_became_peered":"2024-04-26T12:38:10.443611+0000","last_unstale":"2024-04-26T12:43:23.238066+0000","last_undegraded":"2024-04-26T12:43:23.238066+0000","last_fullsized":"2024-04-26T12:43:23.238066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'76","last_scrub_stamp":"2024-04-26T12:43:23.237837+0000","last_deep_scrub":"139'76","last_deep_scrub_stamp":"2024-04-26T12:43:23.237837+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.237837+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:53.656730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":0,"num_write":76,"num_write_kb":155648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":255,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.169750+0000","last_change":"2024-04-26T12:43:08.169750+0000","last_active":"2024-04-26T12:43:08.169750+0000","last_peered":"2024-04-26T12:43:08.169750+0000","last_clean":"2024-04-26T12:43:08.169750+0000","last_became_active":"2024-04-26T12:38:14.457698+0000","last_became_peered":"2024-04-26T12:38:14.457698+0000","last_unstale":"2024-04-26T12:43:08.169750+0000","last_undegraded":"2024-04-26T12:43:08.169750+0000","last_fullsized":"2024-04-26T12:43:08.169750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:08.169495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:08.169495+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.169495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:25:37.150464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"139'25","reported_seq":285,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.335623+0000","last_change":"2024-04-26T12:43:12.335759+0000","last_active":"2024-04-26T12:43:12.335623+0000","last_peered":"2024-04-26T12:43:12.335623+0000","last_clean":"2024-04-26T12:43:12.335623+0000","last_became_active":"2024-04-26T12:38:16.476450+0000","last_became_peered":"2024-04-26T12:38:16.476450+0000","last_unstale":"2024-04-26T12:43:12.335623+0000","last_undegraded":"2024-04-26T12:43:12.335623+0000","last_fullsized":"2024-04-26T12:43:12.335623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'25","last_scrub_stamp":"2024-04-26T12:43:12.335290+0000","last_deep_scrub":"139'25","last_deep_scrub_stamp":"2024-04-26T12:43:12.335290+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.335290+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:43.038569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":254,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":244,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:16.561814+0000","last_change":"2024-04-26T12:43:16.561867+0000","last_active":"2024-04-26T12:43:16.561814+0000","last_peered":"2024-04-26T12:43:16.561814+0000","last_clean":"2024-04-26T12:43:16.561814+0000","last_became_active":"2024-04-26T12:38:18.481733+0000","last_became_peered":"2024-04-26T12:38:18.481733+0000","last_unstale":"2024-04-26T12:43:16.561814+0000","last_undegraded":"2024-04-26T12:43:16.561814+0000","last_fullsized":"2024-04-26T12:43:16.561814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:16.561568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:16.561568+0000","last_clean_scrub_stamp":"2024-04-26T12:43:16.561568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:12.226643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"91'2","reported_seq":192,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.302221+0000","last_change":"2024-04-26T12:43:13.302404+0000","last_active":"2024-04-26T12:43:13.302221+0000","last_peered":"2024-04-26T12:43:13.302221+0000","last_clean":"2024-04-26T12:43:13.302221+0000","last_became_active":"2024-04-26T12:42:21.951213+0000","last_became_peered":"2024-04-26T12:42:21.951213+0000","last_unstale":"2024-04-26T12:43:13.302221+0000","last_undegraded":"2024-04-26T12:43:13.302221+0000","last_fullsized":"2024-04-26T12:43:13.302221+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T12:43:13.301968+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T12:43:13.301968+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.301968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:56.191133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"104'4","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.235702+0000","last_change":"2024-04-26T12:43:19.235770+0000","last_active":"2024-04-26T12:43:19.235702+0000","last_peered":"2024-04-26T12:43:19.235702+0000","last_clean":"2024-04-26T12:43:19.235702+0000","last_became_active":"2024-04-26T12:42:21.952291+0000","last_became_peered":"2024-04-26T12:42:21.952291+0000","last_unstale":"2024-04-26T12:43:19.235702+0000","last_undegraded":"2024-04-26T12:43:19.235702+0000","last_fullsized":"2024-04-26T12:43:19.235702+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'4","last_scrub_stamp":"2024-04-26T12:43:19.235435+0000","last_deep_scrub":"104'4","last_deep_scrub_stamp":"2024-04-26T12:43:19.235435+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.235435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:21.866442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"139'54","reported_seq":312,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:27.151934+0000","last_change":"2024-04-26T12:43:27.152108+0000","last_active":"2024-04-26T12:43:27.151934+0000","last_peered":"2024-04-26T12:43:27.151934+0000","last_clean":"2024-04-26T12:43:27.151934+0000","last_became_active":"2024-04-26T12:42:21.928247+0000","last_became_peered":"2024-04-26T12:42:21.928247+0000","last_unstale":"2024-04-26T12:43:27.151934+0000","last_undegraded":"2024-04-26T12:43:27.151934+0000","last_fullsized":"2024-04-26T12:43:27.151934+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:27.151690+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:27.151690+0000","last_clean_scrub_stamp":"2024-04-26T12:43:27.151690+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:14.119920+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":59,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:09.720995+0000","last_change":"2024-04-26T12:43:09.721066+0000","last_active":"2024-04-26T12:43:09.720995+0000","last_peered":"2024-04-26T12:43:09.720995+0000","last_clean":"2024-04-26T12:43:09.720995+0000","last_became_active":"2024-04-26T12:42:34.022065+0000","last_became_peered":"2024-04-26T12:42:34.022065+0000","last_unstale":"2024-04-26T12:43:09.720995+0000","last_undegraded":"2024-04-26T12:43:09.720995+0000","last_fullsized":"2024-04-26T12:43:09.720995+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:09.720772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:09.720772+0000","last_clean_scrub_stamp":"2024-04-26T12:43:09.720772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:15.509639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"139'19","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:40.314565+0000","last_change":"2024-04-26T12:43:40.314754+0000","last_active":"2024-04-26T12:43:40.314565+0000","last_peered":"2024-04-26T12:43:40.314565+0000","last_clean":"2024-04-26T12:43:40.314565+0000","last_became_active":"2024-04-26T12:42:21.971062+0000","last_became_peered":"2024-04-26T12:42:21.971062+0000","last_unstale":"2024-04-26T12:43:40.314565+0000","last_undegraded":"2024-04-26T12:43:40.314565+0000","last_fullsized":"2024-04-26T12:43:40.314565+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'19","last_scrub_stamp":"2024-04-26T12:43:40.314310+0000","last_deep_scrub":"139'19","last_deep_scrub_stamp":"2024-04-26T12:43:40.314310+0000","last_clean_scrub_stamp":"2024-04-26T12:43:40.314310+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:37.841573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":51,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.705346+0000","last_change":"2024-04-26T12:43:02.705400+0000","last_active":"2024-04-26T12:43:02.705346+0000","last_peered":"2024-04-26T12:43:02.705346+0000","last_clean":"2024-04-26T12:43:02.705346+0000","last_became_active":"2024-04-26T12:42:34.024706+0000","last_became_peered":"2024-04-26T12:42:34.024706+0000","last_unstale":"2024-04-26T12:43:02.705346+0000","last_undegraded":"2024-04-26T12:43:02.705346+0000","last_fullsized":"2024-04-26T12:43:02.705346+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:02.705146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:02.705146+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.705146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:30.502334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"74'2","reported_seq":243,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.036332+0000","last_change":"2024-04-26T12:43:29.036395+0000","last_active":"2024-04-26T12:43:29.036332+0000","last_peered":"2024-04-26T12:43:29.036332+0000","last_clean":"2024-04-26T12:43:29.036332+0000","last_became_active":"2024-04-26T12:38:20.514164+0000","last_became_peered":"2024-04-26T12:38:20.514164+0000","last_unstale":"2024-04-26T12:43:29.036332+0000","last_undegraded":"2024-04-26T12:43:29.036332+0000","last_fullsized":"2024-04-26T12:43:29.036332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'2","last_scrub_stamp":"2024-04-26T12:43:29.036126+0000","last_deep_scrub":"74'2","last_deep_scrub_stamp":"2024-04-26T12:43:29.036126+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.036126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:15.972069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"104'14","reported_seq":234,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:13.703385+0000","last_change":"2024-04-26T12:43:13.703442+0000","last_active":"2024-04-26T12:43:13.703385+0000","last_peered":"2024-04-26T12:43:13.703385+0000","last_clean":"2024-04-26T12:43:13.703385+0000","last_became_active":"2024-04-26T12:42:34.022553+0000","last_became_peered":"2024-04-26T12:42:34.022553+0000","last_unstale":"2024-04-26T12:43:13.703385+0000","last_undegraded":"2024-04-26T12:43:13.703385+0000","last_fullsized":"2024-04-26T12:43:13.703385+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'14","last_scrub_stamp":"2024-04-26T12:43:13.703180+0000","last_deep_scrub":"104'14","last_deep_scrub_stamp":"2024-04-26T12:43:13.703180+0000","last_clean_scrub_stamp":"2024-04-26T12:43:13.703180+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:43.045653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"139'50","reported_seq":312,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.406966+0000","last_change":"2024-04-26T12:43:24.407024+0000","last_active":"2024-04-26T12:43:24.406966+0000","last_peered":"2024-04-26T12:43:24.406966+0000","last_clean":"2024-04-26T12:43:24.406966+0000","last_became_active":"2024-04-26T12:38:10.459929+0000","last_became_peered":"2024-04-26T12:38:10.459929+0000","last_unstale":"2024-04-26T12:43:24.406966+0000","last_undegraded":"2024-04-26T12:43:24.406966+0000","last_fullsized":"2024-04-26T12:43:24.406966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:24.406737+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:24.406737+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.406737+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:52.410906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"139'4","reported_seq":348,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:42:59.867769+0000","last_change":"2024-04-26T12:42:59.867769+0000","last_active":"2024-04-26T12:42:59.867769+0000","last_peered":"2024-04-26T12:42:59.867769+0000","last_clean":"2024-04-26T12:42:59.867769+0000","last_became_active":"2024-04-26T12:38:14.452015+0000","last_became_peered":"2024-04-26T12:38:14.452015+0000","last_unstale":"2024-04-26T12:42:59.867769+0000","last_undegraded":"2024-04-26T12:42:59.867769+0000","last_fullsized":"2024-04-26T12:42:59.867769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'4","last_scrub_stamp":"2024-04-26T12:42:59.867488+0000","last_deep_scrub":"139'4","last_deep_scrub_stamp":"2024-04-26T12:42:59.867488+0000","last_clean_scrub_stamp":"2024-04-26T12:42:59.867488+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:33.256882+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1039,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"139'23","reported_seq":81,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.702843+0000","last_change":"2024-04-26T12:43:07.702919+0000","last_active":"2024-04-26T12:43:07.702843+0000","last_peered":"2024-04-26T12:43:07.702843+0000","last_clean":"2024-04-26T12:43:07.702843+0000","last_became_active":"2024-04-26T12:42:34.017996+0000","last_became_peered":"2024-04-26T12:42:34.017996+0000","last_unstale":"2024-04-26T12:43:07.702843+0000","last_undegraded":"2024-04-26T12:43:07.702843+0000","last_fullsized":"2024-04-26T12:43:07.702843+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'23","last_scrub_stamp":"2024-04-26T12:43:07.702636+0000","last_deep_scrub":"139'23","last_deep_scrub_stamp":"2024-04-26T12:43:07.702636+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.702636+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:06.308608+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":245,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:01.228725+0000","last_change":"2024-04-26T12:43:01.228725+0000","last_active":"2024-04-26T12:43:01.228725+0000","last_peered":"2024-04-26T12:43:01.228725+0000","last_clean":"2024-04-26T12:43:01.228725+0000","last_became_active":"2024-04-26T12:38:18.496684+0000","last_became_peered":"2024-04-26T12:38:18.496684+0000","last_unstale":"2024-04-26T12:43:01.228725+0000","last_undegraded":"2024-04-26T12:43:01.228725+0000","last_fullsized":"2024-04-26T12:43:01.228725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:01.228301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:01.228301+0000","last_clean_scrub_stamp":"2024-04-26T12:43:01.228301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:16.914084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"67'4","reported_seq":118,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:18.715013+0000","last_change":"2024-04-26T12:43:18.715078+0000","last_active":"2024-04-26T12:43:18.715013+0000","last_peered":"2024-04-26T12:43:18.715013+0000","last_clean":"2024-04-26T12:43:18.715013+0000","last_became_active":"2024-04-26T12:42:34.011472+0000","last_became_peered":"2024-04-26T12:42:34.011472+0000","last_unstale":"2024-04-26T12:43:18.715013+0000","last_undegraded":"2024-04-26T12:43:18.715013+0000","last_fullsized":"2024-04-26T12:43:18.715013+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:18.714800+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:18.714800+0000","last_clean_scrub_stamp":"2024-04-26T12:43:18.714800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:03.955597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"117'8","reported_seq":290,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:03.914258+0000","last_change":"2024-04-26T12:43:03.914320+0000","last_active":"2024-04-26T12:43:03.914258+0000","last_peered":"2024-04-26T12:43:03.914258+0000","last_clean":"2024-04-26T12:43:03.914258+0000","last_became_active":"2024-04-26T12:38:12.466120+0000","last_became_peered":"2024-04-26T12:38:12.466120+0000","last_unstale":"2024-04-26T12:43:03.914258+0000","last_undegraded":"2024-04-26T12:43:03.914258+0000","last_fullsized":"2024-04-26T12:43:03.914258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'8","last_scrub_stamp":"2024-04-26T12:43:03.914051+0000","last_deep_scrub":"117'8","last_deep_scrub_stamp":"2024-04-26T12:43:03.914051+0000","last_clean_scrub_stamp":"2024-04-26T12:43:03.914051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:08:16.025477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"139'36","reported_seq":296,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.492557+0000","last_change":"2024-04-26T12:43:11.492695+0000","last_active":"2024-04-26T12:43:11.492557+0000","last_peered":"2024-04-26T12:43:11.492557+0000","last_clean":"2024-04-26T12:43:11.492557+0000","last_became_active":"2024-04-26T12:38:10.450601+0000","last_became_peered":"2024-04-26T12:38:10.450601+0000","last_unstale":"2024-04-26T12:43:11.492557+0000","last_undegraded":"2024-04-26T12:43:11.492557+0000","last_fullsized":"2024-04-26T12:43:11.492557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:11.492274+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:11.492274+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.492274+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:23.983148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"74'12","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:17.055768+0000","last_change":"2024-04-26T12:43:17.055829+0000","last_active":"2024-04-26T12:43:17.055768+0000","last_peered":"2024-04-26T12:43:17.055768+0000","last_clean":"2024-04-26T12:43:17.055768+0000","last_became_active":"2024-04-26T12:38:12.455360+0000","last_became_peered":"2024-04-26T12:38:12.455360+0000","last_unstale":"2024-04-26T12:43:17.055768+0000","last_undegraded":"2024-04-26T12:43:17.055768+0000","last_fullsized":"2024-04-26T12:43:17.055768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'12","last_scrub_stamp":"2024-04-26T12:43:17.055523+0000","last_deep_scrub":"74'12","last_deep_scrub_stamp":"2024-04-26T12:43:17.055523+0000","last_clean_scrub_stamp":"2024-04-26T12:43:17.055523+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:44.852711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":61,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"139'54","reported_seq":321,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:10.556358+0000","last_change":"2024-04-26T12:43:10.556427+0000","last_active":"2024-04-26T12:43:10.556358+0000","last_peered":"2024-04-26T12:43:10.556358+0000","last_clean":"2024-04-26T12:43:10.556358+0000","last_became_active":"2024-04-26T12:38:57.841458+0000","last_became_peered":"2024-04-26T12:38:57.841458+0000","last_unstale":"2024-04-26T12:43:10.556358+0000","last_undegraded":"2024-04-26T12:43:10.556358+0000","last_fullsized":"2024-04-26T12:43:10.556358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:10.556157+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:10.556157+0000","last_clean_scrub_stamp":"2024-04-26T12:43:10.556157+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:43.945550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"104'4","reported_seq":276,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:11.122109+0000","last_change":"2024-04-26T12:43:11.122256+0000","last_active":"2024-04-26T12:43:11.122109+0000","last_peered":"2024-04-26T12:43:11.122109+0000","last_clean":"2024-04-26T12:43:11.122109+0000","last_became_active":"2024-04-26T12:38:12.463655+0000","last_became_peered":"2024-04-26T12:38:12.463655+0000","last_unstale":"2024-04-26T12:43:11.122109+0000","last_undegraded":"2024-04-26T12:43:11.122109+0000","last_fullsized":"2024-04-26T12:43:11.122109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'4","last_scrub_stamp":"2024-04-26T12:43:11.121886+0000","last_deep_scrub":"104'4","last_deep_scrub_stamp":"2024-04-26T12:43:11.121886+0000","last_clean_scrub_stamp":"2024-04-26T12:43:11.121886+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:22.580179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"139'50","reported_seq":320,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.250294+0000","last_change":"2024-04-26T12:43:02.250363+0000","last_active":"2024-04-26T12:43:02.250294+0000","last_peered":"2024-04-26T12:43:02.250294+0000","last_clean":"2024-04-26T12:43:02.250294+0000","last_became_active":"2024-04-26T12:42:21.925708+0000","last_became_peered":"2024-04-26T12:42:21.925708+0000","last_unstale":"2024-04-26T12:43:02.250294+0000","last_undegraded":"2024-04-26T12:43:02.250294+0000","last_fullsized":"2024-04-26T12:43:02.250294+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:02.250088+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:02.250088+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.250088+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:21.366905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":100352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"117'4","reported_seq":274,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:05.898995+0000","last_change":"2024-04-26T12:43:05.899059+0000","last_active":"2024-04-26T12:43:05.898995+0000","last_peered":"2024-04-26T12:43:05.898995+0000","last_clean":"2024-04-26T12:43:05.898995+0000","last_became_active":"2024-04-26T12:38:12.463487+0000","last_became_peered":"2024-04-26T12:38:12.463487+0000","last_unstale":"2024-04-26T12:43:05.898995+0000","last_undegraded":"2024-04-26T12:43:05.898995+0000","last_fullsized":"2024-04-26T12:43:05.898995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:05.898768+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:05.898768+0000","last_clean_scrub_stamp":"2024-04-26T12:43:05.898768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:10.366860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"139'56","reported_seq":324,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:35.325652+0000","last_change":"2024-04-26T12:43:35.325719+0000","last_active":"2024-04-26T12:43:35.325652+0000","last_peered":"2024-04-26T12:43:35.325652+0000","last_clean":"2024-04-26T12:43:35.325652+0000","last_became_active":"2024-04-26T12:42:21.957515+0000","last_became_peered":"2024-04-26T12:42:21.957515+0000","last_unstale":"2024-04-26T12:43:35.325652+0000","last_undegraded":"2024-04-26T12:43:35.325652+0000","last_fullsized":"2024-04-26T12:43:35.325652+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'56","last_scrub_stamp":"2024-04-26T12:43:35.325454+0000","last_deep_scrub":"139'56","last_deep_scrub_stamp":"2024-04-26T12:43:35.325454+0000","last_clean_scrub_stamp":"2024-04-26T12:43:35.325454+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:01.670867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'4","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:39.319545+0000","last_change":"2024-04-26T12:43:39.319656+0000","last_active":"2024-04-26T12:43:39.319545+0000","last_peered":"2024-04-26T12:43:39.319545+0000","last_clean":"2024-04-26T12:43:39.319545+0000","last_became_active":"2024-04-26T12:42:21.970669+0000","last_became_peered":"2024-04-26T12:42:21.970669+0000","last_unstale":"2024-04-26T12:43:39.319545+0000","last_undegraded":"2024-04-26T12:43:39.319545+0000","last_fullsized":"2024-04-26T12:43:39.319545+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-04-26T12:43:39.319284+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-04-26T12:43:39.319284+0000","last_clean_scrub_stamp":"2024-04-26T12:43:39.319284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:58.980373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"139'46","reported_seq":303,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:23.158895+0000","last_change":"2024-04-26T12:43:23.158956+0000","last_active":"2024-04-26T12:43:23.158895+0000","last_peered":"2024-04-26T12:43:23.158895+0000","last_clean":"2024-04-26T12:43:23.158895+0000","last_became_active":"2024-04-26T12:42:21.961965+0000","last_became_peered":"2024-04-26T12:42:21.961965+0000","last_unstale":"2024-04-26T12:43:23.158895+0000","last_undegraded":"2024-04-26T12:43:23.158895+0000","last_fullsized":"2024-04-26T12:43:23.158895+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'46","last_scrub_stamp":"2024-04-26T12:43:23.158679+0000","last_deep_scrub":"139'46","last_deep_scrub_stamp":"2024-04-26T12:43:23.158679+0000","last_clean_scrub_stamp":"2024-04-26T12:43:23.158679+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.144602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":63,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.674574+0000","last_change":"2024-04-26T12:43:00.674626+0000","last_active":"2024-04-26T12:43:00.674574+0000","last_peered":"2024-04-26T12:43:00.674574+0000","last_clean":"2024-04-26T12:43:00.674574+0000","last_became_active":"2024-04-26T12:42:34.024880+0000","last_became_peered":"2024-04-26T12:42:34.024880+0000","last_unstale":"2024-04-26T12:43:00.674574+0000","last_undegraded":"2024-04-26T12:43:00.674574+0000","last_fullsized":"2024-04-26T12:43:00.674574+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:00.674389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:00.674389+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.674389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:29.421111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"139'38","reported_seq":304,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:22.137818+0000","last_change":"2024-04-26T12:43:22.137883+0000","last_active":"2024-04-26T12:43:22.137818+0000","last_peered":"2024-04-26T12:43:22.137818+0000","last_clean":"2024-04-26T12:43:22.137818+0000","last_became_active":"2024-04-26T12:38:57.843177+0000","last_became_peered":"2024-04-26T12:38:57.843177+0000","last_unstale":"2024-04-26T12:43:22.137818+0000","last_undegraded":"2024-04-26T12:43:22.137818+0000","last_fullsized":"2024-04-26T12:43:22.137818+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'38","last_scrub_stamp":"2024-04-26T12:43:22.137607+0000","last_deep_scrub":"139'38","last_deep_scrub_stamp":"2024-04-26T12:43:22.137607+0000","last_clean_scrub_stamp":"2024-04-26T12:43:22.137607+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:20.743579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":194,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.107869+0000","last_change":"2024-04-26T12:43:24.107926+0000","last_active":"2024-04-26T12:43:24.107869+0000","last_peered":"2024-04-26T12:43:24.107869+0000","last_clean":"2024-04-26T12:43:24.107869+0000","last_became_active":"2024-04-26T12:42:21.941594+0000","last_became_peered":"2024-04-26T12:42:21.941594+0000","last_unstale":"2024-04-26T12:43:24.107869+0000","last_undegraded":"2024-04-26T12:43:24.107869+0000","last_fullsized":"2024-04-26T12:43:24.107869+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T12:43:24.107660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T12:43:24.107660+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.107660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:19:10.400981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"139'54","reported_seq":314,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.513113+0000","last_change":"2024-04-26T12:43:15.513189+0000","last_active":"2024-04-26T12:43:15.513113+0000","last_peered":"2024-04-26T12:43:15.513113+0000","last_clean":"2024-04-26T12:43:15.513113+0000","last_became_active":"2024-04-26T12:38:10.475502+0000","last_became_peered":"2024-04-26T12:38:10.475502+0000","last_unstale":"2024-04-26T12:43:15.513113+0000","last_undegraded":"2024-04-26T12:43:15.513113+0000","last_fullsized":"2024-04-26T12:43:15.513113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'54","last_scrub_stamp":"2024-04-26T12:43:15.512868+0000","last_deep_scrub":"139'54","last_deep_scrub_stamp":"2024-04-26T12:43:15.512868+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.512868+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:19.980960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"117'12","reported_seq":306,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:07.568047+0000","last_change":"2024-04-26T12:43:07.568228+0000","last_active":"2024-04-26T12:43:07.568047+0000","last_peered":"2024-04-26T12:43:07.568047+0000","last_clean":"2024-04-26T12:43:07.568047+0000","last_became_active":"2024-04-26T12:38:12.442155+0000","last_became_peered":"2024-04-26T12:38:12.442155+0000","last_unstale":"2024-04-26T12:43:07.568047+0000","last_undegraded":"2024-04-26T12:43:07.568047+0000","last_fullsized":"2024-04-26T12:43:07.568047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'12","last_scrub_stamp":"2024-04-26T12:43:07.567732+0000","last_deep_scrub":"117'12","last_deep_scrub_stamp":"2024-04-26T12:43:07.567732+0000","last_clean_scrub_stamp":"2024-04-26T12:43:07.567732+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:36.516974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":62,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"139'64","reported_seq":322,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.335905+0000","last_change":"2024-04-26T12:43:12.336301+0000","last_active":"2024-04-26T12:43:12.335905+0000","last_peered":"2024-04-26T12:43:12.335905+0000","last_clean":"2024-04-26T12:43:12.335905+0000","last_became_active":"2024-04-26T12:42:21.948694+0000","last_became_peered":"2024-04-26T12:42:21.948694+0000","last_unstale":"2024-04-26T12:43:12.335905+0000","last_undegraded":"2024-04-26T12:43:12.335905+0000","last_fullsized":"2024-04-26T12:43:12.335905+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'64","last_scrub_stamp":"2024-04-26T12:43:12.335694+0000","last_deep_scrub":"139'64","last_deep_scrub_stamp":"2024-04-26T12:43:12.335694+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.335694+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:48.400013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":129024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"91'8","reported_seq":299,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:33.399797+0000","last_change":"2024-04-26T12:43:33.399863+0000","last_active":"2024-04-26T12:43:33.399797+0000","last_peered":"2024-04-26T12:43:33.399797+0000","last_clean":"2024-04-26T12:43:33.399797+0000","last_became_active":"2024-04-26T12:42:21.956925+0000","last_became_peered":"2024-04-26T12:42:21.956925+0000","last_unstale":"2024-04-26T12:43:33.399797+0000","last_undegraded":"2024-04-26T12:43:33.399797+0000","last_fullsized":"2024-04-26T12:43:33.399797+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'8","last_scrub_stamp":"2024-04-26T12:43:33.399592+0000","last_deep_scrub":"91'8","last_deep_scrub_stamp":"2024-04-26T12:43:33.399592+0000","last_clean_scrub_stamp":"2024-04-26T12:43:33.399592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:26.488053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"139'58","reported_seq":328,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:34.242847+0000","last_change":"2024-04-26T12:43:34.242967+0000","last_active":"2024-04-26T12:43:34.242847+0000","last_peered":"2024-04-26T12:43:34.242847+0000","last_clean":"2024-04-26T12:43:34.242847+0000","last_became_active":"2024-04-26T12:42:21.949469+0000","last_became_peered":"2024-04-26T12:42:21.949469+0000","last_unstale":"2024-04-26T12:43:34.242847+0000","last_undegraded":"2024-04-26T12:43:34.242847+0000","last_fullsized":"2024-04-26T12:43:34.242847+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'58","last_scrub_stamp":"2024-04-26T12:43:34.242615+0000","last_deep_scrub":"139'58","last_deep_scrub_stamp":"2024-04-26T12:43:34.242615+0000","last_clean_scrub_stamp":"2024-04-26T12:43:34.242615+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:32.925089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"68'2","reported_seq":123,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:06.691945+0000","last_change":"2024-04-26T12:43:06.692004+0000","last_active":"2024-04-26T12:43:06.691945+0000","last_peered":"2024-04-26T12:43:06.691945+0000","last_clean":"2024-04-26T12:43:06.691945+0000","last_became_active":"2024-04-26T12:42:34.018659+0000","last_became_peered":"2024-04-26T12:42:34.018659+0000","last_unstale":"2024-04-26T12:43:06.691945+0000","last_undegraded":"2024-04-26T12:43:06.691945+0000","last_fullsized":"2024-04-26T12:43:06.691945+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-04-26T12:43:06.691742+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-04-26T12:43:06.691742+0000","last_clean_scrub_stamp":"2024-04-26T12:43:06.691742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:08.695966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"139'36","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.175150+0000","last_change":"2024-04-26T12:43:30.175234+0000","last_active":"2024-04-26T12:43:30.175150+0000","last_peered":"2024-04-26T12:43:30.175150+0000","last_clean":"2024-04-26T12:43:30.175150+0000","last_became_active":"2024-04-26T12:42:21.932263+0000","last_became_peered":"2024-04-26T12:42:21.932263+0000","last_unstale":"2024-04-26T12:43:30.175150+0000","last_undegraded":"2024-04-26T12:43:30.175150+0000","last_fullsized":"2024-04-26T12:43:30.175150+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'36","last_scrub_stamp":"2024-04-26T12:43:30.174919+0000","last_deep_scrub":"139'36","last_deep_scrub_stamp":"2024-04-26T12:43:30.174919+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.174919+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:36.174705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"117'4","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:02.566523+0000","last_change":"2024-04-26T12:43:02.566604+0000","last_active":"2024-04-26T12:43:02.566523+0000","last_peered":"2024-04-26T12:43:02.566523+0000","last_clean":"2024-04-26T12:43:02.566523+0000","last_became_active":"2024-04-26T12:38:12.457703+0000","last_became_peered":"2024-04-26T12:38:12.457703+0000","last_unstale":"2024-04-26T12:43:02.566523+0000","last_undegraded":"2024-04-26T12:43:02.566523+0000","last_fullsized":"2024-04-26T12:43:02.566523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'4","last_scrub_stamp":"2024-04-26T12:43:02.566309+0000","last_deep_scrub":"117'4","last_deep_scrub_stamp":"2024-04-26T12:43:02.566309+0000","last_clean_scrub_stamp":"2024-04-26T12:43:02.566309+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:34.116008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"139'32","reported_seq":295,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:26.327061+0000","last_change":"2024-04-26T12:43:26.327118+0000","last_active":"2024-04-26T12:43:26.327061+0000","last_peered":"2024-04-26T12:43:26.327061+0000","last_clean":"2024-04-26T12:43:26.327061+0000","last_became_active":"2024-04-26T12:38:10.464507+0000","last_became_peered":"2024-04-26T12:38:10.464507+0000","last_unstale":"2024-04-26T12:43:26.327061+0000","last_undegraded":"2024-04-26T12:43:26.327061+0000","last_fullsized":"2024-04-26T12:43:26.327061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:26.326863+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:26.326863+0000","last_clean_scrub_stamp":"2024-04-26T12:43:26.326863+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:11.567660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"117'8","reported_seq":246,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:27.694402+0000","last_change":"2024-04-26T12:43:27.694465+0000","last_active":"2024-04-26T12:43:27.694402+0000","last_peered":"2024-04-26T12:43:27.694402+0000","last_clean":"2024-04-26T12:43:27.694402+0000","last_became_active":"2024-04-26T12:42:34.023978+0000","last_became_peered":"2024-04-26T12:42:34.023978+0000","last_unstale":"2024-04-26T12:43:27.694402+0000","last_undegraded":"2024-04-26T12:43:27.694402+0000","last_fullsized":"2024-04-26T12:43:27.694402+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'8","last_scrub_stamp":"2024-04-26T12:43:27.694206+0000","last_deep_scrub":"117'8","last_deep_scrub_stamp":"2024-04-26T12:43:27.694206+0000","last_clean_scrub_stamp":"2024-04-26T12:43:27.694206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:28.998364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"139'46","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:27.394123+0000","last_change":"2024-04-26T12:43:27.394184+0000","last_active":"2024-04-26T12:43:27.394123+0000","last_peered":"2024-04-26T12:43:27.394123+0000","last_clean":"2024-04-26T12:43:27.394123+0000","last_became_active":"2024-04-26T12:38:10.474068+0000","last_became_peered":"2024-04-26T12:38:10.474068+0000","last_unstale":"2024-04-26T12:43:27.394123+0000","last_undegraded":"2024-04-26T12:43:27.394123+0000","last_fullsized":"2024-04-26T12:43:27.394123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'46","last_scrub_stamp":"2024-04-26T12:43:27.393919+0000","last_deep_scrub":"139'46","last_deep_scrub_stamp":"2024-04-26T12:43:27.393919+0000","last_clean_scrub_stamp":"2024-04-26T12:43:27.393919+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.984089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"67'4","reported_seq":278,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:30.974101+0000","last_change":"2024-04-26T12:43:30.974186+0000","last_active":"2024-04-26T12:43:30.974101+0000","last_peered":"2024-04-26T12:43:30.974101+0000","last_clean":"2024-04-26T12:43:30.974101+0000","last_became_active":"2024-04-26T12:38:57.843260+0000","last_became_peered":"2024-04-26T12:38:57.843260+0000","last_unstale":"2024-04-26T12:43:30.974101+0000","last_undegraded":"2024-04-26T12:43:30.974101+0000","last_fullsized":"2024-04-26T12:43:30.974101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-04-26T12:43:30.973894+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-04-26T12:43:30.973894+0000","last_clean_scrub_stamp":"2024-04-26T12:43:30.973894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:28.080910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"139'34","reported_seq":294,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.488505+0000","last_change":"2024-04-26T12:43:12.488578+0000","last_active":"2024-04-26T12:43:12.488505+0000","last_peered":"2024-04-26T12:43:12.488505+0000","last_clean":"2024-04-26T12:43:12.488505+0000","last_became_active":"2024-04-26T12:38:10.451198+0000","last_became_peered":"2024-04-26T12:38:10.451198+0000","last_unstale":"2024-04-26T12:43:12.488505+0000","last_undegraded":"2024-04-26T12:43:12.488505+0000","last_fullsized":"2024-04-26T12:43:12.488505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'34","last_scrub_stamp":"2024-04-26T12:43:12.488308+0000","last_deep_scrub":"139'34","last_deep_scrub_stamp":"2024-04-26T12:43:12.488308+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.488308+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:11.941406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"104'6","reported_seq":281,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:15.420636+0000","last_change":"2024-04-26T12:43:15.420698+0000","last_active":"2024-04-26T12:43:15.420636+0000","last_peered":"2024-04-26T12:43:15.420636+0000","last_clean":"2024-04-26T12:43:15.420636+0000","last_became_active":"2024-04-26T12:38:12.458296+0000","last_became_peered":"2024-04-26T12:38:12.458296+0000","last_unstale":"2024-04-26T12:43:15.420636+0000","last_undegraded":"2024-04-26T12:43:15.420636+0000","last_fullsized":"2024-04-26T12:43:15.420636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"104'6","last_scrub_stamp":"2024-04-26T12:43:15.420425+0000","last_deep_scrub":"104'6","last_deep_scrub_stamp":"2024-04-26T12:43:15.420425+0000","last_clean_scrub_stamp":"2024-04-26T12:43:15.420425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:12.527441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"139'48","reported_seq":307,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.809465+0000","last_change":"2024-04-26T12:43:12.809527+0000","last_active":"2024-04-26T12:43:12.809465+0000","last_peered":"2024-04-26T12:43:12.809465+0000","last_clean":"2024-04-26T12:43:12.809465+0000","last_became_active":"2024-04-26T12:38:10.474478+0000","last_became_peered":"2024-04-26T12:38:10.474478+0000","last_unstale":"2024-04-26T12:43:12.809465+0000","last_undegraded":"2024-04-26T12:43:12.809465+0000","last_fullsized":"2024-04-26T12:43:12.809465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:12.809240+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:12.809240+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.809240+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:39:00.875299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"74'4","reported_seq":270,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:08.320240+0000","last_change":"2024-04-26T12:43:08.320300+0000","last_active":"2024-04-26T12:43:08.320240+0000","last_peered":"2024-04-26T12:43:08.320240+0000","last_clean":"2024-04-26T12:43:08.320240+0000","last_became_active":"2024-04-26T12:42:21.965634+0000","last_became_peered":"2024-04-26T12:42:21.965634+0000","last_unstale":"2024-04-26T12:43:08.320240+0000","last_undegraded":"2024-04-26T12:43:08.320240+0000","last_fullsized":"2024-04-26T12:43:08.320240+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"74'4","last_scrub_stamp":"2024-04-26T12:43:08.320039+0000","last_deep_scrub":"74'4","last_deep_scrub_stamp":"2024-04-26T12:43:08.320039+0000","last_clean_scrub_stamp":"2024-04-26T12:43:08.320039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:38.031153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"139'32","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:00.549487+0000","last_change":"2024-04-26T12:43:00.549547+0000","last_active":"2024-04-26T12:43:00.549487+0000","last_peered":"2024-04-26T12:43:00.549487+0000","last_clean":"2024-04-26T12:43:00.549487+0000","last_became_active":"2024-04-26T12:38:10.450459+0000","last_became_peered":"2024-04-26T12:38:10.450459+0000","last_unstale":"2024-04-26T12:43:00.549487+0000","last_undegraded":"2024-04-26T12:43:00.549487+0000","last_fullsized":"2024-04-26T12:43:00.549487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'32","last_scrub_stamp":"2024-04-26T12:43:00.549294+0000","last_deep_scrub":"139'32","last_deep_scrub_stamp":"2024-04-26T12:43:00.549294+0000","last_clean_scrub_stamp":"2024-04-26T12:43:00.549294+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:53.533735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"91'4","reported_seq":280,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:32.984102+0000","last_change":"2024-04-26T12:43:32.984161+0000","last_active":"2024-04-26T12:43:32.984102+0000","last_peered":"2024-04-26T12:43:32.984102+0000","last_clean":"2024-04-26T12:43:32.984102+0000","last_became_active":"2024-04-26T12:42:21.967048+0000","last_became_peered":"2024-04-26T12:42:21.967048+0000","last_unstale":"2024-04-26T12:43:32.984102+0000","last_undegraded":"2024-04-26T12:43:32.984102+0000","last_fullsized":"2024-04-26T12:43:32.984102+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T12:43:32.983884+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T12:43:32.983884+0000","last_clean_scrub_stamp":"2024-04-26T12:43:32.983884+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:48.493742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"139'30","reported_seq":293,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:27.342494+0000","last_change":"2024-04-26T12:43:27.342558+0000","last_active":"2024-04-26T12:43:27.342494+0000","last_peered":"2024-04-26T12:43:27.342494+0000","last_clean":"2024-04-26T12:43:27.342494+0000","last_became_active":"2024-04-26T12:38:10.469253+0000","last_became_peered":"2024-04-26T12:38:10.469253+0000","last_unstale":"2024-04-26T12:43:27.342494+0000","last_undegraded":"2024-04-26T12:43:27.342494+0000","last_fullsized":"2024-04-26T12:43:27.342494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'30","last_scrub_stamp":"2024-04-26T12:43:27.342298+0000","last_deep_scrub":"139'30","last_deep_scrub_stamp":"2024-04-26T12:43:27.342298+0000","last_clean_scrub_stamp":"2024-04-26T12:43:27.342298+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:39:18.347016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":30,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"139'48","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:24.264253+0000","last_change":"2024-04-26T12:43:24.264313+0000","last_active":"2024-04-26T12:43:24.264253+0000","last_peered":"2024-04-26T12:43:24.264253+0000","last_clean":"2024-04-26T12:43:24.264253+0000","last_became_active":"2024-04-26T12:38:10.444257+0000","last_became_peered":"2024-04-26T12:38:10.444257+0000","last_unstale":"2024-04-26T12:43:24.264253+0000","last_undegraded":"2024-04-26T12:43:24.264253+0000","last_fullsized":"2024-04-26T12:43:24.264253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'48","last_scrub_stamp":"2024-04-26T12:43:24.264057+0000","last_deep_scrub":"139'48","last_deep_scrub_stamp":"2024-04-26T12:43:24.264057+0000","last_clean_scrub_stamp":"2024-04-26T12:43:24.264057+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:28:39.773915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"91'2","reported_seq":273,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:29.439833+0000","last_change":"2024-04-26T12:43:29.439890+0000","last_active":"2024-04-26T12:43:29.439833+0000","last_peered":"2024-04-26T12:43:29.439833+0000","last_clean":"2024-04-26T12:43:29.439833+0000","last_became_active":"2024-04-26T12:42:21.936930+0000","last_became_peered":"2024-04-26T12:42:21.936930+0000","last_unstale":"2024-04-26T12:43:29.439833+0000","last_undegraded":"2024-04-26T12:43:29.439833+0000","last_fullsized":"2024-04-26T12:43:29.439833+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T12:43:29.439631+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T12:43:29.439631+0000","last_clean_scrub_stamp":"2024-04-26T12:43:29.439631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:49.649723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"139'50","reported_seq":311,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:12.983284+0000","last_change":"2024-04-26T12:43:12.983343+0000","last_active":"2024-04-26T12:43:12.983284+0000","last_peered":"2024-04-26T12:43:12.983284+0000","last_clean":"2024-04-26T12:43:12.983284+0000","last_became_active":"2024-04-26T12:38:10.424010+0000","last_became_peered":"2024-04-26T12:38:10.424010+0000","last_unstale":"2024-04-26T12:43:12.983284+0000","last_undegraded":"2024-04-26T12:43:12.983284+0000","last_fullsized":"2024-04-26T12:43:12.983284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"139'50","last_scrub_stamp":"2024-04-26T12:43:12.983082+0000","last_deep_scrub":"139'50","last_deep_scrub_stamp":"2024-04-26T12:43:12.983082+0000","last_clean_scrub_stamp":"2024-04-26T12:43:12.983082+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:16.724892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"117'2","reported_seq":267,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-04-26T12:43:19.193719+0000","last_change":"2024-04-26T12:43:19.193776+0000","last_active":"2024-04-26T12:43:19.193719+0000","last_peered":"2024-04-26T12:43:19.193719+0000","last_clean":"2024-04-26T12:43:19.193719+0000","last_became_active":"2024-04-26T12:38:12.448756+0000","last_became_peered":"2024-04-26T12:38:12.448756+0000","last_unstale":"2024-04-26T12:43:19.193719+0000","last_undegraded":"2024-04-26T12:43:19.193719+0000","last_fullsized":"2024-04-26T12:43:19.193719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'2","last_scrub_stamp":"2024-04-26T12:43:19.193519+0000","last_deep_scrub":"117'2","last_deep_scrub_stamp":"2024-04-26T12:43:19.193519+0000","last_clean_scrub_stamp":"2024-04-26T12:43:19.193519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:36.418015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":336,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1110,"ondisk_log_size":1110,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1061,"num_read_kb":1543,"num_write":541,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6164,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1018,"ondisk_log_size":1018,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":454,"num_read_kb":454,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1307,"num_read_kb":1275,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37596,"kb_used_data":2260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334244,"statfs":{"total":96636764160,"available":96598265856,"internally_reserved":0,"allocated":2314240,"data_stored":1600353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36992,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334848,"statfs":{"total":96636764160,"available":96598884352,"internally_reserved":0,"allocated":1695744,"data_stored":1009325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1748992,"data_stored":1011582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1687552,"data_stored":1008834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":122,"seq":523986010133,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42200,"kb_used_data":1680,"kb_used_omap":6,"kb_used_meta":40505,"kb_avail":94329640,"statfs":{"total":96636764160,"available":96593551360,"internally_reserved":0,"allocated":1720320,"data_stored":1010124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6715,"internal_metadata":41477573},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41144,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330696,"statfs":{"total":96636764160,"available":96594632704,"internally_reserved":0,"allocated":1687552,"data_stored":1009323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41176,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330664,"statfs":{"total":96636764160,"available":96594599936,"internally_reserved":0,"allocated":1720320,"data_stored":1010960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41736,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330104,"statfs":{"total":96636764160,"available":96594026496,"internally_reserved":0,"allocated":2293760,"data_stored":1599759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5122,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T12:44:00.773 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T12:44:01.133 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T12:44:01.134 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T12:44:01.134 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T12:44:01.134 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.222 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T12:44:01.222 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T12:44:01.222 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.305 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T12:44:01.305 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T12:44:01.306 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.393 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T12:44:01.393 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T12:44:01.393 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.490 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T12:44:01.490 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T12:44:01.491 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.584 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T12:44:01.584 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T12:44:01.584 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.667 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T12:44:01.668 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T12:44:01.668 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.768 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T12:44:01.768 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T12:44:01.769 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.855 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T12:44:01.855 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T12:44:01.856 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T12:44:01.856 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.885 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T12:44:01.885 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T12:44:01.885 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.919 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T12:44:01.919 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T12:44:01.919 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T12:44:01.919 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:01.945 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T12:44:01.946 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T12:44:01.946 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:02.005 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T12:44:02.006 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T12:44:02.006 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T12:44:02.029 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T12:44:02.030 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T12:44:02.030 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-04-26T12:44:02.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:44:02.064 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T12:44:02.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:44:02.358 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T12:44:02.579 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:44:02.579 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T12:44:02.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:44:02.720 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T12:44:02.887 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:44:02.887 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T12:44:03.116 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:44:03.116 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T12:44:03.329 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:44:03.330 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T12:44:03.536 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:44:03.536 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T12:44:03.737 INFO:tasks.ceph:Archiving mon data... 2024-04-26T12:44:03.738 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/data/mon.a.tgz 2024-04-26T12:44:03.738 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-26T12:44:03.744 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.bvoZMgOUlc 2024-04-26T12:44:03.745 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bvoZMgOUlc 2024-04-26T12:44:03.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.bvoZMgOUlc 2024-04-26T12:44:04.008 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.bvoZMgOUlc is 636KB 2024-04-26T12:44:04.070 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.bvoZMgOUlc 2024-04-26T12:44:04.075 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/data/mon.c.tgz 2024-04-26T12:44:04.075 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-26T12:44:04.124 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.vs4iCHCeDs 2024-04-26T12:44:04.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vs4iCHCeDs 2024-04-26T12:44:04.370 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.vs4iCHCeDs 2024-04-26T12:44:04.436 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.vs4iCHCeDs is 810KB 2024-04-26T12:44:04.507 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.vs4iCHCeDs 2024-04-26T12:44:04.513 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/data/mon.b.tgz 2024-04-26T12:44:04.513 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-04-26T12:44:04.519 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.jrzDjkObxp 2024-04-26T12:44:04.519 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jrzDjkObxp 2024-04-26T12:44:04.755 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.jrzDjkObxp 2024-04-26T12:44:04.818 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.jrzDjkObxp is 810KB 2024-04-26T12:44:04.885 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.jrzDjkObxp 2024-04-26T12:44:04.890 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T12:44:04.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:44:04.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T12:44:04.953 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T12:44:04.995 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T12:44:04.995 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T12:44:04.996 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/remote/smithi016/crash 2024-04-26T12:44:04.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:44:05.011 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/remote/smithi131/crash 2024-04-26T12:44:05.012 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T12:44:05.050 INFO:tasks.ceph:Compressing logs... 2024-04-26T12:44:05.050 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T12:44:05.057 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T12:44:05.074 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31282.log 2024-04-26T12:44:05.075 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60247.log 2024-04-26T12:44:05.075 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31282.log.gz 2024-04-26T12:44:05.075 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68361.log 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.60247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60247.log.gz 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68357.log 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68361.log.gz 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61611.log 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68357.log.gz 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33193.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.61611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61611.log.gz 2024-04-26T12:44:05.077 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67791.log 2024-04-26T12:44:05.081 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33929.log 2024-04-26T12:44:05.081 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.67791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58672.log 2024-04-26T12:44:05.081 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67791.log.gz 2024-04-26T12:44:05.081 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62539.log 2024-04-26T12:44:05.081 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-26T12:44:05.081 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33929.log.gz 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54281.log 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58672.log.gz 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62539.log.gz 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36937.log 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54281.log.gz 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62915.log 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36937.log.gz 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34619.log 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67945.log 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62915.log.gz 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54706.log 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34619.log.gz 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60837.log 2024-04-26T12:44:05.082 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67945.log.gz 2024-04-26T12:44:05.086 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54383.log 2024-04-26T12:44:05.086 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54706.log.gz 2024-04-26T12:44:05.086 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34409.log 2024-04-26T12:44:05.086 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.60837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60837.log.gz 2024-04-26T12:44:05.086 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53514.log 2024-04-26T12:44:05.086 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54383.log.gz 2024-04-26T12:44:05.086 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62832.log 2024-04-26T12:44:05.086 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34409.log.gz 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32551.log 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53514.log.gz 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62832.log.gz 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48899.log 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67505.log 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32551.log.gz 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48899.log.gz 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45289.log 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67505.log.gz 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34687.log 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45289.log.gz 2024-04-26T12:44:05.087 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58807.log 2024-04-26T12:44:05.091 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67635.log 2024-04-26T12:44:05.091 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34687.log.gz 2024-04-26T12:44:05.091 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59296.log 2024-04-26T12:44:05.091 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58807.log.gz 2024-04-26T12:44:05.091 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67635.log.gz 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24977.log 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30972.log 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59296.log.gz 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.24977.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.24977.log.gz -5 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.68142.log 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35389.log 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30972.log.gz 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68142.log.gz 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68156.log 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67948.log 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35389.log.gz 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41701.log 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68156.log.gz 2024-04-26T12:44:05.092 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67948.log.gz 2024-04-26T12:44:05.093 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33141.log 2024-04-26T12:44:05.093 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30956.log 2024-04-26T12:44:05.093 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41701.log.gz 2024-04-26T12:44:05.093 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33141.log.gz 2024-04-26T12:44:05.093 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57689.log 2024-04-26T12:44:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67453.log 2024-04-26T12:44:05.096 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30956.log.gz 2024-04-26T12:44:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57689.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.57689.log.gz 2024-04-26T12:44:05.096 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57743.log 2024-04-26T12:44:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54560.log 2024-04-26T12:44:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67453.log.gz 2024-04-26T12:44:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57743.log.gz 2024-04-26T12:44:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67661.log 2024-04-26T12:44:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54560.log: -- /var/log/ceph/ceph-client.admin.62399.log 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54560.log.gz 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62474.log 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67661.log.gz 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.62399.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68137.log 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62399.log.gz 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62474.log.gz 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34296.log 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.68137.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66539.log 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68137.log.gz 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34296.log.gz 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57499.log 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.66539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39930.log 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66539.log.gz 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57499.log.gz 2024-04-26T12:44:05.097 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65694.log 2024-04-26T12:44:05.103 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58036.log 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39930.log.gz 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40520.log 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65694.log.gz 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.58036.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30544.log 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58036.log.gz 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40520.log.gz 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33727.log 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.30544.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57586.log 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30544.log.gz 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32137.log 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33727.log.gz 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66477.log 2024-04-26T12:44:05.104 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57586.log.gz 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32137.log.gz 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32039.log 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.66477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53468.log 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66477.log.gz 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36347.log 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32039.log.gz 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53468.log.gz 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59270.log 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.36347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57899.log 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36347.log.gz 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65525.log 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59270.log.gz 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57899.log.gz 2024-04-26T12:44:05.105 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61545.log 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65525.log.gz 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.61545.log: /var/log/ceph/ceph-client.admin.35306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61545.log.gz 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32358.log 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68383.log 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.32358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32358.log.gz 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34510.log 2024-04-26T12:44:05.106 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54664.log 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68383.log: /var/log/ceph/ceph-client.admin.34510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68383.log.gz 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69298.log 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34510.log.gz 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54664.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.54664.log.gz 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43509.log 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32642.log 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69298.log.gz 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43509.log.gz 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58984.log 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30726.log 2024-04-26T12:44:05.117 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32642.log.gz 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58984.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.58984.log.gz -- 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/ceph-client.admin.34111.log 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32140.log 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30726.log.gz 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34111.log.gz 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62745.log 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32140.log.gz 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69350.log 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.62745.log: -- /var/log/ceph/ceph-client.admin.34653.log 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62745.log.gz 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69350.log.gz 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58002.log 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57656.log 2024-04-26T12:44:05.118 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34653.log.gz 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58002.log.gz 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69842.log 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57656.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57656.log.gz 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54862.log 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69842.log.gz 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32902.log 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35426.log 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54862.log.gz 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32738.log 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32902.log.gz 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34582.log 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35426.log.gz 2024-04-26T12:44:05.119 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30759.log 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32738.log.gz 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68547.log 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34582.log.gz 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30759.log.gz 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51916.log 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33483.log 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68547.log.gz 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68138.log 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51916.log.gz 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59593.log 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33483.log.gz 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69584.log 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68138.log.gz 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59593.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.59593.log.gz /var/log/ceph/ceph-client.admin.33814.log 2024-04-26T12:44:05.120 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68157.log 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69584.log.gz 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58698.log 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33814.log.gz 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65799.log 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68157.log.gz 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69766.log 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58698.log.gz 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30353.log 2024-04-26T12:44:05.121 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65799.log.gz 2024-04-26T12:44:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25170.log 2024-04-26T12:44:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25242.log 2024-04-26T12:44:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.25170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25170.log.gz 2024-04-26T12:44:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T12:44:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.25242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25242.log.gz 2024-04-26T12:44:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T12:44:05.137 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25314.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.25314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25314.log.gz 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25218.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.25218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25218.log.gz 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25194.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.25194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25194.log.gz 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25290.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.25290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25266.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25290.log.gz 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T12:44:05.138 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.25266.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T12:44:05.139 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25266.log.gz 2024-04-26T12:44:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mon.b.log: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T12:44:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25130.log 2024-04-26T12:44:05.139 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T12:44:05.139 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.25130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25130.log.gz 2024-04-26T12:44:05.142 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T12:44:05.153 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30973.log 2024-04-26T12:44:05.153 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69766.log.gz 2024-04-26T12:44:05.153 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67479.log 2024-04-26T12:44:05.153 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30353.log.gz 2024-04-26T12:44:05.153 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33515.log 2024-04-26T12:44:05.153 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30973.log.gz 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66449.log 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67479.log.gz 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67609.log 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33515.log.gz 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.66449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66449.log.gz 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57925.log 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67949.log 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67609.log.gz 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44104.log 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57925.log.gz 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67949.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.67949.log.gz 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/ceph-client.admin.25126.log 2024-04-26T12:44:05.154 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44104.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20155.log 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44104.log.gz 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.25126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30540.log 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25126.log.gz 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.20155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59411.log 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20155.log.gz 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42890.log 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30540.log.gz 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59497.log 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59411.log.gz 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32283.log 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42890.log.gz 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59322.log 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59497.log.gz 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34743.log 2024-04-26T12:44:05.155 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32283.log.gz 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52507.log 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59322.log.gz 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59597.log 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34743.log.gz 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25251.log 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52507.log.gz 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33868.log 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59597.log.gz 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.25251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44698.log 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25251.log.gz 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53276.log 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33868.log.gz 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65287.log 2024-04-26T12:44:05.156 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44698.log.gz 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37528.log 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53276.log.gz 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34456.log 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65287.log.gz 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.37528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69402.log 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37528.log.gz 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69324.log 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34456.log.gz 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59030.log 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69402.log.gz 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55014.log 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69324.log.gz 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32799.log 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59030.log.gz 2024-04-26T12:44:05.157 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34380.log 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55014.log.gz 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67937.log 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32799.log.gz 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30974.log 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34380.log.gz 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69506.log 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67937.log.gz 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55044.log 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30974.log.gz 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69818.log 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69506.log.gz 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47715.log 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55044.log.gz 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30948.log 2024-04-26T12:44:05.158 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69818.log.gz 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50669.log 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47715.log.gz 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30948.log.gz 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.50669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57461.log 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50669.log.gz 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68155.log 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58928.log 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57461.log.gz 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54751.log 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68155.log.gz 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30547.log 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58928.log: /var/log/ceph/ceph-client.admin.54751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46526.log 2024-04-26T12:44:05.159 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54751.log.gz 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58928.log.gz 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30547.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30547.log.gz 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65433.log 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46526.log.gz 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33678.log 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69610.log 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65433.log.gz 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33678.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33678.log.gz 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67713.log 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34999.log 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69610.log: /var/log/ceph/ceph-client.admin.67713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33293.log 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67713.log.gz 2024-04-26T12:44:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69610.log.gz 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34999.log.gz 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55673.log 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33434.log 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33293.log.gz 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30494.log 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55673.log.gz 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33434.log.gz 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61462.log 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32955.log 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33408.log 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.61462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30494.log.gz 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61462.log.gz 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32955.log.gz 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65701.log 2024-04-26T12:44:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58934.log 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33408.log.gz 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69740.log 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65701.log.gz 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35029.log 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58934.log: /var/log/ceph/ceph-client.admin.69740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69714.log 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58934.log.gz 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69740.log.gz/var/log/ceph/ceph-client.admin.35029.log: 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35029.log.gz 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35207.log 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68129.log 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69714.log: /var/log/ceph/ceph-client.admin.35207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33614.log 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69714.log.gz 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35207.log.gz 2024-04-26T12:44:05.162 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68129.log.gz 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64694.log 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30765.log 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33614.log: /var/log/ceph/ceph-client.admin.64694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65396.log 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33614.log.gz 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64694.log.gz 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30765.log.gz 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30750.log 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65644.log 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65396.log: /var/log/ceph/ceph-client.admin.30750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31208.log 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65396.log.gz 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30750.log.gz 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65644.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54171.log 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65644.log.gz 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31208.log.gz 2024-04-26T12:44:05.163 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59177.log 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30328.log 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54171.log: /var/log/ceph/ceph-client.admin.59177.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54171.log.gz 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59177.log.gz 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30328.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.30328.log.gz -5 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32419.log 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65340.log 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.32419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33590.log 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32419.log.gz 2024-04-26T12:44:05.164 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65340.log.gz 2024-04-26T12:44:05.177 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30955.log 2024-04-26T12:44:05.177 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67422.log 2024-04-26T12:44:05.177 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33590.log.gz 2024-04-26T12:44:05.177 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30955.log.gz 2024-04-26T12:44:05.177 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45828.log 2024-04-26T12:44:05.177 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31308.log 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67422.log.gz 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45828.log.gz 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30546.log 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43474.log 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31308.log.gz 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30546.log.gz 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54783.log 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43474.log.gz 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30743.log 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34930.log 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54783.log.gz/var/log/ceph/ceph-client.admin.30743.log: 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30743.log.gz 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54434.log 2024-04-26T12:44:05.178 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61787.log 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34930.log.gz 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54434.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54434.log.gz 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.61787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61787.log.gzgzip 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61650.log 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59657.log 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34752.log: 0.0%/var/log/ceph/ceph-client.admin.61650.log: -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61650.log.gz 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31232.log 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59657.log.gz 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61725.log 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34271.log 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31232.log.gz 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.61725.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34065.log 2024-04-26T12:44:05.179 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61725.log.gz 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34271.log.gz 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35245.log 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67765.log 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34065.log.gz 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35245.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56267.log 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35245.log.gz 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67765.log.gz 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31987.log 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65487.log 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.56267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56267.log.gz 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31987.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54282.log 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31987.log.gz 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65487.log.gz 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32095.log 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59351.log 2024-04-26T12:44:05.180 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54282.log.gz 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32095.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30548.log 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32095.log.gz 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59351.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59351.log.gz -5 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.68573.log 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30548.log.gz 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69246.log 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68573.log.gz 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.log: 92.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67946.log 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34160.log 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69246.log: /var/log/ceph/ceph-client.admin.67946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69246.log.gz 2024-04-26T12:44:05.181 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67946.log.gz 2024-04-26T12:44:05.182 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32711.log 2024-04-26T12:44:05.195 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58861.log 2024-04-26T12:44:05.195 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34160.log.gz 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54509.log 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32711.log.gz 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69376.log 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58861.log.gz 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35504.log 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54509.log.gz 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59029.log 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69376.log: /var/log/ceph/ceph-client.admin.35504.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54248.log 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35504.log.gz 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69376.log.gz 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59029.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.59029.log.gz --verbose 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr: -- /var/log/ceph/ceph-client.admin.51326.log 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34875.log 2024-04-26T12:44:05.196 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54248.log.gz 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33773.log 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51326.log: /var/log/ceph/ceph-client.admin.34875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35057.log 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51326.log.gz 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34875.log.gz 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33773.log.gz 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38123.log 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31258.log 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35057.log.gz 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69558.log 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38123.log.gz 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62749.log 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31258.log.gz 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69220.log 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69558.log.gz 2024-04-26T12:44:05.197 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59466.log 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62749.log.gz 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69688.log 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69220.log.gz 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31156.log 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59466.log.gz 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69428.log 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69688.log: /var/log/ceph/ceph-client.admin.31156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53184.log 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69688.log.gz 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31156.log.gz/var/log/ceph/ceph-client.admin.69428.log: 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33252.log 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69428.log.gz 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67817.log 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53184.log: /var/log/ceph/ceph-client.admin.33252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53520.log 2024-04-26T12:44:05.198 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53184.log.gz 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33252.log.gz 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67817.log.gz 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65691.log 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53520.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53520.log.gz 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32980.log 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65691.log.gz 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69636.log 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.32980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38736.log 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32980.log.gz 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69636.log.gz 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53519.log 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.38736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34691.log 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38736.log.gz 2024-04-26T12:44:05.199 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53519.log.gz 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32135.log 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59527.log 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34691.log.gz 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32135.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54462.log 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32135.log.gz 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59527.log.gz 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69454.log 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62671.log 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54462.log: /var/log/ceph/ceph-client.admin.69454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54462.log.gz 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69454.log.gz 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59207.log 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54599.log 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62671.log: /var/log/ceph/ceph-client.admin.59207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62671.log.gz 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59207.log.gz 2024-04-26T12:44:05.200 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51266.log 2024-04-26T12:44:05.201 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33331.log 2024-04-26T12:44:05.201 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54599.log: /var/log/ceph/ceph-client.admin.51266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54599.log.gz 2024-04-26T12:44:05.201 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51266.log.gz 2024-04-26T12:44:05.201 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53422.log 2024-04-26T12:44:05.208 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69792.log 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33331.log: /var/log/ceph/ceph-client.admin.53422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33331.log.gz 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53422.log.gz 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66513.log 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69792.log: /var/log/ceph/ceph-client.admin.66513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69792.log.gz 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66513.log.gz 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69532.log 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35757.log 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.69532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69532.log.gz 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr: 92.0% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65833.log 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53127.log 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35757.log: /var/log/ceph/ceph-client.admin.65833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35757.log.gz 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65833.log.gz 2024-04-26T12:44:05.209 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69272.log 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53127.log: /var/log/ceph/ceph.audit.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53127.log.gz 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34971.log 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69272.log.gz 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59117.log 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34971.log.gz 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62589.log 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59117.log.gz 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34876.log 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62589.log.gz 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31182.log 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68627.log 2024-04-26T12:44:05.210 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34876.log: /var/log/ceph/ceph-client.admin.31182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34876.log.gz 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31182.log.gz 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34830.log 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30741.log 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.68627.log: /var/log/ceph/ceph-client.admin.34830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68627.log.gz 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34830.log.gz 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59416.log 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62630.log 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30741.log: /var/log/ceph/ceph-client.admin.59416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30741.log.gz 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59416.log.gz 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30975.log 2024-04-26T12:44:05.211 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34032.log 2024-04-26T12:44:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62630.log: /var/log/ceph/ceph-client.admin.30975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62630.log.gz 2024-04-26T12:44:05.218 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30975.log.gz 2024-04-26T12:44:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34226.log 2024-04-26T12:44:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-04-26T12:44:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34032.log: /var/log/ceph/ceph-client.admin.34226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34032.log.gz 2024-04-26T12:44:05.218 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34226.log.gz 2024-04-26T12:44:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51262.log 2024-04-26T12:44:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58079.log 2024-04-26T12:44:05.218 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.50079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51262.log.gz 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30976.log 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32013.log 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58079.log: /var/log/ceph/ceph-client.admin.30976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58079.log.gz 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30976.log.gz 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56861.log 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67843.log 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32013.log: /var/log/ceph/ceph-client.admin.56861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32013.log.gz 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56861.log.gz 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33058.log 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68358.log 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67843.log: /var/log/ceph/ceph-client.admin.33058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67843.log.gz 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33058.log.gz 2024-04-26T12:44:05.219 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35348.log 2024-04-26T12:44:05.220 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48306.log 2024-04-26T12:44:05.220 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68358.log.gz 2024-04-26T12:44:05.220 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35348.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67687.log 2024-04-26T12:44:05.220 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.220 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48306.log.gz 2024-04-26T12:44:05.220 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65855.log 2024-04-26T12:44:05.221 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30454.log 2024-04-26T12:44:05.221 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67687.log.gz 2024-04-26T12:44:05.221 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65855.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54218.log 2024-04-26T12:44:05.221 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.226 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30454.log.gz 2024-04-26T12:44:05.226 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67869.log 2024-04-26T12:44:05.226 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34514.log 2024-04-26T12:44:05.226 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54218.log.gz 2024-04-26T12:44:05.226 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67869.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59202.log 2024-04-26T12:44:05.226 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.226 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34514.log.gz 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38121.log 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.59202.log: /var/log/ceph/ceph-client.admin.38121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59202.log.gz 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38121.log.gz 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54274.log 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30746.log 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54274.log.gz 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49489.log 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30746.log.gz 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30538.log 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54513.log 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.49489.log: /var/log/ceph/ceph-client.admin.30538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49489.log.gz 2024-04-26T12:44:05.227 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30538.log.gz 2024-04-26T12:44:05.228 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47118.log 2024-04-26T12:44:05.228 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57858.log 2024-04-26T12:44:05.228 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54513.log: /var/log/ceph/ceph-client.admin.47118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54513.log.gz 2024-04-26T12:44:05.228 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47118.log.gz 2024-04-26T12:44:05.228 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61701.log 2024-04-26T12:44:05.231 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35061.log 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57858.log: /var/log/ceph/ceph-client.admin.61701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57858.log.gz 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61701.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62448.log 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35061.log.gz 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30536.log 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53396.log 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.62448.log: /var/log/ceph/ceph-client.admin.30536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62448.log.gz 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30536.log.gz 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67934.log 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30381.log 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53396.log: /var/log/ceph/ceph-client.admin.67934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53396.log.gz 2024-04-26T12:44:05.232 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67934.log.gz 2024-04-26T12:44:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30545.log 2024-04-26T12:44:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68359.log 2024-04-26T12:44:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30381.log.gz 2024-04-26T12:44:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30545.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33954.log 2024-04-26T12:44:05.233 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.233 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68359.log.gz 2024-04-26T12:44:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58890.log 2024-04-26T12:44:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68599.log 2024-04-26T12:44:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33954.log: /var/log/ceph/ceph-client.admin.58890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33954.log.gz 2024-04-26T12:44:05.235 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58890.log.gz 2024-04-26T12:44:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35697.log 2024-04-26T12:44:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67947.log 2024-04-26T12:44:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68599.log.gz 2024-04-26T12:44:05.235 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35697.log.gzgzip 2024-04-26T12:44:05.235 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35166.log 2024-04-26T12:44:05.236 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67947.log.gz 2024-04-26T12:44:05.236 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59121.log 2024-04-26T12:44:05.237 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54949.log 2024-04-26T12:44:05.237 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35166.log: /var/log/ceph/ceph-client.admin.59121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35166.log.gz 2024-04-26T12:44:05.237 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59121.log.gz 2024-04-26T12:44:05.238 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65571.log 2024-04-26T12:44:05.238 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32844.log 2024-04-26T12:44:05.238 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54949.log: /var/log/ceph/ceph-client.admin.65571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54949.log.gz 2024-04-26T12:44:05.238 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65571.log.gz 2024-04-26T12:44:05.238 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67583.log 2024-04-26T12:44:05.239 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53214.log 2024-04-26T12:44:05.239 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32844.log.gz 2024-04-26T12:44:05.239 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67583.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35628.log 2024-04-26T12:44:05.239 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.239 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53214.log.gz 2024-04-26T12:44:05.240 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57560.log 2024-04-26T12:44:05.240 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53371.log 2024-04-26T12:44:05.241 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35628.log: /var/log/ceph/ceph-client.admin.57560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35628.log.gz 2024-04-26T12:44:05.241 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57560.log.gz 2024-04-26T12:44:05.241 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30407.log 2024-04-26T12:44:05.242 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58702.log 2024-04-26T12:44:05.242 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53371.log.gz 2024-04-26T12:44:05.242 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30407.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.30407.log.gz 2024-04-26T12:44:05.242 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68337.log 2024-04-26T12:44:05.243 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58702.log.gz 2024-04-26T12:44:05.243 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67531.log 2024-04-26T12:44:05.244 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32617.log 2024-04-26T12:44:05.244 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68337.log.gz 2024-04-26T12:44:05.244 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67531.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32279.log 2024-04-26T12:44:05.244 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.244 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32617.log.gz 2024-04-26T12:44:05.246 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58752.log 2024-04-26T12:44:05.246 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41111.log 2024-04-26T12:44:05.246 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32279.log.gz 2024-04-26T12:44:05.246 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.58752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58752.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67941.log 2024-04-26T12:44:05.246 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.246 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41111.log.gz 2024-04-26T12:44:05.247 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68145.log 2024-04-26T12:44:05.247 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65521.log 2024-04-26T12:44:05.247 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67941.log.gz 2024-04-26T12:44:05.248 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64100.log 2024-04-26T12:44:05.248 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68145.log.gz 2024-04-26T12:44:05.248 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65521.log.gz 2024-04-26T12:44:05.249 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55083.log 2024-04-26T12:44:05.249 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32506.log 2024-04-26T12:44:05.249 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.64100.log: /var/log/ceph/ceph-client.admin.55083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64100.log.gz 2024-04-26T12:44:05.249 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55083.log.gz 2024-04-26T12:44:05.249 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68341.log 2024-04-26T12:44:05.251 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65604.log 2024-04-26T12:44:05.251 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32506.log: /var/log/ceph/ceph-client.admin.68341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32506.log.gz 2024-04-26T12:44:05.251 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68341.log.gz 2024-04-26T12:44:05.251 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68360.log 2024-04-26T12:44:05.251 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69662.log 2024-04-26T12:44:05.252 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.65604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65604.log.gz 2024-04-26T12:44:05.252 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.68360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68360.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32065.log 2024-04-26T12:44:05.252 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:05.252 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69662.log.gz 2024-04-26T12:44:05.253 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62889.log 2024-04-26T12:44:05.254 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39340.log 2024-04-26T12:44:05.254 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32065.log: /var/log/ceph/ceph-client.admin.62889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32065.log.gz 2024-04-26T12:44:05.254 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62889.log.gz 2024-04-26T12:44:05.254 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32461.log 2024-04-26T12:44:05.254 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30760.log 2024-04-26T12:44:05.254 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.39340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39340.log.gz 2024-04-26T12:44:05.255 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32461.log.gz 2024-04-26T12:44:05.255 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53321.log 2024-04-26T12:44:05.255 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.30760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30760.log.gz 2024-04-26T12:44:05.256 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65336.log 2024-04-26T12:44:05.257 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35528.log 2024-04-26T12:44:05.257 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53321.log: /var/log/ceph/ceph-client.admin.65336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53321.log.gz 2024-04-26T12:44:05.257 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65336.log.gz 2024-04-26T12:44:05.257 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57784.log 2024-04-26T12:44:05.257 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69480.log 2024-04-26T12:44:05.257 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35528.log.gz 2024-04-26T12:44:05.258 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.57784.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59382.log 2024-04-26T12:44:05.259 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57784.log.gz 2024-04-26T12:44:05.259 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.69480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69480.log.gz 2024-04-26T12:44:05.259 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33085.log 2024-04-26T12:44:05.259 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61519.log 2024-04-26T12:44:05.260 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33085.log: /var/log/ceph/ceph-client.admin.59382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59382.log.gz 2024-04-26T12:44:05.260 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33085.log.gz 2024-04-26T12:44:05.260 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67557.log 2024-04-26T12:44:05.260 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67895.log 2024-04-26T12:44:05.262 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.61519.log: /var/log/ceph/ceph-client.admin.67557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61519.log.gz 2024-04-26T12:44:05.262 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67557.log.gz 2024-04-26T12:44:05.262 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63510.log 2024-04-26T12:44:05.262 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67739.log 2024-04-26T12:44:05.262 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67895.log: /var/log/ceph/ceph-client.admin.63510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67895.log.gz 2024-04-26T12:44:05.262 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63510.log.gz 2024-04-26T12:44:05.262 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54903.log 2024-04-26T12:44:05.263 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.67739.log: 0.0%/var/log/ceph/ceph-client.admin.54903.log: -- replaced with /var/log/ceph/ceph-client.admin.67739.log.gz 2024-04-26T12:44:05.263 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54903.log.gz 2024-04-26T12:44:05.336 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T12:44:05.368 INFO:teuthology.orchestra.run.smithi016.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T12:44:05.641 INFO:teuthology.orchestra.run.smithi016.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T12:44:05.814 INFO:teuthology.orchestra.run.smithi131.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T12:44:05.876 INFO:teuthology.orchestra.run.smithi016.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T12:44:05.887 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T12:44:06.052 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T12:44:06.064 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T12:44:06.066 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-26T12:44:06.066 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m0.964s 2024-04-26T12:44:06.066 INFO:teuthology.orchestra.run.smithi131.stderr:user 0m3.402s 2024-04-26T12:44:06.066 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m0.149s 2024-04-26T12:44:06.087 INFO:teuthology.orchestra.run.smithi016.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T12:44:06.095 INFO:teuthology.orchestra.run.smithi016.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T12:44:06.380 INFO:teuthology.orchestra.run.smithi016.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T12:44:06.381 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-26T12:44:06.381 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m1.323s 2024-04-26T12:44:06.381 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m4.842s 2024-04-26T12:44:06.381 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m0.305s 2024-04-26T12:44:06.382 INFO:tasks.ceph:Archiving logs... 2024-04-26T12:44:06.382 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/remote/smithi016/log 2024-04-26T12:44:06.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:44:07.266 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/remote/smithi131/log 2024-04-26T12:44:07.267 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T12:44:07.718 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T12:44:07.728 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T12:44:07.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:44:07.731 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T12:44:07.804 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T12:44:07.814 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T12:44:07.814 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:44:07.816 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T12:44:07.827 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T12:44:07.828 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-26T12:44:07.828 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi 67.205.162.81 3 u 66 64 377 0.100 -2.715 1.372 2024-04-26T12:44:07.828 INFO:teuthology.orchestra.run.smithi016.stdout:*hv02.front.sepi 63.231.80.2 3 u 4 64 377 0.096 +0.832 1.738 2024-04-26T12:44:07.828 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi 74.6.168.72 3 u 60 64 377 0.081 -0.061 2.173 2024-04-26T12:44:07.828 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:44:07.829 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T12:44:07.829 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-04-26T12:44:07.829 INFO:teuthology.orchestra.run.smithi131.stdout:*hv01.front.sepi 67.205.162.81 3 u 6 64 377 0.093 -2.018 0.800 2024-04-26T12:44:07.829 INFO:teuthology.orchestra.run.smithi131.stdout:+hv02.front.sepi 63.231.80.2 3 u 64 64 377 0.095 +1.133 0.987 2024-04-26T12:44:07.829 INFO:teuthology.orchestra.run.smithi131.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.051 -0.603 1.322 2024-04-26T12:44:07.829 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T12:44:07.830 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T12:44:07.840 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T12:44:07.840 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T12:44:07.849 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T12:44:07.859 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T12:44:07.868 INFO:teuthology.task.internal:Duration was 963.465991 seconds 2024-04-26T12:44:07.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T12:44:07.877 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T12:44:07.878 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:44:07.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T12:44:07.917 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T12:44:07.917 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-04-26T12:44:07.917 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:44:07.969 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-04-26T12:44:07.969 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T12:44:07.979 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T12:44:07.979 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:44:08.012 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T12:44:08.049 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T12:44:08.049 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:44:08.085 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T12:44:08.167 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T12:44:08.177 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T12:44:08.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:44:08.189 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T12:44:08.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T12:44:08.214 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:44:08.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:44:08.240 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-04-26T12:44:08.257 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-04-26T12:44:08.369 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:44:08.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:44:08.376 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T12:44:08.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T12:44:08.415 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T12:44:08.426 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T12:44:08.427 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/remote/smithi016 2024-04-26T12:44:08.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:44:08.449 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-26_12:10:35-rgw-wip-cbodley2-testing-distro-default-smithi/7674701/remote/smithi131 2024-04-26T12:44:08.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T12:44:08.479 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T12:44:08.479 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:44:08.493 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T12:44:08.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T12:44:08.535 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T12:44:08.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T12:44:08.545 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T12:44:08.545 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:44:08.548 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T12:44:08.552 INFO:teuthology.orchestra.run.smithi016.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:44 /home/ubuntu/cephtest 2024-04-26T12:44:08.571 INFO:teuthology.orchestra.run.smithi131.stdout: 658635 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 12:44 /home/ubuntu/cephtest 2024-04-26T12:44:08.572 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T12:44:08.584 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T12:44:08.657 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 963.4659912586212 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-04-26T12:44:08.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T12:44:08.747 INFO:teuthology.run:pass